#459 – DeepSeek, China, OpenAI, NVIDIA, xAI, TSMC, Stargate, and AI Megaclusters

Feb 3, 2025 5h 16m

About this episode

Dylan Patel is the founder of SemiAnalysis, a research & analysis company specializing in semiconductors, GPUs, CPUs, and AI hardware. Nathan Lambert is a research scientist at the Allen Institute for AI (Ai2) and the author of a blog on AI called Interconnects. Thank you for listening ❤ Check out our sponsors: <a href="https://lexfridman.com/sponsors/ep459-sc">https://lexfridman.com/sponsors/ep459-sc</a> See below for timestamps, transcript, and to give feedback, submit questions, contact Lex, etc. Transcript: <a href="https://lexfridman.com/deepseek-dylan-patel-nathan-lambert-transcript">https://lexfridman.com/deepseek-dylan-patel-nathan-lambert-transcript</a> CONTACT LEX: Feedback – give feedback to Lex: <a href="https://lexfridman.com/survey">https://lexfridman.com/survey</a> AMA – submit questions, videos or call-in: <a href="https://lexfridman.com/ama">https://lexfridman.com/ama</a> Hiring – join our team: <a href="https://lexfridman.com/hiring">https://lexfridman.com/hiring</a> Other – other ways to get in touch: <a href="https://lexfridman.com/contact">https://lexfridman.com/contact</a> EPISODE LINKS: Dylan’s X: <a href="https://x.com/dylan522p">https://x.com/dylan522p</a> SemiAnalysis: <a href="https://semianalysis.com/">https://semianalysis.com/</a> Nathan’s X: <a href="https://x.com/natolambert">https://x.com/natolambert</a> Nathan’s Blog: <a href="https://www.interconnects.ai/">https://www.interconnects.ai/</a> Nathan’s Podcast: <a href="https://www.interconnects.ai/podcast">https://www.interconnects.ai/podcast</a> Nathan’s Website: <a href="https://www.natolambert.com/">https://www.natolambert.com/</a> Nathan’s YouTube: <a href="https://youtube.com/@natolambert">https://youtube.com/@natolambert</a> Nathan’s Book: <a href="https://rlhfbook.com/">https://rlhfbook.com/</a> SPONSORS: To support this podcast, check out our sponsors & get discounts: Invideo AI: AI video generator. Go to <a href="https://lexfridman.com/s/invideoai-ep459-sc">https://invideo.io/i/lexpod</a> GitHub: Developer platform and AI code editor. Go to <a href="https://lexfridman.com/s/github-ep459-sc">https://gh.io/copilot</a> Shopify: Sell stuff online. Go to <a href="https://lexfridman.com/s/shopify-ep459-sc">https://shopify.com/lex</a> NetSuite: Business management software. Go to <a href="https://lexfridman.com/s/netsuite-ep459-sc">http://netsuite.com/lex</a> AG1: All-in-one daily nutrition drinks. Go to <a href="https://lexfridman.com/s/ag1-ep459-sc">https://drinkag1.com/lex</a> OUTLINE: (00:00) – Introduction (13:28) – DeepSeek-R1 and DeepSeek-V3 (35:02) – Low cost of training (1:01:19) – DeepSeek compute cluster (1:08:52) – Export controls on GPUs to China (1:19:10) – AGI timeline (1:28:35) – China’s manufacturing capacity (1:36:30) – Cold war with China (1:41:00) – TSMC and Taiwan (2:04:38) – Best GPUs for AI (2:19:30) – Why DeepSeek is so cheap (2:32:49) – Espionage (2:41:52) – Censorship (2:54:46) – Andrej Karpathy and magic of RL (3:05:17) – OpenAI o3-mini vs DeepSeek r1 (3:24:25) – NVIDIA (3:28:53) – GPU smuggling (3:35:30) – DeepSeek training on OpenAI data (3:45:59) – AI megaclusters (4:21:21) – Who wins the race to AGI? (4:31:34) – AI agents (4:40:16) – Programming and AI (4:47:43) – Open source (4:56:55) – Stargate (5:04:24) – Future of AI

Listen to this episode in English to learn English

Podcast episodes are one of the highest-density ways to absorb English at native pace. #459 – DeepSeek, China, OpenAI, NVIDIA, xAI, TSMC, Stargate, and AI Megaclusters from Lex Fridman Podcast gives you natural dialogue, unscripted speech, and vocabulary that actually appears in real conversations.

In the Clue app, every word in the transcript is tappable. Tap an unknown word, see the translation in your language instantly, and keep listening without breaking flow.

Episodes to Learn English

More podcasts in English