Jensen Huang โ Will Nvidiaโs moat persist?
I asked Jensen about TPU competition, Nvidiaโs lock on the ever more bottlenecked supply chain needed to make advanced chips, whether we should be selling AI chips to China, why Nvidia doesnโt just become a hyperscaler, how it makes its investments, and much more. Enjoy! +๐๐๐๐๐๐๐ ๐๐๐๐๐ * Transcript: https://www.dwarkesh.com/p/jensen-huang * Apple Podcasts: https://podcasts.apple.com/us/podcast/jensen-huang-tpu-competition-why-we-should-sell-chips/id1516093381?i=1000761582962 * Spotify: https://open.spotify.com/episode/1viBRy6dQdlSw0OdFvogXB?si=bc2cdbd467ed4ee3 ๐๐๐๐๐๐๐๐ - Crusoe's cloud runs on state-of-the-art Blackwell GPUs, with Vera Rubin deployment scheduled for later this year. But hardware is only part of the storyโfor inference, Crusoe's MemoryAlloy tech implements a cluster-wide KV cache, delivering up to 10x faster TTFT and 5x better throughput than vLLM. Learn more at https://crusoe.ai/dwarkesh - Cursor helped me build an AI co-researcher over the course of a weekend. Now I have an AI agent that I can collaborate with in Google Docs via inline comment threads! And while other agentic coding tools feel like a total black-box, Cursor let me stay on top of the full implementation. You can try my co-researcher out at https://github.com/dwarkeshsp/ai_coworker, or get started on your own Cursor project today at https://cursor.com/dwarkesh - Jane Street spent ~20,000 GPU hours training backdoors into 3 different language models, then challenged my audience to find the triggers. They received some clever solutionsโlike comparing the base and fine-tuned versions and extrapolating any differences to reveal the hidden backdoorโbut no one was able to solve all 3. So if open problems like this excite you, Jane Street is hiring. Learn more at https://janestreet.com/dwarkesh To sponsor a future episode, visit https://dwarkesh.com/advertise. ๐๐๐๐๐๐๐๐๐๐ 00:00:00 โ Is Nvidiaโs biggest moat its grip on scarce supply chains? 00:16:25 โ Will TPUs break Nvidiaโs hold on AI compute? 00:41:06 โ Why doesnโt Nvidia become a hyperscaler? 00:57:36 โ Should we be selling AI chips to China? 01:35:06 โ Why doesnโt Nvidia make multiple different chip architectures?
Watch on YouTube โ