What is an NPU and when will it matter?

CPUs and GPUs have revolutionized computing. NPUs are next, but they’re not quite ready for prime time. Check out NPU-sporting Copilot+ PCs today: https://snazzy.fm/np Follow Snazzy Labs on Twitter - http://twitter.com/snazzylabs Follow me on Bluesky - https://snazzy.fm/UW Follow me on Threads - https://snazzy.fm/XV Follow me on Mastodon - https://snazzy.fm/NN Follow me on Instagram - http://instagram.com/snazzyq This video breaks down *exactly* what NPUs are, how they work, what they’re going to enable in the tech we use every day, and most importantly—why *you* should even care. Spoiler alert: NPUs are certain to be a *big* deal revolutionizing AI, machine learning, and computing efficiency, even though they aren’t *really* all that different than chips we’ve been using for decades. We’ll break down how NPUs differ from CPUs and GPUs, why they’re essential for handling AI workloads, and how they enable real-time machine learning applications with incredible power efficiency—not to mention real-world demos highlighting it all! 0:00 - Contemplating Intelligence 1:03 - Vintage Application Specific Hardware 3:42 - Smartphone SOCs 4:17 - Why do we need NPUs? 5:15 - What is inside an NPU 6:17 - Cephable Accessibility Demo 7:44 - Windows Live Video Caption 8:48 - Davinci Resolve Magic Mask 10:32 - LMStudio Isn't ready yet