Know What's Happening in AI

Microsoft Announces Powerful New Chip for AI Inference

Microsoft unveiled the Maia 200, its next‑generation AI inference chip, featuring over 100 billion transistors and delivering more than 10 petaflops in 4‑bit precision and roughly 5 petaflops in 8‑bit mode. The processor is positioned as a workhorse for running large language models with lower power draw and reduced inference costs. Microsoft claims a single Maia 200 node can handle today’s biggest models with headroom for future growth. The launch underscores Microsoft’s push to lessen reliance on Nvidia by joining Google’s TPU and Amazon’s Trainium in the custom‑silicon race.