Browse Tag

AI inference

2 Articles

Maia 300 Inference Chip: Microsoft’s Azure AI Push

By Sutopo

8 Min Read

Microsoft's Maia 300 Inference Chip delivers up to 7x the token throughput of Maia 200 and 40% more tokens per megawatt than leading GPU-based systems, reshaping Azure's AI infrastructure economics.

Fugu AI: Cut Inference Costs With Model Routing

By Sutopo

8 Min Read

Fugu AI orchestrates specialist models for structured AI tasks, cutting inference costs versus large generalist models. Here is how it works and when to use it.