Maia 300

Maia 300 is claimed to support multi-gigawatt-scale inference deployments on Azure and to become the primary inference system for Microsoft's own products.

The 40% token improvement per megawatt is still data provided by Microsoft itself and has not yet been independently verified.

The key metric Microsoft gives is that Maia 300 improves token throughput per megawatt of power consumption by 40% compared with the previous generation.

Maia 300 is equipped with 8 HBM4 memory stacks, uses compute chiplets manufactured on TSMC's N2P process, and is deployed in the form of 96-accelerator racks.

Through its self-developed Maia 300, Microsoft aims to optimize the execution efficiency of large language models and complex reasoning models and to reduce its dependence on third-party GPU suppliers.

Official figures show that Maia 300's energy efficiency is 40% higher than current mainstream GPUs.

Maia 300 was tuned for the Azure cloud environment from the outset of its design.

The 40% efficiency improvement is an official figure based on specific benchmarks, and actual performance is affected by factors such as model structure, batch size, memory bandwidth and interconnect bandwidth, so it should be viewed as a comparison under ideal conditions.

Maia 300 falls into the ASIC (application-specific integrated circuit) category, in contrast to the general-purpose programmable architecture of Nvidia GPUs.

Microsoft's advancing Maia while also purchasing Nvidia GPUs is essentially a combined configuration between generality and specialized efficiency, rather than a complete replacement.

Maia 300是Maia系列的迭代产品，命名上跳过了Maia 200，官方尚未给出明确说明。

Microsoft did not disclose the specific benchmarking conditions of Maia 300's energy efficiency tests, and actual performance still needs third-party verification.

Microsoft has not yet disclosed the specific performance parameters and deployment timeline of Maia 300.

One of Maia 300's goals is to reduce Microsoft's dependence on Nvidia GPUs while improving the cost and efficiency of cloud AI workloads.

One of Maia 300's key upgrades is greater capability to handle the latest inference models and agentic tasks.

Production of Maia 300 will start in 2027.

Microsoft plans to have Maia 300 gradually replace the third-party chips that Microsoft's internal inference workloads rely on.

Microsoft released its self-developed AI chip Maia 300.

If the 40% efficiency improvement is credible, it means Azure can deploy about 1.4 times the AI compute under the same power budget, or cut power costs by nearly 30% at the same compute level.

Microsoft officially launched Maia 300, claiming a 40% increase in tokens per watt throughput compared with leading GPU solutions.