AMD Reveals New AI Accelerators Instinct MI325X and MI350

AMD has unveiled its latest AI accelerators, the Instinct MI325X and MI350, at Computex. These new models are part of AMD’s aggressive roadmap to enhance AI and HPC capabilities through 2026.

Specifications and Performance of MI325X

The Instinct MI325X, expected to launch in Q4 2024, features 288GB of HBM3E memory and boasts a peak memory bandwidth of 6TB/s. This model utilizes the CDNA 3 architecture and promises significant performance improvements. It aims to handle up to 1 trillion parameters per server, offering 2x memory and 1.3x peak theoretical FP16 and FP8 performance compared to its competitors.

Future Plans

In 2025, AMD plans to release the Instinct MI350 series, which will be based on the 3nm CDNA 4 architecture. This series will also feature up to 288GB of HBM3E memory and support for FP4/FP6 data types. AMD claims the MI350 will deliver a 35x increase in AI inference performance over the CDNA 3-based models.

Looking further ahead, AMD announced the Instinct MI400 series, set to debut in 2026. This series will utilize the next-generation CDNA architecture, referred to as “CDNA Next.” AMD aims to maintain its leadership in memory capacity and compute performance with these future models.

AMD’s strategy includes an annual cadence for releasing new AI accelerators, reflecting their commitment to rapid innovation. This approach ensures AMD remains competitive in the growing AI and HPC market, especially against rivals like NVIDIA.

The Instinct MI325X, MI350, and MI400 series demonstrate AMD’s dedication to pushing the boundaries of AI and HPC technology. These developments are expected to play a crucial role in various data-intensive applications, supporting the increasing demand for powerful computing solutions.