AMD Instinct MI300: detailed architecture and performance analysis
NVIDIA
Taiwan Semiconductor Manufacturing Company
The AMD Instinct MI300 series, based on the CDNA3 architecture, introduces a heterogeneous chiplet design with up to 8 XCD modules and 4 IOD modules, using advanced CoWoS packaging and 3D V-Cache technology. The lineup includes the MI300X accelerator and the MI300A APU with integrated Zen 4 cores, offering up to 304 compute units, HBM3 memory up to 192 GB, and significant performance improvements over the previous generation and NVIDIA H100 in both HPC and AI workloads.
AMD’s Instinct MI300 series consists of two variants: the MI300X accelerator with 8 XCD compute chiplets and the MI300A APU combining 6 XCD chiplets with 3 CCD chiplets containing 24 Zen 4 cores. Both use 5nm/6nm TSMC process, feature 8 HBM3 stacks, and have a TDP around 750-760 W. The MI300X offers 192 GB HBM3 memory and 304 compute units, while the MI300A has 128 GB and 228 compute units. Performance-wise, AMD claims the MI300X is up to 2.5x faster than NVIDIA H100 in FP32/64 and competitive in AI precision modes. The MI300A demonstrated a 4x lead over H100 in an OpenFOAM benchmark while consuming less power. The CDNA3 architecture introduces new matrix cores supporting FP8, TF32, sparse data, and a redesigned memory hierarchy with Infinity Cache. The chip uses Infinity Fabric interconnects for scalable multi-GPU topologies without external switches.
- Сокращения
- APU = Accelerated Processing Unit — ускоренный процессорный блок
- CCD = Core Complex Die — кристалл с ядрами
- CDNA = Compute DNA — вычислительная архитектура AMD
- CU = Compute Unit — вычислительный блок
- HBM = High Bandwidth Memory — память с высокой пропускной способностью
- HPC = High Performance Computing — высокопроизводительные вычисления
- IOD = Input/Output Die — кристалл ввода-вывода
- TDP = Thermal Design Power — тепловой пакет
- TSV = Through-Silicon Via — сквозные кремниевые переходы
- XCD = Compute Die (XCD) — вычислительный кристалл
Source: ServerNews —
original