AMD unveils the benchmark results of its GPU, Instinct MI300X, in the MLPerf test for the first time, showcasing performance closely comparable to the popular NVIDIA H100. The tests conducted by AMD running the Llama 2 70B model on the MI300X with 192GB HBM3 RAM scored 3,062 token/s (Offline mode) and 2,520 token/s (Server mode). In comparison, NVIDIA’s competitor, the Hopper H100, achieved 3,040 and 2,576 token/s respectively, indicating a close match. However, AMD’s GPU still falls behind NVIDIA’s top-tier H200, which scored 4,016 and 3,717 token/s respectively.
Nevertheless, AMD may not necessarily excel in terms of leadership, as in a market where GPUs are in high demand, the performance parity between MI300X and H100 has significantly boosted AMD’s GPU sales. The revenue generated from data center sales has nearly reached half of the company’s total revenue growth.
Approximately two months ago, AMD introduced the new GPU, MI325X, scheduled for release in Q4 2024, featuring the same HBM3e memory as the H200. Additionally, there are plans for the release of MI350 in the upcoming year 2025.
Source: Tom’s Hardware
TLDR: AMD’s Instinct MI300X GPU showcases performance on par with NVIDIA’s popular H100, boosting AMD’s GPU sales in the data center market, despite still trailing behind NVIDIA’s top-tier H200. Upcoming releases include the MI325X in Q4 2024 and MI350 in 2025.
Leave a Comment