AMD’s new Instinct GPUs might just blow Nvidia out of the water
The chip maker unveiled its newest Instinct GPU series in San Francisco today – and it’s very bullish on performance in the race with Nvidia


AMD has announced the launch of its new Instinct MI325x accelerators as competition heats up with Nvidia in the AI space.
Unveiled at the chip maker’s Advancing AI conference in San Francisco, AMD said the new range is designed specifically to drive performance and efficiency in contending with “demanding AI tasks”.
The new Instinct range is aimed at supercharging foundation model training, fine-tuning, and inference, the company said.
The announcement from AMD marks the latest in a slew of progressive upgrades to its Instinct graphics processing unit (GPU) series in recent years and forms a key focus in its ongoing roadmap to drive AI infrastructure advances for hyperscale customers.
In a press briefing ahead of the Advancing AI event today, AMD executives waxed lyrical about the latest iteration, emphasizing performance capabilities compared to competitors such as Intel and Nvidia.
But it’s the latter of these that enterprises will be keen to see the comparable benchmarks for.
AMD said the MI325X accelerators provide “industry-leading” memory capacity and bandwidth, boasting 256GB of HBM3E supporting 6TB/s. All told, this equates to 1.8x more capacity and 1.3x more bandwidth than Nvidia’s H200 series.
Get the ITPro daily newsletter
Sign up today and you will receive a free copy of our Future Focus 2025 report - the leading guidance on AI, cybersecurity and other IT challenges as per 700+ senior executives
In terms of LLM inference capabilities, the company told assembled press the MI325X can provide up to 1.3x the inference performance on the Mistral 7B model, for example, along with 1.2x inference performance on the Llama 3.1 70B range.
AMD revealed the MI325X accelerators are currently on track for production shipments in Q4 2024, and are expected to have widespread availability from a host of platform providers by Q1 2025.
These include Dell Technologies, HPE, Lenovo, Supermicro, and more.
AMD’s roadmap is accelerating
Looking ahead, AMD execs gave attendees a glimpse at what’s in store with regard to future offerings in 2025 and beyond. The chip maker previews the next-generation AMD Instinct MI350 series accelerators at the annual conference, highlighting its rapid-fire efforts in the next few months.
Based on the AMD CDNA 4 architecture, the MI350 series accelerators are designed to deliver a whopping 35x improvement in inference performance compared to CDNA 3-based accelerators.
This will also include increased memory capacity, the company confirmed, reaching 288GB of HBM3E memory per accelerator.
Development of the MI350 series is on track, AMD said, and will be available during the second half of 2025.

Ross Kelly is ITPro's News & Analysis Editor, responsible for leading the brand's news output and in-depth reporting on the latest stories from across the business technology landscape. Ross was previously a Staff Writer, during which time he developed a keen interest in cyber security, business leadership, and emerging technologies.
He graduated from Edinburgh Napier University in 2016 with a BA (Hons) in Journalism, and joined ITPro in 2022 after four years working in technology conference research.
For news pitches, you can contact Ross at ross.kelly@futurenet.com, or on Twitter and LinkedIn.
-
M&S suspends online sales as 'cyber incident' continues
News Marks & Spencer (M&S) has informed customers that all online and app sales have been suspended as the high street retailer battles a ‘cyber incident’.
By Ross Kelly
-
Manners cost nothing, unless you’re using ChatGPT
Opinion Polite users are costing OpenAI millions of dollars each year – but Ps and Qs are a small dent in what ChatGPT could cost the planet
By Ross Kelly
-
What enterprises need to be Windows 11 ready
Supported Content Hardware purchasing will play a key role in delivering success during the Windows 11 migration rush
By Ross Kelly
-
Why the CPU you chose is the key to Windows 11
The end of Windows 10 is on the horizon – it’s time to upgrade to an fTPM-protected processor
By Bobby Hellard
-
AMD and Intel’s new x86 advisory group looks to tackle Arm, but will it succeed?
News The pair will look to make x86 CPU architecture more interoperable
By George Fitzmaurice
-
AMD’s patient roadmap has become a highway to success
Analysis While everyone was focused on Nvidia’s meteoric rise, AMD was preparing the hardware needed to take the fight to its long-time competitor
By Ross Kelly
-
AMD just made a big statement in the AI PC race with its Ryzen AI Pro 300 series processors
News With all eyes focused on the AI PC craze, AMD looks to one-up the competition
By Ross Kelly
-
AMD Advancing AI live: All the news and updates as they happened
Live Blog ITPro has been live on the ground at the AMD Advancing AI conference in San Francisco this week – here's everything we learned in the big keynote with CEO Lisa Su
By Ross Kelly
-
Why the world is about to be swamped with AI PCs
News With adoption rates set to surge, AI PCs will become far more mainstream in years to come
By Nicole Kobie
-
AMD expands CPU portfolio with new EPYC 4004 Series
News AMD has released its new EPYC 4004 Series processors to power entry level system designs and deliver cost savings to SMBs
By Daniel Todd