New AMD Instinct MI300X and MI300A chips are now available to customers through a number of OEM partners.
The chips are intended to help underpin organizations wanting to build their own hardware on which to run artificial intelligence (AI) workloads and train large language models (LLMs).
The MI300X accelerators in particular have high memory bandwidth – which AMD claims to be “industry leading” in performance tests versus the published performance of rival chips – and is optimized for LLM training and inferencing. Compared to previous generation AMD Instinct MI250X accelerators, the MI300X, which are powered by AMD CDNA3 architecture, deliver 1.5 times more memory capacity, 1.7 times more peak theoretical capacity, and 40% more compute workloads.
The MI300A, meanwhile, is an accelerated processing unit (APU) that uses AMD’s 3D packaging and 4th generation Infinity Architecture and combines AMD CDNA 3 GPU cores with Zen 4 CPUs, and 128GB of HBM3 memory. According to AMD, the MI300A delivers approximately 1.9 times the performance-per-watt on FP32 HPC and AI workloads versus the Instinct MI250X.
Current OEM partners offering products containing MI300X and MI300A chips include:
- Dell Technologies, which showcased the Dell PowerEdge XE9680 server containing eight AMD Instinct MI300 Series accelerators at AMD's Advancing AI event in December.
- Hewlett Packard Enterprise (HPE). Its Cray Supercomputing EX255a supercomputing accelerator blade, shown at the same event, is the first to be powered by AMD Instinct MI300 APUs.
- Supermicro. Its new H13 generation of accelerated servers features AMD Instinct MI300 Series accelerators and 4th generation AMD EPYC CPUs.
- Oracle, which plans to add AMD Instinct MI300X-based instances to support its Oracle Cloud Infrastructure (OCI) Supercluster with ultrafast RDMA networking.
RELATED RESOURCE
Choose an optimal solution that satisfies your computing needs
“AMD Instinct MI300 Series accelerators are designed with our most advanced technologies, delivering leadership performance, and will be in large scale cloud and enterprise deployments,” said Victor Peng, president of AMD.
“By leveraging our leadership hardware, software and open ecosystem approach, cloud providers, OEMs and ODMs are bringing to market technologies that empower enterprises to adopt and deploy AI-powered solutions.”
-
M&S suspends online sales as 'cyber incident' continuesNews Marks & Spencer (M&S) has informed customers that all online and app sales have been suspended as the high street retailer battles a ‘cyber incident’.
-
Manners cost nothing, unless you’re using ChatGPTOpinion Polite users are costing OpenAI millions of dollars each year – but Ps and Qs are a small dent in what ChatGPT could cost the planet
-
Embedded processors in industry, cloud, and beyondSupported Content From the edge to power grids, embedded processors keep data flowing for all enterprises
-
What enterprises need to be Windows 11 readySupported Content Hardware purchasing will play a key role in delivering success during the Windows 11 migration rush
-
Should AI PCs be part of your next hardware refresh?AI PCs are fast becoming a business staple and a surefire way to future-proof your business
-
How IT decision makers can prepare for the AI AgeSupported Content Whether it’s the hardware in your office or what’s powering your virtual machines, the right processors are the key to success
-
Why the CPU you chose is the key to Windows 11The end of Windows 10 is on the horizon – it’s time to upgrade to an fTPM-protected processor
-
AMD Advancing AI live: All the news and updates as they happenedLive Blog ITPro has been live on the ground at the AMD Advancing AI conference in San Francisco this week – here's everything we learned in the big keynote with CEO Lisa Su
-
What SMEs can learn from the supercomputing revolutionSponsored Supercomputing may seem out of reach for the SME, but there are many best practices and technologies filtering down that are worthy of emulation
-
What medium and large enterprises can learn from the supercomputing revolutionSponsored Supercomputing is leading the way with GPU acceleration and power consumption, which medium and large enterprises can emulate during digital transformation
