Oracle and AMD announced a major expansion of their long-standing, multi-generation collaboration to help customers significantly scale their AI capabilities and initiatives. Building on years of co-innovation, Oracle Cloud Infrastructure (OCI) will be a launch partner for the first publicly available AI supercluster powered by AMD Instinct MI450 Series GPUs—with an initial deployment of 50,000 GPUs starting in calendar Q3 2026 and expanding in 2027 and beyond.
This announcement builds upon the joint work of Oracle and AMD to deliver AMD Instinct GPU platforms on OCI to end customers, beginning with the launch of AMD Instinct MI300X powered shapes in 2024 and extending to the general availability of OCI Compute with AMD Instinct MI355X GPUs. These will be available in the zettascale OCI Supercluster.
Demand for large-scale AI capacity is accelerating as next-generation AI models outgrow the limits of current AI clusters. To train and run these workloads, customers need flexible, open compute solutions engineered for extreme scale and efficiency. OCI’s planned new AI superclusters will be powered by the AMD “Helios” rack design, which includes AMD Instinct MI450 Series GPUs, next- generation AMD EPYC CPUs codenamed “Venice,” and next-generation AMD Pensando advanced networking codenamed “Vulcano.” This vertically optimised, rack-scale architecture is designed to deliver maximum performance, scalability, and energy efficiency for large-scale AI training and inference.
“Our customers are building some of the world’s most ambitious AI applications, and that requires robust, scalable, and high-performance infrastructure,” said Mahesh Thiagarajan, executive vice president, Oracle Cloud Infrastructure. “By bringing together the latest AMD processor innovations with OCI’s secure, flexible platform and advanced networking powered by Oracle Acceleron, customers can push the boundaries with confidence. Through our decade-long collaboration with AMD—from EPYC to AMD Instinct accelerators—we’re continuing to deliver the best price-performance, open, secure, and scalable cloud foundation in partnership with AMD to meet customer needs for this next era of AI.”
“AMD and Oracle continue to set the pace for AI innovation in the cloud,” said Forrest Norrod, executive vice president and general manager, Data Centre Solutions Business Group, AMD. “With our AMD Instinct GPUs, EPYC CPUs, and advanced AMD Pensando networking, Oracle customers gain powerful new capabilities for training, fine-tuning, and deploying the next generation of AI. Together, AMD and Oracle are accelerating AI with open, optimised, and secure systems built for massive AI data centres.”
AMD Instinct MI450 Series GPUs Coming to OCI
AMD Instinct MI450 Series GPU-powered shapes are designed to deliver high-performance, flexible cloud deployment options and provide extensive open-source support. This provides the ideal foundation for customers running today’s most advanced language models, generative AI, and high-performance computing workloads. With AMD Instinct MI450 Series GPUs on OCI, customers will be able to benefit from:
- Breakthrough compute and memory: Helps customers achieve faster results, tackle more complex workloads, and reduce the need for model partitioning by increasing memory bandwidth for AI training models. Each AMD Instinct MI450 Series GPU will provide up to 432 GB of HBM4 and 20 TB/s of memory bandwidth, enabling customers to train and infer models that are 50 percent larger than previous generations entirely in-memory.
- AMD optimised “Helios” rack design: Enables customers to operate at scale while optimising performance density, cost, and energy efficiency via dense, liquid-cooled, 72-GPU racks. The AMD “Helios” rack design integrates UALoE scale-up connectivity and Ethernet-based Ultra Ethernet Consortium (UEC)-aligned scale-out networking to minimise latency and maximise throughput across pods and racks.
- Powerful head node: Helps customers maximise cluster utilisation and streamline large-scale workflows by accelerating job orchestration and data processing on an architecture consisting of next-generation AMD EPYC CPUs, code named “Venice.” In addition, these EPYC CPUs will offer confidential computing capabilities and built-in security features to help safeguard sensitive AI workloads end to end.
- DPU-accelerated converged networking: Powers line-rate data ingestion to improve performance and enhance security posture for large-scale AI and cloud infrastructure. Built on the fully programmable AMD Pensando DPU technology, the DPU-accelerated converged networking offers the security and performance required for data centres to run the next era of AI training, inferencing, and cloud workloads.
- Scale-out networking for AI: Enables customers to leverage ultra-fast distributed training and optimised collective communication with a future-ready open networking fabric. Each GPU can be equipped with up to three 800 Gbps AMD Pensando “Vulcano” AI-NICs, providing customers with lossless, high-speed, and programmable connectivity that supports advanced RoCE and UEC standards.
- Innovative UALink and UALoE fabric: Helps customers efficiently expand workloads, reduce memory bottlenecks, and orchestrate large multi-trillion-parameter models. The scalable architecture minimises hops and latency without routing through CPUs and enables direct, hardware-coherent networking and memory sharing among GPUs within a rack via UALink protocol transported over a UALoE fabric. UALink is an open, high-speed interconnect standard purpose built for AI accelerators and supported by a broad industry ecosystem. As a result, customers gain the flexibility, scalability, and reliability needed to run their most demanding AI workloads on open standards-based infrastructure.
- Open-source AMD ROCm software stack: Enables rapid innovation, offers freedom of vendor choice, and simplifies the migration of existing AI and HPC workloads by providing customers with an open, flexible programming environment, including popular frameworks, libraries, compilers, and runtimes.
- Advanced partitioning and virtualisation: Enables customers to safely share clusters and allocate GPUs based on workload needs by facilitating the secure and efficient use of resources via fine-grained GPU and pod partitioning, SR-IOV virtualisation, and robust multi-tenancy.
To give customers that build, train, and inference AI at scale more choice, OCI also announced the general availability of OCI Compute with AMD Instinct MI355X GPUs. These will be available in the zettascale OCI Supercluster that can scale to 131,072 GPUs. AMD Instinct MI355X-powered shapes are designed with superior value, cloud flexibility, and open-source compatibility.
Discussion about this post