Dell Generative AI Open Ecosystem with AMD Instinct Accelerators

Dell Technologies and AMD are introducing an extension to the Dell Generative AI Solutions lineup, further facilitating sophisticated workloads and providing businesses with increased options to advance their distinct Generative AI (GenAI) endeavors. This latest technological advancement underscores the critical significance of open ecosystems and silicon diversity in empowering customers with uncomplicated, reliable, and customized solutions to seamlessly integrate AI into their data processes.

It is crucial to ensure that organizations have the necessary computing power to drive their innovation amid the rapid growth of data in today's AI landscape. The broadening of the portfolio signifies that Dell and AMD, in collaboration, will provide customers with an expanded range of options to support their AI and GenAI workloads.

Marking the quickest adoption in Dell's history, the Dell PowerEdge XE9680 is set to accommodate the upcoming AMD Instinct MI300X accelerator, providing customers with increased options for AI performance. The PowerEdge XE9680, coupled with AMD Instinct MI300X, delivers high-performance capabilities tailored for enterprises aiming to harness the potential of their data and distinguish their business through customized large language models (LLMs).

Equipped with eight MI300X GPUs, boasting 192GB of 5.3 TB/s High Bandwidth Memory (HBM3) per GPU and a cumulative coherent HBM3 capacity of 1.5 TB per server, along with a remarkable FP16 performance exceeding 21 petaflops, the PowerEdge XE9680 featuring MI300X is positioned to democratize GenAI access for enterprises. This advancement enables the training of larger models, reduction of data center footprints, lowered total cost of ownership (TCO), and the attainment of a competitive edge.

In addition to endorsing the AMD MI300X Instinct Accelerator, Dell is unveiling the next phase of Dell Generative AI Solutions. This initiative simplifies the deployment of reliable GenAI for organizations through the introduction of the new Dell Validated Design for Generative AI in collaboration with AMD.

Scheduled for release in the first half of 2024, the fresh Dell Validated Design for Generative AI, leveraging AMD ROCm-powered AI frameworks, expands the Dell Generative AI Solutions ecosystem. This design incorporates open-source Large Language Models (LLMs). AMD ROCm stands as an open-source compilation of drivers, development toolkits, and APIs designed for AMD Instinct accelerators. Dell Validated Designs for Generative AI streamline the process for Dell customers, eliminating uncertainties in integration, performance, and sizing considerations, allowing them to construct reliable GenAI platforms tailored to their specific requirements.

Renowned for its robust performance and unwavering commitment to security and simplicity, the PowerEdge XE9680 stands as a powerhouse in the realm of computing. Dell's OpenManage Enterprise software expedites the deployment of GenAI infrastructure, streamlining processes, while the CloudIQ software ensures intelligent automation from any location. The PowerEdge XE9680 is fortified with integrated cyber recovery measures and embraces a comprehensive zero-trust approach, enhancing security on multiple fronts.

Harnessing the AMD Instinct Platform driven by eight AMD Instinct MI300X accelerators, the PowerEdge XE9680 facilitates nearly linear scaling and low-latency distributed GenAI training and inferencing. This is achieved through the Global Memory Interconnect (xGMI), extending across a cluster of PowerEdge servers. The interconnection of MI300X GPUs utilizes an Ethernet-based AI fabric, employing a Dell-validated GPU fabric and Dell PowerSwitch Z9664F-ON.

Being an active participant in the Ultra Ethernet Consortium (UEC), Dell persistently champions standards-based networking. Dell Technologies stands out in its capability to fully actualize the benefits of an open approach by integrating it comprehensively throughout the entire GenAI solution, encompassing compute, fabric, and storage. The availability of the Dell PowerEdge XE9680, featuring AMD Instinct MI300X accelerators, and the Dell Validated Design for Generative AI with AMD is slated for the first half of 2024.