- ASRock Rack introduces scale-up servers leveraging NVIDIA Blackwell architecture at COMPUTEX 2024.
- Highlighted servers include liquid-cooled racks and direct-to-chip liquid-cooled GPU servers.
- ASRock Rack also showcases GPU servers based on NVIDIA MGX™ modular reference architecture.
- Servers feature NVIDIA Grace™ CPUs and Blackwell Tensor Core GPUs for accelerated computing.
- Support for up to eight NVIDIA BlueField®-3 SuperNICs for AI-optimized Ethernet platform.
- ASRock Rack working on new product for scale-out configurations based on NVIDIA GB200 NVL2.
Main AI News:
ASRock Rack Inc., a frontrunner in server innovation, has debuted a range of scale-up servers harnessing the formidable NVIDIA Blackwell architecture at COMPUTEX 2024. Located at booth L0818 in Hall 1, ASRock Rack’s showcase features the ORV3 NVIDIA GB200 NVL72, a liquid-cooled rack, alongside the 6U8X-GNR2/DLC NVIDIA HGX B200, a direct-to-chip liquid-cooled GPU server. Additionally, ASRock Rack is highlighting GPU servers based on the NVIDIA MGX™ modular reference architecture for accelerated computing.
The ORV3-NVIDIA GB200 NVL72 from ASRock Rack is founded upon the newly unveiled NVIDIA GB200 NVL72 scale-up system. This innovation intertwines 36 NVIDIA Grace™ CPUs and 72 NVIDIA Blackwell Tensor Core GPUs via NVIDIA NVLink™ technology, culminating in a singular, robust GPU engineered for accelerated real-time large language model (LLM) inference at a reduced total cost of ownership (TCO).
In tandem with this rack-scale solution, ASRock Rack has introduced the 6U8X-EGS2 NVIDIA HGX B100 and the 6U8X-GNR2/DLC NVIDIA HGX B200. These servers house the NVIDIA HGX™ B100 8-GPU system or the NVIDIA HGX B200 8-GPU system, respectively. The 6U8X-GNR2/DLC NVIDIA HGX B200 employs direct-to-chip liquid cooling technology, elevating the thermal design power (TDP) thresholds of the NVIDIA Blackwell GPUs within a 6U rackmount design.
For clientele devoid of liquid-cooling infrastructure, ASRock Rack is rolling out the air-cooled 8U8X-GNR2 NVIDIA HGX B200, featuring an NVIDIA HGX B200 8-GPU setup for expedited real-time inference on trillion-parameter models.
All ASRock Rack NVIDIA HGX servers support up to eight NVIDIA BlueField®-3 SuperNICs to harness NVIDIA Spectrum™-X, an AI-optimized Ethernet platform. Moreover, these systems will undergo certification for the comprehensive NVIDIA AI and accelerated computing platform, encompassing NVIDIA NIM inference microservices, a component of the NVIDIA AI Enterprise software platform for generative AI.
“We are unveiling data center solutions fueled by the NVIDIA Blackwell architecture, tailored for the most rigorous workloads in LLM training and generative AI inference,” remarked Weishi Sa, President at ASRock Rack. “We are committed to expanding our portfolio to democratize the advantages of the NVIDIA Blackwell architecture for mainstream LLM inference and data processing.“
In parallel, ASRock Rack is in the developmental phase of a new product predicated on the NVIDIA GB200 NVL2. This endeavor aims to furnish solutions that democratize the capabilities of the NVIDIA Blackwell architecture for scale-out configurations, streamlining integration with extant data center infrastructure.
“Collaborating with ASRock Rack, we are furnishing enterprises with a potent AI ecosystem that seamlessly amalgamates hardware and software, delivering groundbreaking performance and scalability, thereby pushing the frontiers of AI and high-performance computing,” elucidated Kaustubh Sanghani, Vice President of GPU Product Management at NVIDIA.
ASRock Rack Spotlights Servers Anchored on NVIDIA MGX Modular Reference Architecture
In addition to the aforementioned innovations, ASRock Rack presents the 4UMGX-GNR2. This dual-socket GPU server adheres to the NVIDIA MGX 4U standards and supports up to 8 FHFL dual-slot GPUs, including the NVIDIA H200 NVL Tensor Core GPU tailored for mainstream enterprise servers. It boasts five FHHL PCIe 5.0 x16 slots and one HHHL PCIe 5.0 x16 slot, accommodating NVIDIA BlueField-3 DPUs and NVIDIA ConnectX®-7 NICs for multiple 200Gb/s or 400Gb/s network connections. Moreover, it is outfitted with 16 hot-swap drive bays for E1.S (PCIe 5.0 x4) SSDs.
In addition to these pioneering offerings, visitors can explore a myriad of cutting-edge server systems at the ASRock Rack booth L0818 at COMPUTEX. Noteworthy among these is the MECAI-NVIDIA GH200 Grace Hopper Superchip server, unveiled by ASRock Rack earlier this year, on full display.
Conclusion:
ASRock Rack’s collaboration with NVIDIA to unveil servers equipped with the Blackwell architecture signals a significant advancement in data center capabilities. By offering enhanced performance and scalability for AI-driven workloads, these servers are poised to meet the demands of modern data processing needs, driving innovation in the market for accelerated computing solutions.
