KR6288V2 - GHA

KR6288V2 with 4th Gen Intel® Xeon® Scalable processors is an advanced AI system made for hyperscale data centers, delivering high performance with NVIDIA HGX H100/A100 8-GPUs. This server delivers industry-leading 16PFlops of AI performance and lightning-fast CPU-to-GPU interconnect bandwidth, with the H100 Transformer Engine supercharging training speeds for GPT large language models. Its optimized power efficiency and modular design with flexible configuration makes it ideal for the most demanding AI tasks in various scenarios like hyperscale data centers, AI model training, and metaverse workloads.

Unprecedented AI Performance

2x 4th Gen Intel® Xeon® Scalable processors

16PFlops of industry-leading AI performance

H100 Transformer Engine delivers supercharged training speed for GPT large language models

Leading Architecture Design

Lightning-fast CPU-to-GPU interconnect bandwidth

Ultra-high scalable inter-node networking with up to 4.0 Tbps non-blocking bandwidth

Optimized cluster-level architecture with 8:8:2 ratio of GPU to compute network to storage network

Optimized Energy Efficiency

Low air-cooled heat dissipation overhead and high power efﬁciency

54V, 12V separated power supply with N+N redundancy reducing power conversion loss

Direct liquid cooling design with over 80% cold plate coverage keeps PUE ≤1.15

Flexible Configurations for AI Scenarios

Fully modular design and flexible conﬁgurations satisfy both on-premises and cloud deployment

Easily harness large-scale model training, such as GPT-3, MT-NLG, stable diffusion and Alphafold

Diversiﬁed SuperPod solutions accelerating the most cutting-edge innovation including AIGC, AI4Science and Metaverse

Model	KR6288-X2-A0-R0-00
Form Factor	6U rack server
GPU	NVIDIA HGX H100/A100 8-GPUs, TDP up to 700W
CPU	2x 4td Gen Intel® Xeon® Scalable processors
Memory	32x DDR5 DIMMs, up to 4800MT/s
I/O	Front: 1x USB 3.0, 1x USB 2.0, 1x VGA
I/O	Rear: 2x USB 3.0, 1x RJ45, 1x MicroUSB, 1x VGA
OCP	Supports 1x OCP 3.0 (optional), supports NCSI
Management	DC-SCM BMC management module witd Aspeed 2600
Security	TPM 2.0 (Trusted Platform Module)
Storage	24x 2.5” SSD, up to 16x NVMe U.2 2x Onboard NVMe/SATA M.2
PSU	2x 12V 3200W and 6x 54V 2700W, Platinum/Titanium PSU witd N+N redundancy
Dimensions	447mm (W) x 263mm (H) x 860mm (D)