Used Dell PowerEdge XE8640 AI Server

The Dell PowerEdge XE8640 AI Server is a purpose-built 4U air-cooled platform designed to accelerate traditional AI training, inferencing, modeling, simulation, and HPC applications. It combines powerful architecture with up to two 4th or 5th Generation Intel Xeon Scalable processors, delivering up to 64 cores and cutting-edge on-chip innovations to maximize AI and ML performance.

With four NVIDIA H100 Tensor Core 700W SXM5 GPUs interconnected via NVIDIA NVLink technology, the XE8640 achieves extreme computational performance and up to 900GB/s bandwidth for GPU-GPU communication, 1.5x faster than previous generations. Its support for NVIDIA Multi-Instance GPU (MIG) capability enables efficient multi-tenant environments.

The XE8640 incorporates DDR5 memory, PCIe Gen 5.0, and NVMe SSDs to enhance I/O throughput, offering up to four PCIe Gen 5 slots and eight drives for high-performance AI operations. Additionally, it supports NVIDIA GPUDirect® Storage (GDS) for direct memory access between GPU and storage, improving bandwidth while reducing latency and CPU load. With its robust 4U design, this server supports next-gen technologies in ambient temperatures up to 35°C, delivering scalable, reliable performance for advanced AI workloads.