Nvidia unveils the HGX-2, a server platform for HPC and AI workloads

Jonathan MathewsPublic

Nvidia on Tuesday announced a new server platform, the HGX-2, designed to meet the needs of the growing number of applications that seek to leverage both high-performance computing (HPC) and artificial intelligence.

The platform, Nvidia says, is the first to offer high-precision computing capabilities to handle both HPC and AI workloads. It uses FP64 and FP32 for scientific computing and simulations, while enabling FP16 and Int8 for AI training and inference.

The HGX-2 server platform consists of a pair of baseboards. Each baseboard hosts eight V100 32 Gb Tensor Core GPUs. The 16 GPUs are fully connected through 12 NVSwitches to collectively deliver two petaflops of AI performance.

With the HGX-2 serving as a “building block,” Nvidia works with server manufacturers to build full server platforms that can be customized to meet the needs of different data centers.

Full Article