Last year, Nvidia was showing off the DGX-1 AI supercomputer, and now new DGX-2 has double the number of Tesla V100 processing modules for double the number of hamsters running around Nvidia's GPU wheels. The DGX-2 has four times the available memory space, thanks to the updated Tesla V100's larger 32GB of memory.
Nvidia's new NVSwitch technology is a full crossbar GPU interconnect fabric that allows NVIDIA's platform to scale to up to 16 GPUs and use their memory space contiguously. The DGX-1 platform was limited to eight total GPU complexes and associated memory.
Nvidia claims NVSwitch is five times faster than the fastest PCI Express switch and offers an aggregate 2.4TB per second of bandwidth.