Administrator Guide

7 Deep Learning Performance Scale-Out
Volta SXM, use PCIe bridges and this limits the total available bandwidth between CPU to GPU.
See Table 2 with the Host-GPU Complex PCIe Bandwidth Summary.
Configuration
Link Interface b/n CPU-
GPU complex
Total Bandwidth
Notes
M
4x16 Gen3
128GB/s
Each GPU has individual
x16 Gen3 to Host CPU
Table 2: Host-GPU Complex PCIe Bandwidth Summary
SXM1 SXM2
SXM4 SXM3
CPU2CPU1
x16
x16
x16
x16
UPI
Configuration M
X16
IO
Slot
X16
IO
Slot
Figure 4: C4140 Configuration-M
NVLink
PCIe