V100 SXM A100 SXM H100 SXM L40s PCIe
Pass-through Pass-through Pass-through Pass-through
NVIDIA Volta NVIDIA Ampere NVIDIA Hopper NVIDIA Ada Lovelace
32GB 80GB 80GB 48GB (GDDR6, With ECC)
21.1 Billion 12 nm TSMC 54 Billion 7nm TSMC 80 billion 4N TSMC 76 Billion 5nm TSMC
125 TFLOPs 312 TFLOPs 1,979 TFLOPs 183 TFLOPs
366* TFLOPs
*With Sparsity
900 GB/sec 2,000 GB/sec 3.35 TB/sec HBM3 864 GB/sec
5,120 Cores 6,912 Cores 16,896 Cores 18,176 Cores (Lovelace)
640 (1st Generation) 1,024 (3rd Generation) 528 (4th Generation) 568 (4th Generation)
NVLink 2 NVLink 3 NVLink 4 No
300 GB/s 600 GB/s 900 GB/s -
25 Gbps 50 Gbps 25 Gbps (x18) -
- NVSwitch 2 NVSwitch 3 No
- 600 GB/s 900 GB/s -
- 9.6 TB/s 7.2TB/s -
Block Storage - SSD Block Storage - SSD Block Storage - SSD Block Storage - SSD
Red Hat Enterprise Linux RHEL 7.6*, RHEL 8.4
Ubuntu Ubuntu 18.04*, Ubuntu 20.04, Ubuntu 22.04
Windows Windows Server 2016