V100 Type A100 Type H100 SXM
Pass-through Pass-through Pass-through
NVIDIA Volta NVIDIA Ampere NVIDIA Hopper
32GB 80GB 80GB
21.1 Billion 12 nm TSMC 54 Billion 7nm TSMC 80 billion 4N TSMC
125 TFLOPs 312 TFLOPs 1,979 TFLOPs
900 GB/sec 2,000 GB/sec 3.35 TB/sec HBM3
5,120 Cores 6,912 Cores 16,896 Cores
640 (1st Generation) 1,024 (3rd Generation) 528 (4th Generation)
NVLink 2 NVLink 3 NVLink 4
300 GB/s 600 GB/s 900 GB/s
25 Gbps 50 Gbps 25 Gbps (x18)
- NVSwitch 2 NVSwitch 3
- 600 GB/s 900 GB/s
- 9.6 TB/s 7.2TB/s
Block Storage - SSD Block Storage - SSD Block Storage - SSD
Red Hat Enterprise Linux RHEL 7.6, RHEL 8.4
Ubuntu Ubuntu 18.04, Ubuntu 20.04, Ubuntu 22.04
Windows Windows Server 2016