V100 Type | A100 Type | H100 SXM | |
---|---|---|---|
Pass-through | Pass-through | Pass-through | |
NVIDIA Volta | NVIDIA Ampere | NVIDIA Hopper | |
32GB | 80GB | 80GB | |
21.1 Billion 12 nm TSMC | 54 Billion 7nm TSMC | 80 billion 4N TSMC | |
125 TFLOPs | 312 TFLOPs | 1,979 TFLOPs | |
900 GB/sec | 2,000 GB/sec | 3.35 TB/sec HBM3 | |
5,120 Cores | 6,912 Cores | 16,896 Cores | |
640 (1st Generation) | 1,024 (3rd Generation) | 528 (4th Generation) | |
NVLink 2 | NVLink 3 | NVLink 4 | |
300 GB/s | 600 GB/s | 900 GB/s | |
25 Gbps | 50 Gbps | 25 Gbps (x18) | |
- | NVSwitch 2 | NVSwitch 3 | |
- | 600 GB/s | 900 GB/s | |
- | 9.6 TB/s | 7.2TB/s | Block Storage - SSD | Block Storage - SSD | Block Storage - SSD |
Red Hat Enterprise Linux | RHEL 7.6, RHEL 8.4 |
Ubuntu | Ubuntu 18.04, Ubuntu 20.04, Ubuntu 22.04 |
Windows | Windows Server 2016 |