| V100 SXM | A100 SXM | H100 SXM | L40s PCIe | |
|---|---|---|---|---|
| Pass-through | Pass-through | Pass-through | Pass-through | |
| NVIDIA Volta | NVIDIA Ampere | NVIDIA Hopper | NVIDIA Ada Lovelace | |
| 32GB | 80GB | 80GB | 48GB (GDDR6, With ECC) | |
| 21.1 Billion 12 nm TSMC | 54 Billion 7nm TSMC | 80 billion 4N TSMC | 76 Billion 5nm TSMC | |
| 125 TFLOPs | 312 TFLOPs 624* TFLOPs |
1,979* TFLOPs | 183 TFLOPs 366* TFLOPs |
|
| 900 GB/sec | 2,000 GB/sec | 3.35 TB/sec HBM3 | 864 GB/sec | |
| 5,120 Cores | 6,912 Cores | 16,896 Cores | 18,176 Cores (Lovelace) | |
| 640 (1st Generation) | 1,024 (3rd Generation) | 528 (4th Generation) | 568 (4th Generation) | |
| NVLink 2 | NVLink 3 | NVLink 4 | No | |
| 300 GB/s | 600 GB/s | 900 GB/s | - | |
| 25 Gbps | 50 Gbps | 25 Gbps (x18) | - | |
| - | NVSwitch 2 | NVSwitch 3 | No | |
| - | 600 GB/s | 900 GB/s | - | |
| - | 9.6 TB/s | 7.2TB/s | - | Block Storage - SSD | Block Storage - SSD | Block Storage - SSD | Block Storage - SSD |
* With Sparsity
| Red Hat Enterprise Linux | RHEL 7.6*, RHEL 8.4, RHEL 8.8 |
| Ubuntu | Ubuntu 18.04*, Ubuntu 20.04, Ubuntu 22.04 |
| Windows | Windows Server 2016 |