NVIDIA® A100 GPU Computing Accelerator - 80GB HBM2 - PCIe 4.0 x16 - Passive Cooling
NVIDIA part #: 900-21001-0020-000
NVIDIA A100 Tensor Core GPU delivers unprecedented acceleration at every scale to power the world’s highest-performing elastic data centers for AI, data analytics, and HPC. Powered by the NVIDIA Ampere Architecture, A100 is the engine of the NVIDIA data center platform. A100 provides up to 20X higher performance over the prior generation and can be partitioned into seven GPU instances to dynamically adjust to shifting demands. Available in 40GB and 80GB memory versions, A100 80GB debuts the world’s fastest memory bandwidth at over 2 terabytes per second (TB/s) to run the largest models and datasets.
| Main Specifications | |
| Product Series | Nvidia A100 |
| Core Type | NVIDIA TENSOR |
| Host Interface | PCI Express 4.0 x16 |
| GPU Architecture | Ampere |
| Detailed Specifications | |
| PCIe x16 Interconnect Bandwidth | PCIe Gen4 64 GB/s |
| Max Memory Size | 80 GB |
| Max Memory Bandwidth | 1,935 GB/s |
| Peak FP64 | 9.7 TFLOPS |
| Peak FP64 Tensor Core | 19.5 TFLOPS |
| INT8 Tensor Core | 624 TOPS |
| TF32 Tensor Core | 156 TFLOPS |
| FP32 | 19.5 TFLOPS |
| Peak BFLOAT16 Tensor Core | 312 TFLOPS |
| Peak FP16 Tensor Core | 312 TFLOPS |
| Total NVLink Bandwidth | 600 GB/s (via NVLink Bridge for up to 2-GPUs) |
| Multi-Instance GPUs | 7 MIGs at 10GB |
| Cooling | Passive |
| Dual Slot | Yes |
| Supplementary Power Connectors | 1x 8-pin CPU (EPS12V) |
| Max Graphics Card Power (W) | 300W |