Report an Error

NVIDIA A100 SXM4 40 GB

Graphics Processor
GA100
Cores
6912
TMUs
432
ROPs
160
Memory Size
40 GB
Memory Type
HBM2e
Bus Width
5120 bit
GPU Chip
GPU
The A100 SXM4 40 GB is a professional graphics card by NVIDIA, launched on May 14th, 2020. Built on the 7 nm process, and based on the GA100 graphics processor, the card does not support DirectX. Since A100 SXM4 40 GB does not support DirectX 11 or DirectX 12, it might not be able to run all the latest games. The GA100 graphics processor is a large chip with a die area of 826 mm² and 54,200 million transistors. It features 6912 shading units, 432 texture mapping units, and 160 ROPs. Also included are 432 tensor cores which help improve the speed of machine learning applications. NVIDIA has paired 40 GB HBM2e memory with the A100 SXM4 40 GB, which are connected using a 5120-bit memory interface. The GPU is operating at a frequency of 1095 MHz, which can be boosted up to 1410 MHz, memory is running at 1215 MHz.
Being a sxm module card, the NVIDIA A100 SXM4 40 GB does not require any additional power connector, its power draw is rated at 400 W maximum. This device has no display connectivity, as it is not designed to have monitors connected to it. A100 SXM4 40 GB is connected to the rest of the system using a PCI-Express 4.0 x16 interface.

Graphics Processor

GPU Name
GA100
Architecture
Ampere
Foundry
TSMC
Process Size
7 nm
Transistors
54,200 million
Density
65.6M / mm²
Die Size
826 mm²
Chip Package
BGA-2743

Graphics Card

Release Date
May 14th, 2020
Generation
Tesla Ampere
(Axx)
Predecessor
Tesla Turing
Successor
Tesla Ada
Production
Active
Bus Interface
PCIe 4.0 x16

Relative Performance

GeForce 210
1%
GeForce 9400 GT
1%
Radeon HD 4550
1%
Radeon HD 5450
2%
Radeon HD 6450
2%
GeForce GT 520
2%
GeForce GT 220
2%
GeForce GT 430
3%
Radeon HD 5570
3%
Radeon HD 4670
3%
GeForce GT 440
4%
GeForce GT 240
4%
GeForce 9600 GT
4%
Radeon HD 5670
5%
GeForce GT 640
5%
GeForce 9800 GT
5%
Radeon HD 6670
5%
Radeon HD 4830
5%
Radeon HD 4770
6%
Radeon HD 4850
6%
GeForce GTS 250
6%
GeForce GTS 450
6%
Radeon HD 5750
7%
Radeon HD 7750
8%
Radeon HD 5770
8%
GeForce GTX 260
8%
Radeon HD 4870
8%
Radeon Vega 8
8%
GeForce GTX 550 Ti
8%
GeForce GTX 650
8%
Radeon HD 5830
8%
Radeon HD 6790
9%
Radeon HD 4890
9%
GeForce GTX 460
9%
Radeon RX Vega 11
9%
GeForce GT 1030
10%
GeForce GTX 275
10%
Radeon HD 7770 GHz Edition
10%
GeForce GTX 280
10%
GeForce GTX 465
10%
Radeon HD 6850
10%
GeForce GTX 285
11%
Radeon HD 5850
11%
GeForce GTX 650 Ti
12%
Radeon HD 7790
12%
Radeon RX 550
12%
GeForce GTX 470
12%
Radeon HD 6870
12%
Radeon HD 5870
13%
GeForce GTX 560 Ti
14%
Radeon HD 4870 X2
14%
GeForce GTX 750 Ti
14%
Radeon HD 6950
14%
GeForce GTX 295
15%
GeForce GTX 650 Ti Boost
15%
Radeon HD 7850
15%
GeForce GTX 480
15%
Radeon HD 6970
16%
Radeon R7 265
16%
Radeon RX 460
16%
Radeon R7 370
16%
GeForce GTX 660
17%
GeForce GTX 570
17%
Radeon RX 560
17%
GeForce GTX 950
18%
Radeon HD 7870 GHz Edition
18%
Radeon R9 270X
18%
GeForce GTX 660 Ti
19%
GeForce GTX 580
19%
GeForce GTX 1050
19%
Radeon HD 7950
19%
GeForce GTX 1630
19%
Radeon HD 5970
19%
GeForce GTX 760
20%
GeForce GTX 670
21%
GeForce GTX 960
22%
Radeon R9 380
23%
Radeon R9 285
23%
Radeon HD 7970
23%
GeForce GTX 680
23%
GeForce GTX 1050 Ti
24%
GeForce GTX 770
24%
Radeon HD 6990
25%
Radeon R9 280X
25%
GeForce GTX 590
26%
Radeon HD 7970 GHz Edition
26%
GeForce GTX 780
29%
Arc A380
29%
Radeon RX 6400
29%
GeForce GTX 1650
30%
Radeon RX 470
31%
Radeon R9 290
32%
Radeon RX 570
34%
Radeon R9 390
34%
Radeon R9 290X
34%
GeForce GTX 970
35%
GeForce GTX TITAN
35%
GeForce GTX 780 Ti
36%
Radeon R9 390X
36%
Radeon HD 7990
36%
Radeon RX 480
36%
GeForce GTX 690
37%
GeForce GTX 1060 6 GB
38%
Radeon RX 5500 OEM
38%
Radeon RX 580
39%
Radeon RX 5500 XT
39%
Radeon RX 6500 XT
39%
GeForce GTX 980
40%
GeForce GTX 1650 SUPER
40%
Radeon R9 FURY
40%
Radeon RX 590
42%
Radeon R9 295X2
44%
GeForce GTX 1660
44%
Radeon R9 FURY X
45%
GeForce GTX 980 Ti
46%
GeForce GTX TITAN X
47%
GeForce GTX 1660 SUPER
48%
GeForce GTX 1070
51%
GeForce GTX 1660 Ti
51%
GeForce RTX 3050 8 GB
52%
Radeon RX Vega 56
54%
GeForce GTX 1070 Ti
57%
Radeon RX 5600 XT
58%
Radeon RX Vega 64
59%
GeForce GTX 1080
60%
GeForce RTX 2060
60%
Radeon RX 5700
62%
Arc A580
62%
Radeon RX 6600
65%
GeForce RTX 2060 SUPER
67%
GeForce RTX 2070
68%
Radeon RX 5700 XT
68%
GeForce RTX 3060 12 GB
70%
Arc A750
72%
Radeon VII
72%
TITAN X Pascal
74%
Radeon RX 6600 XT
75%
GeForce GTX 1080 Ti
76%
Arc A770
77%
GeForce RTX 2070 SUPER
77%
Radeon RX 6650 XT
81%
Radeon RX 7600
82%
GeForce RTX 4060
82%
GeForce RTX 2080
83%
Radeon RX 7600 XT
85%
GeForce RTX 2080 SUPER
87%
GeForce RTX 3060 Ti
89%
Radeon RX 6700 XT
92%
Radeon RX 6750 XT
98%
GeForce RTX 4060 Ti 8 GB
99%
GeForce RTX 2080 Ti
100%
A100 SXM4 40 GB
100%
GeForce RTX 3070
104%
GeForce RTX 3070 Ti
112%
Radeon RX 7700 XT
113%
Radeon RX 6800
115%
GeForce RTX 4070
127%
Radeon RX 6800 XT
131%
GeForce RTX 3080
136%
Radeon RX 7800 XT
137%
Radeon RX 6900 XT
141%
GeForce RTX 4070 SUPER
148%
Radeon RX 7900 GRE
151%
GeForce RTX 3080 Ti
152%
Radeon RX 6950 XT
152%
GeForce RTX 3090
155%
GeForce RTX 4070 Ti
159%
GeForce RTX 4070 Ti SUPER
173%
Radeon RX 7900 XT
178%
GeForce RTX 3090 Ti
179%
GeForce RTX 4080
201%
GeForce RTX 4080 SUPER
204%
Radeon RX 7900 XTX
206%
GeForce RTX 4090
253%
Based on TPU review data: "Performance Summary" at 1920x1080, 4K for 2080 Ti and faster.
Performance estimated based on architecture, shader count and clocks.

Clock Speeds

Base Clock
1095 MHz
Boost Clock
1410 MHz
Memory Clock
1215 MHz
2.4 Gbps effective

Memory

Memory Size
40 GB
Memory Type
HBM2e
Memory Bus
5120 bit
Bandwidth
1.56 TB/s

Render Config

Shading Units
6912
TMUs
432
ROPs
160
SM Count
108
Tensor Cores
432
L1 Cache
192 KB (per SM)
L2 Cache
40 MB

Theoretical Performance

Pixel Rate
225.6 GPixel/s
Texture Rate
609.1 GTexel/s
BF16
311.84 TFLOPS (16:1)
TF32
155.92 TFLOPs (8:1)
FP64 Tensor
19.49 TFLOPS (1:1)
FP16 (half)
77.97 TFLOPS (4:1)
FP32 (float)
19.49 TFLOPS
FP64 (double)
9.746 TFLOPS (1:2)

Board Design

Slot Width
SXM Module
TDP
400 W
Suggested PSU
800 W
Outputs
No outputs
Power Connectors
None

Graphics Features

DirectX
N/A
OpenGL
N/A
OpenCL
3.0
Vulkan
N/A
CUDA
8.0
Shader Model
N/A

GA100 GPU Notes

Tensor Cores: 3rd Gen
NVENC: No Support
NVDEC: 4th Gen x5
PureVideo HD: VP10
VDPAU: Feature Set J
Apr 27th, 2024 14:52 EDT change timezone

New Forum Posts

Popular Reviews

Controversial News Posts