All Hardware

NVIDIA A100 (TensorRT FP16)

NVIDIA A100-SXM4-80GB

VRAM

80 GB

FP16 Performance

312 TFLOPS

Power (TDP)

400W

Starting Price

$1.89/hr

Highest Accuracy
Top 5 models by mAP@50-95
55.5%
54.9%
54.6%
54.3%
Fastest
Top 5 models by throughput
380 FPS
282 FPS
219 FPS
210 FPS
207 FPS
All Models
39 models benchmarked on NVIDIA A100 (TensorRT FP16)
#ModelmAPFPSLatencyParams
1
yolov9e
55.5%70.714.1ms58.1M
2
rtdetr-x
54.9%61.516.3ms67.0M
3
yolov11x
54.6%69.214.4ms56.9M
4
yolov10x
54.3%92.610.8ms29.5M
5
rtdetr-r101
54.3%58.617.1ms76.0M
6
yolov8x
53.8%63.315.8ms68.2M
7
yolov11l
53.4%95.110.5ms25.3M
8
yolov10l
53.3%120.98.3ms24.4M
9
yolov7-x
53.2%66.515.0ms71.3M
10
rtdetr-r50
53.1%78.012.8ms42.0M
11
yolov9c
53.0%98.510.1ms25.5M
12
yolov8l
52.9%82.512.1ms43.7M
13
rtdetr-l
52.9%92.910.8ms32.0M
14
yolov10b
52.4%149.56.7ms19.1M
15
yolo-nas-l
52.3%91.810.9ms44.5M
16
yolov11m
51.6%115.08.7ms20.1M
17
yolov9m
51.4%117.78.5ms20.1M
18
yolo-nas-m
51.4%104.19.6ms31.9M
19
yolov7
51.3%96.310.4ms36.9M
20
yolox-x
51.1%50.020.0ms99.1M
21
yolov10m
51.0%185.25.4ms15.4M
22
yolov8m
50.2%112.88.9ms25.9M
23
yolox-l
49.6%77.013.0ms54.2M
24
rtdetr-r34
48.8%98.410.2ms31.0M
25
yolo-nas-s
47.6%144.56.9ms12.2M
26
yolov11s
46.9%171.65.8ms9.4M
27
yolox-m
46.9%121.98.2ms25.3M
28
yolov9s
46.7%164.36.1ms7.2M
29
rtdetr-r18
46.5%114.98.7ms20.0M
30
yolov10s
46.2%281.83.5ms7.2M
31
yolov8s
45.0%167.16.0ms11.2M
32
yolox-s
40.4%160.76.2ms9.0M
33
yolov11n
39.5%209.74.8ms2.6M
34
yolov9t
38.4%194.45.1ms2.0M
35
yolov10n
38.4%380.42.6ms2.3M
36
yolov8n
37.4%193.35.2ms3.2M
37
yolov7-tiny
37.4%184.85.4ms6.2M
38
yolox-tiny
32.9%206.64.8ms5.1M
39
yolox-nano
25.8%219.24.6ms0.9M