All Hardware
NVIDIA A100 (TensorRT FP16)
NVIDIA A100-SXM4-80GB
VRAM
80 GB
FP16 Performance
312 TFLOPS
Power (TDP)
400W
Starting Price
$1.89/hr
Cloud Providers
Highest Accuracy
Top 5 models by mAP@50-95
Fastest
Top 5 models by throughput
All Models
39 models benchmarked on NVIDIA A100 (TensorRT FP16)
| # | Model | mAP | FPS | Latency | Params |
|---|---|---|---|---|---|
| 1 | yolov9e | 55.5% | 70.7 | 14.1ms | 58.1M |
| 2 | rtdetr-x | 54.9% | 61.5 | 16.3ms | 67.0M |
| 3 | yolov11x | 54.6% | 69.2 | 14.4ms | 56.9M |
| 4 | yolov10x | 54.3% | 92.6 | 10.8ms | 29.5M |
| 5 | rtdetr-r101 | 54.3% | 58.6 | 17.1ms | 76.0M |
| 6 | yolov8x | 53.8% | 63.3 | 15.8ms | 68.2M |
| 7 | yolov11l | 53.4% | 95.1 | 10.5ms | 25.3M |
| 8 | yolov10l | 53.3% | 120.9 | 8.3ms | 24.4M |
| 9 | yolov7-x | 53.2% | 66.5 | 15.0ms | 71.3M |
| 10 | rtdetr-r50 | 53.1% | 78.0 | 12.8ms | 42.0M |
| 11 | yolov9c | 53.0% | 98.5 | 10.1ms | 25.5M |
| 12 | yolov8l | 52.9% | 82.5 | 12.1ms | 43.7M |
| 13 | rtdetr-l | 52.9% | 92.9 | 10.8ms | 32.0M |
| 14 | yolov10b | 52.4% | 149.5 | 6.7ms | 19.1M |
| 15 | yolo-nas-l | 52.3% | 91.8 | 10.9ms | 44.5M |
| 16 | yolov11m | 51.6% | 115.0 | 8.7ms | 20.1M |
| 17 | yolov9m | 51.4% | 117.7 | 8.5ms | 20.1M |
| 18 | yolo-nas-m | 51.4% | 104.1 | 9.6ms | 31.9M |
| 19 | yolov7 | 51.3% | 96.3 | 10.4ms | 36.9M |
| 20 | yolox-x | 51.1% | 50.0 | 20.0ms | 99.1M |
| 21 | yolov10m | 51.0% | 185.2 | 5.4ms | 15.4M |
| 22 | yolov8m | 50.2% | 112.8 | 8.9ms | 25.9M |
| 23 | yolox-l | 49.6% | 77.0 | 13.0ms | 54.2M |
| 24 | rtdetr-r34 | 48.8% | 98.4 | 10.2ms | 31.0M |
| 25 | yolo-nas-s | 47.6% | 144.5 | 6.9ms | 12.2M |
| 26 | yolov11s | 46.9% | 171.6 | 5.8ms | 9.4M |
| 27 | yolox-m | 46.9% | 121.9 | 8.2ms | 25.3M |
| 28 | yolov9s | 46.7% | 164.3 | 6.1ms | 7.2M |
| 29 | rtdetr-r18 | 46.5% | 114.9 | 8.7ms | 20.0M |
| 30 | yolov10s | 46.2% | 281.8 | 3.5ms | 7.2M |
| 31 | yolov8s | 45.0% | 167.1 | 6.0ms | 11.2M |
| 32 | yolox-s | 40.4% | 160.7 | 6.2ms | 9.0M |
| 33 | yolov11n | 39.5% | 209.7 | 4.8ms | 2.6M |
| 34 | yolov9t | 38.4% | 194.4 | 5.1ms | 2.0M |
| 35 | yolov10n | 38.4% | 380.4 | 2.6ms | 2.3M |
| 36 | yolov8n | 37.4% | 193.3 | 5.2ms | 3.2M |
| 37 | yolov7-tiny | 37.4% | 184.8 | 5.4ms | 6.2M |
| 38 | yolox-tiny | 32.9% | 206.6 | 4.8ms | 5.1M |
| 39 | yolox-nano | 25.8% | 219.2 | 4.6ms | 0.9M |