Hardware Benchmarks
Explore model performance across different hardware configurations
Cloud GPU
NVIDIA A100 (TensorRT FP16)
NVIDIA A100-SXM4-80GB
VRAM80 GB
FP16312 TFLOPS
TDP400W
Starting at$1.89/hr
Cloud GPU
NVIDIA T4 (TensorRT FP16)
NVIDIA Tesla T4
VRAM16 GB
FP1665 TFLOPS
TDP70W
Starting at$0.35/hr
CPU
CPU (ONNX Runtime)
Intel Xeon (8 cores)
Starting at$0.10/hr
Coming Soon
More hardware configurations will be added in future updates
Jetson AGX OrinJetson Orin NXHailo-8Raspberry Pi 5Apple M3WebGPU (Browser)