Preparing for system design interviews?  Try bugzed.com →

ONNX Runtime (GPU)

JSON →
library 1.24.4 ·python
verified Jul 3, 2026

ONNX Runtime is a high-performance inference engine for ONNX models. The `onnxruntime-gpu` package provides GPU acceleration (e.g., via CUDA, ROCm) for these models, building on the core ONNX Runtime. It's actively developed by Microsoft, with frequent releases often aligned with new ONNX operator sets and performance improvements, currently at version 1.24.4.

total hits 36
actors 7 distinct systems
last hit 4d ago human
OAI-SearchBot
8
ChatGPT-User
6
Amazonbot
2
ByteDance
2
Search engines
1
Humans
12

top countries 🇺🇸 United States · 🇸🇬 Singapore · 🇨🇦 Canada · 🇫🇷 France · HK