ONNX Runtime Web

ONNX Runtime Web (ORT Web) is a JavaScript library designed to execute ONNX (Open Neural Network Exchange) machine learning models directly within web browsers and Node.js environments. The current stable version is 1.24.3. The project maintains a regular release cadence, with patch releases frequently published between major quarterly releases, ensuring timely bug fixes, security enhancements, and performance updates. Key differentiators include its ability to run models client-side, reducing server-client communication and enhancing user privacy. It leverages WebAssembly (WASM) for efficient CPU execution and provides GPU acceleration through WebGL (in maintenance mode) and the more modern WebGPU (experimental, launched in v1.17). ORT Web supports a broad range of ONNX operators and offers optimizations for performance and memory usage, making it suitable for deploying various AI models like image classification, object detection, and generative AI directly in web applications.