LitServe
JSON →LitServe is a lightweight, fast AI inference server from Lightning AI. It wraps PyTorch models (and others) into a performant API endpoint with auto-batching, GPU support, and a simple API. Current version 0.2.17, requires Python >=3.10. Released under Apache 2.0, active development with frequent updates.
Traffic · last 30 days stale · no recent hits
total hits 10
actors 3 distinct systems
last hit 17d ago AhrefsBot
top countries 🇺🇸 United States · 🇸🇬 Singapore · NP · 🇨🇦 Canada · 🇺🇦 Ukraine