Hugging Face Text Generation Python Client
JSON →The `text-generation` library is the official Python client for interacting with the Hugging Face Text Generation Inference (TGI) backend, a highly optimized solution for deploying large language models. It provides synchronous and asynchronous APIs for text generation, including streaming capabilities. The current version is 0.7.0, and while the underlying TGI server has a rapid release cadence with frequent updates, the client library itself is updated less often, focusing on stability and compatibility with common TGI server versions.
Traffic · last 30 days stale · no recent hits
total hits 14
actors 5 distinct systems
last hit 17d ago AhrefsBot
top countries 🇺🇸 United States · 🇨🇦 Canada · 🇫🇷 France · 🇩🇪 Germany
Resources
API endpoints
full doc /v1/registry/text-generation
compatibility /v1/registry/text-generation/compatibility