Hugging Face Text Generation Python Client
JSON →The `text-generation` library is the official Python client for interacting with the Hugging Face Text Generation Inference (TGI) backend, a highly optimized solution for deploying large language models. It provides synchronous and asynchronous APIs for text generation, including streaming capabilities. The current version is 0.7.0, and while the underlying TGI server has a rapid release cadence with frequent updates, the client library itself is updated less often, focusing on stability and compatibility with common TGI server versions.
Traffic · last 30 days ↑50% vs prev 7d
total hits 18
actors 8 distinct systems
last hit 22h ago AhrefsBot
top countries 🇺🇸 United States · 🇨🇦 Canada · 🇫🇷 France · 🇩🇪 Germany
Resources
API endpoints
full doc /v1/registry/text-generation
compatibility /v1/registry/text-generation/compatibility