Transformers Stream Generator
JSON →This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/Transformers. It provides a simple way to enable token-by-token streaming for Hugging Face `transformers` models, often used for large language models (LLMs). The library is currently at version 0.0.5 and appears to be in an early development stage with updates released as features or fixes are integrated.
Traffic · last 30 days stale · no recent hits
total hits 15
actors 3 distinct systems
last hit 18d ago ByteDance
top countries 🇸🇬 Singapore · 🇺🇸 United States · VN · 🇩🇪 Germany
Resources
API endpoints
compatibility /v1/registry/transformers-stream-generator/compatibility