Transformers Stream Generator
JSON →This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/Transformers. It provides a simple way to enable token-by-token streaming for Hugging Face `transformers` models, often used for large language models (LLMs). The library is currently at version 0.0.5 and appears to be in an early development stage with updates released as features or fixes are integrated.
Traffic · last 30 days ↑25% vs prev 7d
total hits 19
actors 6 distinct systems
last hit 17h ago ByteDance
top countries 🇺🇸 United States · 🇸🇬 Singapore · 🇩🇪 Germany · 🇫🇷 France
Resources
API endpoints
compatibility /v1/registry/transformers-stream-generator/compatibility