Low-level Guidance (llguidance) Python Bindings
JSON →llguidance is a high-performance Rust library with Python bindings for constrained decoding (structured outputs) in Large Language Models (LLMs). It enables enforcing arbitrary context-free grammars (including JSON schemas and regular expressions) on LLM outputs with minimal overhead, typically around 50μs of CPU time per token. It serves as the fast grammar engine backend for the `guidance` Python library. The current Python binding version is 1.7.0, and releases generally align with updates to the core Rust library.
Traffic · last 30 days stale · no recent hits
total hits 11
actors 5 distinct systems
last hit 18d ago AhrefsBot
top countries 🇺🇸 United States · 🇨🇦 Canada · 🇩🇪 Germany · 🇸🇬 Singapore
API endpoints
full doc /v1/registry/llguidance
install /v1/registry/llguidance/install
compatibility /v1/registry/llguidance/compatibility