Guidance

JSON →
library 0.3.1 ·python
verified Jun 9, 2026 install draft

Microsoft-backed constrained generation framework for LLMs. Programs interleave control flow with generation via lm += gen(...) syntax. Supports regex, CFGs, JSON schema, and select() constraints using a Rust-based llguidance engine. Backends: Transformers, llama.cpp, OpenAI, Azure AI. Model objects are immutable — each += produces a copy.

total hits 27
actors 6 distinct systems
last hit 8d ago DotBot
ByteDance
5
Amazonbot
4
MetaBot
4
Script
2
Humans
7

top countries 🇺🇸 United States · 🇸🇬 Singapore · 🇨🇦 Canada · 🇩🇪 Germany · 🇫🇷 France