Guidance

JSON →
library 0.3.1 ·python
verified Jun 9, 2026 install draft

Microsoft-backed constrained generation framework for LLMs. Programs interleave control flow with generation via lm += gen(...) syntax. Supports regex, CFGs, JSON schema, and select() constraints using a Rust-based llguidance engine. Backends: Transformers, llama.cpp, OpenAI, Azure AI. Model objects are immutable — each += produces a copy.

total hits 32
actors 8 distinct systems
last hit 1h ago ClaudeBot
ByteDance
5
GPTBot
4
Amazonbot
4
MetaBot
4
Script
2
ClaudeBot
1
Humans
7

top countries 🇺🇸 United States · 🇸🇬 Singapore · 🇨🇦 Canada · 🇩🇪 Germany · 🇫🇷 France