{"library":"sglang","type":"library","category":null,"description":"SGLang is a high-performance serving framework for large language models (LLMs) and vision-language models (VLMs), implemented as a domain-specific language embedded in Python. It optimizes LLM inference through advanced techniques like RadixAttention for KV cache reuse, continuous batching, speculative decoding, and various parallelization strategies. The library supports a broad range of models from Hugging Face and offers compatibility with OpenAI APIs. SGLang maintains an active development pace with frequent, often monthly or bi-monthly, releases and is currently at version 0.5.9.","language":"python","status":"active","version":"0.5.9","tags":["LLM","serving","inference","AI","GPU","multimodal"],"install":[{"cmd":"pip install sglang","imports":["import sglang as sgl","from openai import OpenAI"]}],"homepage":"https://sgl-project.github.io","github":"https://github.com/sgl-project/sglang","docs":null,"changelog":null,"pypi":"https://pypi.org/project/sglang/","npm":null,"openapi_spec":null,"status_page":null,"smithery":null,"compatibility":{"summary":{"python_range":"3.10–3.9","success_rate":15,"avg_install_s":15,"avg_import_s":null,"wheel_type":"wheel"},"url":"https://checklist.day/v1/registry/sglang/compatibility"},"provenance":{"verified_status":"timeout","verified_at":"Sun Jun 28","last_verified":"Sun Jun 28","next_check":"Sun Jul 05","install_tag":"stale"}}