Preparing for system design interviews?  Try bugzed.com →

llama-cpp-python: Python Bindings for llama.cpp

JSON →
library 0.3.20 ·python
verified Jun 28, 2026

Python bindings for the `llama.cpp` library, enabling efficient local inference of large language models (LLMs) on various hardware, including CPUs and GPUs (NVIDIA, Apple Metal, AMD ROCm). It provides both a high-level API for easy model interaction and a low-level API for direct C API access. The library is actively maintained with frequent updates, often mirroring upstream `llama.cpp` changes, and currently stands at version 0.3.20.

total hits 38
actors 10 distinct systems
last hit 19d ago AhrefsBot
GPTBot
4
Amazonbot
4
ByteDance
4
Perplexity-User
2
Script
1
OAI-SearchBot
1
Search engines
7
Humans
9

top countries 🇺🇸 United States · 🇸🇬 Singapore · 🇨🇳 China · 🇨🇦 Canada · 🇫🇷 France