ctransformers
JSON →Python bindings for Transformer models implemented in C/C++ using the GGML library. Provides a high-level API for inference with popular models (LLaMA, Falcon, GPT-J, StarCoder, etc.) in GGML/GGUF format, with optional GPU acceleration (CUDA, Metal, ROCm). Latest version 0.2.27, active development.
Traffic · last 30 days ↓80% vs prev 7d
total hits 36
actors 7 distinct systems
last hit 5d ago AhrefsBot
top countries 🇸🇬 Singapore · 🇺🇸 United States · 🇩🇪 Germany · 🇫🇷 France · 🇨🇦 Canada
Resources
homepagectransformers.dev ↗