Pre-compiled cubins for FlashInfer
JSON →FlashInfer-cubin provides pre-compiled kernel binaries for FlashInfer, supporting a wide range of GPU architectures. This optional package for `flashinfer-python` eliminates JIT compilation and downloading overhead at runtime, leading to faster initialization and enabling offline usage. The FlashInfer project focuses on delivering high-performance LLM GPU kernels for serving and inference, maintaining an active development cycle with frequent nightly builds and regular patch releases.
Traffic · last 30 days ↑64% vs prev 7d
total hits 56
actors 7 distinct systems
last hit 4d ago human
top countries 🇺🇸 United States · 🇸🇬 Singapore · NZ · 🇨🇦 Canada · 🇫🇷 France
Resources
API endpoints
full doc /v1/registry/flashinfer-cubin
compatibility /v1/registry/flashinfer-cubin/compatibility