GenAI Perf Analyzer CLI
JSON →GenAI-Perf is a command-line interface (CLI) tool designed for measuring the throughput and latency of generative AI models (Large Language Models, Vision Language Models, Embedding Models, Ranking Models, and LoRA Adapters) served through an inference server. It generates load, measures key performance metrics such as output token throughput, time to first token, inter-token latency, and request throughput, and reports the results to the console, CSV, and JSON files. While currently at version 0.0.16 and under rapid development, it is being actively phased out in favor of NVIDIA's new `AIPerf` tool for generative AI benchmarking.
Traffic · last 30 days ↑13% vs prev 7d
total hits 29
actors 8 distinct systems
last hit 1d ago AhrefsBot
top countries 🇺🇸 United States · VN · 🇫🇷 France · 🇨🇦 Canada · 🇩🇪 Germany
Resources
API endpoints
full doc /v1/registry/genai-perf
install /v1/registry/genai-perf/install
compatibility /v1/registry/genai-perf/compatibility