GenAI Perf Analyzer CLI

JSON →
library 0.0.16 ·python deprecated
verified May 24, 2026

GenAI-Perf is a command-line interface (CLI) tool designed for measuring the throughput and latency of generative AI models (Large Language Models, Vision Language Models, Embedding Models, Ranking Models, and LoRA Adapters) served through an inference server. It generates load, measures key performance metrics such as output token throughput, time to first token, inter-token latency, and request throughput, and reports the results to the console, CSV, and JSON files. While currently at version 0.0.16 and under rapid development, it is being actively phased out in favor of NVIDIA's new `AIPerf` tool for generative AI benchmarking.

total hits 29
actors 8 distinct systems
last hit 1d ago AhrefsBot
MetaBot
4
Script
3
ChatGPT-User
3
GPTBot
2
ByteDance
1
Search engines
1
Humans
9

top countries 🇺🇸 United States · VN · 🇫🇷 France · 🇨🇦 Canada · 🇩🇪 Germany