Preparing for system design interviews?  Try bugzed.com →

GenAI Perf Analyzer CLI

JSON →
library 0.0.16 ·python deprecated
verified Jun 28, 2026

GenAI-Perf is a command-line interface (CLI) tool designed for measuring the throughput and latency of generative AI models (Large Language Models, Vision Language Models, Embedding Models, Ranking Models, and LoRA Adapters) served through an inference server. It generates load, measures key performance metrics such as output token throughput, time to first token, inter-token latency, and request throughput, and reports the results to the console, CSV, and JSON files. While currently at version 0.0.16 and under rapid development, it is being actively phased out in favor of NVIDIA's new `AIPerf` tool for generative AI benchmarking.

total hits 61
actors 9 distinct systems
last hit 17d ago AhrefsBot
ChatGPT-User
22
OAI-SearchBot
5
ByteDance
2
Script
1
Sogou
1
Search engines
2
Humans
23

top countries 🇺🇸 United States · 🇸🇬 Singapore · 🇨🇳 China · VN · NZ