{"slug":"tjacquesson/llmtest-mcp","name":"LLMTest","description":"LLM proxy that benchmarks AI models on real prompts and finds cheaper, faster alternatives across 340+ models.","category":"development","tags":[],"official":false,"stars":0,"transport":null,"install":[{"cmd":"npx llmtest-mcp","imports":[]}],"tools":[{"name":"status","description":"Show proxy status and activity summary"},{"name":"list_flows","description":"List all AI flows with cost and latency stats"},{"name":"get_suggestions","description":"Get pending model-switch recommendations"},{"name":"update_suggestion","description":"Accept or dismiss a suggestion"},{"name":"run_benchmark","description":"Benchmark a flow against challenger models"},{"name":"optimize_prompt","description":"Rewrite a flow's prompt and find a cheaper model that still works"},{"name":"seed_samples","description":"Add test prompts for pre-launch benchmarking"},{"name":"list_samples","description":"Show stored test samples per flow"},{"name":"list_new_models","description":"Show new and trending models"},{"name":"get_account","description":"Check credit balance and usage"},{"name":"get_autopilot_status","description":"Check whether autopilot is on and whether the account is eligible"},{"name":"enable_autopilot","description":"Turn on weekly auto-optimization with safety gates + drift-based auto-revert"},{"name":"disable_autopilot","description":"Turn off autopilot (existing optimizations stay active)"},{"name":"list_active_optimizations","description":"List auto-accepted optimizations still inside their 24h revert window"},{"name":"revert_optimization","description":"Roll an auto-accepted optimization back to the previous prompt"}],"env_vars":["LLMTEST_API_KEY","LLMTEST_BASE_URL"],"auth_type":"none","github":"https://github.com/tjacquesson/llmtest-mcp","homepage":"","server_url":"","status":"active","source":"mcpservers.org","updated_at":"Mon May 25"}