LLM Router
JSON →Multi-LLM routing MCP server â route text, image, video, and audio tasks to 20+ providers (OpenAI, Gemini, Perplexity, Anthropic, fal, ElevenLabs, Runway) with automatic complexity-based model selection, budget control, and provider failover.
Install
pip install llm-routing Tools · 21
- llm_route Route a request to the appropriate LLM model based on task requirements
- llm_classify Classify input text into predefined categories using an LLM
- llm_auto Automatically select and execute the best LLM action for a given input
- llm_stream Stream responses from an LLM in real-time
- llm_query Generate text responses to queries using an LLM
- llm_code Generate or analyze code using an LLM
- llm_analyze Perform analysis on provided data or text using an LLM
- llm_research Conduct research-style queries using an LLM
- llm_image Generate images using an LLM-based model
- llm_video Generate video content using an LLM-based model
- llm_audio Generate audio content using an LLM-based model
- llm_orchestrate Orchestrate multi-step LLM pipelines
- llm_pipeline_templates Manage and apply pipeline templates for LLM workflows
- llm_usage Monitor LLM usage statistics
- llm_budget Track and manage LLM budget allocations
- llm_health Check the health status of LLM services
- llm_savings View cost savings from LLM routing optimizations
- llm_fs_find Find files in the filesystem using LLM-assisted search
- llm_fs_edit_many Edit multiple files in the filesystem using LLM assistance
- llm_check_usage Check current subscription usage for LLM services
- llm_refresh_claude_usage Refresh Claude API usage data for subscription tracking
Environment variables
OPENAI_API_KEYGEMINI_API_KEYOLLAMA_BASE_URLANTHROPIC_API_KEYXAI_API_KEYDEEPSEEK_API_KEYMISTRAL_API_KEYCOHERE_API_KEYPERPLEXITY_API_KEYGROQ_API_KEYTOGETHER_API_KEYSTABILITY_API_KEYELEVENLABS_API_KEYRUNWAY_API_KEYREPLICATE_API_TOKEN
Links
★ 27 GitHub stars