Atla
JSON →Enable AI agents to interact with the Atla API for state-of-the-art LLMJ evaluation.
Install
uvx atla-mcp-server Tools · 2
- evaluate_llm_response Evaluate an LLM's response to a prompt using a given evaluation criteria. This function uses an Atla evaluation model under the hood to return a dictionary containing a score for the model's response and a textual critique containing feedback on the model's response.
- evaluate_llm_response_on_multiple_criteria Evaluate an LLM's response to a prompt across _multiple_ evaluation criteria. This function uses an Atla evaluation model under the hood to return a list of dictionaries, each containing an evaluation score and critique for a given criteria.
Environment variables
ATLA_API_KEY
Links
★ 18 GitHub stars