Trustwise
JSON →Advanced evaluation tools for AI safety, alignment, and performance using the Trustwise API.
Tools · 19
- faithfulness_metric Evaluate the faithfulness of a response to its context
- answer_relevancy_metric Evaluate relevancy of a response to the query
- context_relevancy_metric Evaluate relevancy of context to the query
- pii_metric Detect PII in a response
- prompt_injection_metric Detect prompt injection risk
- summarization_metric Evaluate summarization quality
- clarity_metric Evaluate clarity of a response
- formality_metric Evaluate formality of a response
- helpfulness_metric Evaluate helpfulness of a response
- sensitivity_metric Evaluate sensitivity of a response
- simplicity_metric Evaluate simplicity of a response
- tone_metric Evaluate tone of a response
- toxicity_metric Evaluate toxicity of a response
- refusal_metric Detect refusal to answer or comply with the query
- completion_metric Evaluate completion of the query's instruction
- adherence_metric Evaluate adherence to a given policy or instruction
- stability_metric Evaluate stability (consistency) of multiple responses
- carbon_metric Estimate carbon footprint of a response
- cost_metric Estimate cost of a response
Environment variables
TW_API_KEYYOUR_TRUSTWISE_API_KEYTW_BASE_URLYOUR_TRUSTWISE_INSTANCE_URL
Links
★ 4 GitHub stars