{"library":"ragas","install":[{"cmd":"pip install ragas","imports":["from ragas import EvaluationDataset, SingleTurnSample, evaluate\nfrom ragas.metrics import Faithfulness, ResponseRelevancy\nfrom ragas.llms import LangchainLLMWrapper\nfrom langchain_openai import ChatOpenAI\n\nllm = LangchainLLMWrapper(ChatOpenAI(model='gpt-4o-mini'))\n\nsamples = [\n    SingleTurnSample(\n        user_input='When was the first Super Bowl?',\n        response='The first Super Bowl was held on Jan 15, 1967.',\n        retrieved_contexts=[\n            'The First AFL-NFL World Championship Game was played on January 15, 1967.'\n        ]\n    )\n]\n\ndataset = EvaluationDataset(samples=samples)\n\nresult = evaluate(\n    dataset,\n    metrics=[\n        Faithfulness(llm=llm),\n        ResponseRelevancy(llm=llm)\n    ]\n)\nprint(result)","from ragas import SingleTurnSample\nfrom ragas.metrics import Faithfulness\nfrom ragas.llms import LangchainLLMWrapper\nfrom langchain_openai import ChatOpenAI\nimport asyncio\n\nllm = LangchainLLMWrapper(ChatOpenAI(model='gpt-4o-mini'))\nscorer = Faithfulness(llm=llm)\n\nsample = SingleTurnSample(\n    user_input='What year was Python created?',\n    response='Python was created in 1991.',\n    retrieved_contexts=['Python was first released in 1991 by Guido van Rossum.']\n)\n\n# Async score\nscore = asyncio.run(scorer.single_turn_ascore(sample))\nprint(score)"]}]}