home/categories/data-engineering/hamelsmu-evals-skills-skills-evaluate-rag-skill-md
data-engineeringdata-ai

evaluate-rag

Guides evaluation of RAG pipeline retrieval and generation quality. Use when evaluating a retrieval-augmented generation system, measuring retrieval quality, assessing generation faithfulness or relevance, generating synthetic QA pairs for retrieval testing, or optimizing chunking strategies.

hamelsmu
maintainer
hamelsmu
Updated 3/3/2026
Stars
1105
Forks
117
quick start

Installation and usage

Guides evaluation of RAG pipeline retrieval and generation quality. Use when evaluating a retrieval-augmented generation system, measuring retrieval quality, assessing generation faithfulness or relevance, generating synthetic QA pairs for retrieval testing, or optimizing chunking strategies.

Installation
$ install --globalskills.sh
Usage

Once installed, you can use this skill by running the following command in your terminal:

skills use evaluate-rag