A TREC evaluation track for studying and benchmarking systems which combine retrieval and generation.
Run the full TREC RAG evaluation workflow end to end, from generating evaluation artifacts to scoring LLM responses.
Try RAGDollClimbMix-400b replaces MS MARCO v2.1 for 2026. Access it now through the Pyserini REST API!
Announcement REST API SKILLThe TREC Retrieval-Augmented Generation Track fosters innovation and research in retrieval-augmented generation systems: combining retrieval methods that find relevant information within large corpora with Large Language Models, to help systems produce relevant, accurate, updated, and contextually appropriate content.
The track brings the research community together around a unified benchmark to evaluate the end-to-end performance of systems that combine retrieval and generation. Distinct but complementary tasks enable deeper analysis of individual components and their interactions.
Pick one or both. Full input/output specs live in the agent-ready track guidelines.
The classic IR task: given a set of narratives and access to the ClimbMix collection, retrieve and rank the most relevant segments.
View task guidelinesGiven a set of narratives, retrieve relevant evidence from the ClimbMix collection and return a summarized answer grounded in that evidence.
View task guidelinesOfficial test topics for the 2026 track.
Practice topics, RAG25 nuggets, UMBRELA qrels, and ResearchRubrics for system testing.
Automated end-to-end framework for evaluating TREC RAG systems, from gold-standard construction to scoring long-form answers.
NVIDIA's ClimbMix-400b, served through the Pyserini REST API skill.