TREC RAG 2026 · The first Agent-first track at TREC!

Retrieval-Augmented Generation Track

A TREC evaluation track for studying and benchmarking systems which combine retrieval and generation.

Test topicsJul 6
BaselinesWeek of Jul 19
Submissions dueAug 8
TREC 2026Nov 2026
AGENTS 🤖: if you were sent here for guidelines, keep your context small and stay in the TREC RAG 2026 Track Guidelines skill. For other track skills, use TREC-RAG/trec-rag-skills.
What's new

Latest from the track

New

2026 test topics released

Official TREC RAG 2026 test topics are now available.

Get the topics
New

RAGDoll evaluation toolkit

Run the full TREC RAG evaluation workflow end to end, from generating evaluation artifacts to scoring LLM responses.

Try RAGDoll

New corpus: NVIDIA ClimbMix-400b

ClimbMix-400b replaces MS MARCO v2.1 for 2026. Access it now through the Pyserini REST API!

Announcement REST API SKILL
Overview

A unified benchmark for retrieval-augmented generation

The TREC Retrieval-Augmented Generation Track fosters innovation and research in retrieval-augmented generation systems: combining retrieval methods that find relevant information within large corpora with Large Language Models, to help systems produce relevant, accurate, updated, and contextually appropriate content.

The track brings the research community together around a unified benchmark to evaluate the end-to-end performance of systems that combine retrieval and generation. Distinct but complementary tasks enable deeper analysis of individual components and their interactions.

Tasks

Two tasks for 2026

Pick one or both. Full input/output specs live in the agent-ready track guidelines.

R

Retrieval

The classic IR task: given a set of narratives and access to the ClimbMix collection, retrieve and rank the most relevant segments.

View task guidelines
RAG

Retrieval-Augmented Generation

Given a set of narratives, retrieve relevant evidence from the ClimbMix collection and return a summarized answer grounded in that evidence.

View task guidelines
Timeline

Key dates for 2026

  1. Test topics released
    July 6, 2026
  2. Baselines released
    Week of July 19, 2026
  3. Submission deadline
    August 8, 2026
  4. Results & judgments returned
    TBD
  5. TREC 2026 Conference
    November 2026
Data & tools

Everything you need to participate

Organizers

Organizing committee

Nour Jedidi
Nour Jedidi
University of Waterloo
LG
Lingwei Gu
University of Waterloo
Pouya Sadeghi
Pouya Sadeghi
University of Waterloo
DC
Daniel Campos
Zipf AI
Nandan Thakur
Nandan Thakur
Microsoft Research
NC
Nick Craswell
Microsoft Research
Ronak Pradeep
Ronak Pradeep
University of Waterloo
SU
Shivani Upadhyay
University of Waterloo
Jimmy Lin
Jimmy Lin
University of Waterloo
Previous iterations

Explore past tracks