Posts by Tag

TREC 2024

TREC 2024 RAG UMBRELA Qrels Released

less than 1 minute read

We have just released relevance judgments using UMBRELA [1] for the 301 RAG test topics which we used for our evaluations [2]. You can find them at: RAG 2...

TREC 2024 RAG Baselines, validator script, and submissions open

less than 1 minute read

TREC 2024 RAG - AG input, baseline runs, validator scripts, and submissions open

TREC 2024 RAG Topics Released

less than 1 minute read

TREC 2024 RAG competition has now officially started!

TREC 2024 RAG Evaluation Overview

3 minute read

Version 1.0. Last Updated: July 25, 2024

TREC 2024 RAG Track Guidelines

26 minute read

Version 1.0. Last Updated: July 19, 2024

TREC 2024 RAG Timeline

less than 1 minute read

Version 1.0. Last Updated: August 9, 2024

TREC 2024 RAG Corpus

8 minute read

We are happy to introduce the MS MARCO V2.1 document corpus and its segmented version for this year’s TREC RAG Track!

TREC 2024 RAG - Corpus Discussion

1 minute read

Based on some preliminary experiments and discussions, we are considering using a deduped version of the MS MARCO V2 passage corpus for the TREC 2024 RAG tra...

TREC 2024 RAG - Hello World!

less than 1 minute read

Hello World.

Back to top ↑

Corpus

TREC 2025 RAG Corpus

1 minute read

For TREC 2025, we continue to utilize the MS MARCO V2.1 document corpus and its segmented counterpart, as introduced in TREC 2024. This version addresses ded...

TREC 2024 RAG Corpus

8 minute read

We are happy to introduce the MS MARCO V2.1 document corpus and its segmented version for this year’s TREC RAG Track!

TREC 2024 RAG - Corpus Discussion

1 minute read

Based on some preliminary experiments and discussions, we are considering using a deduped version of the MS MARCO V2 passage corpus for the TREC 2024 RAG tra...

Back to top ↑

Tasks

TREC 2024 RAG Track Guidelines

26 minute read

Version 1.0. Last Updated: July 19, 2024

TREC 2024 RAG Timeline

less than 1 minute read

Version 1.0. Last Updated: August 9, 2024

Back to top ↑

Guidelines

TREC 2024 RAG Evaluation Overview

3 minute read

Version 1.0. Last Updated: July 25, 2024

TREC 2024 RAG Track Guidelines

26 minute read

Version 1.0. Last Updated: July 19, 2024

Back to top ↑

Evaluation

TREC 2024 RAG Evaluation Overview

3 minute read

Version 1.0. Last Updated: July 25, 2024

TREC 2024 RAG Track Guidelines

26 minute read

Version 1.0. Last Updated: July 19, 2024

Back to top ↑

Topics

TREC 2024 RAG Topics Released

less than 1 minute read

TREC 2024 RAG competition has now officially started!

Back to top ↑

Baselines

TREC 2024 RAG Baselines, validator script, and submissions open

less than 1 minute read

TREC 2024 RAG - AG input, baseline runs, validator scripts, and submissions open

Back to top ↑

Submissions

TREC 2024 RAG Baselines, validator script, and submissions open

less than 1 minute read

TREC 2024 RAG - AG input, baseline runs, validator scripts, and submissions open

Back to top ↑

Validation

TREC 2024 RAG Baselines, validator script, and submissions open

less than 1 minute read

TREC 2024 RAG - AG input, baseline runs, validator scripts, and submissions open

Back to top ↑

Qrels

TREC 2024 RAG UMBRELA Qrels Released

less than 1 minute read

We have just released relevance judgments using UMBRELA [1] for the 301 RAG test topics which we used for our evaluations [2]. You can find them at: RAG 2...

Back to top ↑

TREC 2025

TREC 2025 RAG Corpus

1 minute read

For TREC 2025, we continue to utilize the MS MARCO V2.1 document corpus and its segmented counterpart, as introduced in TREC 2024. This version addresses ded...

Back to top ↑