U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Information Technology /Data & informatics

Information retrieval

News and Updates

Projects and Programs

Content-Based Access to Unstructured Information

Ongoing
The goal of the project is to support the development of automatic systems that can provide content-based access to information that has not been explicitly structured for machine consumption. This support is in the form of evaluation infrastructure, since to quote Lord Kelvin, "If you can not

TREC Video Retrieval Evaluation: TRECVID

Ongoing
The TREC conference series is sponsored by the National Institute of Standards and Technology ( NIST) with additional support from other U.S. government agencies. The goal of the conference series is to encourage research in information retrieval by providing a large test collection, uniform scoring

Text Analysis Conference

Ongoing
Mission TAC's mission is to support research within the Natural Language Processing community by providing the infrastructure necessary for large-scale evaluation of NLP methodologies. TAC's primary purpose is not competitive benchmarking; the emphasis is on advancing the state of the art through

Publications

Don't Use LLMs to Make Relevance Judgments

Author(s)
Ian Soboroff
Making the relevance judgments for a TREC-style test collection can be complex and expensive. A typical TREC track usually involves a team of six contractors

Report on The Search Futures Workshop at ECIR 2024

Author(s)
Leif Azzopardi, Charles Clarke, Paul Kantor, Bhaskar Mitra, Johanne Trippas, Zhaochun Ren, Ian Soboroff
The First Search Futures Workshop, in conjunction with the Fourty-sixth European Conference on Information Retrieval (ECIR) 2024, looked into the future of

Awards