Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Novelty Detection: The TREC Experience

Published

Author(s)

Ian M. Soboroff, Donna K. Harman

Abstract

A challenge for search systems is to detect not only when an item is relevant to the user's information need, but also when it contains something new which the user has not seen before. In the TREC novelty track, the task was to highlight sentences containing relevant and new information in a short, topical document stream. This is analogous to highlighting key parts of a document for another person to read, and this kind of output can be useful as input to a summarization system. Search topics involved both news events and reported opinions on hot-usa-button subjects. When people performed this task, they tended to select small blocks of consecutive sentences as relevant, whereas current systems identified many relevant and novel passages. We also found that opinions are much harder to track than events.
Proceedings Title
Proceedings of the 2005 conference on Human Language Technology

Keywords

evaluation, information retrieval, machine learning, novelty detection, passage retrieval

Citation

Soboroff, I. and Harman, D. (2005), Novelty Detection: The TREC Experience, Proceedings of the 2005 conference on Human Language Technology, [online], https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=150273 (Accessed October 31, 2024)

Issues

If you have any questions about this publication or are having problems accessing it, please contact reflib@nist.gov.

Created October 1, 2005, Updated February 19, 2017