NIST 2018 Speaker Recognition Evaluation

The 2018 speaker recognition evaluation (SRE18) is the next in an ongoing series of speaker recognition evaluations conducted by NIST since 1996. The objectives of the evaluation series are (1) to explore promising new ideas in speaker recognition, (2) to support the development of advanced technology incorporating these ideas, and (3) to measure and calibrate the performance of the current state of technology. The evaluations are intended to be of interest to all researchers working on the general problem of text-independent speaker recognition. To this end, the evaluation is designed to focus on core technology issues and to be simple and accessible to those wishing to participate.

SRE18 will be organized in a similar manner to SRE16, focusing on speaker detection over conversational telephone speech (CTS) collected outside North America. Again fixed and open training conditions will be offered to allow cross-system comparisons and to understand the effect of additional and unconstrained amounts of training data on system performance. There are, however, a few differences between SRE16 and SRE18. In particular, in addition to CTS recorded over a variety of handsets, voice over IP (VOIP) data, which is also collected outside North America, as well as audio from video (AfV) will be included as development and test material in SRE18.

Participation in SRE18 is open to all who find the evaluation of interest and are able to comply with the evaluation rules set forth in this plan. There is no cost to participate, but participating teams must be represented at the evaluation workshop to be held in Athens, Greece on December 16-17, 2018. More information about the evaluation and registration can be found in SRE18 plan:

SRE18 Evaluation Plan

Send comments to speaker_poc [at] nist.gov (speaker_poc[at]nist[dot]gov). A notice will go out to the mailing list and the web page will be updated when the evaluation plan becomes available.
Send email address to speaker_poc [at] nist.gov (speaker_poc[at]nist[dot]gov) with request to be added to the mailing list to receive automatic updates.

Important Dates: