U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Information Technology Laboratory /Information Access Division

Multimodal Information Group

We research and develop measurement and evaluation methods to advance and promote the use of technologies that provide more effective access to multimedia and multi-lingual information.

The group focuses on measurement and evaluation methods to facilitate the use of technologies that provide easier access to multimedia and multi-lingual information and that improve human-computer interface modalities. These technologies include recognizing and/or transforming information in speech, text, images, video, and other multimedia modalities, and the fusion of heterogeneous media content.  Focus areas include speech recognition, speaker recognition, language recognition, machine translation, image processing, image understanding, video processing, visual recognition, 2-D and 3D shape analysis, image quality assessment, and interoperable digital media access.

Current Highlights

Projects and Programs

Data Science

Ongoing
Current MIG Data Science project activities DARPA D3M. NIST is supporting the DARPA D3M (Data-Driven Discoveries of Models) program as part of the Test and Evaluation (Government) Team. The D3M Program aims to allow automated systems with subject matter experts to model and solve complex machine

Interdisciplinary Projects

Ongoing
Current: DARPA CCU (Computational Cultural Understanding) ​ Past: IARPA MATERIAL (Machine Translation for English Retrieval of Information in Any Language) DARPA LORELEI (Low Resource Languages for Emergent Incidents) and LoReHLT (Low Resource Human Language Technologies) DARPA BOLT (Broad

Machine Translation

Ongoing
Current MT technology evaluation activities: OpenMT: A biannual NIST evaluation of text-to-text MT technology. Focus is placed on the core task of MT technology where information learned is applicable to other MT technology types. Past MT evaluation activities: LORELEI/LOREHLT, 2016-2019: Low

Speaker and Language Recognition

Ongoing
Current Speaker and Language Recognition technology activities: Speaker Recognition Evaluation series: (1996-) A biennial NIST evaluation of fully automated text-independent speaker recognition technology. View the 2012 NIST SRE report. Human Assisted Speaker Recognition Evaluation series: (2010- )

Publications

Awards

Contacts