Official websites use .gov
A .gov website belongs to an official government organization in the United States.
Secure .gov websites use HTTPS
A lock (
) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.
Summary
Structure
MBE Re-organization
2009-11-14: In order to produce a more comprehensive evaluation and incorporate our sponsor's requirements, we are reorganizing the Multiple Biometric Evaluation. The MBE 2010 will have three tracks: Portal, Video, and Still Face. The Video and Portal tracks will have the same structure as planned but with a delayed start. The Still Face Track has been expanded to include a large-scale identification component, in addition to the verification components. These changes will be beneficial to both our sponsors and the biometrics research community.
Description
MBE 2D Still Update
The evaluation of 2D face recognition algorithms yielded two reports. First, NIST Interagency Report 7709 gave results for both verification and identification algorithms. Second, the NIST Interagency Report 7830 surveyed compression and resolution parameters for storing face images on identity credentials.
MBE PORTAL and VIDEO - Ongoing Updates
New version of the MBE Portal Track Guideline Released
2010-04-01: A new version of the MBE 2010 Portal Track: Guidelines for Participants has been released. The new version has an expanded FAQ. If you have any questions please contact the MBE Liaison at mbe2010 [at] nist.gov (mbe2010[at]nist[dot]gov).
New versions of the MBE Portal and Video Track Applications and Guidelines Released
2010-03-29: A new version of the MBE 2010 Portal Track: Guidelines for Participants and MBE 2010 Portal Track Application have been released. A new version of the MBE 2010 Video Track: Guidelines for Participants and MBE 2010 Video Track Application have been released as well. Participants in either the MBE Portal or Video Tracks should download and review these documents. The Guideline Documents contain an expanded FAQ answering some questions submitted by participants. The Applications have also been amended. If you have any questions please contact the MBE Liaison at mbe2010 [at] nist.gov (mbe2010[at]nist[dot]gov).
Application and Guidelines for MBE 2010 Portal Track Released
2010-02-16: The MBE 2010 Portal Track: Guidelines for Participants and MBE 2010 Portal Track Application have been released. MBE 2010 Portal Track Participants should download and review both of these documents. Due to a gigantic snowstorm the MBE Team was delayed in releasing this information. Accordingly we have delayed the final submission date for the MBE 2010 Portal Track to Monday, April 12th, 2010. If you have any questions please contact the MBE Liaison at mbe2010 [at] nist.gov (mbe2010[at]nist[dot]gov).
Application and Guidelines for MBE 2010 Video Track Released
2010-01-22: The MBE 2010 Video Track: Guidelines for Participants and MBE 2010 Video Track Application have been released. MBE 2010 Video Track Participants should download and review both of these documents. If you have any questions please contact the MBE Liaison at mbe2010 [at] nist.gov (mbe2010[at]nist[dot]gov).
MBE STILL - Ongoing Updates
Participation window
2010-03-29: This notice reaffirms the date for the closure of the participation window for the MBE-STILL evaluation of face recognition technologies as May 14, 2010. This is the date given in the final API document (ver. 1.0.0).Any decision on whether to continue testing in a second phase has not been made. The participation window opened January 27, 2010.
Procedural updates for the MBE-STILL Test
2010-02-19: An updated validation suite is available. This corrects some minor software bugs, uses PPM instead of JPEG images, and includes an expanded set of images. The images form non-identical gallery and probe sets, and thereby give non-degenerate genuine scores.
2010-02-12: Participants must use the NIST public key to submit MBE-STILL implementations to NIST. The encryption procedure uses GPG.
2010-02-01: An updated validation software is available.
2010-02-01: The final API, version 1.0.0, is now available. This modifies prior version with respect to the single function call given in Table 24. The MBE-STILL submission period is open.
2010-01-28: Annex A of the MBE STILL API document has been added. It gives information on how to submit SDKs to NIST. This API document (version number 0.9.3) is otherwise identical to the January 14 document (version 0.9.2).
2010-01-28: The
have been released. To initiate participation in the still face track of MBE 2010, participants must complete this application procedure.
2010-01-15: The MBE-Still validation package is now available. The purpose of validation is to ensure that NIST's execution of your SDK submission produces the expected output. The process requires you to 1) compile and link the provided validation code against your libraries, 2) run the executables, and 3) email the results to mbe2010 [at] nist.gov (mbe2010[at]nist[dot]gov). NIST will run the same validation code on your submitted SDKs and check that the results come out identical. Comments regarding the source code should be directed to gw [at] nist.gov (gw[at]nist[dot]gov).
2010-01-12: Organizations wishing to participate in MBE 2010 should email mbe2010 [at] nist.gov (mbe2010[at]nist[dot]gov). After January 20, 2010 the organizers will respond with the procedural details of the application process.
Participation is open from January 27, 2010 through to May 14, 2010. This applies to 2D still images only. For video and iris tracks of the MBE 2010 please contact mbe2010 [at] nist.gov (mbe2010[at]nist[dot]gov) for further information.
The primary requirement for participation is an ability to implement the MBE API specifications. The latest Evaluation Plan and API document is version 0.9.2 released January 12, 2010. It modifies version 0.9 released December 18, 2009. The modifications are highlighted in yellow.
The API specification contains an elementary one-to-one verification interface specification for testing core face recognition algorithm capability. This part of the test is suitable for academics and new entrants in the face recognition field.
Revised MBE-STILL Test Plan and API
2010-01-12: A slightly revised version of the Concept, Test Plan, and API of the MBE's Still Face recognition track has been released. This version, Concept, Test Plan, and API 0.9.2, supersedes prior versions.
Final MBE-STILL Test Plan and API
2009-12-18: The third version of the Concept, Test Plan, and API of the MBE's Still Face recognition track has been released.
Revised MBE-STILL Draft Test Plan and API
2009-12-09: The second public draft of the Concept, Test Plan, and API of the MBE's Still Face recognition track has been released. Comments and questions should be directed to the mbe2010 [at] nist.gov (organizers) by December 16, 2009. NIST apologizes for the short review period
MBE-STILL Draft Test Plan and API
2009-11-15: The first public draft of the Concept, Test Plan, and API of the MBE's Still Face recognition track has been released. Comments and questions should be directed to the mbe2010 [at] nist.gov (organizers) by November 30, 2009.
MBE Schedule
2009-11-15: The MBE schedule is as follows. A number of contingencies mean that it remains tentative.
- 2009-11 to 2009-12: Work with community on protocol
- 2010-01: Submission / iteration cycle begins (submit, evaluate, return) for Still Face track.
- 2010-02: Portal and Video Track executables due at NIST
- 2010-05: Closing of submission period for still face track
- 2010-08: Protocol and detailed data descriptions delivered
- 2010-09: Initial report is published
Major Accomplishments
MBE STILL - Publications
MBE Compression Study
2011-12-06: Results of a follow-up study to the MBE-STILL test have been published as NISTIR 7830 -Performance of Face Recognition Algorithms on Compressed Images . The report provides a comprehensive assessment of the ability of face recognition algorithms to compare compressed standard face images.
Final MBE-STILL Report
2010-6-17: The first public report of the MBE-STILL test has been published as NIST Interagency Report 7709 - Report on the Evaluation of 2D Still-Image Face Recognition Algorithms.