NIST logo

 

MBE - Multiple Biometrics Evaluation

 

MBE STILL - Publications

MBE Compression Study

2011-12-06: Results of a follow-up study to the MBE-STILL test have been published as NISTIR 7830 -Performance of Face Recognition Algorithms on Compressed Images .  The report provides a comprehensive assessment of the ability of face recognition algorithms to compare compressed standard face images.  

Final MBE-STILL Report

2010-6-17: The first public report of the MBE-STILL test has been published as NIST Interagency Report 7709 - Report on the Evaluation of 2D Still-Image Face Recognition Algorithms.

 

MBE PORTAL and VIDEO - Ongoing Updates

New version of the MBE Portal Track Guideline Released

2010-04-01: A new version of the MBE 2010 Portal Track: Guidelines for Participants has been released. The new version has an expanded FAQ. If you have any questions please contact the MBE Liaison at mbe2010@nist.gov.

New versions of the MBE Portal and Video Track Applications and Guidelines Released

2010-03-29: A new version of the MBE 2010 Portal Track: Guidelines for Participants and MBE 2010 Portal Track Application have been released. A new version of the MBE 2010 Video Track: Guidelines for Participants and MBE 2010 Video Track Application have been released as well. Participants in either the MBE Portal or Video Tracks should download and review these documents. The Guideline Documents contain an expanded FAQ answering some questions submitted by participants. The Applications have also been amended. If you have any questions please contact the MBE Liaison at mbe2010@nist.gov.

Application and Guidelines for MBE 2010 Portal Track Released

2010-02-16: The MBE 2010 Portal Track: Guidelines for Participants and MBE 2010 Portal Track Application have been released. MBE 2010 Portal Track Participants should download and review both of these documents. Due to a gigantic snowstorm the MBE Team was delayed in releasing this information. Accordingly we have delayed the final submission date for the MBE 2010 Portal Track to Monday, April 12th, 2010. If you have any questions please contact the MBE Liaison at mbe2010@nist.gov.

Application and Guidelines for MBE 2010 Video Track Released

2010-01-22: The MBE 2010 Video Track: Guidelines for Participants and MBE 2010 Video Track Application have been released. MBE 2010 Video Track Participants should download and review both of these documents. If you have any questions please contact the MBE Liaison at mbe2010@nist.gov.

 

MBE STILL - Ongoing Updates

Participation window

2010-03-29: This notice reaffirms the date for the closure of the partipation window for the MBE-STILL evaluation of face recognition technologies as May 14, 2010. This is the date given in the final API document (ver. 1.0.0).Any decision on whether to continue testing in a second phase has not been made. The participation window opened January 27, 2010.

Procedural updates for the MBE-STILL Test

2010-02-19: An updated validation suite is available. This corrects some minor software bugs, uses PPM instead of JPEG images, and includes an expanded set of images. The images form non-identical gallery and probe sets, and thereby give non-degenerate genuine scores.

2010-02-12: Participants must use the NIST public key to submit MBE-STILL implementations to NIST. The encryption procedure uses GPG.

2010-02-01: An updated validation software is available.

2010-02-01: The final API, version 1.0.0, is now available. This modifies prior version with respect to the single function call given in Table 24. The MBE-STILL submission period is open.

2010-01-28: Annex A of the MBE STILL API document has been added. It gives information on how to submit SDKs to NIST. This API document (version number 0.9.3) is otherwise identical to the January 14 document (version 0.9.2).

2010-01-28: The MBE 2010 Still Track Application have been released. To initiate participation in the still face track of MBE 2010, participants must complete this application procedure.

2010-01-15: The MBE-Still validation package is now available. The purpose of validation is to ensure that NIST's execution of your SDK submission produces the expected output. The process requires you to 1) compile and link the provided validation code against your libraries, 2) run the executables, and 3) email the results to mbe2010@nist.gov. NIST will run the same validation code on your submitted SDKs and check that the results come out identical. Comments regarding the source code should be directed to gw@nist.gov.

2010-01-12: Organizations wishing to participate in MBE 2010 should email mbe2010@nist.gov. After January 20, 2010 the organizers will respond with the procedural details of the application process.

Participation is open from January 27, 2010 through to May 14, 2010. This applies to 2D still images only. For video and iris tracks of the MBE 2010 please contact mbe2010@nist.gov for further information.

The primary requirement for participation is an ability to implement the MBE API specifications. The latest Evaluation Plan and API document is version 0.9.2 released January 12, 2010. It modifies version 0.9 released December 18, 2009. The modifications are highlighted in yellow.

The API specification contains an elementary one-to-one verification inferface specification for testing core face recognition algorithm capability. This part of the test is suitable for academics and new entrants in the face recognition field.

Revised MBE-STILL Test Plan and API

2010-01-12: A slightly revised version of the Concept, Test Plan, and API of the MBE's Still Face recognition track has been released. This version, Concept, Test Plan, and API 0.9.2, supersedes prior versions.

Final MBE-STILL Test Plan and API

2009-12-18: The third version of the Concept, Test Plan, and API of the MBE's Still Face recognition track has been released.

Revised MBE-STILL Draft Test Plan and API

2009-12-09: The second public draft of the Concept, Test Plan, and API of the MBE's Still Face recognition track has been released. Comments and questions should be directed to the organizers by December 16, 2009. NIST apologizes for the short review period

MBE-STILL Draft Test Plan and API

2009-11-15: The first public draft of the Concept, Test Plan, and API of the MBE's Still Face recognition track has been released. Comments and questions should be directed to the organizers by November 30, 2009.

MBE Schedule

2009-11-15: The MBE schedule is as follows. A number of contingencies mean that it remains tentative.

  • 2009-11 to 2009-12: Work with community on protocol
  • 2010-01: Submission / iteration cycle begins (submit, evaluate, return) for Still Face track.
  • 2010-02: Portal and Video Track executables due at NIST
  • 2010-05: Closing of submission period for still face track
  • 2010-08: Protocol and detailed data descriptions delivered
  • 2010-09: Initial report is published
*
Bookmark and Share

MBE Links

Still Face Final API
Still Face Application
Portal Track Guidelines for Participants
Portal Track Application
Video Track Guidelines for Participants
Video Track Application
Email

Other Links

Fingerprint Homepage
Biometric Evaluations Homepage
ITL Biometric Overview
Iris Homepage
Face Homepage

Sponsors

Department of Homeland Security Department of Justice Director of National Intelligence Multi-Agency

Structure

MBE Re-organization

2009-11-14: In order to produce a more comprehensive evaluation and incorporate our sponsor's requirements, we are reorganizing the Multiple Biometric Evaluation. The MBE 2010 will have three tracks: Portal, Video, and Still Face. The Video and Portal tracks will have the same structure as planned but with a delayed start. The Still Face Track has been expanded to include a large-scale identification component, in addition to the verification components. These changes will be beneficial to both our sponsors and the biometrics research community.