IBPC 2010 Presentations

IBPC 2010 :: Online Proceedings
March 1-5, 2010 National Institute of Standards and Technology

The first International Biometric Performance Conference was convened by staff of NIST ITL's Information Access Division (IAD) to bring together biometric researchers, developers, users, testing experts and technology providers in a discussion of the near term performance issues demanded for operational use of biometrics today. In 48 talks and 11 poster presentations, speakers addressed issues of reliability, security, scalability, computational expense, cost, and the measurement, definition, and standardization thereof. In three satellite workshops, panelists addressed NIST's fingerprint image quality assessment algorithm, NFIQ, fingerprint feature detection and standardization, and template protection. This webpage dcouments the proceedings of the conference. The presentations are linked below .

Sponsor's Opening Remarks

The IBPC 2010 was sponsored by the Department of Homeland Security's Science and Technology Directorate. Arun Vemury presented The DHS Perspective on demands for high performance biometric systems.

Presentations of the International Biometric Performance Conference, 2010

This page is intended as a permanent archive of the presentations delivered to the 201 attendees of the March 2010 IBPC 2010. In a few cases the files linked here are slightly abridged versions of those actually presented. The four co-chairs are grateful to the speakers for their assistance in preparing this proceedings.

The presentations are listed alphabetically by speaker name.

1. Dr. Thomas Amerson & Christina Rolka Biometrics Testing in the Mona Pass. DHS / United States Coast Guard.

2. Nick Bartlow, Don Waymire and Gregory Zektser Holistic Evaluation of Multi-Biometric Systems. BRTCC, Booz Allen Hamilton. The presentation is accompanied by a supporting paper.

3. Terrence E. Boult Evaluation using Synthetic and Semi-Synthetic Biometric Data. University of Colorado at Colorado Springs.

4. Christoph Busch The Benefit of Ground Truth Data to Semantic Conformance Testing of Fingeprint Minutia Encoding. Fraunhofer IGD / Hochschule.

5. Greg Cannon Biometric Performance: A Systems Perspective. Crossmatch Technologies.

6. Raffaele Cappelli and Davide Maltoni FVC-onGoing: On-line Evaluation of Fingerprint Recognition Algorithms. University of Bologna

7. Su Cheng and Ross Micheals Confidence Intervals of FAR and FRR for Large Biometric Data. National Institute of Standards and Technology

8. Adam Czajka Call for cooperation: Biometric Template Ageing. Warsaw University of Technology, PL.

9. Adam Czajka and Marcin Chochowski Call for cooperation: Network of Testing Laboratories. Warsaw University of Technology, PL.

10. Donald P. D'Amato, Nathaniel Hall, and Delia McGarry The Specification and Measurement of Face Image Quality. Noblis.

11. Ted Dunstone Visualization of Operational Performance in Biometric Systems. Biometix.

12. Ted Dunstone Vulnerability Assessment Methodology. Biometrics Institute.

13. V. N. Dvornychenko M. Indovina, G. W. Quinn and J. C. Wu Approaches for Matcher Performance Modeling. National Institute of Standards and Technology

14. Belen Fernandez-Saavedra, R. Sanchez-Reillo, R. Alonso-Moreno, and O. Miguel-Hurtado Environmental Testing Methodology in Biometrics. Carlos III University of Madrid, ES. This presentation is accompanied by a supporting paper.

15. Jean-Christophe Fondeur Biometric Testing And Performance Extrapolation. Sagem Securite

16. Davrondzhon Gafurov, Bian Yang, Patrick Bours and Christoph Busch Independent Performance Evaluation of Biometric Systems: Minutiae Performance versus Pseudonymous Identifier Performance. Gjovik University College, NO This presentation is accompanied by a supporting paper.

17. Nigel Gordon Developing a Methodology for Biometric Security Testing. CESG, UK

18. Dmitry O. Gorodnichy and Richard Hoshino Calibrated (Probabilistic) Confidence Scoring for Biometric Identification. Border Security Agency, CA. This presentation is accompanied by a supporting paper.

19. William Graves US VISIT : The World's Largest Biometric Application. DHS - US-VISIT.

20. Patrick Grother IBPC Welcome. National Institute of Standards and Technology.

21. Patrick Grother and Tony Mansfield The Biometric Testing Landscape. National Institute of Standards and Technology.

22. Patrick Grother et al. NIST Update on IREX, MBE, MINEX I, MINEX II, and PIV. National Institute of Standards and Technology.

23. Terry Hartmann The Integrator Perspective: What I Wish I Knew the Metrics For. Unisys.

24. Olaf Henniger, Dirk Scheuermann, and Thomas Kniess On security evaluation of fingerprint recognition systems. Fraunhofer SIT, DE. This presentation is accompanied by a supporting paper.

25. Austin Hicklin and Brad Ulery Beyond Similarity Scores. Noblis

26. Tom Hopper A Testing Foundation for Sharing Latent Identification Services. Cogent Systems.

27. Michael Indovina Evaluation of Latent Fingerprint Identification Technologies (ELFT). National Institute of Standards and Technology.

28. Eric P. Kukula and Stephen J. Elliott Beyond Current Testing Standards: A Framework for Evaluating Human-sensor Interaction. Purdue University.

29. Rick Lazarick Establishment of Testing Laborarory Accreditation under NVLAP - The DHS Perspective. CSC.

30. Rick Lazarick Biometric Product Qualification Program for US Airport Access Conrol. CSC.

31. Tony Mansfield Metrics & Terminology for Identification System Performance addressing Watch-list and other open set applications. National Physical Laboratory, UK.

32. Alvin Martin Using an Ongoing Series of Performance Evaluations to Drive Speaker Recognition Technology. National Institute of Standards and Technology.

33. Brian Martin Biometric Identification: Metrics & Models. L1 Identity Solutions.

34. Toshi Nakamura New Methodologies for BioAPI Conformance Testing. Oki Software Co., JP.

35. Basia Nasiorowska Facial Recognition Identification Testing Utilizing Still & Live Twin Children Face Images. Interoptic, ZA. This presentation is accompanied by a supporting paper.

36. Markus Nuppeney, Marco Breitenstein and Matthias Niesing EasyPASS - Evaluation of face recognition performance in an operational automated border control system. BSI and Secunet, DE. This presentation is accompanied by a supporting paper.

37. Jonathon Phillips Using challenge problems to advance the technology and science of biometrics. National Institute of Standards and Technology.

38. Jonathon Phillips MBGC Conclusion. National Institute of Standards and Technology.

39. Fares Rahmun and Oliver Bausinger Best Practice Fingerprint Enrolment Standards European Visa Information System. BVA and BSI, DE.

40. Marek Rejman-Greene Towards a framework for the testing of biometric systems: In procurement, design and operational use. HOSDB, UK.

41. Ricardo N. Rodrigues and Venu Govindaraju Assessment of Biometric Robustness Against Spoof Attacks. University of Buffalo.

42. René Salamon and Peter Ebinger From Ground Truth to Semantic Conformance Testing Demonstrated by the Example of Face Image Data. BSI and Fraunhofer IGD, DE.

43. Raul Sanchez-Reillo, J. Uriarte-Antonio, I. Tomeo-Reyes and B. Fernandez-Saavedra Testing Laboratory Interactions for Evaluating Biometrics. Carlos III University of Madrid, ES.

44. Stephanie Schuckers, Andy Adler, Bozhao Tan, Aaron Lewicke, Peter Johnson, Joe Sherry, David Yambay, Rachel Wallace, Greta Collins, Dominic Grimberg Evaluation of Liveness or Anti-spoofing in Biometric Systems. Clarkson University

45. Michael E. Schuckers Distribution-Free Statistical Methods for Biometric Performance Evaluation. St. Lawrence University

46. Günter Schumacher Recognition Performance in the Case of Juvenile Fingerprints. EC Joint Research Centre

47. Koen Simoens, Stefaan Seys, and Bart Preneel Security Analysis of Biometric Template Protection. K.U.Leuven ESAT/SCD- - COSIC, BE.

48. Colin Soutar Biometrics and Identity Assurance. CSC

49. Ambika Suman Evaluating Examiner / Operator-Led Biometric Applications. National Policing Improvement Agency

50. Scott Swann Large-Scale Biometric Testing at the FBI. FBI CJIS

51. Elham Tabassi NFIQ Update. National Institute of Standards and Technology.

52. Ralph Breithaupt and Nils Tekampe Spoof Detection and the Common Criteria. BSI and TUViT, DE.

53. Michael Thieme Testing for Emerging Modalities. International Biometric Group.

54. Sergey Tulyakov and Venu Govindaraju Predicting Performance in Large-Scale Identification Systems by Score Resampling. University of Buffalo

55. Valorie S. Valencia Biometric Covariate Analysis using Partial Area Under Curve. Authenti-Corp

56. Arun Vemury Biometric Performance: The DHS Perspective. DHS Science and Technology Directorate

57. Peter Waggett et al. Reducing Risk Through Large Scale Testing. IBM Corp (and various)

58. Craig Watson Slap Fingerprint Segmentation and Proprietary Fingerprint Template Tests. National Institure of Standards and Technology

59. James L. Wayman, Antonio Possolo and Tony Mansfield Fundamental Issues in Biometric Performance Testing: A modern statistical and philosophical framework for uncertainty assessment. San Jose State University This presentation is accompanied by a supporting paper .

60. James L. Wayman A (condensed) Modern History of Biometric Testing in the US. San Jose State University

61. Geoff Whitaker Mobile Biometric Identification for Policing: Performance Specification and Accuracy Evaluation. National Policing Improvement Agency (NPIA), UK

62. Takahiro Yoshida and Seiichiro Hangai A Study on Accuracy and Problems in using ISO/IEC 19794-2 Finger Minutiae Formats for Automated Fingerprint Verification. Tokyo University of Science, JP This presentation is accompanied by a supporting paper.

63. Xuebing Zhou, Bian Yang and Christoph Busch Security Evaluation of Biometric Privacy Enhancing Techniques. Fraunhofer IGD, DE, and Gjovik University College, NO

Satellite Workshop I :: The Future of NFIQ

A group of sixty fingerprint experts gathered at NIST on March 1, 2010 in the first satellite workshop of the IBPC 2010. This session was convened to discuss options for future development of the NIST Fingerprint Image Quality Tool, NFIQ. Originally developed in 2004, NFIQ has been applied to hundreds of millions of fingerprint images as assess their suitability for matching. The following presentations were made.  

1. Elham Tabassi The Future of NFIQ.

2. Markus Nuppeney, Johannes Merkle and Marco Breitenstein Experiences with the retraining of NFIQ.

Satellite Workshop II :: Testing of Template Protection Schemes

A workshop was held to discuss the challenges of evaluating template protection algorithms. The discussion on how to measure the functionality of these algorithms mostly revolved around how to assess the cryptographic properties of the algorithms being developed and tested. A specific initial step that the community needs to address is documenting potential attacks, which could be done on a forthcoming wiki that NIST will host.  

1. Elaine Newton Satellite Workshop II – Template Protection Testing - Agenda. National Institute of Standards Technology.

2. Elaine Newton Template Protection Testing. National Institute of Standards Technology.

3. Tom Kevenaar Security and Privacy in Biometric Systems - The Purpose of Biometric Encryption. Priv-ID, Secunet, BSI

4. Randall J. Easter Cryptographic Module Validation Program. National Institute of Standards Technology.

5. Christoph Busch ISO 24745 - Biometric Template Protection. Gjovik University College, Fraunhofer IGD

6. Ross Micheals Secure Biometric Templates Wiki. National Institute of Standards Technology.

7. Nalini K. Ratha Performance evaluation of cancelable biometrics. IBM

Satellite Workshop III :: Conformance to Minutia Standards

The accuracy attainable by systems using standardized minutia records is dependent on the software used to prepare and match those records. It has been shown that different minutia detection algorithms systematically produce different numbers of minutia from the same fingerprint image, and additionally place those minutia at different (x,y) locations. The workshop was convened to discuss construction of ground truth reference databases and their use in the quantitative assessment of semantic conformance.  

1. Christoph Busch Semantic Conformance Testing Methodology and intial Results for Fingeprint Minutia Encoding.

2. Patrick Grother Fingerprint Features, Semantic Conformance, Terms / Definitions / Scope.

Sponsors and Supporters

The workshop is organized by the Information Access Division of the Information Technology Laboratory (ITL) at the National Institute of Standards and Technology (NIST).

The workshop is supported by the Department of Homeland Security (DHS), the Federal Bureau of Investigation (FBI), the Department of Defense, Biometric Task Force, and the National Science and Technology Council (NSTC) Subcommittee on Biometrics and Identity Management.