Humans versus Algorithms: Comparisons from the Face Recognition Vendor 2006

Published

September 17, 2008

Author(s)

P J. Phillips, Alice J. O'Toole, Abhijit Narvekar

Abstract

We present a synopsis of results comparing the performance of humans with face recognition algorithms tested in the Face Recognition Vendor Test (FRVT) 2006 and Face Recognition Grand Challenge (FRGC). Algorithms and humans matched face identity in images taken under controlled and uncontrolled illumination. The human-machine comparisons include accuracy benchmarks, an error pattern analysis, and a test of human and machine performance stability across data sets varying in image quality. The results indicate that: 1.) machines can compete quantitatively with humans matching face identity across changes in illumination; 2.) qualitative differences between humans and machines can be exploited to improve identification by fusing human and machine match scores; and 3.) recognition skills for humans and machines are comparably stable across changes in image quality. Combined the results suggest that face recognition algorithms may be ready for applications with task constraints similar to those evaluated in the FRVT 2006.

Proceedings Title

8th IEEE International Conference on Automatic Face and Gesture Recognition

Conference Dates

September 17-19, 2008

Conference Location

Amsterdam, NL

Pub Type

Conferences

Download Paper

Local Download

Keywords

face recognition, human performance

Citation

Phillips, P. , O'Toole, A. and Narvekar, A. (2008), Humans versus Algorithms: Comparisons from the Face Recognition Vendor 2006, 8th IEEE International Conference on Automatic Face and Gesture Recognition, Amsterdam, NL, [online], https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=890058 (Accessed October 15, 2025)