Long gap between photos stymies facial recognition

New research investigates how the aging of our faces affects the performance of automatic facial recognition systems.

“We wanted to determine if state-of-the-art facial recognition systems could recognize the same face imaged multiple years apart, such as at age 20 and again at age 30,” says Anil Jain, professor of computer science and engineering at Michigan State University. “This is the first study of automatic facial recognition using a statistical model and large longitudinal face database.”

Jain and doctoral student Lacey Best-Rowden found that 99 percent of the face images can still be recognized up to six years later.

However, the results also show that due to natural changes that occur to a face over time as a person ages, recognition accuracy begins to drop if the images of a person were taken more than six years apart. This decrease in face recognition accuracy is person-dependent; some people age faster than others due to lifestyle, health conditions, environment, or genetics.

MegaFace Challenge uncovers big gaps in face recognition

“This research shows the importance of capturing new images every four to five years to reduce the number of false positives or chance of not finding a candidate in a facial recognition search due to length of time between captures,” says Pete Langenfeld, manager in the Biometrics and Identification Division at the Michigan State Police.

“Criminal acquisition is dependent on the number of times a person is arrested, as the majority are not required to update their image. However, civil applications that require updated facial images should look at reducing the time between captures if it is greater than every four years.”

Jain’s team studied two police mugshot databases of repeat criminal offenders with each offender having a minimum of four images acquired over at least a five-year period. The total number of repeat offenders studied was 23,600. Mugshot databases are the largest source of facial aging photos available with well-controlled standards to ensure the photos are uniform. These are the largest facial-aging databases studied to date in terms of number of subjects, images per subject, and elapsed times.

Academic research has enabled automated face recognition to play an increasingly large role in the criminal justice system. However, there has been a lack of research about the proper use of these systems, says Brendan Klare, CEO of Rank One Computing, a major supplier of face recognition software.

“This comprehensive study by Jain and Best-Rowden provides for the first time an unprecedented body of knowledge regarding the limits of automated face recognition.”

The paper will appear in the journal IEEE Transactions on Pattern Analysis & Machine Intelligence. The study took place in collaboration with the National Institute of Standards and Technology.

Source: Michigan State University