Multi-modal biometric modeling and recognition of the human face and ear

Steven Cadavid, Mohammad H. Mahoor, Mohamed Abdel-Mottaleb

Research output: Chapter in Book/Report/Conference proceedingConference contribution

9 Citations (Scopus)

Abstract

In this paper we describe a multi-modal ear and face biometric system. The system is comprised of two components: a 3D ear recognition component and a 2D face recognition component. For the 3D ear recognition, a series of frames is extracted from a video clip and the region of interest (i.e., ear) in each frame is independently reconstructed in 3D using Shape From Shading. The resulting 3D models are then registered using the iterative closest point algorithm. We iteratively consider each model in the series as a reference model and calculate the similarity between the reference model and every model in the series using a similarity cost function. Cross validation is performed to assess the relative fidelity of each 3D model. The model that demonstrates the greatest overall similarity is determined to be the most stable 3D model and is subsequently enrolled in the database. For the 2D face recognition, a set of facial landmarks is extracted from frontal facial images using the Active Shape Model technique. Then, the response of facial images to a series of Gabor filters at the locations of facial landmarks are calculated. The Gabor features (attributes) are stored in the database as the face model for recognition. The similarity between the Gabor features of a probe facial image and the reference models are utilized to determine the best match. The match scores of the ear recognition and face recognition modalities are fused to boost the overall recognition rate of the system. Experiments are conducted using a gallery set of 402 video clips and a probe of 60 video clips (images). As a result, a rankone identification rate of 100% was achieved using the weighted sum technique for fusion.

Original languageEnglish
Title of host publication2009 IEEE International Workshop on Safety, Security and Rescue Robotics, SSRR 2009
DOIs
StatePublished - Dec 1 2009
Event2009 IEEE International Workshop on Safety, Security and Rescue Robotics, SSRR 2009 - Denver, CO, United States
Duration: Nov 3 2009Nov 6 2009

Other

Other2009 IEEE International Workshop on Safety, Security and Rescue Robotics, SSRR 2009
CountryUnited States
CityDenver, CO
Period11/3/0911/6/09

Fingerprint

Biometrics
Face recognition
Gabor filters
Cost functions
Fusion reactions

Keywords

  • 2D face recognition
  • 3D ear recognition
  • Data Fusion
  • Multi-modal biometric

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Vision and Pattern Recognition
  • Safety, Risk, Reliability and Quality

Cite this

Cadavid, S., Mahoor, M. H., & Abdel-Mottaleb, M. (2009). Multi-modal biometric modeling and recognition of the human face and ear. In 2009 IEEE International Workshop on Safety, Security and Rescue Robotics, SSRR 2009 [5424152] https://doi.org/10.1109/SSRR.2009.5424152

Multi-modal biometric modeling and recognition of the human face and ear. / Cadavid, Steven; Mahoor, Mohammad H.; Abdel-Mottaleb, Mohamed.

2009 IEEE International Workshop on Safety, Security and Rescue Robotics, SSRR 2009. 2009. 5424152.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Cadavid, S, Mahoor, MH & Abdel-Mottaleb, M 2009, Multi-modal biometric modeling and recognition of the human face and ear. in 2009 IEEE International Workshop on Safety, Security and Rescue Robotics, SSRR 2009., 5424152, 2009 IEEE International Workshop on Safety, Security and Rescue Robotics, SSRR 2009, Denver, CO, United States, 11/3/09. https://doi.org/10.1109/SSRR.2009.5424152
Cadavid S, Mahoor MH, Abdel-Mottaleb M. Multi-modal biometric modeling and recognition of the human face and ear. In 2009 IEEE International Workshop on Safety, Security and Rescue Robotics, SSRR 2009. 2009. 5424152 https://doi.org/10.1109/SSRR.2009.5424152
Cadavid, Steven ; Mahoor, Mohammad H. ; Abdel-Mottaleb, Mohamed. / Multi-modal biometric modeling and recognition of the human face and ear. 2009 IEEE International Workshop on Safety, Security and Rescue Robotics, SSRR 2009. 2009.
@inproceedings{d992a48797f8434ba9685c1717cced47,
title = "Multi-modal biometric modeling and recognition of the human face and ear",
abstract = "In this paper we describe a multi-modal ear and face biometric system. The system is comprised of two components: a 3D ear recognition component and a 2D face recognition component. For the 3D ear recognition, a series of frames is extracted from a video clip and the region of interest (i.e., ear) in each frame is independently reconstructed in 3D using Shape From Shading. The resulting 3D models are then registered using the iterative closest point algorithm. We iteratively consider each model in the series as a reference model and calculate the similarity between the reference model and every model in the series using a similarity cost function. Cross validation is performed to assess the relative fidelity of each 3D model. The model that demonstrates the greatest overall similarity is determined to be the most stable 3D model and is subsequently enrolled in the database. For the 2D face recognition, a set of facial landmarks is extracted from frontal facial images using the Active Shape Model technique. Then, the response of facial images to a series of Gabor filters at the locations of facial landmarks are calculated. The Gabor features (attributes) are stored in the database as the face model for recognition. The similarity between the Gabor features of a probe facial image and the reference models are utilized to determine the best match. The match scores of the ear recognition and face recognition modalities are fused to boost the overall recognition rate of the system. Experiments are conducted using a gallery set of 402 video clips and a probe of 60 video clips (images). As a result, a rankone identification rate of 100{\%} was achieved using the weighted sum technique for fusion.",
keywords = "2D face recognition, 3D ear recognition, Data Fusion, Multi-modal biometric",
author = "Steven Cadavid and Mahoor, {Mohammad H.} and Mohamed Abdel-Mottaleb",
year = "2009",
month = "12",
day = "1",
doi = "10.1109/SSRR.2009.5424152",
language = "English",
isbn = "9781424456291",
booktitle = "2009 IEEE International Workshop on Safety, Security and Rescue Robotics, SSRR 2009",

}

TY - GEN

T1 - Multi-modal biometric modeling and recognition of the human face and ear

AU - Cadavid, Steven

AU - Mahoor, Mohammad H.

AU - Abdel-Mottaleb, Mohamed

PY - 2009/12/1

Y1 - 2009/12/1

N2 - In this paper we describe a multi-modal ear and face biometric system. The system is comprised of two components: a 3D ear recognition component and a 2D face recognition component. For the 3D ear recognition, a series of frames is extracted from a video clip and the region of interest (i.e., ear) in each frame is independently reconstructed in 3D using Shape From Shading. The resulting 3D models are then registered using the iterative closest point algorithm. We iteratively consider each model in the series as a reference model and calculate the similarity between the reference model and every model in the series using a similarity cost function. Cross validation is performed to assess the relative fidelity of each 3D model. The model that demonstrates the greatest overall similarity is determined to be the most stable 3D model and is subsequently enrolled in the database. For the 2D face recognition, a set of facial landmarks is extracted from frontal facial images using the Active Shape Model technique. Then, the response of facial images to a series of Gabor filters at the locations of facial landmarks are calculated. The Gabor features (attributes) are stored in the database as the face model for recognition. The similarity between the Gabor features of a probe facial image and the reference models are utilized to determine the best match. The match scores of the ear recognition and face recognition modalities are fused to boost the overall recognition rate of the system. Experiments are conducted using a gallery set of 402 video clips and a probe of 60 video clips (images). As a result, a rankone identification rate of 100% was achieved using the weighted sum technique for fusion.

AB - In this paper we describe a multi-modal ear and face biometric system. The system is comprised of two components: a 3D ear recognition component and a 2D face recognition component. For the 3D ear recognition, a series of frames is extracted from a video clip and the region of interest (i.e., ear) in each frame is independently reconstructed in 3D using Shape From Shading. The resulting 3D models are then registered using the iterative closest point algorithm. We iteratively consider each model in the series as a reference model and calculate the similarity between the reference model and every model in the series using a similarity cost function. Cross validation is performed to assess the relative fidelity of each 3D model. The model that demonstrates the greatest overall similarity is determined to be the most stable 3D model and is subsequently enrolled in the database. For the 2D face recognition, a set of facial landmarks is extracted from frontal facial images using the Active Shape Model technique. Then, the response of facial images to a series of Gabor filters at the locations of facial landmarks are calculated. The Gabor features (attributes) are stored in the database as the face model for recognition. The similarity between the Gabor features of a probe facial image and the reference models are utilized to determine the best match. The match scores of the ear recognition and face recognition modalities are fused to boost the overall recognition rate of the system. Experiments are conducted using a gallery set of 402 video clips and a probe of 60 video clips (images). As a result, a rankone identification rate of 100% was achieved using the weighted sum technique for fusion.

KW - 2D face recognition

KW - 3D ear recognition

KW - Data Fusion

KW - Multi-modal biometric

UR - http://www.scopus.com/inward/record.url?scp=77951545911&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77951545911&partnerID=8YFLogxK

U2 - 10.1109/SSRR.2009.5424152

DO - 10.1109/SSRR.2009.5424152

M3 - Conference contribution

AN - SCOPUS:77951545911

SN - 9781424456291

BT - 2009 IEEE International Workshop on Safety, Security and Rescue Robotics, SSRR 2009

ER -