Discriminant Correlation Analysis: Real-Time Feature Level Fusion for Multimodal Biometric Recognition

Mohammad Haghighat, Mohamed Abdel-Mottaleb, Wadee Alhalabi

Research output: Contribution to journalArticlepeer-review

189 Scopus citations

Abstract

Information fusion is a key step in multimodal biometric systems. The fusion of information can occur at different levels of a recognition system, i.e., at the feature level, matching-score level, or decision level. However, feature level fusion is believed to be more effective owing to the fact that a feature set contains richer information about the input biometric data than the matching score or the output decision of a classifier. The goal of feature fusion for recognition is to combine relevant information from two or more feature vectors into a single one with more discriminative power than any of the input feature vectors. In pattern recognition problems, we are also interested in separating the classes. In this paper, we present discriminant correlation analysis (DCA), a feature level fusion technique that incorporates the class associations into the correlation analysis of the feature sets. DCA performs an effective feature fusion by maximizing the pairwise correlations across the two feature sets and, at the same time, eliminating the between-class correlations and restricting the correlations to be within the classes. Our proposed method can be used in pattern recognition applications for fusing the features extracted from multiple modalities or combining different feature vectors extracted from a single modality. It is noteworthy that DCA is the first technique that considers class structure in feature fusion. Moreover, it has a very low computational complexity and it can be employed in real-time applications. Multiple sets of experiments performed on various biometric databases and using different feature extraction techniques, show the effectiveness of our proposed method, which outperforms other state-of-the-art approaches.

Original languageEnglish (US)
Article number7470527
Pages (from-to)1984-1996
Number of pages13
JournalIEEE Transactions on Information Forensics and Security
Volume11
Issue number9
DOIs
StatePublished - Sep 2016

Keywords

  • class structure
  • discriminant correlation analysis
  • feature level fusion
  • multimodal biometrics

ASJC Scopus subject areas

  • Safety, Risk, Reliability and Quality
  • Computer Networks and Communications

Fingerprint Dive into the research topics of 'Discriminant Correlation Analysis: Real-Time Feature Level Fusion for Multimodal Biometric Recognition'. Together they form a unique fingerprint.

Cite this