Multimodal Face Recognition: Combination of Geometry with Physiological Information
- 27 July 2005
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 2, 1022
- https://doi.org/10.1109/cvpr.2005.241
Abstract
It is becoming increasingly important to be able to credential and identify authorized personnel at key points of entry. Such identity management systems commonly employ biometric identifiers. In this paper, we present a novel multimodal facial recognition approach that employs data from both visible spectrum and thermal infrared sensors. Data from multiple cameras is used to construct a three-dimensional mesh representing the face and a facial thermal texture map. An annotated face model with explicit two-dimensional parameterization (UV) is then fitted to this data to construct: 1) a three-channel UV deformation image encoding geometry, and 2) a one-channel UV vasculature image encoding facial vasculature. Recognition is accomplished by comparing: 1) the parametric deformation images, 2) the parametric vasculature images, and 3) the visible spectrum texture maps. The novelty of our work lies in the use of deformation images and physiological information as means for comparison. We have performed extensive tests on the Face Recognition Grand Challenge v1.0 dataset and on our own multimodal database with very encouraging results.Keywords
This publication has 30 references indexed in Scilit:
- Face localization and authentication using color and depth imagesIEEE Transactions on Image Processing, 2005
- Recent advances in visual and infrared face recognition—a reviewComputer Vision and Image Understanding, 2005
- Three-dimensional face recognition: an eigensurface approachPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2004
- Face recognitionACM Computing Surveys, 2003
- m-HDAF multiresolution deformable modelsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- g-HDAF Multiresolution Deformable ModelsLecture Notes in Computer Science, 2002
- Facial feature detection and face recognition from 2D and 3D imagesPattern Recognition Letters, 2002
- Geometry imagesACM Transactions on Graphics, 2002
- Eigenfaces for RecognitionJournal of Cognitive Neuroscience, 1991
- Quad trees a data structure for retrieval on composite keysActa Informatica, 1974