PEET: Prototype Embedding and Embedding Transition for Matching Vehicles over Disparate Viewpoints
- 1 June 2007
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
Abstract
This paper presents a novel framework, prototype embedding and embedding transition (PEET), for matching objects, especially vehicles, that undergo drastic pose, appearance, and even modality changes. The problem of matching objects seen under drastic variations is reduced to matching embeddings of object appearances instead of matching the object images directly. An object appearance is first embedded in the space of a representative set of model prototypes (prototype embedding (PE)). Objects captured at disparate temporal and spatial sites are embedded in the space of prototypes that are rendered with the pose of the cameras at the respective sites. Low dimensional embedding vectors are subsequently matched. A significant feature of our approach is that no mapping function is needed to compute the distance between embedding vectors extracted from objects viewed from disparate pose and appearance changes, instead, an embedding transition (ET) scheme is utilized to implicitly realize the complex and non-linear mapping with high accuracy. The heterogeneous nature of matching between high-resolution and low-resolution image objects in PEET is discussed, and an unsupervised learning scheme based on the exploitation of the heterogeneous nature is developed to improve the overall matching performance of mixed resolution objects. The proposed approach has been applied to vehicular object classification and query application, and the extensive experimental results demonstrate the efficacy and versatility of the PEET framework.Keywords
This publication has 8 references indexed in Scilit:
- Scalable Recognition with a Vocabulary TreePublished by Institute of Electrical and Electronics Engineers (IEEE) ,2006
- Boostmap: a method for efficient approximate similarity rankingsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2004
- Estimating 3D hand pose from a cluttered imagePublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Bayesian multi-camera surveillancePublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Tracking across multiple cameras with disjoint viewsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Classification with nonmetric distances: image retrieval and class representationIeee Transactions On Pattern Analysis and Machine Intelligence, 2000
- Linear object classes and image synthesis from a single example imageIeee Transactions On Pattern Analysis and Machine Intelligence, 1997
- Model-based object tracking in monocular image sequences of road traffic scenesInternational Journal of Computer Vision, 1993