Kernel Null Space Methods for Novelty Detection
- 1 June 2013
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10636919,p. 3374-3381
- https://doi.org/10.1109/cvpr.2013.433
Abstract
Detecting samples from previously unknown classes is a crucial task in object recognition, especially when dealing with real-world applications where the closed-world assumption does not hold. We present how to apply a null space method for novelty detection, which maps all training samples of one class to a single point. Beside the possibility of modeling a single class, we are able to treat multiple known classes jointly and to detect novelties for a set of classes with a single model. In contrast to modeling the support of each known class individually, our approach makes use of a projection in a joint subspace where training samples of all known classes have zero intra-class variance. This subspace is called the null space of the training data. To decide about novelty of a test sample, our null space approach allows for solely relying on a distance measure instead of performing density estimation directly. Therefore, we derive a simple yet powerful method for multi-class novelty detection, an important problem not studied sufficiently so far. Our novelty detection approach is assessed in comprehensive multi-class experiments using the publicly available datasets Caltech-256 and Image Net. The analysis reveals that our null space approach is perfectly suited for multi-class novelty detection since it outperforms all other methods.Keywords
This publication has 17 references indexed in Scilit:
- On feature selection with principal component analysis for one-class SVMPattern Recognition Letters, 2012
- Generalized RBF feature maps for Efficient DetectionPublished by British Machine Vision Association and Society for Pattern Recognition ,2010
- Growing a multi-class classifier with a reject optionPattern Recognition Letters, 2008
- Classification using intersection kernel support vector machines is efficientPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2008
- Kernel Null Foley-Sammon TransformPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2008
- Kernel Fisher Discriminants for Outlier DetectionNeural Computation, 2006
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Novelty detection: a review—part 2:Signal Processing, 2003
- Novelty detection: a review—part 1: statistical approachesSignal Processing, 2003
- Estimating the Support of a High-Dimensional DistributionNeural Computation, 2001