On-line Random Forests
Top Cited Papers
- 1 September 2009
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1393-1400
- https://doi.org/10.1109/iccvw.2009.5457447
Abstract
Random Forests (RFs) are frequently used in many computer vision and machine learning applications. Their popularity is mainly driven by their high computational efficiency during both training and evaluation while achieving state-of-the-art results. However, in most applications RFs are used off-line. This limits their usability for many practical problems, for instance, when training data arrives sequentially or the underlying distribution is continuously changing. In this paper, we propose a novel on-line random forest algorithm. We combine ideas from on-line bagging, extremely randomized forests and propose an on-line decision tree growing procedure. Additionally, we add a temporal weighting scheme for adaptively discarding some trees based on their out-of-bag-error in given time intervals and consequently growing of new trees. The experiments on common machine learning data sets show that our algorithm converges to the performance of the off-line RF. Additionally, we conduct experiments for visual tracking, where we demonstrate real-time state-of-the-art performance on well-known scenarios and show good performance in case of occlusions and appearance changes where we outperform trackers based on on-line boosting. Finally, we demonstrate the usability of on-line RFs on the task of interactive real-time segmentation.Keywords
This publication has 14 references indexed in Scilit:
- Regularized multi-class semi-supervised boostingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2009
- Interactive Texture Segmentation using Random Forests and Total VariationPublished by British Machine Vision Association and Society for Pattern Recognition ,2009
- Representing shape with a spatial pyramid kernelPublished by Association for Computing Machinery (ACM) ,2007
- Semi-Supervised LearningPublished by MIT Press ,2006
- Online Adaptive Decision Trees: Pattern Classification and Function ApproximationNeural Computation, 2006
- On-line Boosting and VisionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2006
- Extremely randomized treesMachine Learning, 2006
- The Evolving Tree?A Novel Self-Organizing Network for Data AnalysisNeural Processing Letters, 2004
- Elliptical head tracking using intensity gradients and color histogramsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Random ForestsMachine Learning, 2001