Motion Segmentation in the Presence of Outlying, Incomplete, or Corrupted Trajectories
Top Cited Papers
- 1 December 2009
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 32 (10), 1832-1845
- https://doi.org/10.1109/tpami.2009.191
Abstract
In this paper, we study the problem of segmenting tracked feature point trajectories of multiple moving objects in an image sequence. Using the affine camera model, this problem can be cast as the problem of segmenting samples drawn from multiple linear subspaces. In practice, due to limitations of the tracker, occlusions, and the presence of nonrigid objects in the scene, the obtained motion trajectories may contain grossly mistracked features, missing entries, or corrupted entries. In this paper, we develop a robust subspace separation scheme that deals with these practical issues in a unified mathematical framework. Our methods draw strong connections between lossy compression, rank minimization, and sparse representation. We test our methods extensively on the Hopkins155 motion segmentation database and other motion sequences with outliers and missing data. We compare the performance of our methods to state-of-the-art motion segmentation methods based on expectation-maximization and spectral clustering. For data without outliers or missing information, the results of our methods are on par with the state-of-the-art results and, in many cases, exceed them. In addition, our methods give surprisingly good performance in the presence of the three types of pathological trajectories mentioned above. All code and results are publicly available at http://perception.csl.uiuc.edu/coding/motion/.Keywords
This publication has 26 references indexed in Scilit:
- Guaranteed Minimum-Rank Solutions of Linear Matrix Equations via Nuclear Norm MinimizationSIAM Review, 2010
- Exact Matrix Completion via Convex OptimizationFoundations of Computational Mathematics, 2009
- Classification via Minimum Incremental Coding LengthSIAM Journal on Imaging Sciences, 2009
- A Model-Selection Framework for Multibody Structure-and-Motion of Image SequencesInternational Journal of Computer Vision, 2007
- Multiframe Motion Segmentation with Missing Data Using PowerFactorization and GPCAInternational Journal of Computer Vision, 2007
- Segmentation of Multivariate Mixed Data via Lossy Data Coding and CompressionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2007
- Generalized principal component analysis (GPCA)IEEE Transactions on Pattern Analysis and Machine Intelligence, 2005
- Locality-sensitive hashing scheme based on p-stable distributionsPublished by Association for Computing Machinery (ACM) ,2004
- The minimum description length principle in coding and modelingIEEE Transactions on Information Theory, 1998
- Semidefinite ProgrammingSIAM Review, 1996