Multi-view reconstruction using photo-consistency and exact silhouette constraints: a maximum-flow formulation
- 1 January 2005
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 1 (15505499), 349-356 Vol. 1
- https://doi.org/10.1109/iccv.2005.159
Abstract
This paper describes a novel approach for reconstructing a closed continuous surface of an object from multiple calibrated color images and silhouettes. Any accurate reconstruction must satisfy (1) photo-consistency and (2) silhouette consistency constraints. Most existing techniques treat these cues identically in optimization frameworks where silhouette constraints are traded off against photo-consistency and smoothness priors. Our approach strictly enforces silhouette constraints, while optimizing photo-consistency and smoothness in a global graph-cut framework. We transform the reconstruction problem into computing max-flow/min-cut in a geometric graph, where any cut corresponds to a surface satisfying exact silhouette constraints (its silhouettes should exactly coincide with those of the visual hull); a minimum cut is the most photo-consistent surface amongst them. Our graph-cut formulation is based on the rim mesh, (the combinatorial arrangement of rims or contour generators from many views) which can be computed directly from the silhouettes. Unlike other methods, our approach enforces silhouette constraints without introducing a bias near the visual hull boundary and also recovers the rim curves. Results are presented for synthetic and real datasets.Keywords
This publication has 16 references indexed in Scilit:
- Multi-View Stereo via Volumetric Graph-CutsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- An experimental comparison of min-cut/max- flow algorithms for energy minimization in visionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2004
- Methods for Volumetric Reconstruction of Visual ScenesInternational Journal of Computer Vision, 2004
- Photorealistic scene reconstruction by voxel coloringPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence AlgorithmsInternational Journal of Computer Vision, 2002
- On computing exact visual hulls of solids bounded by smooth surfacesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2001
- Surface Reconstruction from Multiple Views Using Apparent Contours and Surface TexturePublished by Springer Nature ,2000
- A theory of shape by space carvingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1999
- Automatic model construction and pose estimation from photographs using triangular splinesIEEE Transactions on Pattern Analysis and Machine Intelligence, 1998
- The visual hull concept for silhouette-based image understandingIEEE Transactions on Pattern Analysis and Machine Intelligence, 1994