Generation of ROI Enhanced Depth Maps Using Stereoscopic Cameras and a Depth Camera
- 8 December 2008
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Broadcasting
- Vol. 54 (4), 732-740
- https://doi.org/10.1109/tbc.2008.2002338
Abstract
In this paper, we propose a new scheme to generate region-of-interest (ROI) enhanced depth maps combining one low-resolution depth camera with high-resolution stereoscopic cameras. Basically, the hybrid camera system produces four synchronized images at each frame: left and right images from the stereoscopic cameras, a color image and its associated depth map from the depth camera. In the hybrid camera system, after estimating initial depth information for the left image using a stereo matching algorithm, we project depths obtained from the depth camera onto ROI of the left image using three-dimensional (3-D) image warping. Then, the warped depths are linearly interpolated to fill depth holes occurred in ROI. Finally, we merge the ROI depths with background ones extracted from the initial depth information to generate the ROI enhanced depth map. Experimental results show that the proposed depth acquisition system provides more accurate depth information for ROI than previous stereo matching algorithms. Besides, the proposed scheme minimizes inherent problems of the current depth camera, such as limitation of its measuring distance and production of low-resolution depth maps.Keywords
This publication has 20 references indexed in Scilit:
- Point-sampled 3D video of real-world scenesSignal Processing: Image Communication, 2007
- Depth map creation and image-based rendering for advanced 3DTV services providing interoperability and scalabilitySignal Processing: Image Communication, 2007
- Three-dimensional natural video system based on layered representation of depth mapsIEEE Transactions on Consumer Electronics, 2006
- Efficient Belief Propagation for Early VisionInternational Journal of Computer Vision, 2006
- Depth Video Enhancement for Haptic Interaction Using a Smooth Surface ReconstructionIEICE Transactions on Information and Systems, 2006
- Stereoscopic Image Generation Based on Depth Images for 3D TVIEEE Transactions on Broadcasting, 2005
- High-quality video view interpolation using a layered representationACM Transactions on Graphics, 2004
- High-definition real-time depth-mapping TV camera: HDTV Axi-Vision CameraOptics Express, 2004
- Stereo Analysis by Hybrid Recursive Matching for Real-Time Immersive Video ConferencingIEEE Transactions on Circuits and Systems for Video Technology, 2004
- Shape from focusIEEE Transactions on Pattern Analysis and Machine Intelligence, 1994