Abstract
We present a new method for using commodity graphics hardware to achieve real-time, on-line, 2D view synthesis or 3D depth estimation from two or more calibrated cameras. Our method combines a 3D plane-sweeping approach with 2D multi-resolution color consistency tests. We project camera imagery onto each plane, compute measures of color consistency throughout the plane at multiple resolutions, and then choose the color or depth (corresponding plane) that is most consistent. The key to achieving real-time performance is our use of the advanced features included with recent commodity computer graphics hardware to implement the computations simultaneously (in parallel) across all reference image pixels on a plane. Our method is relatively simple to implement, and flexible in term of the number and placement of cameras. With two cameras and an NVIDIA GeForce4 graphics card we can achieve 50-70 M disparity evaluations per second, including image download and read-back overhead. This performance matches the fastest available commercial software-only implementation of correlation-based stereo algorithms, while freeing up the CPU for other uses.
Original language | English |
---|---|
Pages (from-to) | 627-651 |
Number of pages | 25 |
Journal | International Journal of Image and Graphics |
Volume | 4 |
Issue number | 4 |
DOIs | |
State | Published - Oct 1 2004 |
Bibliographical note
Publisher Copyright:© 2004 World Scientific Publishing Company.
Keywords
- View synthesis
- real time computation
- stereo
ASJC Scopus subject areas
- Computer Vision and Pattern Recognition
- Computer Science Applications
- Computer Graphics and Computer-Aided Design