We present a new method for using commodity graphics hardware to achieve real-time, on-line, 2D view synthesis or 3D depth estimation from two or more calibrated cameras. Our method combines a 3D plane-sweeping approach with 2D multi-resolution color consistency tests. We project camera imagery onto each plane, compute measures of color consistency throughout the plane at multiple resolutions, and then choose the color or depth (corresponding plane) that is most consistent. The key to achieving real-time performance is our use of the advanced features included with recent commodity computer graphics hardware to implement the computations simultaneously (in parallel) across all reference image pixels on a plane. Our method is relatively simple to implement, and flexible in term of the number and placement of cameras. With two cameras and an NVIDIA GeForce4 graphics card we can achieve 50-70 M disparity evaluations per second, including image download and read-back overhead. This performance matches the fastest available commercial software-only implementation of correlation-based stereo algorithms, while freeing up the CPU for other uses.
|Number of pages||25|
|Journal||International Journal of Image and Graphics|
|State||Published - Oct 1 2004|
Bibliographical noteFunding Information:
This work was supported in part by the United States National Science Foundation grant “Electronic Books for the Tele-Immersion Age” (Grant No. 0121657), Grant ISS-0237533, and by a generous 2002-2003 Link Foundation fellowship. We made use of equipment purchased under the United States Department of Energy contract “Front Projection Display Wall Group Teleimmersion Tracking Technologies” (Contract No. B519834), and personal computers donated by the Intel Corporation.
© 2004 World Scientific Publishing Company.
- View synthesis
- real time computation
ASJC Scopus subject areas
- Computer Vision and Pattern Recognition
- Computer Science Applications
- Computer Graphics and Computer-Aided Design