Extending epipolar geometry for real-time structured light illumination

Kai Liu, Kangkang Zhang, Jinghe Wei, Jianwen Song, Daniel L. Lau, Ce Zhu, Bin Xu

Research output: Contribution to journalArticlepeer-review

10 Scopus citations


Structured light illumination, scanning along both horizontal and vertical directions, achieves more robust accuracy. By introducing the constraint of epipolar geometry, we previously proposed real-time 3D reconstruction using lookup tables; however, we only knew these offline derived tables were the combinations of the elements in calibration matrices of a camera and a projector, and suffered from long-time computation. In this Letter, by parameterizing the line perspectively mapping a 3D world coordinate into the camera and projector spaces, we propose to extend the epipolar analysis by defining phase and optical poles. Thus, we can geometrically address these parameters via analytic closed-form equations, with which we can (1) directly derive lookup tables in real time from the calibration matrices and (2) optimally reduce the number of tables from 11 to 5 to save much more memory space while further accelerating the processing rate. Experiments show that with the same level of accuracy, we significantly reduce the time to compute the lookup tables from more than 20 min to 20 ms, and increase the speed of computing point clouds from approximately 320 to 492 fps.

Original languageEnglish
Pages (from-to)3280-3283
Number of pages4
JournalOptics Letters
Issue number12
StatePublished - Jun 15 2020

Bibliographical note

Funding Information:
We thank K. Belashchenko and Y. Tserkovnyak for illuminating discussions. This research was supported in part by the U.S. National Science Foundation (NSF) under Grant No. ECCS-1922689. It was finalized during Spin and Heat Transport in Quantum and Topological Materials program at KITP Santa Barbara, which is supported under NSF Grant No. PHY-1748958.

Funding Information:
National Natural Science Foundation of China (61473198); Sichuan Province Science and Technology Support Program (2020YFG0029).

Publisher Copyright:
© 2020 Optical Society of America

ASJC Scopus subject areas

  • Atomic and Molecular Physics, and Optics


Dive into the research topics of 'Extending epipolar geometry for real-time structured light illumination'. Together they form a unique fingerprint.

Cite this