Structured light smart camera for spatial augmented reality applications

Matthew P. Ruffner; Ying Yu; Daniel L. Lau

doi:10.1117/12.2508553

Structured light smart camera for spatial augmented reality applications

Matthew P. Ruffner, Ying Yu, Daniel L. Lau

Electrical and Computer Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

Structured Light Imaging (SLI) is a means of digital reconstruction, or Three-Dimensional (3D) scanning, and has uses that span many disciplines. A projector, camera and Personal Computer (PC) are required to perform such 3D scans. Slight variances in synchronization between these three devices can cause malfunctions in the process due to the limitations of PC graphics processors as real-time systems. Previous work used a Field Programmable Gate Array (FPGA) to both drive the projector and trigger the camera, eliminating these timing issues, but still needing an external camera. This work proposes the incorporation of the camera with the FPGA SLI controller by means of a custom printed circuit board (PCB) design. Featuring a high speed image sensor as well as High Definition Multimedia Interface (HDMI) input and output, this PCB enables the FPGA to perform SLI scans as well as pass through HDMI video to the projector for Spatial Augmented Reality (SAR) purposes. Minimizing ripple noise on the power supply by means of effective circuit design and PCB layout, creates a compact and cost effective machine vision sensing solution.

Original language	English
Title of host publication	Emerging Digital Micromirror Device Based Systems and Applications XI
Editors	Michael R. Douglass, John Ehmke, Benjamin L. Lee
ISBN (Electronic)	9781510625068
DOIs	https://doi.org/10.1117/12.2508553
State	Published - 2019
Event	Emerging Digital Micromirror Device Based Systems and Applications XI 2019 - San Francisco, United States Duration: Feb 5 2019 → Feb 6 2019

Publication series

Name	Proceedings of SPIE - The International Society for Optical Engineering
Volume	10932
ISSN (Print)	0277-786X
ISSN (Electronic)	1996-756X

Conference

Conference	Emerging Digital Micromirror Device Based Systems and Applications XI 2019
Country/Territory	United States
City	San Francisco
Period	2/5/19 → 2/6/19

Bibliographical note

Funding Information:
This work has been supported by Intel Corporation and the National Science Foundation under contract No. 1539157 and the Visual and Experiential Computing initiative. Dr. Daniel L. Lau is a Professor at the University of Kentucky and a Founder of Seikowave Inc., a private company that designs and sells structured light scanners.

Publisher Copyright:
© 2019 SPIE.

Keywords

Image Sensor
Machine Vision
PCB Design
Spatial Augmented Reality

ASJC Scopus subject areas

Electronic, Optical and Magnetic Materials
Condensed Matter Physics
Computer Science Applications
Applied Mathematics
Electrical and Electronic Engineering

Access to Document

10.1117/12.2508553

Cite this

@inproceedings{b2d5ad93a68d4ab3aab370f702918419,

title = "Structured light smart camera for spatial augmented reality applications",

abstract = "Structured Light Imaging (SLI) is a means of digital reconstruction, or Three-Dimensional (3D) scanning, and has uses that span many disciplines. A projector, camera and Personal Computer (PC) are required to perform such 3D scans. Slight variances in synchronization between these three devices can cause malfunctions in the process due to the limitations of PC graphics processors as real-time systems. Previous work used a Field Programmable Gate Array (FPGA) to both drive the projector and trigger the camera, eliminating these timing issues, but still needing an external camera. This work proposes the incorporation of the camera with the FPGA SLI controller by means of a custom printed circuit board (PCB) design. Featuring a high speed image sensor as well as High Definition Multimedia Interface (HDMI) input and output, this PCB enables the FPGA to perform SLI scans as well as pass through HDMI video to the projector for Spatial Augmented Reality (SAR) purposes. Minimizing ripple noise on the power supply by means of effective circuit design and PCB layout, creates a compact and cost effective machine vision sensing solution.",

keywords = "Image Sensor, Machine Vision, PCB Design, Spatial Augmented Reality",

author = "Ruffner, {Matthew P.} and Ying Yu and Lau, {Daniel L.}",

note = "Funding Information: This work has been supported by Intel Corporation and the National Science Foundation under contract No. 1539157 and the Visual and Experiential Computing initiative. Dr. Daniel L. Lau is a Professor at the University of Kentucky and a Founder of Seikowave Inc., a private company that designs and sells structured light scanners. Publisher Copyright: {\textcopyright} 2019 SPIE.; null ; Conference date: 05-02-2019 Through 06-02-2019",

year = "2019",

doi = "10.1117/12.2508553",

language = "English",

series = "Proceedings of SPIE - The International Society for Optical Engineering",

editor = "Douglass, {Michael R.} and John Ehmke and Lee, {Benjamin L.}",

booktitle = "Emerging Digital Micromirror Device Based Systems and Applications XI",

}

Ruffner, MP, Yu, Y & Lau, DL 2019, Structured light smart camera for spatial augmented reality applications. in MR Douglass, J Ehmke & BL Lee (eds), Emerging Digital Micromirror Device Based Systems and Applications XI., 109320J, Proceedings of SPIE - The International Society for Optical Engineering, vol. 10932, Emerging Digital Micromirror Device Based Systems and Applications XI 2019, San Francisco, United States, 2/5/19. https://doi.org/10.1117/12.2508553

Structured light smart camera for spatial augmented reality applications. / Ruffner, Matthew P.; Yu, Ying; Lau, Daniel L.

Emerging Digital Micromirror Device Based Systems and Applications XI. ed. / Michael R. Douglass; John Ehmke; Benjamin L. Lee. 2019. 109320J (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 10932).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Structured light smart camera for spatial augmented reality applications

AU - Ruffner, Matthew P.

AU - Yu, Ying

AU - Lau, Daniel L.

N1 - Funding Information: This work has been supported by Intel Corporation and the National Science Foundation under contract No. 1539157 and the Visual and Experiential Computing initiative. Dr. Daniel L. Lau is a Professor at the University of Kentucky and a Founder of Seikowave Inc., a private company that designs and sells structured light scanners. Publisher Copyright: © 2019 SPIE.

PY - 2019

Y1 - 2019

N2 - Structured Light Imaging (SLI) is a means of digital reconstruction, or Three-Dimensional (3D) scanning, and has uses that span many disciplines. A projector, camera and Personal Computer (PC) are required to perform such 3D scans. Slight variances in synchronization between these three devices can cause malfunctions in the process due to the limitations of PC graphics processors as real-time systems. Previous work used a Field Programmable Gate Array (FPGA) to both drive the projector and trigger the camera, eliminating these timing issues, but still needing an external camera. This work proposes the incorporation of the camera with the FPGA SLI controller by means of a custom printed circuit board (PCB) design. Featuring a high speed image sensor as well as High Definition Multimedia Interface (HDMI) input and output, this PCB enables the FPGA to perform SLI scans as well as pass through HDMI video to the projector for Spatial Augmented Reality (SAR) purposes. Minimizing ripple noise on the power supply by means of effective circuit design and PCB layout, creates a compact and cost effective machine vision sensing solution.

AB - Structured Light Imaging (SLI) is a means of digital reconstruction, or Three-Dimensional (3D) scanning, and has uses that span many disciplines. A projector, camera and Personal Computer (PC) are required to perform such 3D scans. Slight variances in synchronization between these three devices can cause malfunctions in the process due to the limitations of PC graphics processors as real-time systems. Previous work used a Field Programmable Gate Array (FPGA) to both drive the projector and trigger the camera, eliminating these timing issues, but still needing an external camera. This work proposes the incorporation of the camera with the FPGA SLI controller by means of a custom printed circuit board (PCB) design. Featuring a high speed image sensor as well as High Definition Multimedia Interface (HDMI) input and output, this PCB enables the FPGA to perform SLI scans as well as pass through HDMI video to the projector for Spatial Augmented Reality (SAR) purposes. Minimizing ripple noise on the power supply by means of effective circuit design and PCB layout, creates a compact and cost effective machine vision sensing solution.

KW - Image Sensor

KW - Machine Vision

KW - PCB Design

KW - Spatial Augmented Reality

UR - http://www.scopus.com/inward/record.url?scp=85068030701&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85068030701&partnerID=8YFLogxK

U2 - 10.1117/12.2508553

DO - 10.1117/12.2508553

M3 - Conference contribution

AN - SCOPUS:85068030701

T3 - Proceedings of SPIE - The International Society for Optical Engineering

BT - Emerging Digital Micromirror Device Based Systems and Applications XI

A2 - Douglass, Michael R.

A2 - Ehmke, John

A2 - Lee, Benjamin L.

Y2 - 5 February 2019 through 6 February 2019

ER -

Structured light smart camera for spatial augmented reality applications

Abstract

Publication series

Conference

Bibliographical note

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this