NASA EPSCoR KY: Real-Time 3D Video Acquisition for Head and Hand Tracking in Augmented Reality

Based on recent discoveries, we are developing a method to project a single structured pattern of infrared light and then reconstruct the three-dimensional range from the distortions in the reflected and captured image. Traditional structured light methods require several different patterns to recover the depth and are corrupted by object movement during the projection/capture process. Our method efficiently combines several patterns into a single composite pattern projection - allowing for real-time implementations. Attaining video 3D data acquisition would have a profound impact on most applications that are presently limited to 2D video imaging. Furthermore, it would enable many other applications. In particular, we propose a feasibility study for using real time depth imagery for tracking human head and hand motion as an interface to a virtual reality. The requested funding will allow us to continue the composite pattern projection development and conduct investigation of several research issues. The issues that we will investigate are depth accuracy, lateral resolution and temporal latency. The preliminary results of the proposed research will be used to guide us in obtaining long term funding and solidify collaboration between NASA, the Department of Electrical and Computer Engineering and the Department of Computer Science at the University of Kentucky.