Eye gaze correction with stereovision for video-teleconferencing

Ruigang Yang, Zhengyou Zhang

Research output: Contribution to journalArticlepeer-review

45 Scopus citations

Abstract

The lack of eye contact in desktop video teleconferencing substantially reduces the effectiveness of video contents. While expensive and bulky hardware is available on the market to correct eye gaze, researchers have been trying to provide a practical software-based solution to bring video-teleconferencing one step closer to the mass market. This paper presents a novel approach: Based on stereo analysis combined with rich domain knowledge (a personalized face model), we synthesize, using graphics hardware, a virtual video that maintains eye contact. A 3D stereo head tracker with a personalized face model is used to compute initial correspondences across two views. More correspondences are then added through template and feature matching. Finally, all the correspondence information is fused together for view synthesis using view morphing techniques. The combined methods greatly enhance the accuracy and robustness of the synthesized views. Our current system is able to generate an eye-gaze corrected video stream at five frames per second on a commodity 1 GHz PC.

Original languageEnglish
Pages (from-to)956-960
Number of pages5
JournalIEEE Transactions on Pattern Analysis and Machine Intelligence
Volume26
Issue number7
DOIs
StatePublished - Jul 2004

Keywords

  • Eye-gaze correction
  • Head tracking
  • Model-based tracking
  • Pose determination
  • Stereoscopic vision

ASJC Scopus subject areas

  • Software
  • Computer Vision and Pattern Recognition
  • Computational Theory and Mathematics
  • Artificial Intelligence
  • Applied Mathematics

Fingerprint

Dive into the research topics of 'Eye gaze correction with stereovision for video-teleconferencing'. Together they form a unique fingerprint.

Cite this