Video stereolization: Combining motion analysis with user interaction

Miao Liao, Jizhou Gao, Ruigang Yang, Minglun Gong

Research output: Contribution to journalArticlepeer-review

49 Scopus citations

Abstract

We present a semiautomatic system that converts conventional videos into stereoscopic videos by combining motion analysis with user interaction, aiming to transfer as much as possible labeling work from the user to the computer. In addition to the widely used structure from motion (SFM) techniques, we develop two new methods that analyze the optical flow to provide additional qualitative depth constraints. They remove the camera movement restriction imposed by SFM so that general motions can be used in scene depth estimation-the central problem in mono-to-stereo conversion. With these algorithms, the user's labeling task is significantly simplified. We further developed a quadratic programming approach to incorporate both quantitative depth and qualitative depth (such as these from user scribbling) to recover dense depth maps for all frames, from which stereoscopic view can be synthesized. In addition to visual results, we present user study results showing that our approach is more intuitive and less labor intensive, while producing 3D effect comparable to that from current state-of-the-art interactive algorithms.

Original languageEnglish
Article number5928340
Pages (from-to)1079-1088
Number of pages10
JournalIEEE Transactions on Visualization and Computer Graphics
Volume18
Issue number7
DOIs
StatePublished - 2012

Keywords

  • Semiautomatic 2D-3D conversion
  • motion analysis
  • stereo/3D video/movie
  • user labeling

ASJC Scopus subject areas

  • Software
  • Signal Processing
  • Computer Vision and Pattern Recognition
  • Computer Graphics and Computer-Aided Design

Fingerprint

Dive into the research topics of 'Video stereolization: Combining motion analysis with user interaction'. Together they form a unique fingerprint.

Cite this