Eye tracking based perceptual image inpainting quality analysis

M. Vijay Venkatesh, Sen Ching S. Cheung

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

28 Scopus citations

Abstract

The objective of image inpainting is to perform a seamless completion of missing areas in images. Evaluating the perceptual quality of an inpainting algorithm must rely on features of the Human Visual System. Using eye-tracking experiments, we show that there is a strong correlation between inpainting quality and visual attention. By comparing gaze densities within and outside the hole regions of inpainted images, we show that discernible artifacts due to inpainting attract an unusual amount of visual attention. The gaze density within the hole, normalized with the gaze density of the same region from the unmodified image, provides a useful measure in comparing different inpainting processes and corroborates well with subjective rankings.

Original languageEnglish
Title of host publication2010 IEEE International Conference on Image Processing, ICIP 2010 - Proceedings
Pages1109-1112
Number of pages4
DOIs
StatePublished - 2010
Event2010 17th IEEE International Conference on Image Processing, ICIP 2010 - Hong Kong, Hong Kong
Duration: Sep 26 2010Sep 29 2010

Publication series

NameProceedings - International Conference on Image Processing, ICIP
ISSN (Print)1522-4880

Conference

Conference2010 17th IEEE International Conference on Image Processing, ICIP 2010
Country/TerritoryHong Kong
CityHong Kong
Period9/26/109/29/10

Keywords

  • Eye-tracking experiments
  • Gaze
  • Image inpainting
  • Perceptual quality
  • Subjective evaluation

ASJC Scopus subject areas

  • Software
  • Computer Vision and Pattern Recognition
  • Signal Processing

Fingerprint

Dive into the research topics of 'Eye tracking based perceptual image inpainting quality analysis'. Together they form a unique fingerprint.

Cite this