User interaction models for disambiguation in programming by example

Mikaël Mayer, Gustavo Soares, Maxim Grechkin, Vu Le, Mark Marron, Oleksandr Polozov, Rishabh Singh, Benjamin Zorn, Sumit Gulwani

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

61 Scopus citations

Abstract

Programming by Examples (PBE) has the potential to revolutionize end-user programming by enabling end users, most of whom are non-programmers, to create small scripts for automating repetitive tasks. However, examples, though often easy to provide, are an ambiguous specification of the user?s intent. Because of that, a key impedance in adoption of PBE systems is the lack of user confidence in the correctness of the program that was synthesized by the system. We present two novel user interaction models that communicate actionable information to the user to help resolve ambiguity in the examples. One of these models allows the user to effectively navigate between the huge set of programs that are consistent with the examples provided by the user. The other model uses active learning to ask directed example-based questions to the user on the test input data over which the user intends to run the synthesized program. Our user studies show that each of these models significantly reduces the number of errors in the performed task without any difference in completion time. Moreover, both models are perceived as useful, and the proactive active-learning based model has a slightly higher preference regarding the users? confidence in the result.

Original languageEnglish
Title of host publicationUIST 2015 - Proceedings of the 28th Annual ACM Symposium on User Interface Software and Technology
Pages291-301
Number of pages11
ISBN (Electronic)9781450337793
DOIs
StatePublished - Nov 5 2015
Event28th Annual ACM Symposium on User Interface Software and Technology, UIST 2015 - Charlotte, United States
Duration: Nov 8 2015Nov 11 2015

Publication series

NameUIST 2015 - Proceedings of the 28th Annual ACM Symposium on User Interface Software and Technology

Conference

Conference28th Annual ACM Symposium on User Interface Software and Technology, UIST 2015
Country/TerritoryUnited States
CityCharlotte
Period11/8/1511/11/15

ASJC Scopus subject areas

  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'User interaction models for disambiguation in programming by example'. Together they form a unique fingerprint.

Cite this