Toward actionable, broadly accessible contests in software engineering

Jane Cleland-Huang, Yonghee Shin, Ed Keenan, Adam Czauderna, Greg Leach, Evan Moritz, Malcom Gethers, Denys Poshyvanyk, Jane Huffman Hayes, Wenbin Li

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

10 Scopus citations

Abstract

Software Engineering challenges and contests are becoming increasingly popular for focusing researchers' efforts on particular problems. Such contests tend to follow either an exploratory model, in which the contest holders provide data and ask the contestants to discover "interesting things" they can do with it, or task-oriented contests in which contestants must perform a specific task on a provided dataset. Only occasionally do contests provide more rigorous evaluation mechanisms that precisely specify the task to be performed and the metrics that will be used to evaluate the results. In this paper, we propose actionable and crowd-sourced contests: actionable because the contest describes a precise task, datasets, and evaluation metrics, and also provides a downloadable operating environment for the contest; and crowd-sourced because providing these features creates accessibility to Information Technology hobbyists and students who are attracted by the challenge. Our proposed approach is illustrated using research challenges from the software traceability area as well as an experimental workbench named TraceLab.

Original languageEnglish
Title of host publicationProceedings - 34th International Conference on Software Engineering, ICSE 2012
Pages1329-1332
Number of pages4
DOIs
StatePublished - 2012
Event34th International Conference on Software Engineering, ICSE 2012 - Zurich, Switzerland
Duration: Jun 2 2012Jun 9 2012

Publication series

NameProceedings - International Conference on Software Engineering
ISSN (Print)0270-5257

Conference

Conference34th International Conference on Software Engineering, ICSE 2012
Country/TerritorySwitzerland
CityZurich
Period6/2/126/9/12

Keywords

  • Contest
  • Empirical Software Engineering
  • TraceLab
  • Traceability

ASJC Scopus subject areas

  • Software

Fingerprint

Dive into the research topics of 'Toward actionable, broadly accessible contests in software engineering'. Together they form a unique fingerprint.

Cite this