Traceability challenge 2013: Statistical analysis for traceability experiments: Software verification and validation research laboratory (SVVRL) of the University of Kentucky

Mark Hays; Jane Huffman Hayes; Arnold J. Stromberg; Arne C. Bathke

doi:10.1109/TEFSE.2013.6620161

Traceability challenge 2013: Statistical analysis for traceability experiments: Software verification and validation research laboratory (SVVRL) of the University of Kentucky

Mark Hays, Jane Huffman Hayes, Arnold J. Stromberg, Arne C. Bathke

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

3 Scopus citations

Abstract

An important aspect of traceability experiments is the ability to compare techniques. In order to assure proper comparison, it is necessary to perform statistical analysis of the dependent variables collected from technique application. Currently, there is a lack of components in TraceLab to support such analysis. The Software Verification and Validation Research Laboratory (SVVRL) and the Statistics Department of the University of Kentucky have developed a collection of such components as well as a workflow for determining what type of analysis to apply (parametric, non-parametric). The components use industry-accepted R algorithms. The components have been validated using independent standard statistical algorithms applied to publicly available datasets. This work addresses the Purposed grand challenge (research project 4) and Cost-Effective Grand Challenge (research project 4) as well as the Valued Grand Challenge - research project 6.

Original language	English
Title of host publication	2013 7th International Workshop on Traceability in Emerging Forms of Software Engineering, TEFSE 2013 - Proceedings
Pages	90-94
Number of pages	5
DOIs	https://doi.org/10.1109/TEFSE.2013.6620161
State	Published - 2013
Event	2013 7th International Workshop on Traceability in Emerging Forms of Software Engineering, TEFSE 2013 - San Francisco, CA, United States Duration: May 19 2013 → May 19 2013

Publication series

Name	2013 7th International Workshop on Traceability in Emerging Forms of Software Engineering, TEFSE 2013 - Proceedings

Conference

Conference	2013 7th International Workshop on Traceability in Emerging Forms of Software Engineering, TEFSE 2013
Country/Territory	United States
City	San Francisco, CA
Period	5/19/13 → 5/19/13

Keywords

Cost-Effective Grand challenge
Non-parametric tests
Parametric tests
Purposed grand challenge
Statistical analysis
TraceLab component
Traceability experiment
Valued Grand Challenge

ASJC Scopus subject areas

Software

Access to Document

10.1109/TEFSE.2013.6620161

Cite this

Hays, M., Hayes, J. H., Stromberg, A. J., & Bathke, A. C. (2013). Traceability challenge 2013: Statistical analysis for traceability experiments: Software verification and validation research laboratory (SVVRL) of the University of Kentucky. In 2013 7th International Workshop on Traceability in Emerging Forms of Software Engineering, TEFSE 2013 - Proceedings (pp. 90-94). Article 6620161 (2013 7th International Workshop on Traceability in Emerging Forms of Software Engineering, TEFSE 2013 - Proceedings). https://doi.org/10.1109/TEFSE.2013.6620161

Hays, Mark ; Hayes, Jane Huffman ; Stromberg, Arnold J. et al. / Traceability challenge 2013 : Statistical analysis for traceability experiments: Software verification and validation research laboratory (SVVRL) of the University of Kentucky. 2013 7th International Workshop on Traceability in Emerging Forms of Software Engineering, TEFSE 2013 - Proceedings. 2013. pp. 90-94 (2013 7th International Workshop on Traceability in Emerging Forms of Software Engineering, TEFSE 2013 - Proceedings).

@inproceedings{637e9d8e684e459090dc6abba5456958,

title = "Traceability challenge 2013: Statistical analysis for traceability experiments: Software verification and validation research laboratory (SVVRL) of the University of Kentucky",

abstract = "An important aspect of traceability experiments is the ability to compare techniques. In order to assure proper comparison, it is necessary to perform statistical analysis of the dependent variables collected from technique application. Currently, there is a lack of components in TraceLab to support such analysis. The Software Verification and Validation Research Laboratory (SVVRL) and the Statistics Department of the University of Kentucky have developed a collection of such components as well as a workflow for determining what type of analysis to apply (parametric, non-parametric). The components use industry-accepted R algorithms. The components have been validated using independent standard statistical algorithms applied to publicly available datasets. This work addresses the Purposed grand challenge (research project 4) and Cost-Effective Grand Challenge (research project 4) as well as the Valued Grand Challenge - research project 6.",

keywords = "Cost-Effective Grand challenge, Non-parametric tests, Parametric tests, Purposed grand challenge, Statistical analysis, TraceLab component, Traceability experiment, Valued Grand Challenge",

author = "Mark Hays and Hayes, {Jane Huffman} and Stromberg, {Arnold J.} and Bathke, {Arne C.}",

year = "2013",

doi = "10.1109/TEFSE.2013.6620161",

language = "English",

isbn = "9781479904952",

series = "2013 7th International Workshop on Traceability in Emerging Forms of Software Engineering, TEFSE 2013 - Proceedings",

pages = "90--94",

booktitle = "2013 7th International Workshop on Traceability in Emerging Forms of Software Engineering, TEFSE 2013 - Proceedings",

note = "2013 7th International Workshop on Traceability in Emerging Forms of Software Engineering, TEFSE 2013 ; Conference date: 19-05-2013 Through 19-05-2013",

}

Hays, M, Hayes, JH, Stromberg, AJ & Bathke, AC 2013, Traceability challenge 2013: Statistical analysis for traceability experiments: Software verification and validation research laboratory (SVVRL) of the University of Kentucky. in 2013 7th International Workshop on Traceability in Emerging Forms of Software Engineering, TEFSE 2013 - Proceedings., 6620161, 2013 7th International Workshop on Traceability in Emerging Forms of Software Engineering, TEFSE 2013 - Proceedings, pp. 90-94, 2013 7th International Workshop on Traceability in Emerging Forms of Software Engineering, TEFSE 2013, San Francisco, CA, United States, 5/19/13. https://doi.org/10.1109/TEFSE.2013.6620161

Traceability challenge 2013: Statistical analysis for traceability experiments: Software verification and validation research laboratory (SVVRL) of the University of Kentucky. / Hays, Mark; Hayes, Jane Huffman; Stromberg, Arnold J. et al.
2013 7th International Workshop on Traceability in Emerging Forms of Software Engineering, TEFSE 2013 - Proceedings. 2013. p. 90-94 6620161 (2013 7th International Workshop on Traceability in Emerging Forms of Software Engineering, TEFSE 2013 - Proceedings).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Traceability challenge 2013

T2 - 2013 7th International Workshop on Traceability in Emerging Forms of Software Engineering, TEFSE 2013

AU - Hays, Mark

AU - Hayes, Jane Huffman

AU - Stromberg, Arnold J.

AU - Bathke, Arne C.

PY - 2013

Y1 - 2013

N2 - An important aspect of traceability experiments is the ability to compare techniques. In order to assure proper comparison, it is necessary to perform statistical analysis of the dependent variables collected from technique application. Currently, there is a lack of components in TraceLab to support such analysis. The Software Verification and Validation Research Laboratory (SVVRL) and the Statistics Department of the University of Kentucky have developed a collection of such components as well as a workflow for determining what type of analysis to apply (parametric, non-parametric). The components use industry-accepted R algorithms. The components have been validated using independent standard statistical algorithms applied to publicly available datasets. This work addresses the Purposed grand challenge (research project 4) and Cost-Effective Grand Challenge (research project 4) as well as the Valued Grand Challenge - research project 6.

AB - An important aspect of traceability experiments is the ability to compare techniques. In order to assure proper comparison, it is necessary to perform statistical analysis of the dependent variables collected from technique application. Currently, there is a lack of components in TraceLab to support such analysis. The Software Verification and Validation Research Laboratory (SVVRL) and the Statistics Department of the University of Kentucky have developed a collection of such components as well as a workflow for determining what type of analysis to apply (parametric, non-parametric). The components use industry-accepted R algorithms. The components have been validated using independent standard statistical algorithms applied to publicly available datasets. This work addresses the Purposed grand challenge (research project 4) and Cost-Effective Grand Challenge (research project 4) as well as the Valued Grand Challenge - research project 6.

KW - Cost-Effective Grand challenge

KW - Non-parametric tests

KW - Parametric tests

KW - Purposed grand challenge

KW - Statistical analysis

KW - TraceLab component

KW - Traceability experiment

KW - Valued Grand Challenge

UR - http://www.scopus.com/inward/record.url?scp=84890703448&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84890703448&partnerID=8YFLogxK

U2 - 10.1109/TEFSE.2013.6620161

DO - 10.1109/TEFSE.2013.6620161

M3 - Conference contribution

AN - SCOPUS:84890703448

SN - 9781479904952

T3 - 2013 7th International Workshop on Traceability in Emerging Forms of Software Engineering, TEFSE 2013 - Proceedings

SP - 90

EP - 94

BT - 2013 7th International Workshop on Traceability in Emerging Forms of Software Engineering, TEFSE 2013 - Proceedings

Y2 - 19 May 2013 through 19 May 2013

ER -

Hays M, Hayes JH, Stromberg AJ, Bathke AC. Traceability challenge 2013: Statistical analysis for traceability experiments: Software verification and validation research laboratory (SVVRL) of the University of Kentucky. In 2013 7th International Workshop on Traceability in Emerging Forms of Software Engineering, TEFSE 2013 - Proceedings. 2013. p. 90-94. 6620161. (2013 7th International Workshop on Traceability in Emerging Forms of Software Engineering, TEFSE 2013 - Proceedings). doi: 10.1109/TEFSE.2013.6620161

Traceability challenge 2013: Statistical analysis for traceability experiments: Software verification and validation research laboratory (SVVRL) of the University of Kentucky

Abstract

Publication series

Conference

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this