Tracing requirements to defect reports: An application of information retrieval techniques

Suresh Yadla, Jane Huffman Hayes, Alex Dekhtyar

Research output: Contribution to journalArticlepeer-review

43 Scopus citations

Abstract

To support debugging, maintenance, verification and validation (V&V) and/or independent V&V (IV&V), it is necessary to understand the relationship between defect reports and their related artifacts. For example, one cannot correct a code-related defect report without being able to find the code that is affected. Information retrieval (IR) techniques have been used effectively to trace textual artifacts to each other. This has generally been applied to the problem of dynamically generating a trace between artifacts in the software document hierarchy after the fact (after development has proceeded to at least the next lifecycle phase). The same techniques can also be used to trace textual artifacts of the software engineering lifecycle to defect reports. We have applied the term frequency-inverse document frequency (TF-IDF) technique with relevance feedback, as implemented in our requirements tracing on-target (RETRO) tool, to the problem of tracing textual requirement elements to related textual defect reports. We have evaluated the technique using a dataset for a NASA scientific instrument. We found that recall of over 85% and precision of 69%, and recall of 70% and precision of 99% could be achieved, respectively, on two subsets of the dataset.

Original languageEnglish
Pages (from-to)116-124
Number of pages9
JournalInnovations in Systems and Software Engineering
Volume1
Issue number2
DOIs
StatePublished - Sep 2005

Bibliographical note

Funding Information:
Acknowledgements Our work is funded by NASA under grant NAG5-11732. We thank Stephanie Ferguson and Ken McGill. We thank Mike Chapman and the MDP program. We thank Senthil Sundaram for his assistance with RETRO. We thank Ganapathy Chidambaram for his assistance on LSI. We also thank Sarah Howard and James Osborne who worked on early versions of RETRO.

Keywords

  • Defect reports
  • Information retrieval
  • Requirements
  • Requirements traceability matrix (RTM)
  • Requirements tracing
  • Tracing

ASJC Scopus subject areas

  • Software

Fingerprint

Dive into the research topics of 'Tracing requirements to defect reports: An application of information retrieval techniques'. Together they form a unique fingerprint.

Cite this