[Context and motivation] Trace matrices are lynch pins for the development of mission- and safety-critical software systems and are useful for all software systems, yet automated methods for recovering trace links are far from perfect. This limitation makes the job of human analysts who must vet recovered trace links more difficult. [Question/Problem] Earlier studies suggested that certain analyst behaviors when performing trace recovery tasks lead to decreased accuracy of recovered trace relationships. We propose a three-step experimental study to: (a) determine if there really are behaviors that lead to errors of judgment for analysts, (b) enhance the requirements tracing software to curtail such behaviors, and (c) determine if curtailing such behaviors results in increased accuracy. [Principal ideas/results] We report on a preliminary study we undertook in which we modified the user interface of RETRO.NET to curtail two behaviors indicated by the earlier work. We report on observed results. [Contributions] We describe and discuss a major study of potentially unwanted analyst behaviors and present results of a preliminary study toward determining if curbing these behaviors with enhancements to tracing software leads to fewer human errors.
|Title of host publication||Requirements Engineering|
|Subtitle of host publication||Foundation for Software Quality - 24th International Working Conference, REFSQ 2018, Proceedings|
|Editors||Erik Kamsties, Jennifer Horkoff, Fabiano Dalpiaz|
|Number of pages||7|
|State||Published - 2018|
|Event||24th International Working Conference on Requirements Engineering Foundation for Software Quality, REFSQ 2018 - Utrecht, Netherlands|
Duration: Mar 19 2018 → Mar 22 2018
|Name||Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)|
|Conference||24th International Working Conference on Requirements Engineering Foundation for Software Quality, REFSQ 2018|
|Period||3/19/18 → 3/22/18|
Bibliographical noteFunding Information:
Acknowledgment. We thank Dr. Dan Berry for insightful comments and suggestions on prior versions that resulted in a greatly improved paper. We thank all participants from upper division software engineering classes who took their time to participate in our study. We thank NASA and NSF as prior grants funded the development of RETRO.NET. We thank Jody Larsen, the developer of RETRO.NET. We thank NSF for partially funding this work under grants CCF-1511117 and CNS-1642134.
© Springer International Publishing AG, part of Springer Nature 2018.
- Empirical study
- Requirements tracing
- Study of the analyst
- Trace vetting
- User interface
ASJC Scopus subject areas
- Theoretical Computer Science
- Computer Science (all)