Toward automating requirements satisfaction assessment

E. Ashlee Holbrook, Jane Huffman Hayes, Alex Dekhtyar

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

14 Scopus citations


This paper introduces the automation of satisfaction assessment: the process of determining the satisfaction mapping of natural language textual requirements to natural language design elements. Satisfaction assessment is useful because it assists in discovering unsatisfied requirements early in the lifecycle when such issues can be corrected with lower cost and impact than later. We define the basic terms and concepts for this process and explore the feasibility of developing baseline methods for its automation. This paper describes the satisfaction assessment approach algorithmically and then evaluates the effectiveness of two proposed information retrieval (IR) methods in two industrial studies - one based on a large dataset including a complete requirements specification and design specification for a NASA science instrument, and one based on a smaller dataset for an open source project management dataset. We found that both approaches have merit, and that the more sophisticated approach outperformed the simpler approach in terms of overall accuracy of the results.

Original languageEnglish
Title of host publication17th IEEE International Requirements Engineering Conference, RE2009
Number of pages10
StatePublished - 2009
Event17th IEEE International Requirements Engineering Conference, RE2009 - Atlanta, GA, United States
Duration: Aug 31 2009Sep 4 2009

Publication series

NameProceedings of the IEEE International Conference on Requirements Engineering
ISSN (Print)1090-705X


Conference17th IEEE International Requirements Engineering Conference, RE2009
Country/TerritoryUnited States
CityAtlanta, GA

ASJC Scopus subject areas

  • General Computer Science
  • General Engineering
  • Strategy and Management


Dive into the research topics of 'Toward automating requirements satisfaction assessment'. Together they form a unique fingerprint.

Cite this