TY - GEN
T1 - An empirical comparison of the fault-detection capabilities of internal oracles
AU - Yu, Tingting
AU - Srisa-An, Witawas
AU - Rothermel, Gregg
PY - 2013
Y1 - 2013
N2 - Modern computer systems are prone to various classes of runtime faults due to their reliance on features such as concurrency and peripheral devices such as sensors. Testing remains a common method for uncovering faults in these systems, but many runtime faults are difficult to detect using typical testing oracles that monitor only program output. In this work we empirically investigate the use of internal test oracles: oracles that detect faults by monitoring aspects of internal program and system states. We compare these internal oracles to each other and to output-based oracles for relative effectiveness and examine tradeoffs between oracles involving incorrect reports about faults (false positives and false negatives). Our results reveal several implications that test engineers and researchers should consider when testing for runtime faults.
AB - Modern computer systems are prone to various classes of runtime faults due to their reliance on features such as concurrency and peripheral devices such as sensors. Testing remains a common method for uncovering faults in these systems, but many runtime faults are difficult to detect using typical testing oracles that monitor only program output. In this work we empirically investigate the use of internal test oracles: oracles that detect faults by monitoring aspects of internal program and system states. We compare these internal oracles to each other and to output-based oracles for relative effectiveness and examine tradeoffs between oracles involving incorrect reports about faults (false positives and false negatives). Our results reveal several implications that test engineers and researchers should consider when testing for runtime faults.
UR - http://www.scopus.com/inward/record.url?scp=84893289462&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84893289462&partnerID=8YFLogxK
U2 - 10.1109/ISSRE.2013.6698900
DO - 10.1109/ISSRE.2013.6698900
M3 - Conference contribution
AN - SCOPUS:84893289462
SN - 9781479923663
T3 - 2013 IEEE 24th International Symposium on Software Reliability Engineering, ISSRE 2013
SP - 11
EP - 20
BT - 2013 IEEE 24th International Symposium on Software Reliability Engineering, ISSRE 2013
T2 - 2013 IEEE 24th International Symposium on Software Reliability Engineering, ISSRE 2013
Y2 - 4 November 2013 through 7 November 2013
ER -