Experience using web-based shotgun measures for large-system characterization and improvement

This article discusses our experience in using a World Wide Web-based shotgun measurement approach for mining and characterizing large software systems. The approach recognizes that measurement information is essentially management information, that different levels and functions of the organizational hierarchy require different information to make decisions, and that a measurement program is typically a discovery process about an organization's current modes of operations. What we found was the usefulness of a measurement program that also allows managers to dynamically formulate new goals and get answers to questions not specifically related to original goals but raised nonetheless by metric data. We describe three specific cases of decisions that were made using this approach and data collected from one large system and accessed using the company's intranet over the past two years.