Use of software triggers to evaluate software process effectiveness and capture customer usage profiles

Abstract

We have analyzed fault data comprising nearly 30,000 records (including in-process and field data) from two real products A and B over multiple releases, using orthogonal defect classification (ODC). We exploit the information captured by ODC triggers to evaluate the development activities, and identify specific actions for improvement in development. We illustrate the use of triggers to capture customer usage in a way directly meaningful to product development and show the complete trigger profiles by development activity for two releases of product A, and evaluate the effectiveness of product development activities, to target specific areas of improvement and assess the results. We show how systematically the appropriate trigger distribution during the development activities can be made to approach the trigger distribution in the field over six releases, as validated by /spl chi//sup 2/ tests. We discuss the field defect trigger distributions for product A over three releases, and demonstrate the consistency of the profile over multiple releases and discuss the origin of differences. We consider the field trigger profiles of products A and B and discuss the differences in their customer usage and environment.