The purpose of a ruggedness evaluation, or screening program, is to determine the sensitivity of the test method to changes in levels of pertinent operating factors using a small number of tests. Normally, operating conditions for a test method are defined along with allowable tolerances. A ruggedness analysis determines the effect of "worst-case" variation in operating conditions within the specified tolerances. If the ruggedness evaluation indicates high variation (poor precision), the method can be revised with smaller tolerances on operating conditions to improve the precision.

This practice evaluates the effects of seven factors using eight treatments. The disadvantage of this approach is that it only estimates the main effects of the factors and does not detect the effects of interactions among factors. For this reason, this is a screening program and additional investigation is required to investigate whether there are interaction effects.

A major reason for poor precision in test methods is the lack of adequate control over the sources of variation in testing procedures or testing environments. These sources of variation often are not controlled adequately because they were not identified during the development of the test procedures as having a large effect on the determinations. This practice provides a systematic procedure to establish the required degree of control for different testing parameters.

All new test methods must be subjected to an interlaboratory program to develop a precision and bias statement. These programs can be expensive and lengthy, and the result may show that the method is too variable and should not be published without further revision. Interlaboratory studies may give the subcommittee an indication that the method is too variable, but they do not usually give a clear picture of the causes of the variation. Application of this practice using one or two laboratories before finalizing the test method and conducting the interlaboratory study is an economical way to determine these causes.

Many existing test methods were developed before there was a requirement for precision and bias statements. Since this became a requirement, most of these test methods have developed precision and bias statements, and the result is that many have been found to suffer from relatively large amount of variation. This practice provides a relatively simple and economical way to investigate the causes of variation in test methods, so that a subcommittee will have some guidance as to which parts of the test method need to be revised.

The procedure can be used for a screening program within a single laboratory, but involvement of at least three laboratories is recommended, particularly if the single laboratory were to be the one that developed the test method. This is particularly important for new test methods. The originating laboratory is so much a part of the development of the test method that it is difficult for it to be objective in spotting any problems in the clarity of the test method directions. Two additional laboratories will probably contribute fresh critical review of the validity of the test method and provide assistance in clarifying the instructions of the test method when needed. This practice, however, is not intended to provide information on multilaboratory precision, but it does provide some information on single-operator precision, which could be used to develop a temporary repeatability statement until the interlaboratory study is completed.