When control limits are computed from the input data, four methods are available for estimating the process standard deviation . Three methods (referred to as the default, MVLUE, and RMSDF) are available with subgrouped data. A fourth method is used if the data are individual measurements (see Default Method for Individual Measurements).
This method is the default for moving average charts using subgrouped data. The default estimate of is
where N is the number of subgroups for which , is the sample standard deviation of the ith subgroup
and
Here denotes the gamma function, and denotes the ith subgroup mean. A subgroup standard deviation is included in the calculation only if . If the observations are normally distributed, then the expected value of is . Thus, is the unweighted average of N unbiased estimates of . This method is described in the American Society for Testing and Materials (1976).
If you specify SMETHOD=MVLUE, a minimum variance linear unbiased estimate (MVLUE) is computed for . Refer to Burr (1969, 1976) and Nelson (1989, 1994). The MVLUE is a weighted average of N unbiased estimates of of the form , and it is computed as
where
A subgroup standard deviation is included in the calculation only if , and N is the number of subgroups for which . The MVLUE assigns greater weight to estimates of from subgroups with larger sample sizes, and it is intended for situations where the subgroup sample sizes vary. If the subgroup sample sizes are constant, the MVLUE reduces to the default estimate.
If you specify SMETHOD=RMSDF, a weighted root-mean-square estimate is computed for as follows:
where . The weights are the degrees of freedom . A subgroup standard deviation is included in the calculation only if , and N is the number of subgroups for which .
If the unknown standard deviation is constant across subgroups, the root-mean-square estimate is more efficient than the minimum variance linear unbiased estimate. However, in process control applications it is generally not assumed that is constant, and if varies across subgroups, the root-mean-square estimate tends to be more inflated than the MVLUE.
When each subgroup sample contains a single observation (), the process standard deviation is estimated as
where N is the number of observations, and are the individual measurements. This formula is given by Wetherill (1977), who states that the estimate of the variance is biased if the measurements are autocorrelated.