If you specify the CL option in the TABLES statement, PROC SURVEYFREQ computes confidence limits for the proportions in the frequency and crosstabulation tables.
By default, PROC SURVEYFREQ computes Wald ("linear") confidence limits if you do not specify an alternative confidence limit type with the CL(TYPE=) option. In addition to Wald confidence limits, the following types of design-based confidence limits are available for proportions: modified Clopper-Pearson (exact), modified Wilson (score), and logit confidence limits.
PROC SURVEYFREQ also provides the CL(PSMALL) option, which uses the alternative confidence limit type for extreme (small or large) proportions and uses the Wald confidence limits for all other proportions (not extreme). For the default PSMALL= value of 0.25, the procedure computes Wald confidence limits for proportions between 0.25 and 0.75 and computes the alternative confidence limit type for proportions that are outside of this range. For more information, see Curtin et al. (2006).
For information about design-based confidence limits for proportions (including comparisons of their performance), see Korn and Graubard (1999), Korn and Graubard (1998), Curtin et al. (2006), and Sukasih and Jang (2005). For more information about binomial confidence limits, see Brown, Cai, and DasGupta (2001) and Agresti and Coull (1998), in addition to the references cited in the following sections.
For each table request, PROC SURVEYFREQ produces a nondisplayed ODS table, "Table Summary," which contains the number of observations, strata, and clusters that are included in the analysis of the requested table. When you request confidence limits, the "Table Summary" data set also contains the degrees of freedom df and the value of that is used to compute the confidence limits. For more information about this output data set, see Example 97.3.
PROC SURVEYFREQ computes standard Wald ("linear") confidence limits for proportions by default. These confidence limits use the variance estimates that are based on the sample design. For the proportion in table cell (r, c), the Wald confidence limits are computed as
where is the estimate of the proportion in table cell (r, c), is the standard error of the estimate, and is the percentile of the t distribution with df degrees of freedom. (For more information, see the section Degrees of Freedom.) The confidence level is determined by the value of the ALPHA= option; by default, ALPHA=0.05, which produces 95% confidence limits.
The confidence limits for row proportions and column proportions are computed similarly to the confidence limits for table cell proportions.
PROC SURVEYFREQ uses the modification described in Korn and Graubard (1998) to compute design-based Clopper-Pearson (exact) and Wilson (score) confidence limits. This modification substitutes the degrees-of-freedom adjusted effective sample size for the original sample size in the confidence limit computations.
The effective sample size is computed as
where n is the original sample size (unweighted frequency) that corresponds to the total domain of the proportion estimate, and is the design effect.
If the proportion is computed for a table cell of a two-way table, then the domain is the two-way table, and the sample size n is the frequency of the two-way table. If the proportion is a row proportion, which is based on a two-way table row, then the domain is the row, and the sample size n is the frequency of the row.
The design effect for an estimate is the ratio of the actual variance (estimated based on the sample design) to the variance of a simple random sample with the same number of observations. For more information, see the section Design Effect.
If you do not specify the CL(ADJUST=NO) option, the procedure applies a degrees-of-freedom adjustment to the effective sample size to compute the modified sample size. If you specify CL(ADJUST=NO), the procedure does not apply the adjustment and uses the effective sample size in the confidence limit computations.
The modified sample size is computed by applying a degrees-of-freedom adjustment to the effective sample size as
where df is the degrees of freedom and is the percentile of the t distribution with df degrees of freedom. The degrees of freedom computation depends on the sample design and the variance estimation method. For more information, see the section Degrees of Freedom. The confidence level is determined by the value of the ALPHA= option; by default, ALPHA=0.05, which produces 95% confidence limits.
The design effect is usually greater than 1 for complex survey designs, and in that case the effective sample size is less than the actual sample size. If the adjusted effective sample size is greater than the actual sample size n, the procedure truncates the value of to n, as recommended by Korn and Graubard (1998). If you specify the CL(TRUNCATE=NO) option, the procedure does not truncate the value of .
Clopper-Pearson (exact) confidence limits for the binomial proportion are constructed by inverting the equal-tailed test based on the binomial distribution. This method is attributed to Clopper and Pearson (1934). For a derivation of the F distribution expression for the confidence limits, see Leemis and Trivedi (1996).
PROC SURVEYFREQ computes modified Clopper-Pearson confidence limits according to the approach of Korn and Graubard (1998). The degrees-of-freedom adjusted effective sample size is substituted for the sample size in the Clopper-Pearson computation, and the adjusted effective sample size times the proportion estimate is substituted for the number of positive responses. (Or if you specify the CL(ADJUST=NO) option, the procedure uses the unadjusted effective sample size instead of .)
The modified Clopper-Pearson confidence limits for a proportion ( and ) are computed as
where is the percentile of the F distribution with b and c degrees of freedom, is the adjusted effective sample size, and is the proportion estimate.
Wilson confidence limits for the binomial proportion are also known as score confidence limits and are attributed to Wilson (1927). The confidence limits are based on inverting the normal test that uses the null proportion in the variance (the score test). For more information, see Newcombe (1998) and Korn and Graubard (1999).
PROC SURVEYFREQ computes modified Wilson confidence limits by substituting the degrees-of-freedom adjusted effective sample size for the original sample size in the standard Wilson computation. (Or if you specify the CL(ADJUST=NO) option, the procedure substitutes the unadjusted effective sample size .)
The modified Wilson confidence limits for a proportion are computed as
where is the adjusted effective sample size and is the estimate of the proportion. With the degrees-of-freedom adjusted effective sample size , the computation uses . With the unadjusted effective sample size, which you request with the ADJUST=NO option, the computation uses . For more information, see Curtin et al. (2006).
If you specify the CL(TYPE=LOGIT) option, PROC SURVEYFREQ computes logit confidence limits for proportions. For more information, see Agresti (2013) and Korn and Graubard (1998).
Logit confidence limits for proportions are based on the logit transformation . The logit confidence limits and are computed as
where
where is the estimate of the proportion, is the standard error of the estimate, and is the percentile of the t distribution with df degrees of freedom. (For more information, see the section Degrees of Freedom.) The confidence level is determined by the value of the ALPHA= option; by default, ALPHA=0.05, which produces 95% confidence limits.