This example illustrates how you can use the standard errors and confidence intervals to understand the pattern of factor loadings under the maximum likelihood estimation. There are nine tests and you want a three-factor solution (N=3) for a correlation matrix based on 200 observations. The following statements define the input data set and specify the desirable analysis by the FACTOR procedure:
data test(type=corr); title 'Quartimin-Rotated Factor Solution with Standard Errors'; input _name_ $ test1-test9; _type_ = 'corr'; datalines; Test1 1 .561 .602 .290 .404 .328 .367 .179 -.268 Test2 .561 1 .743 .414 .526 .442 .523 .289 -.399 Test3 .602 .743 1 .286 .343 .361 .679 .456 -.532 Test4 .290 .414 .286 1 .677 .446 .412 .400 -.491 Test5 .404 .526 .343 .677 1 .584 .408 .299 -.466 Test6 .328 .442 .361 .446 .584 1 .333 .178 -.306 Test7 .367 .523 .679 .412 .408 .333 1 .711 -.760 Test8 .179 .289 .456 .400 .299 .178 .711 1 -.725 Test9 -.268 -.399 -.532 -.491 -.466 -.306 -.760 -.725 1 ;
title2 'A nine-variable-three-factor example'; proc factor data=test method=ml reorder rotate=quartimin nobs=200 n=3 se cover=.45 alpha=.1; run;
In the PROC FACTOR statement, you apply quartimin rotation with (default) Kaiser normalization. You define loadings with magnitudes greater than 0.45 to be salient (COVER= 0.45) and use 90% confidence intervals (ALPHA= 0.1) to judge the salience. The REORDER option is specified so that variables that have similar loadings with factors are clustered together.
After the quartimin rotation, the correlation matrix for factors is shown in Output 37.4.1.
Output 37.4.1: Quartimin-Rotated Factor Correlations with Standard Errors
Inter-Factor Correlations With 90% confidence limits Estimate/StdErr/LowerCL/UpperCL |
|||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Factor1 | Factor2 | Factor3 | |||||||||||||
Factor1 |
|
|
|
||||||||||||
Factor2 |
|
|
|
||||||||||||
Factor3 |
|
|
|
The factors are medium to highly correlated. The confidence intervals seem to be very wide, suggesting that the estimation
of factor correlations might not be very accurate for this sample size. For example, the 90% confidence interval for the correlation
between Factor1
and Factor2
is (0.30, 0.51), a range of 0.21. You might need a larger sample to get a narrower interval, or you might need a better estimation.
Next, coverage displays for factor loadings are shown in Output 37.4.2.
Output 37.4.2: Using the Rotated Factor Pattern to Interpret the Factors
Rotated Factor Pattern (Standardized Regression Coefficients) With 90% confidence limits; Cover |*| = 0.45? Estimate/StdErr/LowerCL/UpperCL/Coverage Display |
||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Factor1 | Factor2 | Factor3 | ||||||||||||||||
test8 |
|
|
|
|||||||||||||||
test7 |
|
|
|
|||||||||||||||
test9 |
|
|
|
|||||||||||||||
test3 |
|
|
|
|||||||||||||||
test2 |
|
|
|
|||||||||||||||
test1 |
|
|
|
|||||||||||||||
test5 |
|
|
|
|||||||||||||||
test4 |
|
|
|
|||||||||||||||
test6 |
|
|
|
The coverage displays in Output 37.4.2 show that Test8
, Test7
, and Test9
have salient relationships with Factor1
. The coverage displays are either ‘0*[ ]’ or ‘[ ]*0’, indicating that the entire 90% confidence intervals for the corresponding
loadings are beyond the salience value at 0.45. On the other hand, the coverage display for Test3
on Factor1
is ‘0[ ]*’. This indicates that even though the loading estimate is significantly larger than zero, it is not large enough
to be salient. Similarly, Test3
, Test2
, and Test1
have salient relationships with Factor2
, while Test5
and Test4
have salient relationships with Factor3
. For Test6
, its relationship with Factor3
is a little bit ambiguous; the 90% confidence interval approximately covers values between 0.40 and 0.64. This means that
the population value might have been smaller or larger than 0.45. It is marginal evidence for a salient relationship.
For oblique factor solutions, some researchers prefer to examine the factor structure loadings, which represent correlations, for determining salient relationships. In Output 37.4.3, the factor structure loadings and the associated standard error estimates and coverage displays are shown.
Output 37.4.3: Using the Factor Structure to Interpret the Factors
Factor Structure (Correlations) With 90% confidence limits; Cover |*| = 0.45? Estimate/StdErr/LowerCL/UpperCL/Coverage Display |
||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Factor1 | Factor2 | Factor3 | ||||||||||||||||
test8 |
|
|
|
|||||||||||||||
test7 |
|
|
|
|||||||||||||||
test9 |
|
|
|
|||||||||||||||
test3 |
|
|
|
|||||||||||||||
test2 |
|
|
|
|||||||||||||||
test1 |
|
|
|
|||||||||||||||
test5 |
|
|
|
|||||||||||||||
test4 |
|
|
|
|||||||||||||||
test6 |
|
|
|
The interpretations based on the factor structure matrix do not change much from that based on the factor loadings except
for Test3
and Test9
. Test9
now has a salient correlation with Factor3
. For Test3
, it has salient correlations with both Factor1
and Factor2
. Fortunately, there are still tests that have salient correlations only with either Factor1
or Factor2
(but not both). This would make interpretations of factors less problematic.