Recall the main-effects model fit to the Neuralgia data set in Example 54.2. The Treatment*Sex
interaction, which was previously shown to be nonsignificant, is added back into the model for this discussion.
In the following statements, the ODDSRATIO statement is specified to produce odds ratios of pairwise differences of the Treatment
parameters in the presence of the Sex
interaction. The LSMEANS statement is specified with several options: the E option displays the coefficients that are used to compute the LS-means for each Treatment
level, the DIFF option takes all pairwise differences of the LS-means for the levels of the Treatment
variable, the ODDSRATIO option computes odds ratios of these differences, the CL option produces confidence intervals for the differences and odds ratios, and the ADJUST=BON option performs a very conservative adjustment of the p-values and confidence intervals.
proc logistic data=Neuralgia; class Treatment Sex / param=glm; model Pain= Treatment|Sex Age; oddsratio Treatment; lsmeans Treatment / e diff oddsratio cl adjust=bon; run;
The results from the ODDSRATIO statement are displayed in Output 54.16.1. All pairwise differences of levels of the Treatment
effect are compared. However, because of the interaction between the Treatment
and Sex
variables, each difference is computed at each of the two levels of the Sex
variable. These results show that the difference between Treatment
levels A and B is insignificant for both genders.
To compute these odds ratios, you must first construct a linear combination of the parameters, , for each level that is compared with all other levels fixed at some value. For example, to compare Treatment
=A with B for Sex
=F, you fix the Age
variable at its mean, 70.05, and construct the following vectors:
Treatment |
Sex |
Treatment*Sex |
|||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Intercept |
A |
B |
P |
F |
M |
AF |
AM |
BF |
BM |
PF |
PM |
Age |
|||
|
1 |
1 |
0 |
0 |
1 |
0 |
1 |
0 |
0 |
0 |
0 |
0 |
70.05 |
||
|
1 |
0 |
1 |
0 |
1 |
0 |
0 |
0 |
1 |
0 |
0 |
0 |
70.05 |
||
|
0 |
1 |
–1 |
0 |
0 |
0 |
1 |
0 |
–1 |
0 |
0 |
0 |
0 |
Then the odds ratio for Treatment
A versus B at Sex
=F is computed as . Different vectors must be similarly constructed when Sex
=M because the resulting odds ratio will be different due to the interaction.
Output 54.16.1: Odds Ratios from the ODDSRATIO Statement
Odds Ratio Estimates and Wald Confidence Intervals | |||
---|---|---|---|
Label | Estimate | 95% Confidence Limits | |
Treatment A vs B at Sex=F | 0.398 | 0.016 | 9.722 |
Treatment A vs P at Sex=F | 16.892 | 1.269 | 224.838 |
Treatment B vs P at Sex=F | 42.492 | 2.276 | 793.254 |
Treatment A vs B at Sex=M | 0.663 | 0.078 | 5.623 |
Treatment A vs P at Sex=M | 34.766 | 1.807 | 668.724 |
Treatment B vs P at Sex=M | 52.458 | 2.258 | >999.999 |
The results from the LSMEANS statement are displayed in Output 54.16.2 through Output 54.16.4.
The LS-means are computed by constructing each of the coefficient vectors shown in Output 54.16.2, and then computing . The LS-means are not estimates of the event probabilities; they are estimates of the linear predictors on the logit scale.
In order to obtain event probabilities, you need to apply the inverse-link transformation by specifying the ILINK option in
the LSMEANS statement. Notice in Output 54.16.2 that the Sex rows do not indicate either Sex
=F or Sex
=M. Instead, the LS-means are computed at an average of these two levels, so only one result needs to be reported. For more
information about the construction of LS-means, see the section Construction of Least Squares Means of Chapter 42: The GLM Procedure.
Output 54.16.2: Treatment LS-Means Coefficients
Coefficients for Treatment Least Squares Means | |||||
---|---|---|---|---|---|
Parameter | Treatment | Sex | Row1 | Row2 | Row3 |
Intercept: Pain=No | 1 | 1 | 1 | ||
Treatment A | A | 1 | |||
Treatment B | B | 1 | |||
Treatment P | P | 1 | |||
Sex F | F | 0.5 | 0.5 | 0.5 | |
Sex M | M | 0.5 | 0.5 | 0.5 | |
Treatment A * Sex F | A | F | 0.5 | ||
Treatment A * Sex M | A | M | 0.5 | ||
Treatment B * Sex F | B | F | 0.5 | ||
Treatment B * Sex M | B | M | 0.5 | ||
Treatment P * Sex F | P | F | 0.5 | ||
Treatment P * Sex M | P | M | 0.5 | ||
Age | 70.05 | 70.05 | 70.05 |
The Treatment
LS-means shown in Output 54.16.3 are all significantly nonzero at the 0.05 level. These LS-means are predicted population margins of the logits; that is, they estimate the marginal means over a balanced population, and they are effectively the within-Treatment
means appropriately adjusted for the other effects in the model. The LS-means are not event probabilities; in order to obtain
event probabilities, you need to apply the inverse-link transformation by specifying the ILINK option in the LSMEANS statement. For more information about LS-means, see the section LSMEANS Statement of Chapter 19: Shared Concepts and Topics.
Output 54.16.3: Treatment LS-Means
Treatment Least Squares Means | |||||||
---|---|---|---|---|---|---|---|
Treatment | Estimate | Standard Error | z Value | Pr > |z| | Alpha | Lower | Upper |
A | 1.3195 | 0.6664 | 1.98 | 0.0477 | 0.05 | 0.01331 | 2.6257 |
B | 1.9864 | 0.7874 | 2.52 | 0.0116 | 0.05 | 0.4431 | 3.5297 |
P | -1.8682 | 0.7620 | -2.45 | 0.0142 | 0.05 | -3.3618 | -0.3747 |
Pairwise differences between the Treatment
LS-means, requested with the DIFF option, are displayed in Output 54.16.4. The LS-mean for the level that is displayed in the _Treatment column is subtracted from the LS-mean for the level in the
Treatment column, so the first row displays the LS-mean for Treatment
level A minus the LS-mean for Treatment
level B. The Pr > |z| column indicates that the A and B levels are not significantly different; however, both of these levels
are different from level P. If the inverse-link transformation is specified with the ILINK option, then these differences
do not transform back to differences in probabilities.
There are two odds ratios for Treatment
level A versus B in Output 54.16.1; these are constructed at each level of the interacting covariate Sex
. In contrast, there is only one LS-means odds ratio for Treatment
level A versus B in Output 54.16.4. This odds ratio is computed at an average of the interacting effects by creating the vectors shown in Output 54.16.2 (the Row1 column corresponds to and the Row2 column corresponds to ) and computing .
Since multiple tests are performed, you can protect yourself from falsely significant results by adjusting your p-values for multiplicity. The ADJUST=BON option performs the very conservative Bonferroni adjustment, and adds the columns labeled with 'Adj' to Output 54.16.4. Comparing the Pr > |z| column to the Adj P column, you can see that the p-values are adjusted upwards; in this case, there is no change in your conclusions. The confidence intervals are also adjusted for multiplicity—all adjusted intervals are wider than the unadjusted intervals, but again your conclusions in this example are unchanged.
Output 54.16.4: Differences and Odds Ratios for the Treatment LS-Means
Differences of Treatment Least Squares Means Adjustment for Multiple Comparisons: Bonferroni |
||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Treatment | _Treatment | Estimate | Standard Error | z Value | Pr > |z| | Adj P | Alpha | Lower | Upper | Adj Lower | Adj Upper | Odds Ratio | Lower Confidence Limit for Odds Ratio |
Upper Confidence Limit for Odds Ratio |
Adj Lower Odds Ratio |
Adj Upper Odds Ratio |
A | B | -0.6669 | 1.0026 | -0.67 | 0.5059 | 1.0000 | 0.05 | -2.6321 | 1.2982 | -3.0672 | 1.7334 | 0.513 | 0.072 | 3.663 | 0.047 | 5.660 |
A | P | 3.1877 | 1.0376 | 3.07 | 0.0021 | 0.0064 | 0.05 | 1.1541 | 5.2214 | 0.7037 | 5.6717 | 24.234 | 3.171 | 185.195 | 2.021 | 290.542 |
B | P | 3.8547 | 1.2126 | 3.18 | 0.0015 | 0.0044 | 0.05 | 1.4780 | 6.2313 | 0.9517 | 6.7576 | 47.213 | 4.384 | 508.441 | 2.590 | 860.612 |
If you want to jointly test whether the active treatments are different from the placebo, you can specify a custom hypothesis test with the LSMESTIMATE statement. In the following statements, the LS-means for the two treatments are contrasted against the LS-mean of the placebo, and the JOINT option performs a joint test that the two treatments are not different from placebo.
proc logistic data=Neuralgia; class Treatment Sex / param=glm; model Pain= Treatment|Sex Age; lsmestimate treatment 1 0 -1, 0 1 -1 / joint; run;
Output 54.16.5 displays the results from the LSMESTIMATE statement. The “Least Squares Means Estimate” table displays the differences of the two active treatments against the placebo, and the results are identical to the second and third rows of Output 54.16.3. The “Chi-Square Test for Least Squares Means Estimates” table displays the joint test. In all of these tests, you reject the null hypothesis that the treatment has the same effect as the placebo.
Output 54.16.5: Custom LS-Mean Tests
Least Squares Means Estimates | |||||
---|---|---|---|---|---|
Effect | Label | Estimate | Standard Error | z Value | Pr > |z| |
Treatment | Row 1 | 3.1877 | 1.0376 | 3.07 | 0.0021 |
Treatment | Row 2 | 3.8547 | 1.2126 | 3.18 | 0.0015 |
Chi-Square Test for Least Squares Means Estimates |
|||
---|---|---|---|
Effect | Num DF | Chi-Square | Pr > ChiSq |
Treatment | 2 | 12.13 | 0.0023 |
If you want to work with LS-means but you prefer to compute the Treatment
odds ratios within the Sex
levels in the same fashion as the ODDSRATIO statement does, you can specify the SLICE statement. In the following statements, you specify the same options in the SLICE statement as you do in the LSMEANS statement, except that you also specify the SLICEBY= option to perform an LS-means analysis partitioned into sets that are defined by the Sex
variable:
proc logistic data=Neuralgia; class Treatment Sex / param=glm; model Pain= Treatment|Sex Age; slice Treatment*Sex / sliceby=Sex diff oddsratio cl adjust=bon; run;
The results for Sex=F are displayed in Output 54.16.6 and Output 54.16.7. The joint test in Output 54.16.6 tests the equality of the LS-means of the levels of Treatment
for Sex=F, and rejects equality at level 0.05. In Output 54.16.7, the odds ratios and confidence intervals match those reported for Sex=F in Output 54.16.1, and multiplicity adjustments are performed.
Output 54.16.6: Joint Test of Treatment Equality for Females
Chi-Square Test for Treatment*Sex Least Squares Means Slice |
|||
---|---|---|---|
Slice | Num DF | Chi-Square | Pr > ChiSq |
Sex F | 2 | 8.22 | 0.0164 |
Output 54.16.7: Differences of the Treatment LS-Means for Females
Simple Differences of Treatment*Sex Least Squares Means Adjustment for Multiple Comparisons: Bonferroni |
|||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Slice | Treatment | _Treatment | Estimate | Standard Error | z Value | Pr > |z| | Adj P | Alpha | Lower | Upper | Adj Lower | Adj Upper | Odds Ratio | Lower Confidence Limit for Odds Ratio |
Upper Confidence Limit for Odds Ratio |
Adj Lower Odds Ratio |
Adj Upper Odds Ratio |
Sex F | A | B | -0.9224 | 1.6311 | -0.57 | 0.5717 | 1.0000 | 0.05 | -4.1193 | 2.2744 | -4.8272 | 2.9824 | 0.398 | 0.016 | 9.722 | 0.008 | 19.734 |
Sex F | A | P | 2.8269 | 1.3207 | 2.14 | 0.0323 | 0.0970 | 0.05 | 0.2384 | 5.4154 | -0.3348 | 5.9886 | 16.892 | 1.269 | 224.838 | 0.715 | 398.848 |
Sex F | B | P | 3.7493 | 1.4933 | 2.51 | 0.0120 | 0.0361 | 0.05 | 0.8225 | 6.6761 | 0.1744 | 7.3243 | 42.492 | 2.276 | 793.254 | 1.190 | >999.999 |
Similarly, the results for Sex=M are shown in Output 54.16.8 and Output 54.16.9.
Output 54.16.8: Joint Test of Treatment Equality for Males
Chi-Square Test for Treatment*Sex Least Squares Means Slice |
|||
---|---|---|---|
Slice | Num DF | Chi-Square | Pr > ChiSq |
Sex M | 2 | 6.64 | 0.0361 |
Output 54.16.9: Differences of the Treatment LS-Means for Males
Simple Differences of Treatment*Sex Least Squares Means Adjustment for Multiple Comparisons: Bonferroni |
|||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Slice | Treatment | _Treatment | Estimate | Standard Error | z Value | Pr > |z| | Adj P | Alpha | Lower | Upper | Adj Lower | Adj Upper | Odds Ratio | Lower Confidence Limit for Odds Ratio |
Upper Confidence Limit for Odds Ratio |
Adj Lower Odds Ratio |
Adj Upper Odds Ratio |
Sex M | A | B | -0.4114 | 1.0910 | -0.38 | 0.7061 | 1.0000 | 0.05 | -2.5496 | 1.7268 | -3.0231 | 2.2003 | 0.663 | 0.078 | 5.623 | 0.049 | 9.028 |
Sex M | A | P | 3.5486 | 1.5086 | 2.35 | 0.0187 | 0.0560 | 0.05 | 0.5919 | 6.5054 | -0.06286 | 7.1601 | 34.766 | 1.807 | 668.724 | 0.939 | >999.999 |
Sex M | B | P | 3.9600 | 1.6049 | 2.47 | 0.0136 | 0.0408 | 0.05 | 0.8145 | 7.1055 | 0.1180 | 7.8021 | 52.458 | 2.258 | >999.999 | 1.125 | >999.999 |