The SEQTEST Procedure

Stochastic Curtailment

Lan, Simon, and Halperin (1982) introduce stochastic curtailment to stop a trial if, given current data, it is likely to predict the outcome of the trial with high probability. That is, a trial can be stopped to reject the null hypothesis $H_{0}$ if, given current data in the analyses, the conditional probability of rejecting $H_{0}$ under $H_{0}$ at the end of the trial is greater than $\gamma $, where the constant $\gamma $ should be between 0.5 and 1 and values of 0.8 or 0.9 are recommended (Jennison and Turnbull, 2000, p. 206). Similarly, a trial can be stopped to accept the null hypothesis $H_{0}$ if, given current data in the analyses, the conditional probability of rejecting $H_{0}$ under the alternative hypothesis $H_{1}$ at the end of the trial is less than $\gamma $.

The following two approaches for stochastic curtailment are available in the SEQTEST procedures: conditional power approach and predictive power approach. For each approach, the derived group sequential test is used as the reference test for rejection.

Conditional Power Approach

In the SEQTEST procedure, you can compute two types of conditional power as described in the following sections:

TYPE=ALLSTAGES

The default TYPE=ALLSTAGES suboption in the CONDPOWER and PLOT=CONDPOWER options computes the conditional power at an interim stage k as the total probability of rejecting the null hypothesis at all future stages given the observed statistic (Zhu, Ni, and Yao, 2011, pp. 131–132).

For a one-sided test with an upper alternative, the conditional power at an interim stage k is given by

\begin{eqnarray*}  p_{ku} ( \theta ) &  = &  P_{\theta }( z_{k+1} > a_{k+1} \,  | \,  z_{k}, \theta ) \\ &  + &  P_{\theta }( b_{k+1} \leq z_{k+1} < a_{k+1}, z_{k+2} > a_{k+2} \,  | \,  z_{k}, \theta ) \\ &  + &  \ldots \\ &  + &  P_{\theta }( b_{j} \leq z_{j} < a_{j}, j=k+1, \ldots , K-1, z_{K} > a_{K} \,  | \,  z_{k}, \theta ) \end{eqnarray*}

where $z_{k}$ is the observed statistic and $\theta $ is the hypothetical reference. The conditional power for a one-sided test with a lower alternative is similarly derived.

For a two-sided test, the conditional power for the upper alternative is given by

\begin{eqnarray*}  p_{ku} ( \theta ) &  = &  P_{\theta }( z_{k+1} > a_{k+1} \,  | \,  z_{k}, \theta ) \\ &  + &  P_{\theta }( \_ a_{k+1} < z_{k+1} \leq \_ b_{k+1} \;  \mr {or} \;  b_{k+1} \leq z_{k+1} < a_{k+1}, z_{k+2} > a_{k+2} \,  | \,  z_{k}, \theta ) \\ &  + &  \ldots \\ &  + &  _{\theta }( \_ a_{j} < z_{j} \leq \_ b_{j} \;  \mr {or} \;  b_{j} \leq z_{j} < a_{j}, j=k+1, \ldots , K-1, z_{K} > a_{K} \,  | \,  z_{k}, \theta ) \end{eqnarray*}

The conditional power for the lower alternative is similarly derived.

TYPE=FINALSTAGE

The TYPE=FINALSTAGE suboption in the CONDPOWER and PLOT=CONDPOWER options computes the conditional power at an interim stage k as the probability that the test statistic at the final stage (stage K) would exceed the rejection critical value given the observed statistic (Jennison and Turnbull, 2000, p. 207).

The conditional distribution of $Z_{K}$ given the observed statistic $z_{k}$ at the kth stage and the hypothetical reference $\theta $ is

\[  Z_{K} \,  | \,  (z_{k}, \theta ) \,  \sim \,  N \left( \,  z_{k} \, \,  \Pi ^{\frac{1}{2}}_{k} + \theta \, \,  I^{\frac{1}{2}}_{X} \,  (1 - \Pi _{k}) \,  , \,  1 - \Pi _{k} \right)  \]

where $\Pi _{k}= I_{k} / I_{X}$ is the fraction of information at the kth stage.

The power for the upper alternative, $\mr {prob} ( \,  Z_{K} > a_{K} \,  | \,  z_{k}, \theta )$, is then given by

\[  p_{ku} ( \theta ) = \Phi \left( (1-\Pi _{k})^{-\frac{1}{2}} \,  (z_{k} \,  {\Pi }^{\frac{1}{2}}_{k} - a_{K}) \,  + \,  \theta \,  I^{\frac{1}{2}}_{X} \,  (1-\Pi _{k})^{\frac{1}{2}} \right)  \]

where $\Phi $ is the cumulative distribution function of the standardized Z statistic and $a_{K}$ is the upper critical value at the final stage.

Similarly, the power for the lower alternative, $\mr {prob} ( Z_{K} < a_{\_ K} \,  | \,  z_{k}, \theta )$, is

\[  p_{kl} ( \theta ) = 1 - \Phi \left( (1-\Pi _{k})^{-\frac{1}{2}} \,  (z_{k} \,  {\Pi }^{\frac{1}{2}}_{k} - a_{\_ K}) \,  + \,  \theta \,  I^{\frac{1}{2}}_{X} \,  (1-\Pi _{k})^{\frac{1}{2}} \right)  \]

where $a_{\_ K}$ is the lower critical value at the final stage.

If $\theta = \hat{\theta }_{k} = z_{k} I^{-\frac{1}{2}}_{k}$, the maximum likelihood estimate at stage k, the powers for the upper and lower alternatives can be simplified:

\[  p_{ku} ( \theta ) = \Phi \left( (1-\Pi _{k})^{-\frac{1}{2}} \, \,  (z_{k} \,  {\Pi }^{-\frac{1}{2}}_{k} - a_{K} ) \right)  \]
\[  p_{kl} ( \theta ) = 1 - \Phi \left( (1-\Pi _{k})^{-\frac{1}{2}} \, \,  (z_{k} \,  {\Pi }^{-\frac{1}{2}}_{k} - a_{\_ K}) \right)  \]

If there exist interim stages between the kth stage and the final stage, $k < K-1$, the conditional power computed with TYPE=FINALSTAGE is not the conditional probability to reject the null hypothesis $H_{0}$. In this case, you can set the next stage as the final stage, and the conditional power is the conditional probability of rejecting $H_{0}$.

A special case of the conditional power is the futility index (Ware, Muller, and Braunwald, 1985). It is 1 minus the conditional power under $H_{1}: \theta = \theta _{1}$:

\[  1 - p_{ku} ( \theta _{1}) \, \, \,  \mr {or} \, \, \,  1 - p_{kl} ( \theta _{1})  \]

That is, it is the probability of accepting the null hypothesis under the alternative hypothesis given current data. A high futility index indicates a small probability of success (rejecting $H_{0}$) given the current data.

Predictive Power Approach

The conditional power depends on the specified reference $\theta $, which might be supported by the current data (Jennison and Turnbull, 2000, p. 210). An alternative is to use the predictive power (Herson, 1979), which is a weighted average of the conditional power over values of $\theta $. Without prior knowledge about $\theta $, then with $\hat{\theta } = z_{k} / \sqrt {I_{k}}$, the maximum likelihood estimate at stage k, the posterior distribution for $\theta $ (Jennison and Turnbull, 2000, p. 211) is

\[  \theta \, | \,  Z_{K} \sim N \left( \frac{z_{k}}{\sqrt {I_{k}}}, \, \,  \frac{1}{I_{k}} \right)  \]

Thus, the predictive power at stage k for the upper and lower alternatives can be derived as

\[  p_{ku} = 1 - \Phi \left( (1-\Pi _{k})^{-\frac{1}{2}} \, \,  (a_{K} \,  {\Pi }^{\frac{1}{2}}_{k} - z_{k}) \right)  \]
\[  p_{kl} = \Phi \left( (1-\Pi _{k})^{-\frac{1}{2}} \, \,  (a_{\_ K} \,  {\Pi }^{\frac{1}{2}}_{k} - z_{k}) \right)  \]

where $a_{K}$ and $a_{\_ K}$ are the upper and lower critical values at the final stage.