The SEVERITY Procedure

Estimating Regression Effects

Parameter Initialization for Regression Models
Reporting Estimates of Regression Parameters
CDF and PDF Estimates with Regression Effects

The SEVERITY procedure enables you to estimate the effects of regressor (exogenous) variables while fitting a distribution if the distribution has a scale parameter or a log-transformed scale parameter.

Let ( $j = 1, \dotsc , k$ ) denote the regressor variables. Let $\beta _ j$ denote the regression parameter that corresponds to the regressor . If regression effects are not specified, then the model for the response variable is of the form

$Y \sim \mathcal{F}(\Theta )$

where $\mathcal{F}$ is the distribution of with parameters $\Theta$ . This model is typically referred to as the error model. The regression effects are modeled by extending the error model to the following form:

$Y \sim \exp (\sum _{j=1}^{k} \beta _ j x_ j) \cdot \mathcal{F}(\Theta )$

Under this model, the distribution of is valid and belongs to the same parametric family as $\mathcal{F}$ if and only if $\mathcal{F}$ has a scale parameter. Let $\theta$ denote the scale parameter and $\Omega$ denote the set of nonscale distribution parameters of $\mathcal{F}$ . Then the model can be rewritten as

$Y \sim \mathcal{F}(\theta , \Omega )$

such that $\theta$ is affected by the regressors as

$\theta = \theta _0 \cdot \exp (\sum _{j=1}^{k} \beta _ j x_ j)$

where $\theta _0$ is the base value of the scale parameter. Thus, the regression model consists of the following parameters: $\theta _0$ , $\Omega$ , and $\beta _ j (j=1, \dotsc , k)$ .

Given this form of the model, distributions without a scale parameter cannot be considered when regression effects are to be modeled. If a distribution does not have a direct scale parameter, then PROC SEVERITY accepts it only if it has a log-transformed scale parameter — that is, if it has a parameter $p = \log (\theta )$ .

Parameter Initialization for Regression Models

The regression parameters are initialized either by using the values you specify or by the default method.

If you provide initial values for the regression parameters, then you must provide valid, nonmissing initial values for $\theta _0$ and $\beta _ j$ parameters for all .

You can specify the initial value for $\theta _0$ using either the INEST= data set or the INIT= option in the DIST statement. If the distribution has a direct scale parameter (no transformation), then the initial value for the first parameter of the distribution is used as an initial value for $\theta _0$ . If the distribution has a log-transformed scale parameter, then the initial value for the first parameter of the distribution is used as an initial value for $\log (\theta _0)$ .

You can use only the INEST= data set to specify the initial values for $\beta _ j$ . The INEST= data set must contain nonmissing initial values for all the regressors specified in the SCALEMODEL statement. The only missing value allowed is the special missing value .R, which indicates that the regressor is linearly dependent on other regressors. If you specify .R for a regressor for one distribution in a BY group, you must specify it so for all the distributions in that BY group.

If you do not specify valid initial values for $\theta _0$ or $\beta _ j$ parameters for all , then PROC SEVERITY initializes those parameters using the following method:

Let a random variable be distributed as $\mathcal{F}(\theta , \Omega )$ , where $\theta$ is the scale parameter. By definition of the scale parameter, a random variable $W = Y/\theta$ is distributed as $\mathcal{G}(\Omega )$ such that $\mathcal{G}(\Omega ) = \mathcal{F}(1, \Omega )$ . Given a random error term that is generated from a distribution $\mathcal{G}(\Omega )$ , a value from the distribution of can be generated as

$y = \theta \cdot e$

Taking the logarithm of both sides and using the relationship of $\theta$ with the regressors yields:

$\log (y) = \log (\theta _0) + \sum _{j=1}^{k} \beta _ j x_ j + \log (e)$

PROC SEVERITY makes use of the preceding relationship to initialize parameters of a regression model with distribution dist as follows:

The following linear regression problem is solved to obtain initial estimates of $\beta _0$ and $\beta _ j$ :

$\log (y) = \beta _0 + \sum _{j=1}^{k} \beta _ j x_ j$

The estimates of $\beta _ j (j=1, \dotsc , k)$ in the solution of this regression problem are used to initialize the respective regression parameters of the model. The estimate of $\beta _0$ is later used to initialize the value of $\theta _0$ .

The results of this regression are also used to detect whether any regressors are linearly dependent on the other regressors. If any such regressors are found, then a warning is written to the SAS log and the corresponding regressor is eliminated from further analysis. The estimates for linearly dependent regressors are denoted by a special missing value of .R in the OUTEST= data set and in any displayed output.

Let denote the initial value of the scale parameter.

If the distribution model of dist does not contain the dist_PARMINIT subroutine, then and all the nonscale distribution parameters are initialized to the default value of 0.001.

However, it is strongly recommended that each distribution’s model contain the dist_PARMINIT subroutine. See the section Defining a Distribution Model with the FCMP Procedure for more information. If that subroutine is defined, then is initialized as follows:

Each input value of the response variable is transformed to its scale-normalized version as

$w_ i = \frac{y_ i}{\exp (\beta _0 + \sum _{j=1}^{k} \beta _ j x_{ij})}$

where $x_{ij}$ denotes the value of th regressor in the th input observation. These values are used to compute the input arguments for the dist_PARMINIT subroutine. The values that are computed by the subroutine for nonscale parameters are used as their respective initial values. If the distribution has an untransformed scale parameter, then is set to the value of the scale parameter that is computed by the subroutine. If the distribution has a log-transformed scale parameter , then is computed as $s_0 = \exp (l_0)$ , where is the value of computed by the subroutine.

The value of $\theta _0$ is initialized as

$\theta _0 = s_0 \cdot \exp (\beta _0)$

Reporting Estimates of Regression Parameters

When you request estimates to be written to the output (either ODS displayed output or in the OUTEST= data set), the estimate of the base value of the first distribution parameter is reported. If the first parameter is the log-transformed scale parameter, then the estimate of $\log (\theta _0)$ is reported; otherwise, the estimate of $\theta _0$ is reported. The transform of the first parameter of a distribution dist is controlled by the dist_SCALETRANSFORM function that is defined for it.

CDF and PDF Estimates with Regression Effects

When regression effects are estimated, the estimate of the scale parameter depends on the values of the regressors and the estimates of the regression parameters. This dependency results in a potentially different distribution for each observation. To make estimates of the cumulative distribution function (CDF) and probability density function (PDF) comparable across distributions and comparable to the empirical distribution function (EDF), PROC SEVERITY reports the CDF and PDF estimates from a representative distribution. The representative distribution is a mixture of a certain number of distributions, where each distribution differs only in the value of the scale parameter. You can specify the number of distributions in the mixture and how their scale values are chosen by using the DFMIXTURE= option in the SCALEMODEL statement.

Let denote the number of observations used for estimation, denote the number of components in the mixture distribution, denote the scale parameter of the th mixture component, and denote the weight associated with th mixture component.

Let $f(y; s_ k,\hat{\Omega })$ and $F(y; s_ k,\hat{\Omega })$ denote the PDF and CDF, respectively, of the th component distribution, where $\hat{\Omega }$ denotes the set of estimates of all parameters of the distribution other than the scale parameter. Then, the PDF and CDF estimates, $f^{*}(y)$ and $F^{*}(y)$ , respectively, of the mixture distribution at are computed as follows:

$\displaystyle f^{*}(y)$	$\displaystyle = \frac{1}{D} \sum _{k=1}^{K} d_ k f(y; s_ k, \hat{\Omega })$
$\displaystyle F^{*}(y)$	$\displaystyle = \frac{1}{D} \sum _{k=1}^{K} d_ k F(y; s_ k, \hat{\Omega })$

where is the normalization factor ( $D = \sum _{k=1}^{K} d_ k$ ).

The CDF estimates reported in OUTCDF= data set, plotted in CDF plots, and used for computing the EDF-based statistics of fit are the $F^{*}(y)$ values. The PDF estimates plotted in PDF plots are the $f^{*}(y)$ values.

The scale values for the mixture components are derived from the set $\{ \hat{\theta }_ i\}$ ( $i=1 \ldots N$ ) of scale values, where $\hat{\theta }_ i$ denotes the estimate of the scale parameter due to observation . It is computed as

$\hat{\theta }_ i = \hat{\theta }_0 \cdot \exp (\sum _{j=1}^{k} \hat{\beta }_ j x_{ij})$

where $\hat{\theta }_0$ is an estimate of the base value of the scale parameter, $\hat{\beta }_ j$ are the estimates of regression coefficients, and $x_{ij}$ is the value of regressor in observation .

Let denote the weight of observation . If the WEIGHT statement is specified, then it is equal to the value of the specified weight variable for the corresponding observation in the DATA= data set; otherwise, it is set to 1.

You can specify one of the following method-names in the DFMIXTURE= option in the SCALEMODEL statement to specify the method of choosing and the corresponding and values:

FULL

In this method, there are as many mixture components as the number of observations that are used for estimation. In other words, , $s_ k = \hat{\theta }_ k$ , and ( $k=1 \ldots N$ ). This is the slowest method, because it requires computations to compute the mixture CDF $F^{*}(y_ i)$ or the mixture PDF $f^{*}(y_ i)$ of one observation. For observations, the computational complexity in terms of number of PDF or CDF evaluations is . Even for moderately large values of , the time taken to compute the mixture CDF and PDF can significantly exceed the time taken to estimate the model parameters. So, it is recommended that you use this method only for small data sets.

MEAN

In this method, the mixture contains only one distribution, whose scale value is the mean of the scale values that are implied by all the observations. In other words, is computed as

$s_1 = \frac{1}{W} \sum _{i=1}^{N} w_ i \hat{\theta }_ i$

where is the total weight ( $W = \sum _{i=1}^{N} w_ i$ ).

This method is the fastest because it requires only one CDF or PDF evaluation per observation. The computational complexity is for observations.

If you do not specify the DFMIXTURE= option in the SCALEMODEL statement, then this is the default method.

QUANTILE

In this method, a certain number of quantiles are chosen from the set of all scale values. If you specify a value of $\Argument{q}$ for the K= option when specifying this method, then $K=\Argument{q}-1$ and are set to be the $(\Argument{q}-1)$ $\Argument{q}$ -quantiles from the set $\{ \hat{\theta }_ i\}$ ( $i=1 \ldots N$ ). The weight of each of the components () is assumed to be 1 for this method.

The default value of $\Argument{q}$ is 2, which implies a one-point mixture with a distribution whose scale value is equal to the median scale value.

For this method, PROC SEVERITY needs to sort the scale values in the set $\{ \hat{\theta }_ i\}$ , which requires $O(N \log (N))$ computations. Then, computing mixture estimate of one observation requires $(\Argument{q}-1)$ CDF or PDF evaluations. Hence, the computational complexity of this method is $O(qN)+O(N \log (N))$ for computing a mixture PDF or CDF of observations. For $\Argument{q} << N$ , it is significantly faster than the FULL method.

RANDOM

In this method, a uniform random sample of observations is chosen and the mixture contains the distributions that are implied by those observations. If you specify a value of $\Argument{r}$ for the K= option when specifying this method, then the size of the sample is $\Argument{r}$ . Hence, $K=\Argument{r}$ . If denotes the index of th observation in the sample ( $j=1 \ldots \Argument{r}$ ), such that $1 \le l_ j \le N$ , then the scale of th component distribution in the mixture is $s_ k = \hat{\theta }_{l_ k}$ and the weight associated with it is $d_ k = w_{l_ k}$ .

You can also specify the seed to be used for generating the random sample by using the SEED= option for this method. The same sample of observations is used for all models.

Computing a mixture estimate of one observation requires $\Argument{r}$ CDF or PDF evaluations. Hence, the computational complexity of this method is $O(\Argument{r}N)$ for computing a mixture PDF or CDF of observations. For $\Argument{r} << N$ , it is significantly faster than the FULL method.