Highly Fractional Factorial Designs

Reliability analysis is commonly thought of as an approach to model failures of existing products. The usual reliability analysis involves characterization of failures of the products using distributions such as exponential, Weibull and lognormal. Based on the fitted distribution, failures are mitigated, or warranty returns are predicted, or maintenance actions are planned. However, reliability analysis can also be used as a powerful tool to design robust products that operate with minimal failures, by adopting the methodology of Design for Reliability (DFR). In DFR, reliability analysis is carried out in conjunction with physics of failure and experiment design techniques. Under this approach, Design of Experiments (DOE) uses life data to "build" reliability into the products, not just quantify the existing reliability. Such an approach, if properly implemented, can result in significant cost savings, especially in terms of fewer warranty returns or repair and maintenance actions. Although DOE techniques can be used to improve product reliability and also make this reliability robust to noise factors, the discussion in this chapter is focused on reliability improvement.

Reliability DOE Analysis

Reliability DOE (R-DOE) analysis is fairly similar to the analysis of other designed experiments except that the response is the life of the product in the respective units (e.g., for an automobile component the units of life may be miles, for a mechanical component this may be cycles, and for a pharmaceutical product this may be months or years). However, two important differences exist that make R-DOE analysis unique. The first is that the life data of most products are typically well modeled by either the lognormal, Weibull or exponential distribution, but usually do not follow the normal distribution. Traditional DOE techniques follow the assumption that response values at any treatment level follow the normal distribution and therefore, the error terms, $ϵ$, can be assumed to be normally and independently distributed. This assumption may not be valid for the response data used in most of the R-DOE analyses. Further, the life data obtained may either be complete or censored, and in this case standard regression techniques applicable to the response data in traditional DOEs can no longer be used.

Stresses affecting the life of the product may also be investigated using R-DOE analysis. In this case, the primary purpose of any R-DOE analysis is to identify which of the investigated stresses affect the life of the product (by investigating if a change in the level of any stress leads to a significant change in the life of the product). Once the important stresses affecting the life of the product have been identified, detailed analyses can be carried out using ReliaSoft's ALTA software. ALTA includes a number of life-stress relationships (LSRs) to model the relation between life and the stress affecting the life of the product.

R-DOE Analysis of Lognormally Distributed Data

Assume that the life, $T$, for a certain product has been found to be lognormally distributed. The probability density function for the lognormal distribution is:

$f(T)=\frac{1}{T{\sigma }^{\prime }\sqrt{2\pi }}{e}^{-\frac{1}{2}{\left(\frac{\ln (T)-{\mu }^{\prime }}{{\sigma }^{\prime }}\right)}^2}$

where ${\mu }^{\prime }$ represents the mean of the natural logarithm of the times-to-failure and ${\sigma }^{\prime }$ represents the standard deviation of the natural logarithms of the times-to-failure [Life Data Analysis Reference]. If the analyst wants to investigate a single two level factor that may affect the life, $T$, then the following model may be used:

$T_i={\mu }_i+{\xi }_i$

where:

• $T_i$ represents the times-to-failure at the $i$th treatment level of the factor
• ${\mu }_i$ represents the mean value of $T_i$ for the $i$th treatment
• ${\xi }_i$ is the random error term
• The subscript $i$ represents the treatment level of the factor with $i=1,2$ for a two level factor

The model of the equation given above is analogous to the ANOVA model, $Y_i={\mu }_i+{ϵ}_i$, used in Two Level Factorial Experiments for traditional DOE analyses. Note, however, that the random error term, ${\xi }_i$, is not normally distributed here because the response, $T$, is lognormally distributed. It is known that the logarithmic value of a lognormally distributed random variable follows the normal distribution. Therefore, if the logarithmic transformation of $T$, $ln(T)$, is used, the model will be identical to the ANOVA model, $Y_i={\mu }_i+{ϵ}_i$, used in two level factorial experiments. Thus, using the logarithmic failure times, the model can be written as:

$\ln (T_i)={\mu }_i^{\prime }+{ϵ}_i$

where:

• $\ln (T_i)$ represents the logarithmic times-to-failure at the $i$th treatment
• ${\mu }_i^{\prime }$ represents the mean of the natural logarithm of the times-to-failure at the $i$th treatment
• ${\sigma }^{\prime }$ represents the standard deviation of the natural logarithms of the times-to-failure

The random error term, ${ϵ}_i$, is normally distributed because the response, $\ln (T_i)$, is normally distributed. Since the model of the equation given above is identical to the ANOVA model used in traditional DOE analysis, regression techniques can be applied here and the R-DOE analysis can be carried out similar to the traditional DOE analyses. Recall from Two Level factorial Experiments that if the factor(s) affecting the response has only two levels, then the notation of the regression model can be applied to the ANOVA model. Therefore, the model of can be written using a single indicator variable, $x_1$, to represent the two level factor as:

$\ln (T_i)={\beta }_0+{\beta }_1{x}_{i1}+{ϵ}_i$

where ${\beta }_0$ is the intercept term and ${\beta }_1$ is the effect coefficient for the investigated factor. Setting the two equations given above equal to each other returns:

${\mu }_i^{\prime }={\beta }_0+{\beta }_1{x}_{i1}$

The natural logarithm of the times-to-failure at any factor level, ${\mu }_i^{\prime }$, is referred to as the life characteristic because it represents a characteristic point of the underlying life distribution. The life characteristic used in the R-DOE analysis will change based on the underlying distribution assumed for the life data. If the analyst wants to investigate the effect of two factors (each at two levels) on the life of the product, then the life characteristic equation can be easily expanded as follows:

${\mu }_i^{\prime }={\beta }_0+{\beta }_1{x}_{i1}+{\beta }_2{x}_{i2}$

where ${\beta }_2$ is the effect coefficient for the second factor and $x_2$ is the indicator variable representing the second factor. If the interaction effect is also to be investigated, then the following equation can be used:

${\mu }_i^{\prime }={\beta }_0+{\beta }_1{x}_{i1}+{\beta }_2{x}_{i2}+{\beta }_{12}{x}_{i1}{x}_{i2}$

In general the model to investigate a given number of factors can be expressed as:

${\mu }_i^{\prime }={\beta }_0+{\beta }_1{x}_{i1}+{\beta }_2{x}_{i2}+{\beta }_{12}{x}_{i1}{x}_{i2}+...$

Based on the model equations mentioned thus far, the analyst can easily conduct an R-DOE analysis for the lognormally distributed life data using standard regression techniques. However this is no longer true once the data also includes censored observations. In the case of censored data, the analysis has to be carried out using maximum likelihood estimation (MLE) techniques.

Maximum Likelihood Estimation for the Lognormal Distribution

The maximum likelihood estimation method can be used to estimate parameters in R-DOE analyses when censored data are present. The likelihood function is calculated for each observed time-to-failure, $t_i$, and the parameters of the model are obtained by maximizing the log-likelihood function. The likelihood function for complete data following the lognormal distribution is given as:

$\begin{array}{rl}{L}_{failures}=& \underset{i=1}{\prod ^{F_e}}f(t_i,{\mu }_i^{\prime })\\ =& \underset{i=1}{\prod ^{F_e}}\left[\frac{1}{t_i{\sigma }^{\prime }\sqrt{2\pi }}{e}^{-\frac{1}{2}{\left(\frac{\ln (t_i)-{\mu }_i^{\prime }}{{\sigma }^{\prime }}\right)}^2}\right]\\ =& \underset{i=1}{\prod ^{F_e}}\left[\frac{1}{t_i{\sigma }^{\prime }\sqrt{2\pi }}{e}^{-\frac{1}{2}{\left(\frac{\ln (t_i)-({\beta }_0+{\beta }_1{x}_{i1}+{\beta }_2{x}_{i2}+...)}{{\sigma }^{\prime }}\right)}^2}\right]\end{array}$

where:

• $F_e$ is the total number of observed times-to-failure
• ${\mu }_i^{\prime }$ is the life characteristic and has been substituted based on the model used to investigate a given number of factors
• $t_i$ is the time of the $i$th failure

For right censored data, the likelihood function is [Life Data Analysis Reference]:

$L_{suspensions}=\underset{i=1}{\prod ^{S_e}}[1-\frac{1}{\sqrt{2\pi }}\underset{-\mathrm{\infty }}{\overset{\left(\frac{\ln (t_i)-{\mu }_i^{\prime }}{{\sigma }^{\prime }}\right)}{}}{e}^{-\frac{g^2}{2}}dg]$

where:

• $S_e$ is the total number of observed suspensions
• $t_i$ is the time of $i$th suspension

For interval data, the likelihood function is [Life Data Analysis Reference]:

$L_{interval}=\underset{i=11}{\prod ^{FI}}[\frac{1}{\sqrt{2\pi }}\underset{-\mathrm{\infty }}{\overset{\left(\frac{\ln (t_i^2)-{\mu }_i^{\prime }}{{\sigma }^{\prime }}\right)}{}}{e}^{-\frac{g^2}{2}}dg-\frac{1}{\sqrt{2\pi }}\underset{-\mathrm{\infty }}{\overset{\left(\frac{\ln (t_i^1)-{\mu }_i^{\prime }}{{\sigma }^{\prime }}\right)}{}}{e}^{-\frac{g^2}{2}}dg]$:

where:

• $FI$ is the total number of interval data
• $t_i^1$ is the beginning time of the $i$th interval
• and $t_i^2$ is the end time of the $i$th interval

When all types of data (complete, right censored and interval) are present, the complete likelihood function is:

$L({\sigma }^{\prime },{\beta }_0,{\beta }_1...)=L_{failures}\cdot L_{suspensions}\cdot L_{interval}$

Then the log-likelihood function is:

$\mathrm{\Lambda }({\sigma }^{\prime },{\beta }_0,{\beta }_1...)=\ln (L)$

The MLE estimates are obtained by solving for parameters $({\sigma }^{\prime },{\beta }_0,{\beta }_1...)$ so that:

$\begin{array}{rl}\frac{\partial \mathrm{\Lambda }}{\partial {\sigma }^{\prime }}=& 0\\ \frac{\partial \mathrm{\Lambda }}{\partial {\beta }_0}=& 0\\ \frac{\partial \mathrm{\Lambda }}{\partial {\beta }_1}=& 0\\ & ...\end{array}$

Once the estimates are obtained, the significance of any parameter, ${\theta }_i$, can be assessed using the likelihood ratio test.

Hypothesis Tests

Hypothesis testing in R-DOE analyses is carried out using the likelihood ratio test. To test the significance of a factor, the corresponding effect coefficient, ${\theta }_i$, is tested. The following statements are used:

$\begin{array}{rlr}& H_0:& {\theta }_i=0\\ & H_1:& {\theta }_i\ne 0\end{array}$

The statistic used for the test is the likelihood ratio, $LR$. The likelihood ratio for the parameter ${\theta }_i$ is calculated as follows:

$LR=-2\ln \frac{L({\hat{\theta }}_{(-i)})}{L(\hat{\theta })}$

where:

• $\hat{\theta }$ is the vector of all parameter estimates obtained using MLE (i.e., $\hat{\theta }=[{\hat{\sigma }}^{\prime }$ ${\hat{\beta }}_0$ ${\hat{\beta }}_1$... ${]}^{\prime }$ )
• ${\hat{\theta }}_{(-i)}$ is the vector of all parameter estimates excluding the estimate of ${\theta }_i$
• $L(\hat{\theta })$ is the value of the likelihood function when all parameters are included in the model
• $L({\hat{\theta }}_{(-i)})$ is the value of the likelihood function when all parameters except ${\theta }_i$ are included in the model

If the null hypothesis, $H_0$, is true, then the ratio, $-2\ln L({\hat{\theta }}_{(-i)})/L(\hat{\theta })$, follows the chi-squared distribution with one degree of freedom. Therefore, $H_0$ is rejected at a significance level, $\alpha$, if $LR$ is greater than the critical value ${\chi }_{1,\alpha }^2$.

The likelihood ratio test can also be used to test the significance of a number of parameters, $r$, at the same time. In this case, $L({\hat{\theta }}_{(-i)})$ represents the likelihood value when all $r$ parameters to be tested are not included in the model. In other words, $L({\hat{\theta }}_{(-i)})$ would represent the likelihood value for the reduced model that does not contain the $r$ parameters under test. Here, the ratio $-2\ln L({\hat{\theta }}_{(-i)})/L(\hat{\theta })$ will follow the chi-squared distribution with $k-r$ degrees of freedom if all $r$ parameters are insignificant (with $k$ representing the number of parameters in the full model). Thus, if $LR>{\chi }_{k-r,\alpha }^2$, the null hypothesis, $H_0$, is rejected and it can be concluded that at least one of the $r$ parameters is significant.

Example

To illustrate the use of MLE in R-DOE analysis, consider the case where the life of a product is thought to be affected by two factors, $A$ and $B$. The failure of the product has been found to follow the lognormal distribution. The analyst decides to run an R-DOE analysis using a single replicate of the $2^2$ design. Previous studies indicate that the interaction between $A$ and $B$ does not affect the life of the product. The design for this experiment can be set up in DOE++ as shown in the following figure.

Design properties for the experiment in the example.

The resulting experiment design and the corresponding times-to-failure data obtained are shown next. Note that, although the life data set contains complete data and regression techniques are applicable, calculations are shown using MLE. DOE ++ uses MLE for all R-DOE analysis calculations.

The $2^2$ experiment design and the corresponding life data for the example.

Because the purpose of the experiment is to study two factors without considering their interaction, the applicable model for the lognormally distributed response data is:

${\mu }_i^{\prime }={\beta }_0+{\beta }_1{x}_{i1}+{\beta }_2{x}_{i2}$

where ${\mu }_i^{\prime }$ is the mean of the natural logarithm of the times-to-failure at the $i$th treatment combination ( $i=1,2,3,4$ ), ${\beta }_1$ is the effect coefficient for factor $A$ and ${\beta }_2$ is the effect coefficient for factor $B$. The analysis for this case is carried out in DOE++ by removing the interaction $AB$.

The following hypotheses need to be tested in this example:

1) $H_0:{\beta }_1=0$

$H_1:{\beta }_1\ne 0$

This test investigates the main effect of factor $A$. The statistic for this test is:

$L{R}_A=-2\ln \frac{L_{\stackrel{~}{}A}}{L}$

where $L$ represents the value of the likelihood function when all coefficients are included in the model and $L_{\stackrel{~}{}A}$ represents the value of the likelihood function when all coefficients except ${\beta }_1$ are included in the model.

2) $H_0:{\beta }_2=0$

$H_1:{\beta }_2\ne 0$

This test investigates the main effect of factor $B$. The statistic for this test is:

$L{R}_B=-2\ln \frac{L_{\stackrel{~}{}B}}{L}$

where $L$ represents the value of the likelihood function when all coefficients are included in the model and $L_{\stackrel{~}{}B}$ represents the value of the likelihood function when all coefficients except ${\beta }_2$ are included in the model.

To calculate the test statistics, the maximum likelihood estimates of the parameters must be known. The estimates are obtained next.

MLE Estimates

Since the life data for the present experiment are complete and follow the lognormal distribution, the likelihood function can be written as:

$L=\underset{i=1}{\prod ^4}\left[\frac{1}{t_i{\sigma }^{\prime }\sqrt{2\pi }}{e}^{-\frac{1}{2}{\left(\frac{\ln (t_i)-{\mu }_i^{\prime }}{{\sigma }^{\prime }}\right)}^2}\right]$

Substituting ${\mu }_i^{\prime }$ from the applicable model for the lognormally distributed response data, the likelihood function is:

$L=\underset{i=1}{\prod ^4}\left[\frac{1}{t_i{\sigma }^{\prime }\sqrt{2\pi }}{e}^{-\frac{1}{2}{\left(\frac{\ln (t_i)-({\beta }_0+{\beta }_1{x}_{i1}+{\beta }_2{x}_{i2})}{{\sigma }^{\prime }}\right)}^2}\right]$

Then the log-likelihood function is:

$\begin{array}{rl}\mathrm{\Lambda }({\sigma }^{\prime },{\beta }_0,{\beta }_1,{\beta }_2)=& \ln (L)\\ =& \underset{i=1}{\sum ^4}\ln \left[\frac{1}{t_i{\sigma }^{\prime }\sqrt{2\pi }}{e}^{-\frac{1}{2}{\left(\frac{\ln (t_i)-({\beta }_0+{\beta }_1{x}_{i1}+{\beta }_2{x}_{i2})}{{\sigma }^{\prime }}\right)}^2}\right]\\ =& \ln \left[\frac{1}{t_1{t}_2{t}_3{t}_4{({\sigma }^{\prime }\sqrt{2\pi })}^4}\right]+\\ & [-\frac{1}{2}\underset{i=1}{\sum ^4}{\left(\frac{\ln (t_i)-({\beta }_0+{\beta }_1{x}_{i1}+{\beta }_2{x}_{i2})}{{\sigma }^{\prime }}\right)}^2]\\ =& -[\ln (t_1{t}_2{t}_3{t}_4)+4\ln ({\sigma }^{\prime })+2\ln (2\pi )]+\\ & [-\frac{1}{2}\underset{i=1}{\sum ^4}{\left(\frac{\ln (t_i)-({\beta }_0+{\beta }_1{x}_{i1}+{\beta }_2{x}_{i2})}{{\sigma }^{\prime }}\right)}^2]\end{array}$

To obtain the MLE estimates of the parameters, ${\sigma }^{\prime },{\beta }_0,{\beta }_1$ and ${\beta }_2$, the log-likelihood function must be differentiated with respect to these parameters:

$\begin{array}{rl}\frac{\partial \mathrm{\Lambda }}{\partial {\sigma }^{\prime }}=& -\frac{4}{{\sigma }^{\prime }}+\frac{1}{{({\sigma }^{\prime })}^3}\underset{i=1}{\sum ^4}{[\ln (t_i)-({\beta }_0+{\beta }_1{x}_{i1}+{\beta }_2{x}_{i2})]}^2\\ \frac{\partial \mathrm{\Lambda }}{\partial {\beta }_0}=& \frac{1}{{({\sigma }^{\prime })}^2}\underset{i=1}{\sum ^4}[\ln (t_i)-({\beta }_0+{\beta }_1{x}_{i1}+{\beta }_2{x}_{i2})]\\ \frac{\partial \mathrm{\Lambda }}{\partial {\beta }_1}=& \frac{1}{{({\sigma }^{\prime })}^2}\underset{i=1}{\sum ^4}{x}_{i1}[\ln (t_i)-({\beta }_0+{\beta }_1{x}_{i1}+{\beta }_2{x}_{i2})]\\ \frac{\partial \mathrm{\Lambda }}{\partial {\beta }_2}=& \frac{1}{{({\sigma }^{\prime })}^2}\underset{i=1}{\sum ^4}{x}_{i2}[\ln (t_i)-({\beta }_0+{\beta }_1{x}_{i1}+{\beta }_2{x}_{i2})]\end{array}$

Equating the $\partial \mathrm{\Lambda }/\partial {\theta }_i$ terms to zero returns the required estimates. The coefficients ${\hat{\beta }}_0$, ${\hat{\beta }}_1$ and ${\hat{\beta }}_2$ are obtained first as these are required to estimate ${\hat{\sigma }}^{\prime }$. Setting $\partial \mathrm{\Lambda }/\partial {\beta }_0=0$:

$\underset{i=1}{\sum ^4}[\ln (t_i)-({\beta }_0+{\beta }_1{x}_{i1}+{\beta }_2{x}_{i2})]=0$

Substituting the values of $t_i$, $x_{i1}$ and $x_{i2}$ from the figure above and simplifying:

$\ln t_1+\ln t_2+\ln t_3+\ln t_4-4{\beta }_0=0$

Thus:

$\begin{array}{rl}{\hat{\beta }}_0=& \frac{1}{4}(\ln t_1+\ln t_2+\ln t_3+\ln t_4)\\ =& \frac{1}{4}(3.2958+3.2189+3.912+4.0073)\\ =& 3.6085\end{array}$

Setting $\partial \mathrm{\Lambda }/\partial {\beta }_1=0$:

$x_{i1}\ln t_1+x_{i1}\ln t_2+x_{i1}\ln t_3+x_{i1}\ln t_4-4{\beta }_1=0$

Thus:

$\begin{array}{rl}{\hat{\beta }}_1=& \frac{1}{4}(-\ln t_1+\ln t_2-\ln t_3+\ln t_4)\\ =& \frac{1}{4}(-3.2958+3.2189-3.912+4.0073)\\ =& 0.0046\end{array}$

Setting $\partial \mathrm{\Lambda }/\partial {\beta }_2=0$:

$x_{i2}\ln t_1+x_{i2}\ln t_2+x_{i3}\ln t_3+x_{i4}\ln t_4-4{\beta }_2=0$

Thus:

$\begin{array}{rl}{\hat{\beta }}_2=& \frac{1}{4}(-\ln t_1-\ln t_2+\ln t_3+\ln t_4)\\ =& \frac{1}{4}(-3.2958-3.2189+3.912+4.0073)\\ =& 0.3512\end{array}$

Knowing ${\hat{\beta }}_0,{\hat{\beta }}_1$ and ${\hat{\beta }}_2$, ${\hat{\sigma }}^{\prime }$ can now be obtained. Setting $\partial \mathrm{\Lambda }/\partial {\sigma }^{\prime }=0$:

$-\frac{4}{{\sigma }^{\prime }}+\frac{1}{{({\sigma }^{\prime })}^3}\underset{i=1}{\sum ^4}{[\ln (t_i)-(3.6085+0.0046x_{i1}+0.3512x_{i2})]}^2=0$

Thus:

$\begin{array}{rl}{\hat{\sigma }}^{\prime }=& \frac{1}{2}\sqrt{\underset{i=1}{\sum ^4}{[\ln (t_i)-(3.6085+0.0046x_{i1}+0.3512x_{i2})]}^2}\\ =& 0.043\end{array}$

Once the estimates have been calculated, the likelihood ratio test can be carried out for the two factors.

Likelihood Ratio Test

The likelihood ratio test for factor $A$ is conducted by using the likelihood value corresponding to the full model and the likelihood value when $A$ is not included in the model. The likelihood value corresponding to the full model (in this case ${\mu }_i^{\prime }={\beta }_0+{\beta }_1{x}_{i1}+{\beta }_2{x}_{i2}$ ) is:

$\begin{array}{rl}L=& \underset{i=1}{\prod ^4}\left[\frac{1}{t_i{\hat{\sigma }}^{\prime }\sqrt{2\pi }}{e}^{-\frac{1}{2}{\left(\frac{\ln (t_i)-({\hat{\beta }}_0+{\hat{\beta }}_1{x}_{i1}+{\hat{\beta }}_2{x}_{i2})}{{\hat{\sigma }}^{\prime }}\right)}^2}\right]\\ =& 0.000537311\end{array}$

The corresponding logarithmic value is $\ln (L)=\ln (0.000537311)=-7.529$. The likelihood value for the reduced model that does not contain factor $A$ (in this case ${\mu }_i^{\prime }={\beta }_0+{\beta }_2{x}_{i2}$ ) is:

$\begin{array}{rl}{L}_{\stackrel{~}{}A}=& \underset{i=1}{\prod ^4}\left[\frac{1}{t_i{\hat{\sigma }}^{\prime }\sqrt{2\pi }}{e}^{-\frac{1}{2}{\left(\frac{\ln (t_i)-({\hat{\beta }}_0+{\hat{\beta }}_2{x}_{i2})}{{\hat{\sigma }}^{\prime }}\right)}^2}\right]\\ =& 0.000525337\end{array}$

The corresponding logarithmic value is $\ln (L_{\stackrel{~}{}A})=\ln (0.000525337)=-7.552$. Therefore, the likelihood ratio to test the significance of factor $A$ is:

$\begin{array}{rl}L{R}_A=& -2\ln \frac{L_{\stackrel{~}{}A}}{L}\\ =& -2\ln \frac{0.000525337}{0.000537311}\\ =& 0.0451\end{array}$

The $p$ value corresponding to $L{R}_A$ is:

$\begin{array}{rl}pvalue=& 1-P({\chi }_1^2<L{R}_A)\\ =& 1-0.1682\\ =& 0.8318\end{array}$

Assuming that the desired significance level for the present experiment is 0.1, since $p$ $value>0.1$, $H_0:{\beta }_1=0$ cannot be rejected and it can be concluded that factor $A$ does not affect the life of the product.

The likelihood ratio to test factor $B$ can be calculated in a similar way as shown next:

$\begin{array}{rl}L{R}_B=& -2\ln \frac{L_{\stackrel{~}{}B}}{L}\\ =& -2\ln \frac{1.17995E-07}{0.000537311}\\ =& 16.8475\end{array}$

The $p$ value corresponding to $L{R}_B$ is:

$\begin{array}{rl}pvalue=& 1-P({\chi }_1^2<L{R}_B)\\ =& 1-0.99996\\ =& 0.00004\end{array}$

Since $p$ $value<0.1$, $H_0:{\beta }_2=0$ is rejected and it is concluded that factor $B$ affects the life of the product. The previous calculation results are displayed as the Likelihood Ratio Test Table in the results obtained from DOE++ as shown in the figure below.

Likelihood ratio test results from DOE++ for the experiment in the example.

Fisher Matrix Bounds on Parameters

In general, the MLE estimates of the parameters are asymptotically normal. This means that for large sample sizes the distribution of the estimates from the same population would be very close to the normal distribution [Meeker and Escobar]. If $\hat{\theta }$ is the MLE estimate of any parameter, $\theta$, then the ( $1-\alpha$ )% two-sided confidence bounds on the parameter are:

$\hat{\theta }-z_{\alpha /2}\cdot \sqrt{Var(\hat{\theta })}<\theta <\hat{\theta }+z_{\alpha /2}\cdot \sqrt{Var(\hat{\theta })}$

where $Var(\hat{\theta })$ represents the variance of $\hat{\theta }$ and $z_{\alpha /2}$ is the critical value corresponding to a significance level of $\alpha /2$ on the standard normal distribution. The variance of the parameter, $Var(\hat{\theta })$, is obtained using the Fisher information matrix. For $k$ parameters, the Fisher information matrix is obtained from the log-likelihood function $\mathrm{\Lambda }$ as follows:

$F=\left[\begin{array}{cccc}-\frac{{\partial }^2\mathrm{\Lambda }}{\partial {\theta }_1^2}& -\frac{{\partial }^2\mathrm{\Lambda }}{\partial {\theta }_1\partial {\theta }_2}& ...& -\frac{{\partial }^2\mathrm{\Lambda }}{\partial {\theta }_1\partial {\theta }_k}\\ -\frac{{\partial }^2\mathrm{\Lambda }}{\partial {\theta }_1\partial {\theta }_2}& -\frac{{\partial }^2\mathrm{\Lambda }}{\partial {\theta }_2^2}& ...& -\frac{{\partial }^2\mathrm{\Lambda }}{\partial {\theta }_2\partial {\theta }_k}\\ .& .& ...& .\\ .& .& ...& .\\ -\frac{{\partial }^2\mathrm{\Lambda }}{\partial {\theta }_1\partial {\theta }_k}& .& ...& -\frac{{\partial }^2\mathrm{\Lambda }}{\partial {\theta }_k^2}\end{array}\right]$

The variance-covariance matrix is obtained by inverting the Fisher matrix $F$:

$\left[\begin{array}{cccc}Var({\hat{\theta }}_1)& Cov({\hat{\theta }}_1,{\hat{\theta }}_2)& ...& \\ Cov({\hat{\theta }}_1,{\hat{\theta }}_2)& Var({\hat{\theta }}_2)& ...& \\ .& .& ...& \\ .& .& ...& \\ Cov({\hat{\theta }}_1,{\hat{\theta }}_k)& .& ...& Var({\hat{\theta }}_k)\end{array}\right]=$

${\left[\begin{array}{cccc}-\frac{{\partial }^2\mathrm{\Lambda }}{\partial {\theta }_1^2}& -\frac{{\partial }^2\mathrm{\Lambda }}{\partial {\theta }_1\partial {\theta }_2}& ...& \\ -\frac{{\partial }^2\mathrm{\Lambda }}{\partial {\theta }_1\partial {\theta }_2}& -\frac{{\partial }^2\mathrm{\Lambda }}{\partial {\theta }_2^2}& ...& \\ .& .& ...& \\ .& .& ...& \\ -\frac{{\partial }^2\mathrm{\Lambda }}{\partial {\theta }_1\partial {\theta }_k}& .& ...& -\frac{{\partial }^2\mathrm{\Lambda }}{\partial {\theta }_k^2}\end{array}\right]}^{-1}$

Once the variance-covariance matrix is known the variance of any parameter can be obtained from the diagonal elements of the matrix. Note that if a parameter, $\theta$, can take only positive values, it is assumed that the $\ln (\hat{\theta })$ follows the normal distribution [Meeker and Escobar]. The bounds on the parameter in this case are:

$CIon\ln (\hat{\theta })=\ln (\hat{\theta })\pm z_{\alpha /2}\sqrt{Var(\ln (\hat{\theta }))}$

Using $Var[f(\hat{\theta })]={(\partial f/\partial \theta )}^2\cdot Var(\hat{\theta })$ we get $Var(\ln (\hat{\theta }))={(1/\hat{\theta })}^{2}Var(\hat{\theta })$. Substituting this value we have:

$\begin{array}{rl}CIon\ln (\hat{\theta })=& \ln (\hat{\theta })\pm z_{\alpha /2}\sqrt{{(1/\hat{\theta })}^{2}Var(\hat{\theta })}\\ =& \ln (\hat{\theta })\pm (z_{\alpha /2}/\hat{\theta })\sqrt{Var(\hat{\theta })}\\ orCIon\hat{\theta }=& \exp [\ln (\hat{\theta })\pm (z_{\alpha /2}/\hat{\theta })\sqrt{Var(\hat{\theta })}]\\ =& \hat{\theta }\cdot \exp [\pm (z_{\alpha /2}/\hat{\theta })\sqrt{Var(\hat{\theta })}]\end{array}$

Knowing $Var(\hat{\theta })$ from the variance-covariance matrix, the confidence bounds on $\hat{\theta }$ can then be determined.

Example

Continuing with the example, the confidence bounds on the MLE estimates of the parameters ${\beta }_0$, ${\beta }_1$, ${\beta }_2$ and ${\sigma }^{\prime }$ can now be obtained. The Fisher information matrix for the example is:

$\begin{array}{rl}F=& \left[\begin{array}{cccc}-\frac{{\partial }^2\mathrm{\Lambda }}{\partial {\beta }_0^2}& -\frac{{\partial }^2\mathrm{\Lambda }}{\partial {\beta }_0\partial {\beta }_1}& -\frac{{\partial }^2\mathrm{\Lambda }}{\partial {\beta }_0\partial {\beta }_2}& -\frac{{\partial }^2\mathrm{\Lambda }}{\partial {\beta }_0\partial {\sigma }^{\prime }}\\ & -\frac{{\partial }^2\mathrm{\Lambda }}{\partial {\beta }_1^2}& -\frac{{\partial }^2\mathrm{\Lambda }}{\partial {\beta }_1\partial {\beta }_2}& -\frac{{\partial }^2\mathrm{\Lambda }}{\partial {\beta }_1\partial {\sigma }^{\prime }}\\ & & -\frac{{\partial }^2\mathrm{\Lambda }}{\partial {\beta }_2^2}& -\frac{{\partial }^2\mathrm{\Lambda }}{\partial {\beta }_2\partial {\sigma }^{\prime }}\\ sym.& & & -\frac{{\partial }^2\mathrm{\Lambda }}{\partial {\sigma }^{\prime 2}}\end{array}\right]\\ =& \left[\begin{array}{cccc}\frac{4}{{\sigma }^{\prime 2}}& \frac{1}{{\sigma }^{\prime 2}}\underset{i=1}{\sum ^4}{x}_{i1}& \frac{1}{{\sigma }^{\prime 2}}\underset{i=1}{\sum ^4}{x}_{i2}& \frac{2}{{\sigma }^{\prime 3}}[\underset{i=1}{\sum ^4}(\ln t_i-{\mu }_i^{\prime })]\\ & \frac{1}{{\sigma }^{\prime 2}}\underset{i=1}{\sum ^4}{x}_{i1}^2& \frac{1}{{\sigma }^{\prime 2}}\underset{i=1}{\sum ^4}{x}_{i1}{x}_{i2}& \frac{2}{{\sigma }^{\prime 3}}[\underset{i=1}{\sum ^4}{x}_{i1}\cdot (\ln t_i-{\mu }_i^{\prime })]\\ & & \frac{1}{{\sigma }^{\prime 2}}\underset{i=1}{\sum ^4}{x}_{i2}^2& \frac{2}{{\sigma }^{\prime 3}}[\underset{i=1}{\sum ^4}{x}_{i2}\cdot (\ln t_i-{\mu }_i^{\prime })]\\ sym.& & & \frac{4}{{\sigma }^{\prime 2}}+\frac{(-3)}{{\sigma }^{\prime 4}}\underset{i=1}{\sum ^4}{(\ln t_i-{\mu }_i^{\prime })}^2]\end{array}\right]\\ =& \left[\begin{array}{cccc}2165.6741& 0& 0& -1.1195E-11\\ & 2165.6741& 0& -1.1195E-11\\ & & 2165.6741& -3.358E-11\\ sym.& & & 4330.8227\end{array}\right]\end{array}$

The variance-covariance matrix can be obtained by taking the inverse of the Fisher matrix $F$:

$\left[\begin{array}{cccc}Var({\hat{\beta }}_0)& Cov({\hat{\beta }}_0,{\hat{\beta }}_1)& Cov({\hat{\beta }}_0,{\hat{\beta }}_2)& Cov({\hat{\beta }}_0,{\hat{\sigma }}^{\prime })\\ & Var({\hat{\beta }}_1)& Cov({\hat{\beta }}_1,{\hat{\beta }}_2)& Cov({\hat{\beta }}_0,{\hat{\sigma }}^{\prime })\\ & & Var({\hat{\beta }}_2)& Cov({\hat{\beta }}_0,{\hat{\sigma }}^{\prime })\\ sym.& & & Var({\hat{\sigma }}^{\prime })\end{array}\right]=F^{-1}$

Inverting $F$ returns the following matrix:

$F^{-1}=\left[\begin{array}{cccc}4.617E-4& 0& 0& 0\\ & 4.617E-4& 0& 0\\ & & 4.617E-4& 0\\ sym.& & & 2.309E-4\end{array}\right]$

Therefore, the variance of the parameter estimates are:

$\begin{array}{rl}Var({\hat{\beta }}_0)=& 4.617E-4\\ Var({\hat{\beta }}_1)=& 4.617E-4\\ Var({\hat{\beta }}_2)=& 4.617E-4\\ Var({\hat{\sigma }}^{\prime })=& 2.309E-4\end{array}$

Knowing the variance, the confidence bounds on the parameters can be calculated. For example, the 90% bounds ( $\alpha =0.1$ ) on ${\hat{\beta }}_2$ can be calculated as shown next:

$\begin{array}{rl}CI=& {\hat{\beta }}_2\pm z_{\alpha /2}\cdot \sqrt{Var({\hat{\beta }}_2)}\\ =& {\hat{\beta }}_2\pm z_{0.05}\cdot \sqrt{Var({\hat{\beta }}_2)}\\ =& 0.3512\pm 1.645\cdot \sqrt{4.617E-4}\\ =& 0.3512\pm 0.0354\\ =& 0.3158and0.3866\end{array}$

The 90% bounds on ${\sigma }^{\prime }$ are (considering that ${\sigma }^{\prime }$ can only take positive values):

$\begin{array}{rl}CI=& {\hat{\sigma }}^{\prime }\cdot \exp [\pm (z_{0.05}/{\hat{\sigma }}^{\prime })\sqrt{Var({\hat{\sigma }}^{\prime })}]\\ =& 0.043\cdot \exp [\pm (1.645/0.043)\sqrt{2.309E-4}]\\ =& 0.024and0.077\end{array}$

The standard error for the parameters can be obtained by taking the positive square root of the variance. For example, the standard error for ${\hat{\beta }}_1$ is:

$\begin{array}{rl}se({\hat{\beta }}_1)=& \sqrt{Var({\hat{\beta }}_1)}\\ =& \sqrt{4.617E-4}\\ =& 0.0215\end{array}$

The $z$ statistic for ${\hat{\beta }}_1$ is:

$\begin{array}{rl}{z}_0=& \frac{{\hat{\beta }}_1}{se({\hat{\beta }}_1)}\\ =& \frac{0.0046}{0.0215}\\ =& 0.21\end{array}$

The $p$ value corresponding to this statistic based on the standard normal distribution is:

$\begin{array}{rl}pvalue=& 2\cdot (1-P(Z\le |z_0|)\\ =& 2\cdot (1-0.58435)\\ =& 0.8313\end{array}$

The previous calculation results are displayed as MLE Information in the results obtained from DOE++ as shown in the following figure. In the figure, the Effect corresponding to each factor is simply twice the MLE estimate of the coefficient for that factor. Generally, the $p$ value corresponding to any coefficient in the MLE Information table should match the value obtained from the likelihood ratio test (displayed in the Likelihood Ratio Test table of the figure below). If the sample size is not large enough, as in the case of the present example, a difference may be seen in the two values. In such cases, the $p$ value from the likelihood ratio test should be given preference. For the present example, the $p$ value of 0.8318 for ${\hat{\beta }}_1$, obtained from the likelihood ratio test, would be preferred to the $p$ value of 0.8313 displayed under MLE information. For details see [Meeker and Escobar].

MLE information from DOE++ for the example.

R-DOE Analysis of Data Following the Weibull Distribution

The probability density function for the 2-parameter Weibull distribution is:

$f(T)=\frac{\beta }{\eta }{\left(\frac{T}{\eta }\right)}^{\beta -1}\exp [-{\left(\frac{T}{\eta }\right)}^{\beta }]$

where $\eta$ is the scale parameter of the Weibull distribution and $\beta$ is the shape parameter [Life Data Analysis Reference]. To distinguish the Weibull shape parameter from the effect coefficients, the shape parameter is represented as $Beta$ instead of $\beta$ in the remaining chapter. For data following the 2-parameter Weibull distribution, the life characteristic used in R-DOE analysis is the scale parameter, $\eta$ [Accelerated Life Testing Reference]. Since $\eta$ represents life data that cannot take negative values, a logarithmic transformation is applied to it. The resulting model used in the R-DOE analysis for a two factor experiment with each factor at two levels can be written as follows:

$\ln ({\eta }_i)={\beta }_0+{\beta }_1{x}_{i1}+{\beta }_2{x}_{i2}+{\beta }_{12}{x}_{i1}{x}_{i2}$

where:

• ${\eta }_i$ is the value of the scale parameter at the $i$th treatment combination of the two factors
• $x_1$ is the indicator variable representing the level of the first factor
• $x_2$ is the indicator variable representing the level of the second factor
• ${\beta }_0$ is the intercept term
• ${\beta }_1$ and ${\beta }_2$ are the effect coefficients for the two factors
• and ${\beta }_{12}$ is the effect coefficient for the interaction of the two factors

The model can be easily expanded to include other factors and their interactions. Note that when any data follows the Weibull distribution, the logarithmic transformation of the data follows the extreme-value distribution, whose probability density function is given as follows:

$f(\ln (T))=\frac{1}{{\sigma }^{″}}\exp [\frac{\ln (T)-{\mu }^{″}}{{\sigma }^{″}}-\exp \left(\frac{\ln (T)-{\mu }^{″}}{{\sigma }^{″}}\right)]$

where the $T$s follow the Weibull distribution, ${\mu }^{″}$ is the location parameter of the extreme-value distribution and ${\sigma }^{″}$ is the scale parameter of the extreme-value distribution. The two equations given above show that for R-DOE analysis of life data that follows the Weibull distribution, the random error terms, ${ϵ}_i$, will follow the extreme-value distribution (and not the normal distribution). Hence, regression techniques are not applicable even if the data is complete. Therefore, maximum likelihood estimation has to be used.

Maximum Likelihood Estimation for the Weibull Distribution

The likelihood function for complete data in R-DOE analysis of Weibull distributed life data is:

$\begin{array}{rl}{L}_{failures}=& \underset{i=1}{\prod ^{F_e}}f(t_i,{\eta }_i)\\ =& \underset{i=1}{\prod ^{F_e}}[\frac{Beta}{{\eta }_i}{\left(\frac{t_i}{{\eta }_i}\right)}^{Beta-1}\exp [-{\left(\frac{t_i}{{\eta }_i}\right)}^{Beta}]]\end{array}$

where:

• $F_e$ is the total number of observed times-to-failure
• ${\eta }_i$ is the life characteristic at the $i$th treatment
• and $t_i$ is the time of the $i$th failure

For right censored data, the likelihood function is:

$L_{suspensions}=\underset{i=1}{\prod ^{S_e}}[\exp [-{\left(\frac{t_i}{{\eta }_i}\right)}^{Beta}]]$

where:

• $S_e$ is the total number of observed suspensions
• and $t_i$ is the time of $i$th suspension

For interval data, the likelihood function is:

$L_{interval}=\underset{i=1}{\prod ^{FI}}[\exp [-{\left(\frac{t_i^2}{{\eta }_i}\right)}^{Beta}]-\exp [-{\left(\frac{t_i^1}{{\eta }_i}\right)}^{Beta}]]$

where:

• $FI$ is the total number of interval data
• $t_i^1$ is the beginning time of the $i$th interval
• and $t_i^2$ is the end time of the $i$ th interval

In each of the likelihood functions, ${\eta }_i$ is substituted as:

${\eta }_i=\exp ({\beta }_0+{\beta }_1{x}_{i1}+{\beta }_2{x}_{i2}+...)$

The complete likelihood function when all types of data (complete, right and left censored) are present is:

$L(Beta,{\beta }_0,{\beta }_1...)=L_{failures}\cdot L_{suspensions}\cdot L_{interval}$

Then the log-likelihood function is:

$\mathrm{\Lambda }(Beta,{\beta }_0,{\beta }_1...)=\ln (L)$

The MLE estimates are obtained by solving for parameters $(Beta,{\beta }_0,{\beta }_1...)$ so that:

$\begin{array}{rl}\frac{\partial \mathrm{\Lambda }}{\partial Beta}=& 0\\ \frac{\partial \mathrm{\Lambda }}{\partial {\beta }_0}=& 0\\ \frac{\partial \mathrm{\Lambda }}{\partial {\beta }_1}=& 0\\ & ...\end{array}$

Once the estimates are obtained, the significance of any parameter, ${\theta }_i$, can be assessed using the likelihood ratio test. Other results can also be obtained as discussed in Sections MLE for the Lognormal and Fisher Matrix Bounds on Parameters.

R-DOE Analysis of Data Following the Exponential Distribution

The exponential distribution is a special case of the Weibull distribution when the shape parameter $Beta$ is equal to 1. Substituting $Beta=1$ in the probability density function for the 2-parameter Weibull distribution gives:

$\begin{array}{rl}f(T)=& \frac{1}{\eta }\exp (-\frac{T}{\eta })\\ =& \lambda \exp (-\lambda T)\end{array}$

where $1/\eta$ of the Weibull pdf has been replaced by $\lambda$. Parameter $\lambda$ is called the failure rate [Life Data Analysis Reference]. Hence, R-DOE analysis for exponentially distributed data can be carried out by substituting $Beta=1$ and replacing $1/\eta$ by $\lambda$ in the Weibull distribution.

Model Diagnostics

Residual plots can be used to check if the model obtained, based on the MLE estimates, is a good fit to the data. DOE++ uses standardized residuals for R-DOE analyses. If the data follows the lognormal distribution, then standardized residuals are calculated using the following equation:

$\begin{array}{rl}{\hat{e}}_i=& \frac{\ln (t_i)-{\hat{\mu }}_i}{{\hat{\sigma }}^{\prime }}\\ =& \frac{\ln (t_i)-({\hat{\beta }}_0+{\hat{\beta }}_1{x}_{i1}+{\hat{\beta }}_2{x}_{i2}+...)}{{\hat{\sigma }}^{\prime }}\end{array}$

For the probability plot, the standardized residuals are displayed on a normal probability plot. This is because under the assumed model for the lognormal distribution, the standardized residuals should follow a normal distribution with a mean of 0 and a standard deviation of 1.
For data that follows the Weibull distribution, the standardized residuals are calculated as shown next:

$\begin{array}{rl}{\hat{e}}_i=& \hat{B}eta[\ln (t_i)-\ln ({\hat{\eta }}_i)]\\ =& \hat{B}eta[\ln (t_i)-({\hat{\beta }}_0+{\hat{\beta }}_1{x}_{i1}+{\hat{\beta }}_2{x}_{i2}+...)]\end{array}$

The probability plot, in this case, is used to check if the residuals follow the extreme-value distribution with a mean of 0. Note that in all residual plots, when an observation, $t_i$, is censored the corresponding residual is also censored.

Application Examples

Example

This example illustrates the use of R-DOE analysis to design reliability into a product. An experiment was carried out to investigate the effect of five factors (each at two levels) on the reliability of fluorescent lights [Taguchi, 1987, p. 930]. The factors, $A$ through $E$, were studied using a $2^{5-2}$ design (with the defining relations $D=-AC$ and $E=-BC$ ) under the assumption that all interaction effects except $AB$ $(=DE)$ can be assumed to be inactive. For each treatment, two lights were tested (two replicates) with the readings taken every two days. The experiment was run for 20 days, and if a light had not failed by the 20th day, then it was assumed to be a suspension. The experimental design and the corresponding failure times are shown next.

The $2^{5-2}$ experiment design for the example to study factors affecting the reliability of fluorescent lights.

The short duration of the experiment and failure times were probably because the lights were tested under conditions which resulted in stress higher than normal conditions. The failure of the lights was assumed to follow the lognormal distribution.

The analysis results from DOE++ for this experiment are shown next.

Results of the R-DOE analysis for the experiment in the example.

The results are obtained by selecting the main effects of the five factors and the interaction $AB$ using the Select Effects icon in the Control Panel. The results show that factors $B$, $D$ and $E$ are active at a significance level of 0.05. The MLE estimates of the effect coefficients corresponding to these factors are $-0.2015$, $0.2729$ and $-0.1527$, respectively. Based on these coefficients, the best settings for these effects to improve the reliability of the fluorescent lights (by maximizing the response, which in this case is the failure time) are:

• Factor $B$ should be set at the lower level of $-1$ since its coefficient is negative
• Factor $D$ should be set at the higher level of $1$ since its coefficient is positive
• Factor $E$ should be set at the lower level of $-1$ since its coefficient is negative

Note that, since actual factor levels are not disclosed (presumably for proprietary reasons), predictions beyond the test conditions cannot be carried out in this case.

Example

Consider a product whose reliability is thought to be affected by eight potential factors - $A$ (temperature), $B$ (humidity), $C$ (load), $D$ (fan-speed), $E$ (voltage), $F$ (material), $G$ (vibration) and $H$ (current). Assuming that all interaction effects are absent, a $2^{8-4}$ design is used to investigate the eight factors at two levels. The generators used to obtain the design are $E=ABC$, $F=BCD$, $G=ACD$ and $H=ABD$. The design and the corresponding life data obtained are shown in the figure below. Readings for the experiment are taken every 20 time units and the test is terminated at 200 time units. The life of the product is assumed to follow the Weibull distribution.

The results from DOE++ for this experiment are shown in the figure below.

The 2 design to investigate the reliability of a product for the example.

The results show that only factors $A$ and $D$ are active at a significance level of 0.1.

Assume that, in terms of the actual units, the $-1$ level of factor $A$ corresponds to a temperature of 333 $K$ and the $+1$ level corresponds to a temperature of 383 $K$. Similarly, assume that the two levels of factor $D$ are 1000 $rpm$ and 2000 $rpm$ respectively. From the MLE estimates of the effect coefficients it can be noted that to improve reliability (by maximizing the response) factors $A$ and $D$ should be set as follows:

• Factor $A$ should be set at the lower level of 333 $K$ since its coefficient is negative
• Factor $D$ should be set at the higher level of 2000 $rpm$ since its coefficient is positive

Now assume that the use conditions for the product for the significant factors, $A$ and $D$, are a temperature of 298 $K$ and a fan-speed of 3000 $rpm,$ respectively. The analysis can be taken a step further to obtain an estimate of the reliability of the product at the use conditions using ReliaSoft's ALTA software. The data is entered into ALTA as shown in the figure below.

Results for the experiment in the example.

ALTA allows for modeling of the nature of relationship between life and stress. It is assumed that the relation between life of the product and temperature follows the Arrhenius relation [Accelerated Life Testing Reference] while the relation between life and fan-speed follows the inverse power law relation [Accelerated Life Testing Reference]. Using these relations ALTA fits the following model for the data in the figure below:

$\eta =\exp [-0.4322+1037.2886\frac{1}{\text{Temp}}+0.3772\cdot \ln (\text{Fan-Speed})]$

Additional reliability analysis for the example, conducted using ReliaSoft's ALTA software.

Based on this model the B10 life of the product at the use conditions is obtained as shown next. The Weibull reliability equation is:

$R(t)=\exp [-{(\frac{t}{\eta })}^{Beta}]$

Substituting the value of $\eta$ from the fitted model and the value of $Beta(=3.4582)$ as obtained from ALTA, the reliability equation becomes:

$R(t)=\exp -{\left[\frac{t}{\exp [-0.4322+1037.2886\frac{1}{\text{Temp}}+0.3772\cdot \ln (\text{Fan-Speed})]}\right]}^{3.4582}$

Finally, substituting the use conditions (Temp $=298$ $K$, Fan-Speed $=3000$ $rpm$ ) and the desired reliability value of 90%, the B10 life is obtained:

$\begin{array}{rl}0.90=& \exp -{\left[\frac{t}{\exp [-0.4322+1037.2886\frac{1}{298}+0.3772\cdot \ln (3000)]}\right]}^{3.4582}\\ t=& 225.4482\end{array}$

Therefore, at the use conditions, the B10 life of the product is 225 time units. This result and other reliability metrics can be directly obtained from ALTA.

Additional R-DOE Analyses

DOE++ also allows for the analysis of single factor R-DOE experiments. This analysis is similar to the analysis of single factor designed experiments mentioned in Two Level Factorial Experiments. In single factor R-DOE analysis, the focus is on discovering whether change in the level of a factor affects reliability and how each of the factor levels are different from the other levels. The analysis models and calculations are similar to multi-factor R-DOE analysis.

Example

To illustrate single factor R-DOE analysis, consider the data in the table where life data readings for a product are taken at three levels of a certain factor, $A$. Factor $A$ may either be a stress that is thought to affect life or three different designs of the same product or the same product manufactured by three different machines or operators, etc. The goal of the experiment is to see if there is a change in life due to change in the levels of the factor. The design for this experiment is shown in the figure below. The life of the product is assumed to follow the Weibull distribution. Therefore, the life characteristic to be used in the R-DOE analysis is the scale parameter, $\eta$. Since factor $A$ has three levels, the model for the life characteristic, $\eta$, is:

$\ln ({\eta }_i)={\beta }_0+{\beta }_1{x}_{i1}+{\beta }_2{x}_{i2}$

where ${\beta }_0$ is the intercept, ${\beta }_1$ is the effect coefficient for the first level of the factor ( ${\beta }_1$ is represented as "A[1]" in DOE++) and ${\beta }_2$ is the effect coefficient for the second level of the factor ( ${\beta }_2$ is represented as "A[2]" in DOE++). Two indicator variables, $x_1$ and $x_2,$ are the used to represent the three levels of factor $A$ such that:

$\begin{array}{rlr}& x_1=& 1,x_2=0\text{ Level 1 Effect}\\ & x_1=& 0,x_2=1\text{ Level 2 Effect}\\ & x_1=& -1,x_2=-1\text{ Level 3 Effect}\end{array}$

Data obtained from a single factor R-DOE experiment.

The following hypothesis test needs to be carried out in this example:

$\begin{array}{rlr}& H_0:& {\theta }_i=0\\ & H_1:& {\theta }_i\ne 0\end{array}$

where ${\theta }_i=[{\beta }_1,{\beta }_2{]}^{\prime }$. The statistic for this test is:

• $LR=-2\ln \frac{L({\hat{\theta }}_{(-i)})}{L(\hat{\theta })}$

where $L(\hat{\theta })$ is the value of the likelihood function corresponding to the full model, and $L({\hat{\theta }}_{(-i)})$ is the likelihood value for the reduced model. To calculate the statistic for this test, the MLE estimates of the parameters must be obtained.

Experiment design for the example.

MLE Estimates

Following the procedure used in the analysis of multi-factor R-DOE experiments, MLE estimates of the parameters are obtained by differentiating the log-likelihood function $\mathrm{\Lambda }$:

$\begin{array}{rlr}& \mathrm{\Lambda }=& \underset{iϵ1}{\sum ^{F_e}}\ln [\frac{Beta}{{\eta }_i}{\left(\frac{t_i}{{\eta }_i}\right)}^{Beta-1}\exp [-{\left(\frac{t_i}{{\eta }_i}\right)}^{Beta}]]\\ & & +\underset{iϵ1}{\sum ^{S_e}}[-{\left(\frac{t_i}{{\eta }_i}\right)}^{Beta}]\\ & & +\underset{iϵ1}{\sum ^{FI}}\ln [\exp [-{\left(\frac{t_i^2}{{\eta }_i}\right)}^{Beta}]-\exp [-{\left(\frac{t_i^1}{{\eta }_i}\right)}^{Beta}]]\end{array}$

Substituting ${\eta }_i$ from the model for the life characteristic $\eta$ and setting the partial derivatives $\partial \mathrm{\Lambda }/\partial {\theta }_i$ to zero, the parameter estimates are obtained as $\hat{B}eta=1.8532$, ${\hat{\beta }}_0=6.4217$, ${\hat{\beta }}_1=-0.4983$ and ${\hat{\beta }}_2=0.1384$. These parameters are shown in the figure below in the MLE Information table.

MLE results for the experiment in the example.

Likelihood Ratio Test

Knowing the MLE estimates, the likelihood ratio test for the significance of factor $A$ can be carried out. The likelihood value for the full model, $L(\hat{\theta })$, is the value of the likelihood function corresponding to the model $\ln ({\eta }_i)={\beta }_0+{\beta }_1{x}_{i1}+{\beta }_2{x}_{i2}$:

$\begin{array}{rl}L(\hat{\theta })=& L(\hat{B}eta,{\hat{\beta }}_0,{\hat{\beta }}_1,{\hat{\beta }}_2)\\ =& 9.2E-50\end{array}$

The likelihood value for the reduced model, $L({\hat{\theta }}_{(-i)})$, is the value of the likelihood function corresponding to the model $\ln ({\eta }_i)={\beta }_0$:

$\begin{array}{rl}L({\hat{\theta }}_{(-i)})=& L(\hat{B}eta,{\hat{\beta }}_0)\\ =& 2.9E-48\end{array}$

Then the likelihood ratio is:

$\begin{array}{rl}LR=& -2\ln \frac{L({\hat{\theta }}_{(-i)})}{L(\hat{\theta })}\\ =& 6.8858\end{array}$

If the null hypothesis, $H_0$, is true then the likelihood ratio will follow the Chi-Squared distribution. The number of degrees of freedom for this distribution is equal to the difference in the number of parameters between the full and the reduced model. In this case, this difference is 2. The $p$ value corresponding to the likelihood ratio on the Chi-Squared distribution with two degrees of freedom is:

$\begin{array}{rl}pvalue=& 1-P({\chi }_2^2<LR)\\ =& 1-0.968\\ =& 0.032\end{array}$

Assuming that the desired significance is 0.1, since $p$ $value<0.1$, $H_0:{\theta }_i=0$ is rejected it is concluded that, at a significance of 0.1, at least one of the parameters, ${\beta }_1$ or ${\beta }_2$, is non-zero. Therefore, factor $A$ affects the life of the product. This result is shown in the Likelihood Ratio Test table in the figure above. Additional results for single factor R-DOE analysis obtained from DOE ++ include information on the life characteristic and comparison of life characteristics at different levels of the factor.

Life Characteristic Summary Results

Results in the Life Characteristic Summary table, include information about the life characteristic corresponding to each treatment level of the factor. If $\ln ({\eta }_i)$ is represented as $E(y_i)$, then the model for the life characteristic $\eta$ can be written as:

$E(y_i)={\beta }_0+{\beta }_1{x}_{i1}+{\beta }_2{x}_{i2}$

The respective equations for all three treatment levels for a single replicate of the experiment can be expressed in matrix notation as:

$E(y)=X\beta$

where:

$E(y)=\left[\begin{array}{c}E(y_1)\\ E(y_2)\\ E(y_3)\end{array}\right]X=\left[\begin{array}{ccc}1& 1& 0\\ 1& 0& 1\\ 1& -1& -1\end{array}\right]\beta =\left[\begin{array}{c}{\beta }_0\\ {\beta }_1\\ {\beta }_2\end{array}\right]$

Knowing ${\hat{\beta }}_0$, ${\hat{\beta }}_1$ and ${\hat{\beta }}_2$, the predicted value of the life characteristic at any level can be obtained. For example, for the second level:

$\begin{array}{rl}E({\hat{y}}_2)=& {\hat{\beta }}_0+{\hat{\beta }}_2\\ or\ln ({\hat{\eta }}_2)=& {\hat{\beta }}_0+{\hat{\beta }}_2\\ =& 6.421743+0.138414\\ =& 6.560157\end{array}$

Thus:

$\begin{array}{rl}{\hat{\eta }}_2=& \exp (6.560157)\\ =& 706.3828\end{array}$

The variance for the predicted values of life characteristic can be calculated using the following equation:

$Var(y)=XVar(\hat{\beta })X^{\prime }$

where $Var(\hat{\beta })$ is the variance-covariance matrix for ${\hat{\beta }}_0$, ${\hat{\beta }}_1$ and ${\hat{\beta }}_2$. Substituting the required values:

$\begin{array}{rl}Var(\hat{y})=& \left[\begin{array}{ccc}1& 1& 0\\ 1& 0& 1\\ 1& -1& -1\end{array}\right]\left[\begin{array}{ccc}0.0291& -0.0174& 0.0031\\ -0.0174& 0.0423& -0.0154\\ 0.0031& -0.0154& 0.0478\end{array}\right]{\left[\begin{array}{ccc}1& 1& 0\\ 1& 0& 1\\ 1& -1& -1\end{array}\right]}^{\prime }\\ =& \left[\begin{array}{ccc}0.0364& -0.0006& -0.0009\\ -0.0006& 0.0829& 0.0141\\ -0.0009& 0.0141& 0.1167\end{array}\right]\end{array}$

From the previous matrix, $Var({\hat{y}}_2)=0.0829$. Therefore, the 90% confidence interval ( $\alpha =0.1$ ) on ${\hat{y}}_2$ is:

$\begin{array}{rl}CIon{\hat{y}}_2=& E({\hat{y}}_2)\pm z_{\alpha /2}\sqrt{Var({\hat{y}}_2)}\\ =& E({\hat{y}}_2)\pm z_{0.05}\sqrt{Var({\hat{y}}_2)}\\ =& 6.560157\pm 1.645\sqrt{0.0829}\\ =& 6.0867and7.0336\end{array}$

Since ${\hat{y}}_2=\ln ({\hat{\eta }}_2),$ the 90% confidence interval on ${\hat{\eta }}_2$ is:

$\begin{array}{rl}CIon{\hat{\eta }}_2=& \exp (6.0867)and\exp (7.0336)\\ =& 439.9and1134.1\end{array}$

Results for other levels can be calculated in a similar manner and are shown in the figure below.

Life characteristic results for the experiment in the example.

Life Comparisons Results

Results under Life Comparisons include information on how life is different at a level in comparison to any other level of the factor. For example, the difference between the predicted values of life at levels 1 and 2 is (in terms of the logarithmic transformation):

$\begin{array}{rl}E({\hat{y}}_1)-E({\hat{y}}_2)=& 5.923453-6.560157\\ =& -0.6367\end{array}$

The pooled standard error for this difference can be obtained as:

$\begin{array}{rl}PooledStd.Error=& \sqrt{Var({\hat{y}}_1-{\hat{y}}_2)}\\ =& \sqrt{Var({\hat{y}}_1)+Var({\hat{y}}_2)}\\ =& \sqrt{0.0366+0.0831}\\ =& 0.3454\end{array}$

If the covariance between ${\hat{y}}_1$ and ${\hat{y}}_2$ is taken into account, then the pooled standard error is:

$\begin{array}{rl}PooledStd.Error=& \sqrt{Var({\hat{y}}_1-{\hat{y}}_2)}\\ =& \sqrt{Var({\hat{y}}_1)+Var({\hat{y}}_2)-2\cdot Cov({\hat{y}}_1,{\hat{y}}_2)}\\ =& \sqrt{0.0364+0.0829-2\cdot (-0.0006)}\\ =& 0.3471\end{array}$

This is the value displayed by DOE++. Knowing the pooled standard error the confidence interval on the difference can be calculated. The 90% confidence interval on the difference in (logarithmic) life between levels 1 and 2 of factor $A$ is:

$\begin{array}{rl}=& \{E({\hat{y}}_1)-E({\hat{y}}_2)\}\pm z_{\alpha /2}\cdot PooledStd.Error\\ =& \{E({\hat{y}}_1)-E({\hat{y}}_2)\}\pm z_{0.05}\cdot PooledStd.Error\\ =& -0.6367\pm 1.645\cdot 0.3471\\ =& -1.208and-0.066\end{array}$

Since the confidence interval does not include zero it can be concluded that the two levels are significantly different at $\alpha =0.1$. Another way to test for the significance of the difference in levels is to observe the $p$ value. The $z$ statistic corresponding to this difference is:

$\begin{array}{rl}{z}_{(1-2)}=& \frac{E({\hat{y}}_1)-E({\hat{y}}_2)}{PooledStd.Error}\\ =& \frac{-0.6367}{0.3471}\\ =& -1.834\end{array}$

The $p$ value corresponding to this statistic, based on the standard normal distribution, is:

$\begin{array}{rl}pvalue=& 2\cdot (1-P(Z<|-1.8335|)\\ =& 2\cdot (0.03336)\\ =& 0.0667\end{array}$

Since $p$ $value<\alpha ,$ it can be concluded that the levels are significantly different at $\alpha =0.1$. The results for other levels can be calculated in a similar manner and are shown in the figure above.