The Normal Distribution
The normal distribution, also known as the Gaussian distribution, is the most widely-used general purpose distribution. It is for this reason that it is included among the lifetime distributions commonly used for reliability and life data analysis. There are some who argue that the normal distribution is inappropriate for modeling lifetime data because the left-hand limit of the distribution extends to negative infinity. This could conceivably result in modeling negative times-to-failure. However, provided that the distribution in question has a relatively high mean and a relatively small standard deviation, the issue of negative failure times should not present itself as a problem. Nevertheless, the normal distribution has been shown to be useful for modeling the lifetimes of consumable items, such as printer toner cartridges.
Normal Probability Density Function
The pdf of the normal distribution is given by:
- [math]\displaystyle{ f(t)=\frac{1}{\sigma \sqrt{2\pi }}{{e}^{-\frac{1}{2}{{\left( \frac{t-\mu }{\sigma } \right)}^{2}}}} }[/math]
where:
- [math]\displaystyle{ \mu\,\! }[/math] = mean of the normal times-to-faiure, also noted as [math]\displaystyle{ \bar{T} }[/math],
- [math]\displaystyle{ \theta\,\! }[/math] = standard deviation of the times-to-failure
It is a 2-parameter distribution with parameters [math]\displaystyle{ \mu \,\! }[/math] (or [math]\displaystyle{ \bar{T} }[/math] ) and [math]\displaystyle{ {{\sigma }}\,\! }[/math] (i.e., the mean and the standard deviation, respectively).
Normal Statistical Properties
The Normal Mean, Median and Mode
The normal mean or MTTF is actually one of the parameters of the distribution, usually denoted as [math]\displaystyle{ \mu . }[/math] Because the normal distribution is symmetrical, the median and the mode are always equal to the mean:
- [math]\displaystyle{ \mu =\tilde{T}=\breve{T} }[/math]
The Normal Standard Deviation
As with the mean, the standard deviation for the normal distribution is actually one of the parameters, usually denoted as [math]\displaystyle{ {{\sigma }_{T}}\,\! }[/math].
The Normal Reliability Function
The reliability for a mission of time [math]\displaystyle{ T }[/math] for the normal distribution is determined by:
- [math]\displaystyle{ R(t)=\int_{t}^{\infty }f(x)dx=\int_{t}^{\infty }\frac{1}{{{\sigma }}\sqrt{2\pi }}{{e}^{-\tfrac{1}{2}{{\left( \tfrac{x-\mu }{{{\sigma }}} \right)}^{2}}}}dx }[/math]
There is no closed-form solution for the normal reliability function. Solutions can be obtained via the use of standard normal tables. Since the application automatically solves for the reliability, we will not discuss manual solution methods. For interested readers, full explanations can be found in the references.
The Normal Conditional Reliability Function
The normal conditional reliability function is given by:
- [math]\displaystyle{ R(t|T)=\frac{R(T+t)}{R(T)}=\frac{\int_{T+t}^{\infty }\tfrac{1}{{{\sigma }}\sqrt{2\pi }}{{e}^{-\tfrac{1}{2}{{\left( \tfrac{x-\mu }{{{\sigma }}} \right)}^{2}}}}dx}{\int_{T}^{\infty }\tfrac{1}{{{\sigma }}\sqrt{2\pi }}{{e}^{-\tfrac{1}{2}{{\left( \tfrac{x-\mu }{{{\sigma }}} \right)}^{2}}}}dx} }[/math]
Once again, the use of standard normal tables for the calculation of the normal conditional reliability is necessary, as there is no closed form solution.
The Normal Reliable Life
Since there is no closed-form solution for the normal reliability function, there will also be no closed-form solution for the normal reliable life. To determine the normal reliable life, one must solve:
- [math]\displaystyle{ R(T)=\int_{T}^{\infty }\frac{1}{{{\sigma }}\sqrt{2\pi }}{{e}^{-\tfrac{1}{2}{{\left( \tfrac{t-\mu }{{{\sigma }}} \right)}^{2}}}}dt }[/math]
for [math]\displaystyle{ T }[/math] .
The Normal Failure Rate Function
The instantaneous normal failure rate is given by:
- [math]\displaystyle{ \lambda (t)=\frac{f(t)}{R(t)}=\frac{\tfrac{1}{{{\sigma }}\sqrt{2\pi }}{{e}^{-\tfrac{1}{2}{{\left( \tfrac{t-\mu }{{{\sigma }}} \right)}^{2}}}}}{\int_{t}^{\infty }\tfrac{1}{{{\sigma }}\sqrt{2\pi }}{{e}^{-\tfrac{1}{2}{{\left( \tfrac{x-\mu }{{{\sigma }}} \right)}^{2}}}}dx} }[/math]
Characteristics of the Normal Distribution
Some of the specific characteristics of the normal distribution are the following:
- The normal pdf has a mean, [math]\displaystyle{ \bar{T} }[/math] , which is equal to the median, [math]\displaystyle{ \breve{T} }[/math], and also equal to the mode, [math]\displaystyle{ \tilde{T} }[/math], or [math]\displaystyle{ \bar{T}=\breve{T}=\tilde{T} }[/math]. This is because the normal distribution is symmetrical about its mean.
- The mean, [math]\displaystyle{ \mu }[/math] , or the mean life or the [math]\displaystyle{ MTTF }[/math] , is also the location parameter of the normal pdf, as it locates the pdf along the abscissa. It can assume values of [math]\displaystyle{ -\infty \lt \bar{T}\lt \infty }[/math] .
- The normal pdf has no shape parameter. This means that the normal pdf has only one shape, the bell shape, and this shape does not change.
- The standard deviation, [math]\displaystyle{ {{\sigma }} }[/math] , is the scale parameter of the normal pdf.
- As [math]\displaystyle{ {{\sigma }} }[/math] decreases, the pdf gets pushed toward the mean, or it becomes narrower and taller.
- As [math]\displaystyle{ {{\sigma }} }[/math] increases, the pdf spreads out away from the mean, or it becomes broader and shallower.
- The standard deviation can assume values of [math]\displaystyle{ 0\lt {{\sigma }}\lt \infty }[/math] .
- The greater the variability, the larger the value of [math]\displaystyle{ {{\sigma }} }[/math] , and vice versa.
- The standard deviation is also the distance between the mean and the point of inflection of the pdf, on each side of the mean. The point of inflection is that point of the pdf where the slope changes its value from a decreasing to an increasing one, or where the second derivative of the pdf has a value of zero.
- The normal pdf starts at [math]\displaystyle{ t=-\infty }[/math] with an [math]\displaystyle{ f(t)=0 }[/math] . As [math]\displaystyle{ t }[/math] increases, [math]\displaystyle{ f(t) }[/math] also increases, goes through its point of inflection and reaches its maximum value at [math]\displaystyle{ t=\bar{T} }[/math] . Thereafter, [math]\displaystyle{ f(t) }[/math] decreases, goes through its point of inflection, and assumes a value of [math]\displaystyle{ f(t)=0 }[/math] at [math]\displaystyle{ t=+\infty }[/math] .
Weibull++ Notes on Negative Time Values
One of the disadvantages of using the normal distribution for reliability calculations is the fact that the normal distribution starts at negative infinity. This can result in negative values for some of the results. Negative values for time are not accepted in most of the components of Weibull++, nor are they implemented. Certain components of the application reserve negative values for suspensions, or will not return negative results. For example, the Quick Calculation Pad will return a null value (zero) if the result is negative. Only the Free-Form (Probit) data sheet can accept negative values for the random variable (x-axis values).
Estimation of the Parameters
Probability Plotting
As described before, probability plotting involves plotting the failure times and associated unreliability estimates on specially constructed probability plotting paper. The form of this paper is based on a linearization of the cdf of the specific distribution. For the normal distribution, the cumulative density function can be written as:
- [math]\displaystyle{ F(t)=\Phi \left( \frac{t-\mu }{{{\sigma }}} \right) }[/math]
or:
- [math]\displaystyle{ {{\Phi }^{-1}}\left[ F(t) \right]=-\frac{\mu}{\sigma}+\frac{1}{\sigma}t }[/math]
where:
- [math]\displaystyle{ \Phi (x)=\frac{1}{\sqrt{2\pi }}\int_{-\infty }^{x}{{e}^{-\tfrac{{{t}^{2}}}{2}}}dt }[/math]
Now, let:
- [math]\displaystyle{ y={{\Phi }^{-1}}\left[ F(t) \right] }[/math]
- [math]\displaystyle{ a=-\frac{\mu }{\sigma } }[/math]
and:
- [math]\displaystyle{ b=\frac{1}{\sigma } }[/math]
which results in the linear equation of:
- [math]\displaystyle{ \begin{align} y=a+bT \end{align} }[/math]
The normal probability paper resulting from this linearized cdf function is shown next.
Since the normal distribution is symmetrical, the area under the pdf curve from [math]\displaystyle{ -\infty }[/math] to [math]\displaystyle{ \mu }[/math] is [math]\displaystyle{ 0.5 }[/math] , as is the area from [math]\displaystyle{ \mu }[/math] to [math]\displaystyle{ +\infty }[/math] . Consequently, the value of [math]\displaystyle{ \mu }[/math] is said to be the point where [math]\displaystyle{ R(t)=Q(t)=50% }[/math] . This means that the estimate of [math]\displaystyle{ \mu }[/math] can be read from the point where the plotted line crosses the 50% unreliability line.
To determine the value of [math]\displaystyle{ \sigma }[/math] from the probability plot, it is first necessary to understand that the area under the pdf curve that lies between one standard deviation in either direction from the mean (or two standard deviations total) represents 68.3% of the area under the curve. This is represented graphically in the following figure.
Consequently, the interval between [math]\displaystyle{ Q(t)=84.15% }[/math] and [math]\displaystyle{ Q(t)=15.85% }[/math] represents two standard deviations, since this is an interval of 68.3% ( [math]\displaystyle{ 84.15-15.85=68.3 }[/math] ), and is centered on the mean at 50%. As a result, the standard deviation can be estimated from:
- [math]\displaystyle{ \widehat{\sigma }=\frac{t(Q=84.15%)-t(Q=15.85%)}{2} }[/math]
That is: the value of [math]\displaystyle{ \widehat{\sigma } }[/math] is obtained by subtracting the time value where the plotted line crosses the 84.15% unreliability line from the time value where the plotted line crosses the 15.85% unreliability line and dividing the result by two. This process is illustrated in the following example.
Normal Distribution Probability Plotting Example
7 units are put on a life test and run until failure. The failure times are 85, 90, 95, 100, 105, 110, and 115 hours. Assuming a normal distribution, estimate the parameters using probability plotting.
In order to plot the points for the probability plot, the appropriate estimates for the unreliability values must be obtained. These values will be estimated through the use of median ranks, which can be obtained from statistical tables or from the Quick Statistical Reference (QSR) tool in Weibull++. The following table shows the times-to-failure and the appropriate median rank values for this example:
These points can now be plotted on a normal probability plotting paper as shown in the next figure.
Draw the best possible line through the plot points. The time values where the line intersects the 15.85%, 50%, and 84.15% unreliability values should be projected down to the abscissa, as shown in the following plot.
The estimate of [math]\displaystyle{ \mu \,\! }[/math] is determined from the time value at the 50% unreliability level, which in this case is 100 hours. The value of the estimator of [math]\displaystyle{ \sigma \,\! }[/math] is determined as follows:
- [math]\displaystyle{ \begin{align} \widehat{\sigma }= & \frac{t(Q=84.15%)-t(Q=15.85%)}{2} \\ \widehat{\sigma }= & \frac{112-88}{2}=\frac{24}{2} \\ \widehat{\sigma }= & 12\text{ hours} \end{align}\,\! }[/math]
Alternately, [math]\displaystyle{ \widehat{\sigma }\,\! }[/math] could be determined by measuring the distance from [math]\displaystyle{ t(Q=15.85%)\,\! }[/math] to [math]\displaystyle{ t(Q=50%)\,\! }[/math], or [math]\displaystyle{ t(Q=50%)\,\! }[/math] to [math]\displaystyle{ t(Q=84.15%)\,\! }[/math], as either of these two distances is equal to the value of one standard deviation.
Rank Regression on Y
Performing rank regression on Y requires that a straight line be fitted to a set of data points such that the sum of the squares of the vertical deviations from the points to the line is minimized.
The least squares parameter estimation method (regression analysis) was discussed in Parameter Estimation, and the following equations for regression on Y were derived:
- [math]\displaystyle{ \begin{align}\hat{a}= & \bar{b}-\hat{b}\bar{x} \\ =& \frac{\sum_{i=1}^N y_{i}}{N}-\hat{b}\frac{\sum_{i=1}^{N}x_{i}}{N}\\ \end{align} }[/math]
and:
- [math]\displaystyle{ \hat{b}=\frac{\underset{i=1}{\overset{N}{\mathop{\sum }}}\,{{x}_{i}}{{y}_{i}}-\tfrac{\underset{i=1}{\overset{N}{\mathop{\sum }}}\,{{x}_{i}}\underset{i=1}{\overset{N}{\mathop{\sum }}}\,{{y}_{i}}}{N}}{\underset{i=1}{\overset{N}{\mathop{\sum }}}\,x_{i}^{2}-\tfrac{{{\left( \underset{i=1}{\overset{N}{\mathop{\sum }}}\,{{x}_{i}} \right)}^{2}}}{N}} }[/math]
In the case of the normal distribution, the equations for [math]\displaystyle{ {{y}_{i}} }[/math] and [math]\displaystyle{ {{x}_{i}} }[/math] are:
- [math]\displaystyle{ {{y}_{i}}={{\Phi }^{-1}}\left[ F({{t}_{i}}) \right] }[/math]
and:
- [math]\displaystyle{ \begin{align} {{x}_{i}}={{t}_{i}} \end{align} }[/math]
where the values for [math]\displaystyle{ F({{T}_{i}}) }[/math] are estimated from the median ranks. Once [math]\displaystyle{ \widehat{a} }[/math] and [math]\displaystyle{ \widehat{b} }[/math] are obtained, [math]\displaystyle{ \widehat{\sigma } }[/math] and [math]\displaystyle{ \widehat{\mu } }[/math] can easily be obtained from above equations.
The Correlation Coefficient
The estimator of the sample correlation coefficient, [math]\displaystyle{ \hat{\rho } }[/math] , is given by:
- [math]\displaystyle{ \hat{\rho }=\frac{\underset{i=1}{\overset{N}{\mathop{\sum }}}\,({{x}_{i}}-\overline{x})({{y}_{i}}-\overline{y})}{\sqrt{\underset{i=1}{\overset{N}{\mathop{\sum }}}\,{{({{x}_{i}}-\overline{x})}^{2}}\cdot \underset{i=1}{\overset{N}{\mathop{\sum }}}\,{{({{y}_{i}}-\overline{y})}^{2}}}} }[/math]
RRY Example
Normal Distribution RRY Example
14 units were reliability tested and the following life test data were obtained. Assuming the data follow a normal distribution, estimate the parameters and determine the correlation coefficient, [math]\displaystyle{ \rho\,\! }[/math], using rank regression on Y.
| The test data | |
|---|---|
| Data point index | Time-to-failure |
| 1 | 5 |
| 2 | 10 |
| 3 | 15 |
| 4 | 20 |
| 5 | 25 |
| 6 | 30 |
| 7 | 35 |
| 8 | 40 |
| 9 | 50 |
| 10 | 60 |
| 11 | 70 |
| 12 | 80 |
| 13 | 90 |
| 14 | 100 |
Solution
Construct a table like the one shown next.
- The median rank values ( [math]\displaystyle{ F({{t}_{i}}) }[/math] ) can be found in rank tables, available in many statistical texts, or they can be estimated by using the Quick Statistical Reference in Weibull++.
- The [math]\displaystyle{ {{y}_{i}} }[/math] values were obtained from standardized normal distribution's area tables by entering for [math]\displaystyle{ F(z) }[/math] and getting the corresponding [math]\displaystyle{ z }[/math] value ( [math]\displaystyle{ {{y}_{i}} }[/math] ). As with the median rank values, these standard normal values can be obtained with the Quick Statistical Reference.
Given the values in the table above, calculate [math]\displaystyle{ \widehat{a} }[/math] and [math]\displaystyle{ \widehat{b} }[/math] using:
- [math]\displaystyle{ \begin{align} & \widehat{b}= & \frac{\underset{i=1}{\overset{14}{\mathop{\sum }}}\,{{T}_{i}}{{y}_{i}}-(\underset{i=1}{\overset{14}{\mathop{\sum }}}\,{{T}_{i}})(\underset{i=1}{\overset{14}{\mathop{\sum }}}\,{{y}_{i}})/14}{\underset{i=1}{\overset{14}{\mathop{\sum }}}\,T_{i}^{2}-{{(\underset{i=1}{\overset{14}{\mathop{\sum }}}\,{{T}_{i}})}^{2}}/14} \\ & & \\ & \widehat{b}= & \frac{365.2711-(630)(0)/14}{40,600-{{(630)}^{2}}/14}=0.02982 \end{align} }[/math]
and:
- [math]\displaystyle{ \widehat{a}=\overline{y}-\widehat{b}\overline{T}=\frac{\underset{i=1}{\overset{N}{\mathop{\sum }}}\,{{y}_{i}}}{N}-\widehat{b}\frac{\underset{i=1}{\overset{N}{\mathop{\sum }}}\,{{t}_{i}}}{N} }[/math]
or:
- [math]\displaystyle{ \widehat{a}=\frac{0}{14}-(0.02982)\frac{630}{14}=-1.3419 }[/math]
Therefore:
- [math]\displaystyle{ \widehat{\sigma}=\frac{1}{\hat{b}}=\frac{1}{0.02982}=33.5367 }[/math]
and:
- [math]\displaystyle{ \widehat{\mu }=-\widehat{a}\cdot \widehat{\sigma }=-(-1.3419)\cdot 33.5367\simeq 45 }[/math]
or [math]\displaystyle{ \widehat{\mu }=45 }[/math] hours [math]\displaystyle{ . }[/math]
The correlation coefficient can be estimated using:
- [math]\displaystyle{ \widehat{\rho }=0.979 }[/math]
The preceding example can be repeated using Weibull++ .
- Create a new folio for Times-to-Failure data, and enter the data given in this example.
- Choose Normal from the Distributions list.
- Go to the Analysis page and select Rank Regression on Y (RRY).
- Click the Calculate icon located on the Main page.
The probability plot is shown next.
Rank Regression on X
As was mentioned previously, performing a rank regression on X requires that a straight line be fitted to a set of data points such that the sum of the squares of the horizontal deviations from the points to the fitted line is minimized.
Again, the first task is to bring our function, the probability of failure function for normal distribution, into a linear form. This step is exactly the same as in regression on Y analysis. All other equations apply in this case as they did for the regression on Y. The deviation from the previous analysis begins on the least squares fit step where: in this case, we treat [math]\displaystyle{ x }[/math] as the dependent variable and [math]\displaystyle{ y }[/math] as the independent variable. The best-fitting straight line for the data, for regression on X, is the straight line:
- [math]\displaystyle{ x=\widehat{a}+\widehat{b}y }[/math]
The corresponding equations for [math]\displaystyle{ \widehat{a} }[/math] and [math]\displaystyle{ \widehat{b} }[/math] are:
- [math]\displaystyle{ \hat{a}=\overline{x}-\hat{b}\overline{y}=\frac{\underset{i=1}{\overset{N}{\mathop{\sum }}}\,{{x}_{i}}}{N}-\hat{b}\frac{\underset{i=1}{\overset{N}{\mathop{\sum }}}\,{{y}_{i}}}{N} }[/math]
and:
- [math]\displaystyle{ \hat{b}=\frac{\underset{i=1}{\overset{N}{\mathop{\sum }}}\,{{x}_{i}}{{y}_{i}}-\tfrac{\underset{i=1}{\overset{N}{\mathop{\sum }}}\,{{x}_{i}}\underset{i=1}{\overset{N}{\mathop{\sum }}}\,{{y}_{i}}}{N}}{\underset{i=1}{\overset{N}{\mathop{\sum }}}\,y_{i}^{2}-\tfrac{{{\left( \underset{i=1}{\overset{N}{\mathop{\sum }}}\,{{y}_{i}} \right)}^{2}}}{N}} }[/math]
where:
- [math]\displaystyle{ {{y}_{i}}={{\Phi }^{-1}}\left[ F({{t}_{i}}) \right] }[/math]
and:
- [math]\displaystyle{ \begin{align} {{x}_{i}}={{t}_{i}} \end{align} }[/math]
and the [math]\displaystyle{ F({{t}_{i}})\,\! }[/math] values are estimated from the median ranks. Once [math]\displaystyle{ \widehat{a} }[/math] and [math]\displaystyle{ \widehat{b} }[/math] are obtained, solve the above linear equation for the unknown value of [math]\displaystyle{ y }[/math] which corresponds to:
- [math]\displaystyle{ y=-\frac{\widehat{a}}{\widehat{b}}+\frac{1}{\widehat{b}}x }[/math]
Solving for the parameters, we get:
- [math]\displaystyle{ a=-\frac{\widehat{a}}{\widehat{b}}=-\frac{\mu }{\sigma }\Rightarrow \mu =\widehat{a} }[/math]
and:
- [math]\displaystyle{ b=\frac{1}{\widehat{b}}=\frac{1}{\sigma }\Rightarrow \sigma =\widehat{b} }[/math]
The correlation coefficient is evaluated as before.
RRX Example
Normal Distribution RRX Example
Using the same data set from the RRY example given above, and assuming a normal distribution, estimate the parameters and determine the correlation coefficient, [math]\displaystyle{ \rho \,\! }[/math] , using rank regression on X.
Solution
The table constructed for the RRY analysis applies to this example also. Using the values on this table, we get:
- [math]\displaystyle{ \begin{align} \hat{b}= & \frac{\underset{i=1}{\overset{14}{\mathop{\sum }}}\,{{t}_{i}}{{y}_{i}}-\tfrac{\underset{i=1}{\overset{14}{\mathop{\sum }}}\,{{t}_{i}}\underset{i=1}{\overset{14}{\mathop{\sum }}}\,{{y}_{i}}}{14}}{\underset{i=1}{\overset{14}{\mathop{\sum }}}\,y_{i}^{2}-\tfrac{{{\left( \underset{i=1}{\overset{14}{\mathop{\sum }}}\,{{y}_{i}} \right)}^{2}}}{14}} \\ \widehat{b}= & \frac{365.2711-(630)(0)/14}{11.3646-{{(0)}^{2}}/14}=32.1411 \end{align} }[/math]
and:
- [math]\displaystyle{ \hat{a}=\overline{x}-\hat{b}\overline{y}=\frac{\underset{i=1}{\overset{14}{\mathop{\sum }}}\,{{t}_{i}}}{14}-\widehat{b}\frac{\underset{i=1}{\overset{14}{\mathop{\sum }}}\,{{y}_{i}}}{14} }[/math]
or:
- [math]\displaystyle{ \widehat{a}=\frac{630}{14}-(32.1411)\frac{(0)}{14}=45 }[/math]
Therefore:
- [math]\displaystyle{ \widehat{\sigma }=\widehat{b}=32.1411 }[/math]
and:
- [math]\displaystyle{ \widehat{\mu }=\widehat{a}=45\text{ hours} }[/math]
The correlation coefficient is obtained as:
- [math]\displaystyle{ \widehat{\rho }=0.979 }[/math]
Note that the results for regression on X are not necessarily the same as the results for regression on Y. The only time when the two regressions are the same (i.e., will yield the same equation for a line) is when the data lie perfectly on a straight line.
The plot of the Weibull++ solution for this example is shown next.
Maximum Likelihood Estimation
As it was outlined in Parameter Estimation, maximum likelihood estimation works by developing a likelihood function based on the available data and finding the values of the parameter estimates that maximize the likelihood function. This can be achieved by using iterative methods to determine the parameter estimate values that maximize the likelihood function. This can be rather difficult and time-consuming, particularly when dealing with the three-parameter distribution. Another method of finding the parameter estimates involves taking the partial derivatives of the likelihood function with respect to the parameters, setting the resulting equations equal to zero, and solving simultaneously to determine the values of the parameter estimates. The log-likelihood functions and associated partial derivatives used to determine maximum likelihood estimates for the normal distribution are covered in the Appendix.
Special Note About Bias
Estimators (i.e., parameter estimates) have properties such as unbiasedness, minimum variance, sufficiency, consistency, squared error constancy, efficiency and completeness, as discussed in Dudewicz and Mishra [7] and in Dietrich [5]. Numerous books and papers deal with these properties and this coverage is beyond the scope of this reference.
However, we would like to briefly address one of these properties, unbiasedness. An estimator is said to be unbiased if the estimator [math]\displaystyle{ \widehat{\theta }=d({{X}_{1,}}{{X}_{2,}}...,{{X}_{n)}} }[/math] satisfies the condition [math]\displaystyle{ E\left[ \widehat{\theta } \right] }[/math] [math]\displaystyle{ =\theta }[/math] for all [math]\displaystyle{ \theta \in \Omega . }[/math]
Note that [math]\displaystyle{ E\left[ X \right] }[/math] denotes the expected value of X and is defined (for continuous distributions) by:
- [math]\displaystyle{ \begin{align} E\left[ X \right]= \int_{\varpi }x\cdot f(x)dx \\ X\in & \varpi . \end{align} }[/math]
It can be shown in Dudewicz and Mishra [7] and in Dietrich [5] that the MLE estimator for the mean of the normal (and lognormal) distribution does satisfy the unbiasedness criteria, or [math]\displaystyle{ E\left[ \widehat{\mu } \right] }[/math] [math]\displaystyle{ =\mu . }[/math] The same is not true for the estimate of the variance [math]\displaystyle{ \hat{\sigma }^{2} }[/math] . The maximum likelihood estimate for the variance for the normal distribution is given by:
- [math]\displaystyle{ \hat{\sigma }^{2}=\frac{1}{N}\underset{i=1}{\overset{N}{\mathop \sum }}\,{{({{t}_{i}}-\bar{T})}^{2}} }[/math]
with a standard deviation of:
- [math]\displaystyle{ {{\hat{\sigma }}}=\sqrt{\frac{1}{N}\underset{i=1}{\overset{N}{\mathop \sum }}\,{{({{t}_{i}}-\bar{T})}^{2}}} }[/math]
These estimates, however, have been shown to be biased. It can be shown [7][5] that the unbiased estimate of the variance and standard deviation for complete data is given by:
- [math]\displaystyle{ \begin{align} \hat{\sigma }^{2}= & \left[ \frac{N}{N-1} \right]\cdot \left[ \frac{1}{N}\underset{i=1}{\overset{N}{\mathop \sum }}\,{{({{t}_{i}}-\bar{T})}^{2}} \right]=\frac{1}{N-1}\underset{i=1}{\overset{N}{\mathop \sum }}\,{{({{t}_{i}}-\bar{T})}^{2}} \\ {{{\hat{\sigma }}}}= & \sqrt{\left[ \frac{N}{N-1} \right]\cdot \left[ \frac{1}{N}\underset{i=1}{\overset{N}{\mathop \sum }}\,{{({{t}_{i}}-\bar{T})}^{2}} \right]} \\ = & \sqrt{\frac{1}{N-1}\underset{i=1}{\overset{N}{\mathop \sum }}\,{{({{t}_{i}}-\bar{T})}^{2}}} \end{align} }[/math]
Note that for larger values of [math]\displaystyle{ N }[/math] , [math]\displaystyle{ \sqrt{\left[ N/(N-1) \right]} }[/math] tends to 1.
The Use Unbiased Std on Normal Data option on the Calculations page of the User Setup allows biasing to be considered when estimating the parameters.
When this option is selected, Weibull++ returns the unbiased standard deviation as defined. This is only true for complete data sets. For all other data types, Weibull++ by default returns the biased standard deviation as defined above regardless of the selection status of this option. The next figure shows this setting in Weibull++.
[math]\displaystyle{ }[/math]
MLE Example
Normal Distribution MLE Example
Using the same data set from the RRY and RRX examples given above and assuming a normal distribution, estimate the parameters using the MLE method.
Solution
In this example we have non-grouped data without suspensions and without interval data. The partial derivatives of the normal log-likelihood function, [math]\displaystyle{ \Lambda , }[/math] are given by:
- [math]\displaystyle{ \begin{align} \frac{\partial \Lambda }{\partial \mu }= & \frac{1}{{{\sigma }^{2}}}\underset{i=1}{\overset{14}{\mathop \sum }}\,({{t}_{i}}-\mu )=0 \\ \frac{\partial \Lambda }{\partial \sigma }= & \underset{i=1}{\overset{14}{\mathop \sum }}\,\left( \frac{{{t}_{i}}-\mu }{{{\sigma }^{3}}}-\frac{1}{\sigma } \right)=0 \end{align} }[/math]
(The derivations of these equations are presented in the appendix.) Substituting the values of [math]\displaystyle{ {{t}_{i}} }[/math] and solving the above system simultaneously, we get [math]\displaystyle{ \widehat{\sigma }=29.58 }[/math] hours [math]\displaystyle{ , }[/math] [math]\displaystyle{ \widehat{\mu }=45 }[/math] hours [math]\displaystyle{ . }[/math]
The Fisher matrix is:
- [math]\displaystyle{ \left[ \begin{matrix} \widehat{Var}\left( \widehat{\mu } \right)=62.5000 & {} & \widehat{Cov}\left( \widehat{\mu },\widehat{\sigma } \right)=0.0000 \\ {} & {} & {} \\ \widehat{Cov}\left( \widehat{\mu },\widehat{\sigma } \right)=0.0000 & {} & \widehat{Var}\left( \widehat{\sigma } \right)=31.2500 \\ \end{matrix} \right] }[/math]
The plot of the Weibull++ solution for this example is shown next.
Confidence Bounds
The method used by the application in estimating the different types of confidence bounds for normally distributed data is presented in this section. The complete derivations were presented in detail (for a general function) in Confidence Bounds.
Exact Confidence Bounds
There are closed-form solutions for exact confidence bounds for both the normal and lognormal distributions. However these closed-forms solutions only apply to complete data. To achieve consistent application across all possible data types, Weibull++ always uses the Fisher matrix method or likelihood ratio method in computing confidence intervals.
Fisher Matrix Confidence Bounds
Bounds on the Parameters
The lower and upper bounds on the mean, [math]\displaystyle{ \widehat{\mu } }[/math] , are estimated from:
- [math]\displaystyle{ \begin{align} & {{\mu }_{U}}= & \widehat{\mu }+{{K}_{\alpha }}\sqrt{Var(\widehat{\mu })}\text{ (upper bound)} \\ & {{\mu }_{L}}= & \widehat{\mu }-{{K}_{\alpha }}\sqrt{Var(\widehat{\mu })}\text{ (lower bound)} \end{align} }[/math]
Since the standard deviation, [math]\displaystyle{ {{\widehat{\sigma }}} }[/math] , must be positive, [math]\displaystyle{ \ln ({{\widehat{\sigma }}}) }[/math] is treated as normally distributed, and the bounds are estimated from:
- [math]\displaystyle{ \begin{align} & {{\sigma }_{U}}= & {{\widehat{\sigma }}}\cdot {{e}^{\tfrac{{{K}_{\alpha }}\sqrt{Var({{\widehat{\sigma }}})}}{{{\widehat{\sigma }}}}}}\text{ (upper bound)} \\ & {{\sigma }_{L}}= & \frac{{{\widehat{\sigma }}}}{{{e}^{\tfrac{{{K}_{\alpha }}\sqrt{Var({{\widehat{\sigma }}})}}{{{\widehat{\sigma }}}}}}}\text{ (lower bound)} \end{align} }[/math]
where [math]\displaystyle{ {{K}_{\alpha }}\,\! }[/math] is defined by:
- [math]\displaystyle{ \alpha =\frac{1}{\sqrt{2\pi }}\int_{{{K}_{\alpha }}}^{\infty }{{e}^{-\tfrac{{{t}^{2}}}{2}}}dt=1-\Phi ({{K}_{\alpha }}) }[/math]
If [math]\displaystyle{ \delta \,\! }[/math] is the confidence level, then [math]\displaystyle{ \alpha =\tfrac{1-\delta }{2} }[/math] for the two-sided bounds and [math]\displaystyle{ \alpha =1-\delta }[/math] for the one-sided bounds.
The variances and covariances of [math]\displaystyle{ \widehat{\mu } }[/math] and [math]\displaystyle{ {{\widehat{\sigma }}} }[/math] are estimated from the Fisher matrix, as follows:
- [math]\displaystyle{ \left( \begin{matrix} \widehat{Var}\left( \widehat{\mu } \right) & \widehat{Cov}\left( \widehat{\mu },{{\widehat{\sigma }}} \right) \\ \widehat{Cov}\left( \widehat{\mu },{{\widehat{\sigma }}} \right) & \widehat{Var}\left( {{\widehat{\sigma }}} \right) \\ \end{matrix} \right)=\left( \begin{matrix} -\tfrac{{{\partial }^{2}}\Lambda }{\partial {{\mu }^{2}}} & -\tfrac{{{\partial }^{2}}\Lambda }{\partial \mu \partial {{\sigma }}} \\ {} & {} \\ -\tfrac{{{\partial }^{2}}\Lambda }{\partial \mu \partial {{\sigma }}} & -\tfrac{{{\partial }^{2}}\Lambda }{\partial \sigma^{2}} \\ \end{matrix} \right)_{\mu =\widehat{\mu },\sigma =\widehat{\sigma }}^{-1} }[/math]
[math]\displaystyle{ \Lambda }[/math] is the log-likelihood function of the normal distribution, described in Parameter Estimation and Appendix D.
Bounds on Reliability
The reliability of the normal distribution is:
- [math]\displaystyle{ \widehat{R}(t;\hat{\mu },{{\hat{\sigma }}})=\int_{t}^{\infty }\frac{1}{{{\widehat{\sigma }}}\sqrt{2\pi }}{{e}^{-\tfrac{1}{2}{{\left( \tfrac{t-\widehat{\mu }}{{{\widehat{\sigma }}}} \right)}^{2}}}}dt }[/math]
Let [math]\displaystyle{ \widehat{z}=\tfrac{t-\widehat{\mu }}{{{\widehat{\sigma }}}} }[/math], the above equation then becomes:
- [math]\displaystyle{ \hat{R}(\widehat{z})=\int_{\widehat{z}(t)}^{\infty }\frac{1}{\sqrt{2\pi }}{{e}^{-\tfrac{1}{2}{{z}^{2}}}}dz }[/math]
The bounds on [math]\displaystyle{ z }[/math] are estimated from:
- [math]\displaystyle{ \begin{align} & {{z}_{U}}= & \widehat{z}+{{K}_{\alpha }}\sqrt{Var(\widehat{z})} \\ & {{z}_{L}}= & \widehat{z}-{{K}_{\alpha }}\sqrt{Var(\widehat{z})} \end{align} }[/math]
where:
- [math]\displaystyle{ Var(\widehat{z})={{\left( \frac{\partial \hat{z}}{\partial \mu } \right)}^{2}}Var(\widehat{\mu })+{{\left( \frac{\partial \hat{z}}{\partial {{\sigma }}} \right)}^{2}}Var({{\widehat{\sigma }}})+2\left( \frac{\partial \hat{z}}{\partial \mu } \right)\left( \frac{\partial \hat{z}}{\partial {{\sigma }}} \right)Cov\left( \widehat{\mu },{{\widehat{\sigma }}} \right) }[/math]
or:
- [math]\displaystyle{ Var(\widehat{z})=\frac{1}{\widehat{\sigma }^{2}}\left[ Var(\widehat{\mu })+{{\widehat{z}}^{2}}Var({{\widehat{\sigma }}})+2\cdot \widehat{z}\cdot Cov\left( \widehat{\mu },{{\widehat{\sigma }}} \right) \right] }[/math]
The upper and lower bounds on reliability are:
- [math]\displaystyle{ \begin{align} & {{R}_{U}}= & \int_{{{z}_{L}}}^{\infty }\frac{1}{\sqrt{2\pi }}{{e}^{-\tfrac{1}{2}{{z}^{2}}}}dz\text{ (upper bound)} \\ & {{R}_{L}}= & \int_{{{z}_{U}}}^{\infty }\frac{1}{\sqrt{2\pi }}{{e}^{-\tfrac{1}{2}{{z}^{2}}}}dz\text{ (lower bound)} \end{align} }[/math]
Bounds on Time
The bounds around time for a given normal percentile (unreliability) are estimated by first solving the reliability equation with respect to time, as follows:
- [math]\displaystyle{ \hat{T}(\widehat{\mu },{{\widehat{\sigma }}})=\widehat{\mu }+z\cdot {{\widehat{\sigma }}} }[/math]
where:
- [math]\displaystyle{ z={{\Phi }^{-1}}\left[ F(T) \right] }[/math]
and:
- [math]\displaystyle{ \Phi (z)=\frac{1}{\sqrt{2\pi }}\int_{-\infty }^{z}{{e}^{-\tfrac{1}{2}{{z}^{2}}}}dz }[/math]
The next step is to calculate the variance of [math]\displaystyle{ \hat{T}(\widehat{\mu },{{\widehat{\sigma }}}) }[/math] or:
- [math]\displaystyle{ \begin{align} Var(\hat{T})= & {{\left( \frac{\partial \hat{T}}{\partial \mu } \right)}^{2}}Var(\widehat{\mu })+{{\left( \frac{\partial \hat{T}}{\partial {{\sigma }}} \right)}^{2}}Var({{\widehat{\sigma }}}) \\ & +2\left( \frac{\partial \hat{T}}{\partial \mu } \right)\left( \frac{\partial \hat{T}}{\partial {{\sigma }}} \right)Cov\left( \widehat{\mu },{{\widehat{\sigma }}} \right) \\ Var(\hat{T})= & Var(\widehat{\mu })+{{\widehat{z}}^{2}}Var({{\widehat{\sigma }}})+2\cdot z\cdot Cov\left( \widehat{\mu },{{\widehat{\sigma }}} \right) \end{align} }[/math]
The upper and lower bounds are then found by:
- [math]\displaystyle{ \begin{align} & {{T}_{U}}= & \hat{T}+{{K}_{\alpha }}\sqrt{Var(\hat{T})}\text{ (upper bound)} \\ & {{T}_{L}}= & \hat{T}-{{K}_{\alpha }}\sqrt{Var(\hat{T})}\text{ (lower bound)} \end{align} }[/math]
Likelihood Ratio Confidence Bounds
Bounds on Parameters
As covered in Confidence Bounds, the likelihood confidence bounds are calculated by finding values for [math]\displaystyle{ {{\theta }_{1}} }[/math] and [math]\displaystyle{ {{\theta }_{2}} }[/math] that satisfy:
- [math]\displaystyle{ -2\cdot \text{ln}\left( \frac{L({{\theta }_{1}},{{\theta }_{2}})}{L({{\widehat{\theta }}_{1}},{{\widehat{\theta }}_{2}})} \right)=\chi _{\alpha ;1}^{2} }[/math]
This equation can be rewritten as:
- [math]\displaystyle{ L({{\theta }_{1}},{{\theta }_{2}})=L({{\widehat{\theta }}_{1}},{{\widehat{\theta }}_{2}})\cdot {{e}^{\tfrac{-\chi _{\alpha ;1}^{2}}{2}}} }[/math]
For complete data, the likelihood formula for the normal distribution is given by:
- [math]\displaystyle{ L(\mu ,\sigma )=\underset{i=1}{\overset{N}{\mathop \prod }}\,f({{t}_{i}};\mu ,\sigma )=\underset{i=1}{\overset{N}{\mathop \prod }}\,\frac{1}{\sigma \cdot \sqrt{2\pi }}\cdot {{e}^{-\tfrac{1}{2}{{\left( \tfrac{{{t}_{i}}-\mu }{\sigma } \right)}^{2}}}} }[/math]
where the [math]\displaystyle{ {{t}_{i}}\,\! }[/math] values represent the original time to failure data. For a given value of [math]\displaystyle{ \alpha \,\! }[/math] , values for [math]\displaystyle{ \mu \,\! }[/math] and [math]\displaystyle{ \sigma \,\! }[/math] can be found which represent the maximum and minimum values that satisfy the above likelihood ratio equation. These represent the confidence bounds for the parameters at a confidence level [math]\displaystyle{ \delta \,\! }[/math], where [math]\displaystyle{ \alpha =\delta \,\! }[/math] for two-sided bounds and [math]\displaystyle{ \alpha =2\delta -1\,\! }[/math] for one-sided.
Example: LR Bounds on Parameters
Five units are put on a reliability test and experience failures at 12, 24, 28, 34, and 46 hours. Assuming a normal distribution, the MLE parameter estimates are calculated to be [math]\displaystyle{ \widehat{\mu }=28.8 }[/math] and [math]\displaystyle{ \widehat{\sigma }=11.2143. }[/math] Calculate the two-sided 80% confidence bounds on these parameters using the likelihood ratio method.
Solution
The first step is to calculate the likelihood function for the parameter estimates:
- [math]\displaystyle{ \begin{align} L(\widehat{\mu },\widehat{\sigma })= & \underset{i=1}{\overset{N}{\mathop \prod }}\,f({{t}_{i}};\widehat{\mu },\widehat{\sigma })=\underset{i=1}{\overset{5}{\mathop \prod }}\,\frac{1}{\widehat{\sigma }\cdot \sqrt{2\pi }}\cdot {{e}^{-\tfrac{1}{2}{{\left( \tfrac{{{t}_{i}}-\widehat{\mu }}{\widehat{\sigma }} \right)}^{2}}}} \\ L(\widehat{\mu },\widehat{\sigma })= & \underset{i=1}{\overset{5}{\mathop \prod }}\,\frac{1}{11.2143\cdot \sqrt{2\pi }}\cdot {{e}^{-\tfrac{1}{2}{{\left( \tfrac{{{t}_{i}}-28.8}{11.2143} \right)}^{2}}}} \\ L(\widehat{\mu },\widehat{\sigma })= & 4.676897\times {{10}^{-9}} \end{align} }[/math]
where [math]\displaystyle{ {{t}_{i}} }[/math] are the original time-to-failure data points. We can now rearrange the likelihood ratio equation to the form:
- [math]\displaystyle{ L(\mu ,\sigma )-L(\widehat{\mu },\widehat{\sigma })\cdot {{e}^{\tfrac{-\chi _{\alpha ;1}^{2}}{2}}}=0 }[/math]
Since our specified confidence level, [math]\displaystyle{ \delta }[/math] , is 80%, we can calculate the value of the chi-squared statistic, [math]\displaystyle{ \chi _{0.8;1}^{2}=1.642374. }[/math] We can now substitute this information into the equation:
- [math]\displaystyle{ \begin{align} L(\mu ,\sigma )-L(\widehat{\mu },\widehat{\sigma })\cdot {{e}^{\tfrac{-\chi _{\alpha ;1}^{2}}{2}}}= & 0, \\ \\ L(\mu ,\sigma )-4.676897\times {{10}^{-9}}\cdot {{e}^{\tfrac{-1.642374}{2}}}= & 0, \\ \\ L(\mu ,\sigma )-2.057410\times {{10}^{-9}}= & 0. \end{align} }[/math]
It now remains to find the values of [math]\displaystyle{ \mu }[/math] and [math]\displaystyle{ \sigma }[/math] which satisfy this equation. This is an iterative process that requires setting the value of [math]\displaystyle{ \mu }[/math] and finding the appropriate values of [math]\displaystyle{ \sigma }[/math] , and vice versa.
The following table gives the values of [math]\displaystyle{ \sigma }[/math] based on given values of [math]\displaystyle{ \mu }[/math] .
This data set is represented graphically in the following contour plot:
(Note that this plot is generated with degrees of freedom [math]\displaystyle{ k=1 }[/math] , as we are only determining bounds on one parameter. The contour plots generated in Weibull++ are done with degrees of freedom [math]\displaystyle{ k=2 }[/math] , for use in comparing both parameters simultaneously.) As can be determined from the table, the lowest calculated value for [math]\displaystyle{ \sigma }[/math] is 7.849, while the highest is 17.909. These represent the two-sided 80% confidence limits on this parameter. Since solutions for the equation do not exist for values of [math]\displaystyle{ \mu }[/math] below 22 or above 35.5, these can be considered the two-sided 80% confidence limits for this parameter. In order to obtain more accurate values for the confidence limits on [math]\displaystyle{ \mu }[/math] , we can perform the same procedure as before, but finding the two values of [math]\displaystyle{ \mu }[/math] that correspond with a given value of [math]\displaystyle{ \sigma . }[/math] Using this method, we find that the two-sided 80% confidence limits on [math]\displaystyle{ \mu }[/math] are 21.807 and 35.793, which are close to the initial estimates of 22 and 35.5.
Bounds on Time and Reliability
In order to calculate the bounds on a time estimate for a given reliability, or on a reliability estimate for a given time, the likelihood function needs to be rewritten in terms of one parameter and time/reliability, so that the maximum and minimum values of the time can be observed as the parameter is varied. This can be accomplished by substituting a form of the normal reliability equation into the likelihood function. The normal reliability equation can be written as:
- [math]\displaystyle{ R=1-\Phi \left( \frac{t-\mu }{\sigma } \right) }[/math]
This can be rearranged to the form:
- [math]\displaystyle{ \mu =t-\sigma \cdot {{\Phi }^{-1}}(1-R) }[/math]
where [math]\displaystyle{ {{\Phi }^{-1}}\,\! }[/math] is the inverse standard normal. This equation can now be substituted into the likelihood ratio equation to produce an equation in terms of [math]\displaystyle{ \sigma , }[/math] [math]\displaystyle{ t }[/math] and [math]\displaystyle{ R }[/math]:
- [math]\displaystyle{ L(\sigma ,t/R)=\underset{i=1}{\overset{N}{\mathop \prod }}\,\frac{1}{\sigma \cdot \sqrt{2\pi }}\cdot {{e}^{-\tfrac{1}{2}{{\left( \tfrac{{{t}_{i}}-\left[ t-\sigma \cdot {{\Phi }^{-1}}(1-R) \right]}{\sigma } \right)}^{2}}}} }[/math]
The unknown parameter [math]\displaystyle{ t/R }[/math] depends on what type of bounds are being determined. If one is trying to determine the bounds on time for a given reliability, then [math]\displaystyle{ R }[/math] is a known constant and [math]\displaystyle{ t }[/math] is the unknown parameter. Conversely, if one is trying to determine the bounds on reliability for a given time, then [math]\displaystyle{ t }[/math] is a known constant and [math]\displaystyle{ R }[/math] is the unknown parameter. The likelihood ratio equation can be used to solve the values of interest.
Example: LR Bounds on Time
For the same data set given above in the parameter bounds example, determine the two-sided 80% confidence bounds on the time estimate for a reliability of 40%. The ML estimate for the time at [math]\displaystyle{ R(t)=40% }[/math] is 31.637.
Solution
In this example, we are trying to determine the two-sided 80% confidence bounds on the time estimate of 31.637. This is accomplished by substituting [math]\displaystyle{ R=0.40 }[/math] and [math]\displaystyle{ \alpha =0.8 }[/math] into the likelihood ratio equation for the normal distribution, and varying [math]\displaystyle{ \sigma }[/math] until the maximum and minimum values of [math]\displaystyle{ t }[/math] are found. The following table gives the values of [math]\displaystyle{ t }[/math] based on given values of [math]\displaystyle{ \sigma }[/math] .
This data set is represented graphically in the following contour plot:
As can be determined from the table, the lowest calculated value for [math]\displaystyle{ t }[/math] is 25.046, while the highest is 39.250. These represent the 80% confidence limits on the time at which reliability is equal to 40%.
Example: LR Bounds on Reliability
For the same data set given above in the parameter bounds and time bounds examples, determine the two-sided 80% confidence bounds on the reliability estimate for [math]\displaystyle{ t=30 }[/math]. The ML estimate for the reliability at [math]\displaystyle{ t=30 }[/math] is 45.739%.
Solution
In this example, we are trying to determine the two-sided 80% confidence bounds on the reliability estimate of 45.739%. This is accomplished by substituting [math]\displaystyle{ t=30 }[/math] and [math]\displaystyle{ \alpha =0.8 }[/math] into the likelihood ratio equation for normal distribution, and varying [math]\displaystyle{ \sigma }[/math] until the maximum and minimum values of [math]\displaystyle{ R }[/math] are found. The following table gives the values of [math]\displaystyle{ R }[/math] based on given values of [math]\displaystyle{ \sigma }[/math] .
This data set is represented graphically in the following contour plot:
As can be determined from the table, the lowest calculated value for [math]\displaystyle{ R }[/math] is 24.776%, while the highest is 68.000%. These represent the 80% two-sided confidence limits on the reliability at [math]\displaystyle{ t=30 }[/math].
Bayesian Confidence Bounds
Bounds on Parameters
From Confidence Bounds, we know that the marginal posterior distribution of [math]\displaystyle{ \mu }[/math] can be written as:
- [math]\displaystyle{ \begin{align} f(\mu |Data)= & \int_{0}^{\infty }f(\mu ,\sigma |Data)d\sigma \\ = & \frac{\int_{0}^{\infty }L(Data|\mu ,\sigma )\varphi (\mu )\varphi (\sigma )d\sigma }{\int_{0}^{\infty }\int_{-\infty }^{\infty }L(Data|\mu ,\sigma )\varphi (\mu )\varphi (\sigma )d\mu d\sigma } \end{align} }[/math]
where:
- [math]\displaystyle{ \varphi (\sigma ) }[/math] = [math]\displaystyle{ \tfrac{1}{\sigma } }[/math] is the non-informative prior of [math]\displaystyle{ \sigma }[/math] .
- [math]\displaystyle{ \varphi (\mu ) }[/math] is a uniform distribution from - [math]\displaystyle{ \infty }[/math] to + [math]\displaystyle{ \infty }[/math] , the non-informative prior of [math]\displaystyle{ \mu . }[/math]
Using the above prior distributions, [math]\displaystyle{ f(\mu |Data) }[/math] can be rewritten as:
- [math]\displaystyle{ f(\mu |Data)=\frac{\int_{0}^{\infty }L(Data|\mu ,\sigma )\tfrac{1}{\sigma }d\sigma }{\int_{0}^{\infty }\int_{-\infty }^{\infty }L(Data|\mu ,\sigma )\tfrac{1}{\sigma }d\mu d\sigma } }[/math]
The one-sided upper bound of [math]\displaystyle{ \mu }[/math] is:
- [math]\displaystyle{ CL=P(\mu \le {{\mu }_{U}})=\int_{-\infty }^{{{\mu }_{U}}}f(\mu |Data)d\mu }[/math]
The one-sided lower bound of [math]\displaystyle{ \mu }[/math] is:
- [math]\displaystyle{ 1-CL=P(\mu \le {{\mu }_{L}})=\int_{-\infty }^{{{\mu }_{L}}}f(\mu |Data)d\mu }[/math]
The two-sided bounds of [math]\displaystyle{ \mu }[/math] are:
- [math]\displaystyle{ CL=P({{\mu }_{L}}\le \mu \le {{\mu }_{U}})=\int_{{{\mu }_{L}}}^{{{\mu }_{U}}}f(\mu |Data)d\mu }[/math]
The same method can be used to obtained the bounds of [math]\displaystyle{ \sigma }[/math].
Bounds on Time (Type 1)
The reliable life for the normal distribution is:
- [math]\displaystyle{ \begin{align} T=\mu +\sigma {{\Phi }^{-1}}(1-R) \end{align} }[/math]
The one-sided upper bound on time is:
- [math]\displaystyle{ CL=\underset{}{\overset{}{\mathop{\Pr }}}\,(T\le {{T}_{U}})=\underset{}{\overset{}{\mathop{\Pr }}}\,(\mu +\sigma {{\Phi }^{-1}}(1-R)\le {{T}_{U}}) }[/math]
The above equation can be rewritten in terms of [math]\displaystyle{ \mu }[/math] as:
- [math]\displaystyle{ CL=\underset{}{\overset{}{\mathop{\Pr }}}\,(\mu \le {{T}_{U}}-\sigma {{\Phi }^{-1}}(1-R)) }[/math]
From the posterior distribution of [math]\displaystyle{ \mu }[/math]:
- [math]\displaystyle{ CL=\frac{\int_{0}^{\infty }\int_{-\infty }^{{{T}_{U}}-\sigma {{\Phi }^{-1}}(1-R)}L(\sigma ,\mu )\tfrac{1}{\sigma }d\mu d\sigma }{\int_{0}^{\infty }\int_{-\infty }^{\infty }L(\sigma ,\mu )\tfrac{1}{\sigma }d\mu d\sigma } }[/math]
The same method can be applied for one-sided lower bounds and two-sided bounds on time.
Bounds on Reliability (Type 2)
The one-sided upper bound on reliability is:
- [math]\displaystyle{ CL=\underset{}{\overset{}{\mathop{\Pr }}}\,(R\le {{R}_{U}})=\underset{}{\overset{}{\mathop{\Pr }}}\,(\mu \le T-\sigma {{\Phi }^{-1}}(1-{{R}_{U}})) }[/math]
From the posterior distribution of [math]\displaystyle{ \mu }[/math]:
- [math]\displaystyle{ CL=\frac{\int_{0}^{\infty }\int_{-\infty }^{T-\sigma {{\Phi }^{-1}}(1-{{R}_{U}})}L(\sigma ,\mu )\tfrac{1}{\sigma }d\mu d\sigma }{\int_{0}^{\infty }\int_{-\infty }^{\infty }L(\sigma ,\mu )\tfrac{1}{\sigma }d\mu d\sigma } }[/math]
The same method can be used to calculate the one-sided lower bounds and the two-sided bounds on reliability.
Normal Distribution Examples
The following examples illustrate the different types of life data that can be analyzed in Weibull++ using the normal distribution. For more information on the different types of life data, see Life Data Classification.
Complete Data Example
6 units are tested to failure. The following failure times data are obtained: 12125, 11260, 12080, 12825, 13550 and 14670 hours. Assuming that the data are normally distributed, do the following:
Objectives
- 1. Find the parameters for the data set, using the Rank Regression on X (RRX) parameter estimation method
- 2. Obtain the probability plot for the data with 90%, two-sided Type 1 confidence bounds.
- 3. Obtain the pdf plot for the data.
- 4. Using the Quick Calculation Pad (QCP), determine the reliability for a mission of 11,000 hours, as well as the upper and lower two-sided 90% confidence limit on this reliability.
- 5. Using the QCP, determine the MTTF, as well as the upper and lower two-sided 90% confidence limit on this MTTF.
- 6. Obtain tabulated values for the failure rate for 10 different mission end times. The mission end times are 1,000 to 10,000 hours, using increments of 1,000 hours.
Solution
The following figure shows the data as entered in Weibull++, as well as the calculated parameters.
The following figures show the probability plot with the 90% two-sided confidence bounds and the pdf plot.
Both the reliability and MTTF can be easily obtained from the QCP. The QCP, with results, for both cases is shown in the next two figures.
To obtain tabulated values for the failure rate, use the Analysis Workbook or General Spreadsheet features that are included in Weibull++. (For more information on these features, please refer to the Weibull++ User's Guide. For a step-by-step example on creating Weibull++ reports, please see the Quick Start Guide). The following worksheet shows the mission times and the corresponding failure rates.
Suspension Data Example
19 units are being reliability tested and the following is a table of their times-to-failure and suspensions.
| Non-Grouped Data Times-to-Failure Data with Suspensions | ||
| Data point index | Last Inspected | State End Time |
|---|---|---|
| 1 | F | 2 |
| 2 | S | 3 |
| 3 | F | 5 |
| 4 | S | 7 |
| 5 | F | 11 |
| 6 | S | 13 |
| 7 | S | 17 |
| 8 | S | 19 |
| 9 | F | 23 |
| 10 | F | 29 |
| 11 | S | 31 |
| 12 | F | 37 |
| 13 | S | 41 |
| 14 | F | 43 |
| 15 | S | 47 |
| 16 | S | 53 |
| 17 | F | 59 |
| 18 | S | 61 |
| 19 | S | 67 |
Using the normal distribution and the maximum likelihood (MLE) parameter estimation method, the computed parameters are:
- [math]\displaystyle{ \begin{align} & \widehat{\mu }= & 48.07 \\ & {{{\hat{\sigma }}}_{T}}= & 28.41. \end{align}\,\! }[/math]
If we analyze the data set with the rank regression on x (RRX) method, the computed parameters are:
- [math]\displaystyle{ \begin{align} & \widehat{\mu }= & 46.40 \\ & {{{\hat{\sigma }}}_{T}}= & 28.64. \end{align}\,\! }[/math]
For the rank regression on y (RRY) method, the parameters are:
- [math]\displaystyle{ \begin{align} & \widehat{\mu }= & 47.34 \\ & {{{\hat{\sigma }}}_{T}}= & 29.96. \end{align}\,\! }[/math]
Interval Censored Data Example
8 units are being reliability tested, and the following is a table of their failure times:
| Non-Grouped Interval Data | ||
| Data point index | Last Inspected | State End Time |
|---|---|---|
| 1 | 30 | 32 |
| 2 | 32 | 35 |
| 3 | 35 | 37 |
| 4 | 37 | 40 |
| 5 | 42 | 42 |
| 6 | 45 | 45 |
| 7 | 50 | 50 |
| 8 | 55 | 55 |
This is a sequence of interval times-to-failure data. Using the normal distribution and the maximum likelihood (MLE) parameter estimation method, the computed parameters are:
- [math]\displaystyle{ \begin{align} & \widehat{\mu }= & 41.40 \\ & {{{\hat{\sigma }}}_{T}}= & 7.740. \end{align}\,\! }[/math]
For rank regression on x:
- [math]\displaystyle{ \begin{align} & \widehat{\mu }= & 41.40 \\ & {{{\hat{\sigma }}}_{T}}= & 9.03. \end{align}\,\! }[/math]
If we analyze the data set with the rank regression on y (RRY) parameter estimation method, the computed parameters are:
- [math]\displaystyle{ \begin{align} & \widehat{\mu }= & 41.39 \\ & {{{\hat{\sigma }}}_{T}}= & 9.25. \end{align}\,\! }[/math]
The following plot shows the results if the data were analyzed using the rank regression on X (RRX) method.
Mixed Data Types Example
Suppose our data set includes left and right censored, interval censored and complete data, as shown in the following table.
| Grouped Data Times-to-Failure with Suspensions and Intervals (Interval, Left and Right Censored) | ||||
|---|---|---|---|---|
| Data point index | Number in State | Last Inspection | State (S or F) | State End Time |
| 1 | 1 | 10 | F | 10 |
| 2 | 1 | 20 | S | 20 |
| 3 | 2 | 0 | F | 30 |
| 4 | 2 | 40 | F | 40 |
| 5 | 1 | 50 | F | 50 |
| 6 | 1 | 60 | S | 60 |
| 7 | 1 | 70 | F | 70 |
| 8 | 2 | 20 | F | 80 |
| 9 | 1 | 10 | F | 85 |
| 10 | 1 | 100 | F | 100 |
Using the normal distribution and the maximum likelihood (MLE) parameter estimation method, the computed parameters are:
- [math]\displaystyle{ \begin{align} & \widehat{\mu }= & 48.11 \\ & {{{\hat{\sigma }}}_{T}}= & 26.42 \end{align}\,\! }[/math]
If we analyze the data set with the rank regression on x (RRX) method, the computed parameters are:
- [math]\displaystyle{ \begin{align} & \widehat{\mu }= & 49.99 \\ & {{{\hat{\sigma }}}_{T}}= & 30.17 \end{align}\,\! }[/math]
For the rank regression on y (RRY) method, the parameters are:
- [math]\displaystyle{ \begin{align} & \widehat{\mu }= & 51.61 \\ & {{{\hat{\sigma }}}_{T}}= & 33.07 \end{align}\,\! }[/math]
Comparison of Analysis Methods
8 units are being reliability tested, and the following is a table of their failure times:
| Non-Grouped Times-to-Failure Data | ||
| Data point index | State F or S | State End Time |
|---|---|---|
| 1 | F | 2 |
| 2 | F | 5 |
| 3 | F | 11 |
| 4 | F | 23 |
| 5 | F | 29 |
| 6 | F | 37 |
| 7 | F | 43 |
| 8 | F | 59 |
Using the normal distribution and the maximum likelihood (MLE) parameter estimation method, the computed parameters are:
- [math]\displaystyle{ \begin{align} & \widehat{\mu }= & 26.13 \\ & {{{\hat{\sigma }}}_{T}}= & 18.57 \end{align}\,\! }[/math]
If we analyze the data set with the rank regression on x (RRX) method, the computed parameters are:
- [math]\displaystyle{ \begin{align} & \widehat{\mu }= & 26.13 \\ & {{{\hat{\sigma }}}_{T}}= & 21.64 \end{align}\,\! }[/math]
For the rank regression on y (RRY) method, the parameters are:
- [math]\displaystyle{ \begin{align} & \widehat{\mu }= & 26.13 \\ & {{{\hat{\sigma }}}_{T}}= & 22.28. \end{align}\,\! }[/math]