﻿ Comparison of the Bayesian Methods on Interval-Censored Data for Weibull Distribution

Open Journal of Statistics
Vol.4 No.8(2014), Article ID:49744,8 pages DOI:10.4236/ojs.2014.48053

Comparison of the Bayesian Methods on Interval-Censored Data for Weibull Distribution

Al Omari Mohammed Ahmed

Department of Mathematics, Faculty of Arts and Science in Qilwah, Al Baha University, Baha, KSA

Email: alomari1050@hotmail.com   Received 19 May 2014; revised 15 June 2014; accepted 30 June 2014

Abstract

This study considers the estimation of Maximum Likelihood Estimator and the Bayesian Estimator of the Weibull distribution with interval-censored data. The Bayesian estimation can’t be used to solve the parameters analytically thus Markov Chain Monte Carlo is used, where the full conditional distribution for the scale and shape parameters are obtained via Metropolis-Hastings algorithm. Also Lindley’s approximation is used. The two methods are compared to maximum likelihood counterparts and the comparisons are made with respect to the mean square error (MSE) to determine the best for estimating of the scale and shape parameters.

Keywords:

Weibull Distribution, Bayesian Method, Interval Censored, Metropolis-Hastings Algorithm, Lindley’s Approximation 1. Introduction

The Weibull distribution observably has the widest variety of applications in many areas, including life testing, reliability theory and others. The most used methods, which are considered to be the traditional methods, are maximum likelihood and the moment estimation (Cohen and Whitten,  ). Sinha  estimated the parameters of Weibull distribution by maximum likelihood and Bayesian using Lindley’s approximation. Smith  developed the maximum likelihood and Bayesian estimators and compared them using the three-parameter Weibull distribution. Singh et al.  used the Bayesian estimation approach to estimate the parameters of exponentiated Weibull. Hossain and Zimmer  estimated the scale and shape parameters of Weibull distribution using complete and censored samples by maximum likelihood estimator and least squares method. Nassar and Eissa  obtained the Bayesian approach using Lindely approximations to estimate the two shape parameters and the reliability function of the exponentiated Weibull distribution. Soliman et al.  estimated Weibull distribution by using maximum likelihood estimator and Bayesian approach followed by estimating the hazard and reliability functions. Kantar and Senoglu  reported their findings on the comparative study for the location and scale parameters of the Weibull distribution with a given shape parameter. Gupta et al.  estimated Weibull extension model by Bayesian method using Markov Chain Monte Carlo (MCMC). Kundu and Howlader  obtained Bayesian inference and prediction of the inverse Weibull distribution for Type-II censored data, where the Gibbs sampling technique was used to generate MCMC samples from the posterior distribution followed by an importance sampling technique for constructing the Bayes estimation. Comparison between Bayesian and maximum likelihood estimation of the scale parameter in Weibull distribution with known shape was considered by Pandey et al.  .

2. Methodology

2.1. Maximum Likelihood Estimation of Weibull Distribution with Interval-Censored Data

The probability density function of Weibull distribution is: The cumulative distribution function (cdf) of the Weibull distribution is given as with the scale parameter and the shape parameter of the Weibull distribution The likelihood function of interval censored as given in Flygare et al.  is (1)

The logarithm of the likelihood function with interval censored can be expressed as follows: (2)

To obtain the equations for the unknown parameters, we differentiate Equation (2) partially with respect to the scale and shape parameters and equal it to zero. The resulting equations are given respectively as, (3) (4)

where cannot be solved analytically, and for that we employed Newton Raphson method to find the numerical solution.

2.2. Bayesian Using Gamma Prior Estimation of Weibull Based on Interval-Censored Data

In this subsection we consider the case when both the scale and shape parameters are unknown, and we compute the Bayes estimates of the shape and scale parameters. It is assumed that and each have independent gamma , and gamma priors respectively  It is a natural conjugate prior.

The posterior probability density function of and given the data with gamma prior is combining Equation (7) with likelihood function and using Bayes theorem, the joint posterior distribution is derived as see Al Omari et al. (8)

With this, the Bayes estimates for the scale and shape parameters under squared error loss function are given as: (9) (10)

The integration of the scale and shape parameter we can’t solve it analytical for that we used MetropolisHastings algorithm and Lindley’s approximation to solve the problem.

Metropolis-Hastings Algorithm

The Metropolis-Hastings algorithm is a very general Markov Chain Mote Carlo method, it can be used to obtain random samples from any arbitrarily complicated target distribution of any dimension that is known up to a normalizing constant. In fact, Metropolis algorithm is an alternative to Gibbs sampler that does not require availability of full conditionals see Hastings  and Soliman et al.  .

Therefore, the full conditional of the posterior density function using gamma prior of and given the data are combining the gamma prior with likelihood as given below (11)

From Equation (11) we can get the conditional posterior of the scale parameter as follows (12)

The conditional posterior of the shape parameter is given below (13)

As show in the conditional posterior of the scale and shape parameters it’s not follow any close distribution for that we suggest to use the Metropolis-Hastings algorithm to generate MCMC sample.

Algorithm:

1) Start with initial value , 2) The current value , and generate the candidate value , from arbitrary distribution uniform (0, 1).

3) The next value of is given below as where 4) Generate u from Uniform (0, 1) and accept with probability p if and return to step 2), otherwise accept .

5) The next value of is given below as where 6) Generate from uniform (0, 1) and accept with probability p if and return to step 2), otherwise accept and return to step 2).

7) The Bayesian based interval-censored data of the scale and shape parameters under the squared error loss function is given as  8) Obtain the posterior variance of Bayesian using gamma prior based interval-censored data as  2.3. Lindley’s Approximation

The Equations (9) and (10) cannot be solved analytically and for that we obtained Lindley’s expansion to solve the parameters approximation.

According to Al Omari et al.  Lindley’s approximation proposed a ratio of integral of the form where is the log-likelihood and , are arbitrary functions of in applying this procedure, it is assumed that is the prior distribution for and with being some function of interest.

The posterior expectation according to Sinha  is where According to  Lindley expansion is therefore approximated asymptotically by where L is the log-likelihood equation in (2). See Sinha  for more detail.

Taking the scale parameter estimation, where For the shape parameter      3. Simulation Study

To assess the performance of the maximum likelihood and Bayesian with help of the Lindley’s approximation and Markov Chain Monte Carlo, where the Metropolis-Hastings algorithm used to estimate the scale and shape parameters, the mean squared errors (MSE) for each method were calculated using 10,000 replications for sample size n = 25, 50 and 100 of Weibull distribution with interval-censored data for different value of parameters were the scale parameter , shape parametric , 1, 1.5 and 2, the considered values of , are meant for illustration only and other values can also be taken for generating the samples from Weibull distribution.

4. Discussion

As shown in Table 1, the estimate of the scale parameter of Weibull distribution with interval-censored data was compared between maximum likelihood (MLE), Bayesian using Lindley’s approximation (BL) and Bayesian using Metropolis-Hastings algorithm (BM) by mean squared error (MSE). We observed that the Bayesian using

Table 1 . Estimated average lengths of the scale parameter and MSE of Weibull distribution.

Table 2. Estimated average lengths of the shape parameter and MSE of Weibull distribution.

Metropolis-Hastings algorithm (BM) is better compare to the others, moreover, Bayesian with help from Lindley’s approximation is better than MLE estimators when . When the number of sample size increases the mean squared error (MSE) decreases in all cases.

In Table 2, the estimate of the shape parameter of Weibull distribution with interval-censored data was compared between maximum likelihood (MLE), Bayesian using Lindley’s approximation (BL) and Bayesian using Metropolis-Hastings algorithm (BM) by mean squared error (MSE). We found that the Bayesian using Metropolis-Hastings algorithm (BM) is the best compare to the others, moreover, Bayesian using Lindley’s approximation is better than MLE estimators when . When the number of sample size increases the mean squared error (MSE) decreases in all cases.

5. Conclusion

The Bayesian using Metropolis-Hastings algorithm for estimating the scale and shape parameters of Weibull distribution-based interval-censored data is the best compare to others. In this paper, we contribute applying Bayesian estimation approach based on interval-censored data considered with Bayes using Makov Chain Monte Carlo (MCMC).

References

1. Cohen, C.A. and Whitten, B. (1982) Modified Maximum Likelihood and Modified Moment Estimators for the Three-Parameter Weibull Distribution. Communications in Statistics-Theory and Methods, 11, 2631-2656. http://dx.doi.org/10.1080/03610928208828412
2. Sinha, S.K. (1986) Bayes Estimation of the Reliability Function and Hazard Rate of a Weibull Failure Time Distribution. Trabajos de Estadística, 1, 47-56. http://dx.doi.org/10.1007/BF02863554
3. Smith, R.L. and Naylor, J. (1987) A Comparison of Maximum Likelihood and Bayesian Estimators for the Three-Parameter Weibull Distribution. Applied Statistics, 36, 358-369. http://dx.doi.org/10.2307/2347795
4. Singh, U., Gupta, P.K. and Upadhyay, S. (2002) Estimation of Exponentiated Weibull Shape Parameters under LINEX Loss Function. Communications in Statistics-Simulation and Computation, 31, 523-537. http://dx.doi.org/10.1081/SAC-120004310
5. Hossain, A.M. and Zimmer, W.J. (2003) Comparison of Estimation Methods for Weibull Parameters: Complete and Censored Samples. Journal of Statistical Computation and Simulation, 73, 145-153. http://dx.doi.org/10.1080/00949650215730
6. Nassar, M. and Eissa, F.H. (2005) Bayesian Estimation for the Exponentiated Weibull Model. Communications in Statistics—Theory and Methods, 33, 2343-2362. http://dx.doi.org/10.1081/STA-200031447
7. Soliman, A.A., Abd Ellah, A.H. and Sultan, K.S. (2006) Comparison of Estimates Using Record Statistics from Weibull Model: Bayesian and Non-Bayesian Approaches. Computational Statistics & Data Analysis, 51, 2065-2077. http://dx.doi.org/10.1016/j.csda.2005.12.020
8. Kantar, Y.M. and Senoglu, B. (2008) A Comparative Study for the Location and Scale Parameters of the Weibull Distribution with Given Shape Parameter. Computers Geosciences, 34, 1900-1909. http://dx.doi.org/10.1016/j.cageo.2008.04.004
9. Gupta, A., Mukherjee, B. and Upadhyay, S. (2008) Weibull Extension Model: A Bayes Study Using Markov Chain Monte Carlo Simulation. Reliability Engineering & System Safety, 93, 1434-1443. http://dx.doi.org/10.1016/j.ress.2007.10.008
10. Kundu, D. and Howlader, H. (2010) Bayesian Inference and Prediction of the Inverse Weibull Distribution for Type-II Censored Data. Computational Statistics & Data Analysis, 54, 1547-1558. http://dx.doi.org/10.1016/j.csda.2010.01.003
11. Pandey, B., Dwividi, N. and Pulastya, B. (2011) Comparison between Bayesian and Maximum Likelihood Estimation of the Scale Parameter in Weibull Distribution with Known Shape under Linex Loss Function. Journal of Scientific Research, 55, 163-172.
12. Flygare, M.E. and Buckwalter, J.A. (1985) Maximum Likelihood Estimation for the 2-Parameter Weibull Distribution Based on Interval-Data. IEEE Transactions on Reliability, 34, 57-60. http://dx.doi.org/10.1109/TR.1985.5221930
13. Al Omari, M.A., Ibrahim, N.A., Arasan, J. and Adam, M.B. (2012) Extension of Jeffreys’s Prior Estimate for Weibull Censored Data Using Lindley’s Approximation. Australian Journal of Basic and Applied Sciences, 5, 884-889.
14. Hastings, W.K. (1970) Monte Carlo Sampling Methods Using Markov Chains and Their Applications. Biometrika, 57, 97-109. http://dx.doi.org/10.1093/biomet/57.1.97
15. Soliman, A.A., Abd-Ellah, A.H., Abou-Elheggag, N.A. and Ahmed, E.A. (2011) Modified Weibull Model: A Bayes Study Using MCMC Approach Based on Progressive Censoring Data. Reliability Engineering & System Safety, 100, 48-57. http://dx.doi.org/10.1016/j.ress.2011.12.013
16. Al Omari, M.A., Ibrahim, N.A., Arasan, J. and Adam, M.B. (2012) Bayesian Survival and Hazard Estimate for Weibull Censored Time Distribution. Journal of Applied Sciences, 12, 1313-1317. http://dx.doi.org/10.3923/jas.2012.1313.1317