statistical analysis of lifetime data using new modified weibull distributions
October 30, 2017 | Author: Anonymous | Category: N/A
Short Description
of eighteen electronic devices (in days). scriptie lifetime! ......
Description
STATISTICAL ANALYSIS OF LIFETIME DATA USING NEW MODIFIED WEIBULL DISTRIBUTIONS
A thesis submitted to the University of Manchester for the degree of Doctor of Philosophy in the Faculty of Engineering and Physical Sciences
2014
Saad J Almalki School of Mathematics
Contents
Abstract
20
Declaration
21
Copyright Statement
22
Dedication
28
Acknowledgements
29
1 Introduction and Background
31
1.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
31
1.2 Historical and Background Information . . . . . . . . . . . . . . . . . .
31
1.3 Research Motivations . . . . . . . . . . . . . . . . . . . . . . . . . . . .
39
1.4 Organization of the thesis . . . . . . . . . . . . . . . . . . . . . . . . .
41
1.5 Publications and conferences . . . . . . . . . . . . . . . . . . . . . . . .
43
2 Review of Modifications of the Weibull Distribution
45
2.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
45
2.2 Continuous modifications of the Weibull distribution . . . . . . . . . .
46
2
2.2.1
Inverse Weibull distribution . . . . . . . . . . . . . . . . . . . .
46
2.2.2
Log-Weibull distribution . . . . . . . . . . . . . . . . . . . . . .
48
2.2.3
Reflected Weibull distribution . . . . . . . . . . . . . . . . . . .
48
2.2.4
Gamma Weibull distribution . . . . . . . . . . . . . . . . . . . .
49
2.2.5
Kies and Phani’s modified Weibull distributions . . . . . . . . .
52
2.2.6
Exponentiated Weibull distribution . . . . . . . . . . . . . . . .
52
2.2.7
Generalized Weibull distribution . . . . . . . . . . . . . . . . . .
55
2.2.8
Additive Weibull distribution . . . . . . . . . . . . . . . . . . .
55
2.2.9
Extended Weibull distribution . . . . . . . . . . . . . . . . . . .
56
2.2.10 Power Lindley distribution . . . . . . . . . . . . . . . . . . . . .
59
2.2.11 Modified Weibull distribution . . . . . . . . . . . . . . . . . . .
60
2.2.12 Generalized power Weibull distribution . . . . . . . . . . . . . .
62
2.2.13 Modified Weibull extension . . . . . . . . . . . . . . . . . . . . .
62
2.2.14 Beta Weibull distributions . . . . . . . . . . . . . . . . . . . . .
64
2.2.15 Odd Weibull distribution . . . . . . . . . . . . . . . . . . . . . .
67
2.2.16 Flexible Weibull extension . . . . . . . . . . . . . . . . . . . . .
68
2.2.17 Generalized modified Weibull distribution . . . . . . . . . . . .
69
2.2.18 Sarhan and Zaindin’s modified Weibull distribution . . . . . . .
70
2.2.19 Kumaraswamy Weibull distribution . . . . . . . . . . . . . . . .
71
2.2.20 Kumaraswamy modified Weibull distribution . . . . . . . . . . .
73
2.3 Discrete Weibull distributions . . . . . . . . . . . . . . . . . . . . . . .
74
2.3.1
Discrete Weibull distribution I . . . . . . . . . . . . . . . . . . .
3
74
2.3.2
Discrete Weibull distribution II . . . . . . . . . . . . . . . . . .
75
2.3.3
Discrete Weibull distribution III . . . . . . . . . . . . . . . . . .
75
2.3.4
Discrete inverse Weibull distribution . . . . . . . . . . . . . . .
76
2.3.5
Discrete modified Weibull distribution . . . . . . . . . . . . . .
78
2.3.6
Discrete additive Weibull distribution . . . . . . . . . . . . . . .
78
2.4 Maximum likelihood estimation . . . . . . . . . . . . . . . . . . . . . .
79
2.5 Goodness of Fit . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
80
2.5.1
The Log-likelihood Ratio Test . . . . . . . . . . . . . . . . . . .
80
2.5.2
Kolmogorov−Smirnov test . . . . . . . . . . . . . . . . . . . . .
81
2.6 Total time on test . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
81
2.7 Information criterion . . . . . . . . . . . . . . . . . . . . . . . . . . . .
83
2.8 Summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
84
3 New Modified Weibull Distribution
85
3.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
85
3.2 Definition . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
86
3.3 Sub-models . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
88
3.4 The Shape of the probability density function . . . . . . . . . . . . . .
89
3.5 The shape of the hazard function . . . . . . . . . . . . . . . . . . . . .
91
3.6 Simulation from the NMW . . . . . . . . . . . . . . . . . . . . . . . . .
93
3.7 The moments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
96
3.8 The moment generating function . . . . . . . . . . . . . . . . . . . . .
99
3.9 Order statistics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 100
4
3.10 Parameter estimation . . . . . . . . . . . . . . . . . . . . . . . . . . . . 101 3.11 Applications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 102 3.11.1 Aarset data . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 103 3.11.2 Meeker and Escobar data . . . . . . . . . . . . . . . . . . . . . 106 3.12 Sub-model of the NMW with γ = 1 . . . . . . . . . . . . . . . . . . . . 109 3.13 Summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 111
4 Reduced New Modified Weibull Distribution
112
4.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 112 4.2 The reduced distribution . . . . . . . . . . . . . . . . . . . . . . . . . . 114 4.3 The hazard rate function . . . . . . . . . . . . . . . . . . . . . . . . . . 115 4.4 The moments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 117 4.5 The moment generating function . . . . . . . . . . . . . . . . . . . . . 117 4.6 Renyi entropy . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 118 4.7 Reliability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 119 4.8 Order statistics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 120 4.9 Parameter estimation . . . . . . . . . . . . . . . . . . . . . . . . . . . . 121 4.9.1
Complete data . . . . . . . . . . . . . . . . . . . . . . . . . . . 121
4.9.2
Censored data . . . . . . . . . . . . . . . . . . . . . . . . . . . . 122
4.9.3
Simulation study . . . . . . . . . . . . . . . . . . . . . . . . . . 123
4.10 Applications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 124 4.10.1 Complete data . . . . . . . . . . . . . . . . . . . . . . . . . . . 127 4.10.2 Censored data . . . . . . . . . . . . . . . . . . . . . . . . . . . . 131
5
4.11 Summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 136
5 Exponentiated Reduced Modified Weibull Distribution
137
5.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 137 5.2 The ERMW distribution . . . . . . . . . . . . . . . . . . . . . . . . . . 138 5.3 Special cases . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 139 5.4 Shape . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 142 5.5 Moments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 145 5.6 Order statistics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 146 5.7 Estimation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 147 5.7.1
Maximum likelihood estimation . . . . . . . . . . . . . . . . . . 147
5.7.2
Simulation study . . . . . . . . . . . . . . . . . . . . . . . . . . 148
5.8 Applications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 150 5.8.1
Infected pigs data . . . . . . . . . . . . . . . . . . . . . . . . . . 151
5.8.2
Kumar data . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 155
5.9 Summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 158
6 A New Discrete Modified Weibull Distribution
159
6.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 159 6.2 The new distribution . . . . . . . . . . . . . . . . . . . . . . . . . . . . 160 6.2.1
Discrete reduced modified Weibull distribution . . . . . . . . . . 160
6.3 The hazard rate function . . . . . . . . . . . . . . . . . . . . . . . . . . 161 6.4 A series expansion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 163 6.5 The moments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 165 6
6.6 Order statistics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 166 6.7 Extreme value behavior . . . . . . . . . . . . . . . . . . . . . . . . . . . 168 6.8 Estimation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 169 6.8.1
Maximum likelihood estimation . . . . . . . . . . . . . . . . . . 169
6.8.2
Simulation study . . . . . . . . . . . . . . . . . . . . . . . . . . 171
6.9 Applications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 173 6.9.1
Complete data . . . . . . . . . . . . . . . . . . . . . . . . . . . 174
6.9.2
Censored data . . . . . . . . . . . . . . . . . . . . . . . . . . . . 179
6.10 Summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 181
7 Comparing the exponentiated and generalized modified Weibull distributions
182
7.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 182 7.2 Applications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 184 7.2.1
Serum-reversal data . . . . . . . . . . . . . . . . . . . . . . . . . 184
7.2.2
Radiotherapy data . . . . . . . . . . . . . . . . . . . . . . . . . 185
7.2.3
Infected pigs data . . . . . . . . . . . . . . . . . . . . . . . . . . 189
7.3 Summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 192
8 Conclusion, discussion and future work
193
8.1 Conclusion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 193 8.2 Discussion and future work . . . . . . . . . . . . . . . . . . . . . . . . . 195
A Appendix for chapter 3
219
7
B Appendix for chapter 4
221
C Appendix for chapter 5
224
D Appendix for chapter 6
226
Word count 32812 8
List of Tables 3.1 The sub-models of the NMW. . . . . . . . . . . . . . . . . . . . . . . .
89
3.2 MLEs of parameters and corresponding standard errors in brackets for the Aarset data.
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 104
3.3 Log-likelihood, K-S statistic, AIC, BIC, AICc and CAIC values of models fitted to Aarst data for comparison with beta modified Weibull (Silva et al (2010)). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 104 3.4 MLEs of parameters and corresponding standard errors in brackets for the Meeker and Escobar data (1998). . . . . . . . . . . . . . . . . . . . 107 3.5 Log-likelihood, K-S statistic, AIC, BIC, AICc and CAIC values of models fitted to Meeker and Escobar data (1998) . . . . . . . . . . . . . . . 107 3.6 Results of fitting NMW with γ = 1 to both data sets. . . . . . . . . . . 109
4.1 The first 8-th moments of the RNMW using (4.8) and numerical integration. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 117 4.2 MLEs of parameters, standard errors, AIC, BIC, AICc and CAIC for Aarset data. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 128 4.3 K-S statistics for models fitted to Aarset data. . . . . . . . . . . . . . . 128
9
4.4 MLEs of parameters, standard errors, AIC, BIC, AICc and CAIC for Kumar data. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 130 4.5 K-S statistics for models fitted to Kumar data. . . . . . . . . . . . . . . 131 4.6 MLEs of parameters, standard errors, AIC, BIC, AICc and CAIC for drug data. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 133 4.7 K-S statistics for models fitted to the drug data. . . . . . . . . . . . . . 134 4.8 MLEs of parameters, standard errors, AIC, BIC, AICc and CAIC for serum-reversal data. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 135 4.9 K-S statistics for models fitted to serum-reversal data.
. . . . . . . . . 135
5.1 Infected pigs data (in days). . . . . . . . . . . . . . . . . . . . . . . . . 151 5.2 MLEs of parameters, standard errors, AIC, BIC, AICc and CAIC for the distributions fitted to the infected pigs data set. . . . . . . . . . . . 153 5.3 K-S statistics for the distributions fitted to the infected pigs data set. . 153 5.4 MLEs of parameters, standard errors, AIC, BIC AICc and CAIC for the distributions fitted to Kumar data. . . . . . . . . . . . . . . . . . . 156 5.5 K-S statistics for the distributions fitted to Kumar data. . . . . . . . . 156
6.1 The survival functions of the DMW, DAddW and DW distributions. . . 173 6.2 Aarset data (in weeks). . . . . . . . . . . . . . . . . . . . . . . . . . . . 174 6.3 MLEs of parameters for the discrete Aarset data, standard errors in brackets, and the measures AIC, BIC, AICc and CAIC.
. . . . . . . . 174
6.4 Lifetimes of eighteen electronic devices (in days). . . . . . . . . . . . . 175
10
6.5 MLEs of parameters for data in Table 6.4, standard errors in brackets, and the measures AIC, BIC, AICc and CAIC. . . . . . . . . . . . . . . 176 6.6 The leukemia data. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 177 6.7 MLEs of parameters for leukemia data, standard errors in brackets, and the measures AIC, BIC, AICc and CAIC.
. . . . . . . . . . . . . . . . 178
6.8 MLEs of parameters for the drug data, standard errors in brackets, and the measures AIC, BIC, AICc and CAIC. . . . . . . . . . . . . . . . . . 180
7.1 MLEs of parameters, standard errors, AIC, BIC, AICc and CAIC for radiotherapy data. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 189 7.2 MLEs of parameters, standard errors, AIC, BIC, AICc and CAIC for the distributions fitted to the infected pigs data set. . . . . . . . . . . . 190 7.3 K-S statistics for the distributions fitted to the infected pigs data set. . 190
11
List of Figures 1.1 Monotonic and non-monotonic hazard rate functions . . . . . . . . . .
33
2.1 PDF and HF of the inverse Weibull distribution . . . . . . . . . . . . .
47
2.2 PDF and HF of the log-Weibull distribution . . . . . . . . . . . . . . .
48
2.3 PDF and HF of the reflected Weibull distribution . . . . . . . . . . . .
49
2.4 PDF and HF of Kies distribution . . . . . . . . . . . . . . . . . . . . .
53
2.5 PDF and HF of Phani distribution . . . . . . . . . . . . . . . . . . . .
53
2.6 PDF and HF of the exponentiated Weibull distribution . . . . . . . . .
54
2.7 PDF and HF of the exponentiated Weibull distribution . . . . . . . . .
56
2.8 PDF and HF of the additive Weibull distribution . . . . . . . . . . . .
57
2.9 PDF and HF of the extended Weibull distribution . . . . . . . . . . . .
58
2.10 PDF and HF of Ghitany et al.’s distribution . . . . . . . . . . . . . . .
59
2.11 PDF and HF of the power Lindley distribution . . . . . . . . . . . . . .
60
2.12 PDF and HF of the modified Weibull distribution . . . . . . . . . . . .
61
2.13 PDF and HF of the generalized power Weibull distribution . . . . . . .
63
2.14 PDF and HF of the modified Weibull extension . . . . . . . . . . . . .
63
2.15 PDF and HF of the exponentiated modified Weibull extension . . . . .
64
12
2.16 PDF and HF of the beta Weibull distribution . . . . . . . . . . . . . .
65
2.17 PDF and HF of the beta modified Weibull distribution . . . . . . . . .
66
2.18 PDF and HF of the beta exponentiated Weibull distribution . . . . . .
67
2.19 PDF and HF of the odd Weibull distribution . . . . . . . . . . . . . . .
68
2.20 PDF and HF of the flexible Weibull extension . . . . . . . . . . . . . .
69
2.21 PDF and HF of the generalized modified Weibull distribution . . . . .
70
2.22 PDF and HF of Sarhan and Zaindin’s modified Weibull distribution . .
71
2.23 PDF and HF of Sarhan and Zaindin’s generalized modified Weibull distribution . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
72
2.24 PDF and HF of Kumaraswamy Weibull distribution . . . . . . . . . . .
73
2.25 PDF and HF of Kumaraswamy modified Weibull distribution . . . . . .
74
2.26 PMF and HF of the discrete Weibull distribution I . . . . . . . . . . .
75
2.27 PMF and HF of the discrete Weibull distribution II . . . . . . . . . . .
76
2.28 PMF and HF of the discrete Weibull distribution III . . . . . . . . . .
76
2.29 PMF and HF of the discrete inverse Weibull distribution . . . . . . . .
77
2.30 PMF and HF of the discrete modified Weibull distribution . . . . . . .
78
2.31 PMF and HF of the discrete additive Weibull distribution . . . . . . .
79
2.32 Scaled TTT-transform curve for different distributions. . . . . . . . . .
83
3.1 Probability density functions of the NMW. . . . . . . . . . . . . . . . .
87
3.2 Hazard functions of the NMW. . . . . . . . . . . . . . . . . . . . . . .
88
3.3 Probability density function of NMW: (a): θ, γ > 1, (b): θ, γ < 1, (c): θ > 1, γ < 1, (d): θ < 1, γ > 1. . . . . . . . . . . . . . . . . . . . . . . .
13
92
3.4 Probability density function of NMW when θ, γ > 1.
. . . . . . . . . .
93
3.5 Probability density functions of NMW: (a): θ, γ > 1, (b): θ, γ < 1, (c): θ > 1, γ < 1, (d): θ < 1, γ > 1. . . . . . . . . . . . . . . . . . . . . . . .
94
3.6 Hazard function of NMW: (a): θ, γ > 1, (b): θ, γ < 1, (c): θ > 1, γ < 1, (d): θ < 1, γ > 1. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
95
3.7 Hazard function of the NMW with a long useful life period. . . . . . . .
96
3.8 PDF of the NMW and the histograms of simulated data (Method 1, n=1000) where (a): α=0.05, β=5, γ=1.25, θ=2 and λ=0.05, (b): α=1.15, β=0.25, γ=5, θ=0.8 andλ=2, (c): α=1.5, β=3, γ=0.85, θ=2.5 and λ=0.5, (d): α=2.5, β=5, γ=9, θ=1.15 and λ=5. . . . . . . . . . . . . . . . . . . . .
97
3.9 Probability density functions of the NMW and the histograms of simulated data (Method 2, n=1000) where (a):α=0.05, β=5, γ=1.25, θ=2 and λ=0.05, (b):α=1.15, β=0.25, γ=5, θ=0.8 andλ=2, (c):α=1.5, β=3, γ=0.85, θ=2.5 and λ=0.5, (d):α=2.5, β=5, γ=9, θ=1.15 and λ=5. . . . . . . . . . . . . . . . . . . . . . . . .
98
3.10 TTT-transform plot for the Aarst. . . . . . . . . . . . . . . . . . . . . . 103 3.11 For Aarst data: (a) hazard function (b) TTT-Transform plot (c) pdf and (d) survival function using NMW plus sub models, and beta modified Weibull. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 105 3.12 TTT-transform plot for the Mekeer data. . . . . . . . . . . . . . . . . . 106
14
3.13 For Meeker and Escobar data: (a) hazard function (b) TTT-Transform plot (c) pdf and (d) survival function using NMW plus sub models, and beta modified Weibull. . . . . . . . . . . . . . . . . . . . . . . . . . . . 108 3.14 (a) and (b): fitted pdf and survival functions for Aarst data, (c) and (d): those for Meeker and Escobar data, 5 parameters (solid lines) vs 4 parameters (dotted lines). . . . . . . . . . . . . . . . . . . . . . . . . . 110
4.1 Kurtosis-skewness plot for the NMW distribution (left) and its reduced version (right). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 114 4.2 Probability density function of the reduced distribution. . . . . . . . . . 115 4.3 The hazard function of the RNMW and the root of
d dx
log {h(x0 )} = 0.
116
4.4 Hazard function of the RNMW distribution. . . . . . . . . . . . . . . . 116 4.5 Biases of the MLEs of (α, β, λ) versus n = 10, 11, . . . , 100 ((α, β, λ) = (0.1, 0.1, 0.1)). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 125 4.6 Mean squared errors of the MLEs of (α, β, λ) versus n = 10, 11, . . . , 100 (α, β, λ) = (0.1, 0.1, 0.1). . . . . . . . . . . . . . . . . . . . . . . . . . . 126 4.7 For Aarst data: (a) Histogram and fitted PDFs; (b) Empirical and fitted survival functions; (c) Empirical and fitted TTT-transforms; (c) Nonparametric and fitted hazard rate functions. . . . . . . . . . . . . . 129 4.8 TTT-transform plot for the Kumar. . . . . . . . . . . . . . . . . . . . . 130 4.9 For Kumar data: (a) Histogram and fitted PDFs; (b) Empirical and fitted survival functions; (c) Empirical and fitted TTT-transforms; (c) Nonparametric and fitted hazard rate functions. . . . . . . . . . . . . . 132
15
4.10 TTT-transform plot for the drug data. . . . . . . . . . . . . . . . . . . 133 4.11 For drug data: (a) Empirical and fitted survival functions; (b) Nonparametric and fitted hazard rate functions. . . . . . . . . . . . . . . . 134 4.12 TTT-transform plot for the serum-reversal data. . . . . . . . . . . . . . 135 4.13 For serum data: (a) Empirical and fitted survival functions; (b) Nonparametric and fitted hazard rate functions. . . . . . . . . . . . . . . . 136
5.1 PDF of the ERMW distribution for selected α, β, λ and θ. . . . . . . . 139 5.2 The HF of the ERMW distribution. . . . . . . . . . . . . . . . . . . . . 140 5.3 (a) The PDF of the RGMW distribution, (b) The HF of the RGMW distribution. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 141 5.4 (a) The PDF of the REW distribution, (b) The HF of the REW distribution. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 141 5.5 The HF of the ERMW distribution as α changes. . . . . . . . . . . . . 143 5.6 The HF of the ERMW distribution as θ changes. . . . . . . . . . . . . 144 5.7 Mean, variance, skewness and kurtosis of the ERMW distribution versus θ for selected λ and α = β = 1. . . . . . . . . . . . . . . . . . . . . . . 145 5.8 Mean, variance, skewness and kurtosis of the ERMW distribution versus λ for selected θ and α = β = 1. . . . . . . . . . . . . . . . . . . . . . . 146 5.9 Biases of the MLEs of (α, β, λ, θ) = (1, 1, 1, 1) versus n = 10, 11, . . . , 100. 149 5.10 Mean squared errors of the MLEs of (α, β, λ, θ) = (1, 1, 1, 1) versus n = 10, 11, . . . , 100. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 150 5.11 TTT-transform plot for the infected pigs data. . . . . . . . . . . . . . . 152
16
5.12 For infected pigs data: (a) Histogram and fitted PDFs; (b) Empirical and fitted survival functions; (c) Empirical and fitted TTT-transforms; (d) Nonparametric and fitted HFs. . . . . . . . . . . . . . . . . . . . . 154 5.13 TTT-transform plot for Kumar data. . . . . . . . . . . . . . . . . . . . 155 5.14 For Kumar data: (a) Histogram and fitted PDFs; (b) Empirical and fitted survival functions; (c) Empirical and fitted TTT-transforms; (d) Nonparametric and fitted HFs.
. . . . . . . . . . . . . . . . . . . . . . 157
6.1 PMFs of the DRMW distribution. . . . . . . . . . . . . . . . . . . . . . 161 6.2 Hazard rate functions of the DRMW distribution. . . . . . . . . . . . . 164 6.3 Hazard rate functions of the DRMW distribution with long useful life period. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 164 6.4 Biases of the MLEs of (q, b, c) versus n = 10, 11, . . . , 100. . . . . . . . . 172 6.5 Mean squared errors of the MLEs of (q, b, c) versus n = 10, 11, . . . , 100. 172 6.6 TTT-transform plot for the Aarst Discret. . . . . . . . . . . . . . . . . 175 6.7 For the discrete Aarset data: (a) The histogram and the estimated PMFs; (b) The empirical and estimated hazard rate functions; (c) The empirical and estimated survival functions; (d) The empirical and fitted scaled TTT-transform plots. . . . . . . . . . . . . . . . . . . . . . . . . 176 6.8 TTT-transform plot for the Discret 18. . . . . . . . . . . . . . . . . . . 177
17
6.9 For the electronic devices data: (a) The histogram and the estimated PMFs; (b) The empirical and estimated hazard rate functions; (c) The empirical and estimated survival functions; (d) The empirical and fitted scaled TTT-transform plots. . . . . . . . . . . . . . . . . . . . . . . . . 178 6.10 TTT-transform plot for the Leukamia. . . . . . . . . . . . . . . . . . . 179 6.11 For leukemia data: (a) The histogram and the estimated PMFs; (b) The empirical and estimated hazard rate functions; (c) The empirical and estimated survival functions; (d) The empirical and fitted scaled TTT-transform plots. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 180 6.12 For drug data: (a) Fitted survival functions using the DRMW and other models; (b) Nonparametric and fitted hazard rate functions using the DRMW and other models. . . . . . . . . . . . . . . . . . . . . . . . . . 181
7.1 TTT-transform plot for the radiotherapy data. . . . . . . . . . . . . . . 183 7.2 For the serum-reversal data: (a) HF presented in Carrasco et al. (2008), (b) Nonparametric HF and the HF for the fitted GMW distribution using estimates in Table 1 of Carrasco et al. (2008). . . . . . . . . . . . 185 7.3 For radiotherapy data: (a) SF presented in Carrasco et al. (2008), (b) Our SF, (c) HF presented in Carrasco et al. (2008), (d) Our HF using the MW. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 187 7.4 For the radiotherapy data: (a) SF presented in Carrasco et al. (2008), (b) Our SF, (c) HF presented in Carrasco et al. (2008), (d) Our HF using the GMW. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 188
18
7.5 For infected pigs data: (a) Histogram and fitted PDFs; (b) Empirical and fitted SFs; (c) Empirical and fitted TTT-transforms; (d) Nonparametric and fitted HFs. . . . . . . . . . . . . . . . . . . . . . . . . . . . 191
8.1 Hazard rate functions of the reduced distribution. . . . . . . . . . . . . 199
19
The University of Manchester Saad J Almalki Doctor of Philosophy Statistical Analysis of Lifetime Data Using New Modified Weibull Distributions July 16, 2014 The Weibull distribution is a popular and widely used distribution in reliability and in lifetime data analysis. Since 1958, the Weibull distribution has been modified by many researchers to allow for non-monotonic hazard functions. Many modifications of the Weibull distribution have achieved the above purpose. On the other hand, the number of parameters has increased, the forms of the survival and hazard functions have become more complicated and the estimation problems have risen. This thesis provides an extensive review of some discrete and continuous versions of the modifications of the Weibull distribution, which could serve as an important reference and encourage further modifications of the Weibull distribution. Four different modifications of the Weibull distribution are proposed to address some of the above problems using different techniques. First model, with five parameters, is constructed by considering a two-component serial system with one component following a Weibull distribution and another following a modified Weibull distribution. A new method has been proposed to reduce the number of parameters of the new modified Weibull distribution from five to three parameters to simplify the distribution and address the estimation problems. The reduced version has the same desirable properties of the original distribution in spite of having two less parameters. It can be an alternative distribution for all modifications of the Weibull distribution with bathtub shaped hazard rate functions. To deal with unimodal shaped hazard rates, the third model with four parameters, named as the exponentiated reduced modified Weibull distribution is introduced. This model is flexible, has a nice physical interpretation and has the ability to capture monotonically increasing, unimodal and bathtub shaped hazard rates. It is a generalization of the reduced modified Weibull distribution. The proposed distribution gives the best fit comparing to other modifications of the Weibull distribution including those having similar properties. A three-parameter discrete distribution is introduced based on the reduced distribution. It is one of only three discrete distributions allowing for bathtub shaped hazard rate functions. Four real data sets have applied to this distribution. The new distribution is shown to outperform at least three other models including the ones allowing for bathtub shaped hazard rate functions. The new models show flexibility and can be used to model different kinds of real data sets better than other modified versions of Weibull distribution including those having the same number of parameters. The mathematical properties and statistical inferences of the new models are studied. Based on a simulation study the performances of the MLEs of each model are assessed with respect to sample size n. We find no evidence that the generalized modified Weibull distribution can provide a better fit than the exponentiated Weibull distribution for data sets exhibiting the modified unimodal hazard function.
20
Declaration No portion of the work referred to in the thesis has been submitted in support of an application for another degree or qualification of this or any other university or other institute of learning.
21
Copyright Statement i. The author of this thesis (including any appendices and/or schedules to this thesis) owns certain copyright or related rights in it (the “Copyright”) and s/he has given The University of Manchester certain rights to use such Copyright, including for administrative purposes. ii. Copies of this thesis, either in full or in extracts and whether in hard or electronic copy, may be made only in accordance with the Copyright, Designs and Patents Act 1988 (as amended) and regulations issued under it or, where appropriate, in accordance with licensing agreements which the University has from time to time. This page must form part of any such copies made. iii. The ownership of certain Copyright, patents, designs, trade marks and other intellectual property (the “Intellectual Property”) and any reproductions of copyright works in the thesis, for example graphs and tables (“Reproductions”), which may be described in this thesis, may not be owned by the author and may be owned by third parties. Such Intellectual Property and Reproductions cannot and must not be made available for use without the prior written permission of the owner(s) of the relevant Intellectual Property and/or Reproductions. iv. Further information on the conditions under which disclosure, publication and commercialisation of this thesis, the Copyright and any Intellectual Property and/or Reproductions described in it may take place is available in the University IP Policy (see http://documents.manchester.ac.uk/DocuInfo.aspx?DocID=487), in any relevant Thesis restriction declarations deposited in the University Library, The University Library’s regulations (see http://www.manchester.ac.uk/library/aboutus/regulations) and in The University’s Policy on Presentation of Theses.
22
Notation Symbol
Description
F (·)
The cumulative distribution function
f (·)
The probability density function
p(·)
The probability mass function
S(·)
The survival function
h(·)
The hazard rate function
H(·)
The cumulative hazard function
Fˆ (·)
The empirical distribution function
int {·}
The integer part
Γ(·)
Gamma function
γ(·, x)
Incomplete gamma function
Γδ (·, ·)
Generalized gamma function
Γx,δ (·, ·)
Incomplete generalized gamma function
B(·, ·)
Beta function
Ix (·, ·)
Incomplete beta function
Q(·)
The quintile function
Fw (·)
The CDF of the traditional Weibull distribution
SW (·)
The survival function of the Weibull distribution
hW (·)
The hazard function of the Weibull distribution
SM W (·)
The survival function of the modified Weibull distribution
hM W (·)
The hazard function of the modified Weibull distribution
µ′r
The r−th moment of the new modified Weibull distribution
MX (·)
The moment generating function
fr:n (x)
The pdf of the rth order statistic X(r)
′ (r:n)
µk
The kth moment of the rth order statistic X(r) 23
L(·)
The likelihood function
L(·)
The log-likelihood function
H (p)
Renyi entropy
I −1
The variance- covariance matrix
ω
The log-likelihood ratio statistic
24
Abbreviations CDF
Cumulative hazard function
PDF
Probability density function
HF
Hazard function
PMF
Probability mass functions
SF
Survival function
MLE
Maximum likelihood estimate
DW(I)
Type I discrete Weibull distribution
DW(II)
Type II discrete Weibull distribution
DW(III)
Type III discrete Weibull distribution
DIW
Discrete Inverse Weibull distribution
DMW
Discrete modified Weibull distribution
DAddW
Discrete additive Weibull distribution
IW
Inverse Weibull distribution
KumIW
Kumaraswamy inverse Weibull distribution
BIW
Beta inverse Weibull distribution
LogW
Log-Weibull distribution
RefW
Reflected Weibull distribution
KiesMW
Kies’s modified Weibull distribution
PhMW
Phani’s modified Weibull distribution
EW
Exponentiated Weibull distribution
EP
Exponentiated Pareto distribution
GR
Generalized Rayleigh distribution
EGam
Exponentiated gamma distribution
EGum
Exponentiated Gumbel distribution
EF
Eponentiated Fr´echet distribution 25
GLFR
Generalized linear failure rate distribution
GG
Generalized Gompertz distribution
EGLE
Exponentiated generalized linear exponential distribution
GE
Generalized exponential distribution
GW
Generalized Weibull distribution
AddW
Additive Weibull distribution
SZMW
Sarhan and Zaindin’s modified Weibull distribution
ExW
Extended Weibull distribution
PL
Power Lindley distribution
MW
Modified Weibull distribution
GMW
Generalized modified Weibull distribution
BMW
Beta modified Weibull distribution
MCMC
Markov chain Monte Carlo
GPW
Generalized power Weibull
MWEx
Modified Weibull extension
EMWEx
Exponentiated modified Weibull extension
BGW
Beta generalized Weibull distribution
BW
Beta-Weibull distribution
BEW
Beta exponentiated Weibull
BGE
Beta generalized Exponential
OddW
Odd Weibull distribution
FlxWE
Flexible Weibull extension
KumW
Kumaraswamy Weibull distribution
KumE
Kumaraswamy exponential distribution
KumR
Kumaraswamy Rayleigh distribution
EKum
Exponentiated Kumaraswamy Weibull distribution
KumMW
Kumaraswamy modified Weibull distribution
NMW
New Modified Weibull Distribution
ERMW
Exponentiated reduced modified Weibull distribution
DRMW
Discrete modified Weibull distribution
LFR
The linear failure rate distribution
AIC
Akaike information criterion 26
BIC
Bayesian information criterion
CAIC
Consistent Akaike information criterion
K-S
Kolmogorov-Smirnov statistic
TTT
Total Time on Test
LRT
Likelihood ratio statistic
RNMW
Reduced New Modified Weibull Distribution
MLE
Maximum likelihood estimates
TBF
Time between failures
NDMW
A new discrete modified Weibull distribution
DGD
The discrete gamma distribution
DND
The discrete normal distribution
DRD
The discrete Rayleigh distribution
DBD
The discrete Burr distribution
DPD
The discrete Pareto distribution
SDD
A finite range simple discrete life distribution
DB3
The discrete Burr type III
DLD
The discrete Lindley distribution
RGMW
Reduced generalized modified Weibull distribution
REW
Reduced exponentiated Weibull distribution
RMW
Reduced Lai et al.’s modified Weibull distribution
RW
Reduced Weibull distribution
MSE
Mean squared error
CP
Coverage probability
CL
Coverage length
WPP
Weibull Probability Plot
IWPP
Inverse Weibull Probability Plot
27
Dedication Exclusively dedicated to my brother, Fahad Almalki, who passed away in a car crash on the morning of Thursday the 29th of September 2011 in Jeddah, Saudi Arabia . “May Allah forgive and have mercy upon him, excuse him and pardon him, and make honorable his reception.” It was the saddest day of my life, and no words can describe my feeling when I lost my brother. He was not just my brother, but my dearest, most loyal, respectful, trustworthy, and honest friend. My head and my heart will never forget him; everything around me, and all inside of me, reminds me of him. It is difficult, and may be impossible, to combine a time of such great happiness with memories such great sadness, but I would like to do so. I would like to apologise to the many people around me who I should also dedicate this work to. You deserve that and more, but I am so sorry, it must be dedicated to my brother. My father, my mother, my wife, my eldest daughter Juri and my youngest daughter Joud, my eldest son Abdulrahman and my youngest son Muhammad, my sisters, my brothers, my relatives and my friends; I thank you so much for your support, but this work must be dedicated to my brother.
28
Acknowledgements First of all, all praise is due to Allah, the Lord of the Worlds. The Beneficent, the Merciful. Without Allah’s help, I could not have completed this thesis. My beloved mother and father, the biggest loves and the greatest persons in my life; many thanks to you, for your love, kindness, support, and your patience. A special and great acknowledgment, and show of appreciation, for my wife. The most perfect and loving woman in my life. Thank you for everything, thank you for your endless love and support. Many kind and heartfelt thanks for my love, my world, my children, Juri, Joud, Abudlrahman and Muhammad. I know I have spent so much time away from you, but know that I always tried to do my best. You are the source of my happiness and my inspiration. Thank you for every single minute and second I have been away to study. When I am moving forward to the final steps of this period of my academic life, I have to reflect on the years spent in the university with my professors. They who have given so much, and made such great efforts in helping build the next period of my academic life. I would like to express my deepest gratitude, appreciation, and love to those who carried the holiest message in the life, those who paved the way of knowledge: all of my distinguished professors. I would like to individually give special acknowledgement and appreciation to: • My supervisor Dr. Jingsong Yuan, who supervised my thesis and guided me during my PhD. I am grateful for his support, help, patience and his amiability. • My co-supervisor Dr. Saralees Nadarajah, who helped on countless many occasions and taught me how to a research career. He inspired me to strive to become a great researcher, and be interested in research throughout the rest of my life. I hope to be like what he sees. 29
30 • My advisor Prof. Jianxin Pan, who despite being very busy with research, teaching and other great work in the school, has supported me and always made sure to ask about me. I would like also to thank my colleagues Yerkin Kitapbayev and Steven Falconer, and all the members of the School of Mathematics in the University of Manchester.
Chapter 1 Introduction and Background 1.1
Introduction
After an extensive review of modifications to the Weibull distribution, this thesis contributes four new modifications to the Weibull distribution that can be used to analyse different kinds of lifetime data sets with different shapes of hazard rate. This chapter is a prefatory chapter to the thesis. Section 1.2 provides some historical and background information of lifetime distributions, the hazard function (HF) and their applications. The motivations of this thesis are presented in Section 1.3 and the organisation of the thesis is described in Section 1.4. Large parts of this thesis have been published in or submitted to journals for publication and some have been presented in conferences, these are presented in Section 1.5.
1.2
Historical and Background Information
Statistical lifetime distributions (sometimes called ageing distributions) are widely used in many different fields for modelling data sets. They have been applied to many areas: reliability engineering such as machine life cycles, medical sciences such as the survival times of patients after surgery or duration to recurrence of a kind of cancer after surgical removal, computer sciences such as the failure rates of a software system, insurance such as the durations without claims of customers policies, marketing such as the lifetimes of customers, and social sciences such as duration of marriage till divorce or duration that a graduate remains unemployed, among others. For more
1.2 Historical and Background Information
32
details about the above lifetime applications we refer to Lai and Xie (2006), Pham (2006), Ohishi et al (2009), Lai (2012) and Bemmaor and Glady (2012). If X is a lifetime random variable with f (x) being its probability density function (PDF), F (x) being its cumulative distribution function (CDF), and S(x) being its survival function (SF), then the hazard function (HF) h(x) is defined as the ratio of f (x) to S(x) h(x) =
f (x) , S(x)
(1.1)
and h(x)△x represents the approximate probability of failure in the interval [x, x+△x), cf. Lawless (1982). The hazard rate function plays a fundamental role in lifetime modelling. A lifetime distribution is said to have an increasing hazard rate if its HF h(x) is monotonically increasing over time and to have a decreasing hazard rate if h(x) is monotonically decreasing. If h(x) initially decreases, followed by an approximately constant period (called useful life period), then followed by an increasing period, the distribution is said to have a bathtub shape. The distribution is said to have a unimodal hazard rate if its hazard rate function has a unique mode, also called an upside-down bathtub shape. The different shapes of the hazard rate function can be investigated using the first derivative of the hazard function as follows. The shape of the HF can be: • Monotonically increasing (non-decreasing) shape if the values of the first derivative of h(x) respect to x is positive for all values of x. • Monotonically decreasing (non-increasing) shape if the values of the first derivative of h(x) respect to x is negative for all values of x. • Constant if the values of the first derivative of h(x) respect to x equals 0. • Bathtub shaped if the values of the first derivative of h(x) respect to x are negative for x ∈ (0, x0 ) and positive for x > x0 and the value x0 is a unique and positive solution of h′ (x0 ) = 0. • Unimodal (upside-down bathtub) shaped if h′ (x) > 0 for x ∈ (0, x0 ) and h′ (x) < 0 for x > x0 and the value x0 is a unique and positive solution of h′ (x0 ) = 0
1.2 Historical and Background Information
33
• Unimodal followed by increasing (modified unimodal (bathtub) shaped) if the HF first has a unimodal and then followed by increasing. Figure 1.1 shows the monotonic shapes of the HF (left side) and some nonmonotonic shapes (right side)
Monotone HFs
Non-monotonic HFs
Figure 1.1: Monotonic and non-monotonic hazard rate functions
The most popular lifetime distributions including the exponential, Weibull, gamma, Rayleigh, Pareto and Gompertz have monotonic hazard rate functions, cf. Lawless (1982). However, certain lifetime data (for example, human mortality, machine life cycles and data from some biological and medical studies) require non-monotonic shapes like the bathtub shape, the unimodal (upside-down bathtub) or modified unimodal shape. Human mortality is shown to have a bathtub shaped HF. Initially, the hazard rate of the death (newborn babies) is very high level specially in the first six months after birth, that is caused by deformities, heart dysfunctions or other infant diseases. Then, the risk of level of death decreases rapidly until it reaches its lowest level and remains approximately constant. At some point, during the ages between 30 and 40 the death risk increases over time. The first period is called infant mortality, the second is called useful life period (normal life period) and the third period is a wear out period. This can be interpreted as the fate of the individual person during his life or it can be interpreted as the hazard rates of three groups, first group includes the infants (about 0-6 months) with decreasing hazard rate, second group with approximately constant hazard rate contains people below the ages between 30 and 40 and the third group with
1.2 Historical and Background Information
34
increasing hazard rate for the people above the ages between 30 and 40. The bathtub shape can also be seen in the failures times of some electrical products, where the early failures are caused by some manufactory defects, handling or types of storage. The useful life period, when the products are used, have relatively constant failure rate, and is the longest period among the three. At the end of the product life the wear out period appears with increasing failure rate over time. On the other hand, when the main reasons of the failures of products are caused by fatigue and corrosion, the failure rates of those products will exhibit unimodal shapes, cf. Lai and Xie (2006). In some medical situations, for example breast cancer, the hazard rate has been shown to be unimodal or modified unimodal shape. The hazard rate for breast cancer recurrence after surgical removal has been observed to have unimodal shape, cf. Demicheli et al (2004). Initially, the hazard rate for breast cancer recurrence begins with a low level, then increases gradually after a finite period time after the surgical removal until reaching a peak before then decreasing. Another example of the unimodal shape is the hazard of infection with some new viruses, where it increases in the early viruses’ ages from low level till it reaches a peak and then decreases. The hazard rate of death of breast cancer patients represents a modified unimodal shape (unimodal shape followed by increasing). It has a modified unimodal shape with three phases, first increasing, then decreasing, then again increasing, which has nice and useful interpretations, cf. Zajicek (2011). It can be interpreted as a description of three groups of patients, first group is represented by the first phase that contains the weak patients who die within the first three years, so the hazard rate of this group is increasing, while the second phase represents the group with strong patients, their bodies have became familiar with the disease and they are getting better. The hazard rate of death of these patients is decreasing. In the third phase they become weaker and their ability to cope with the disease declines, then the hazard rate of death increases. Also, that can be interpreted in the case of the statuses of patient with the disease. At first the patient has been surprised and dose not recognize the appropriate ways to deal and cope with the disease, as a result the hazard rate will be increasing. After while, the patient becomes more knowledgeable and her ability to cope the disease increases, so the hazard rate of death decreases. Finally, as the
1.2 Historical and Background Information
35
age of the patient increases, the hazard rate increases again over the time, see Zajicek (2011). The Weibull distribution is one of the most important, desirable and widely used lifetime distributions. It has been used in many different fields with many applications. The CDF of the Weibull distribution is simple and has a closed form which gives a simple expression of its survival and hazard functions. It is a flexible distribution that can be used to fit different kinds of of lifetime data sets in different fields. Moreover, it has a physical meaning and interpretations of its parameters. The two-parameter Weibull distribution is specified by the cumulative distribution function CDF ( ) F (x) = 1 − exp −αxθ , x > 0,
(1.2)
where α > 0 and θ > 0 are the scale and shape parameters, respectively. The corresponding probability density function PDF is ( ) f (x) = αθxθ−1 exp −αxθ , x > 0.
(1.3)
The corresponding hazard function HF is h(x) = αθxθ−1 , x > 0,
(1.4)
which can be increasing, decreasing or constant depending on θ > 1, θ < 1 or θ = 1. Unfortunately, it dose not exhibit any kind of non-monotonic hazard rate shape. For many years, using different techniques, many researchers have developed various modified forms of the Weibull distribution to achieve non-monotonic shapes. The two-parameter flexible Weibull extension of Bebbington et al (2007) has a hazard function that can be increasing, decreasing or bathtub shaped. Zhang and Xie (2011) studied the characteristics and application of the truncated Weibull distribution which has a bathtub shaped hazard function. A three-parameter model, called the exponentiated Weibull distribution, was introduced by Mudholkar and Srivastave (1993). Another three-parameter model is by Marshall and Olkin (1997) and called the extended Weibull distribution. Xie et al (2002) proposed a three-parameter modified Weibull extension with a bathtub shaped hazard function. The modified Weibull (MW) distribution of Lai et al (2003) multiplies the Weibull cumulative hazard function αxθ by eλx , which was later generalized to exponentiated form by Carrasco et al (2008).
1.2 Historical and Background Information
36
Recent studies of the modified Weibull include Jiang et al (2010), Soliman et al (2012) and Upadhyaya and Gupta (2010). Among the four-parameter distributions, the additive Weibull distribution (AddW) of Xie and Lai (1996) with cumulative distribution function CDF F (x) = 1 − e−αx
θ −βxγ
, x ≥ 0,
has a bathtub-shaped hazard function consisting of two Weibull hazards, one increasing (θ > 1) and one decreasing (0 < γ < 1). The modified Weibull distribution of Sarhan and Zaindin (SZMW) (2009) can be derived from the additive Weibull distribution by setting θ = 1. A four-parameter beta Weibull distribution was proposed by Famoye et al (2005). Five-parameter modified Weibull distributions include Phani’s modified Weibull (1987) which generalizes the four-parameter Weibull distribution which was proposed by Kies (1958), the Kumaraswamy Weibull by Cordeiro et al (2010) and the beta modified Weibull (BMW) introduced by Silva et al (2010) and further studied by Nadarajah et al (2011). The latest examples include the beta generalized Weibull distribution by Singla, et al (2012), exponentiated generalized linear exponential distribution by Sarhan et al (2013), the generalized Gomprtz distribution by El-Gohary et al (2013) and the exponentiated modified weibull extension distribution by Sarhan and Apaloo (2013) which exhibits a bathtub-shaped pattern. It has been pointed out by Nadrajah and Kotz (2005) that some of the modified Weibull distributions can be obtained as special cases of Gurvich et al (1997)’s form F (x) = 1 − exp (−H(x)) , x ≥ 0,
(1.5)
where H(x) is a monotonically increasing function of x. This is true for any lifetime distribution F as H(x) = − log(1 − F (x)) will be the cumulative hazard function. Although some flexible distributions exist among these modifications with only two or three parameters, such as the flexible Weibull extension of Bebbington et al (2007), the MW distribution of Lai et al (2003) and the modified Weibull extension of Xie et al (2002), the effective and flexible modified Weibull distributions have four or five parameters. In contrast, although the distributions with four parameters or more that exhibit a bathtub shaped hazard rate are useful and flexible, they are also complex Nelson (1990) and cause estimation problems as a consequence of the number of parameters, especially when the sample size is not large.
1.2 Historical and Background Information
37
If G(x) is a CDF, then a distribution with CDF, F (x) = G(x)θ , is called an exponentiated distribution. Using this exponentiation, several lifetime distributions have been generalized. Kundu and Gupta (1999) generalized the standard exponential distribution to the generalized exponential (GE) distribution with CDF ( )θ F (x; α, θ) = 1 − e−αx for x > 0, where α > 0 and θ > 0. This distribution has been extensively studied by several authors, see, for example, Gupta and Kundu (2001a, 2001b), Raqab (2004), Gupta and Kundu (2007), and Kundu and Gupta (2008). Mudholkar and Srivastava (1993) generalized the Weibull distribution to the exponentiated Weibull (EW) distribution. The CDF of the EW distribution is ( γ )θ F (x; α, γ, θ) = 1 − e−αx
(1.6)
for x > 0, where α > 0, γ > 0 and θ > 0. The exponentiated Pareto (EP) distribution was proposed by Gupta et al. (1998), while the generalized Rayleigh (GR) distribution was studied by Surles and Padgett (2001, 2005) and Kundu and Raqab (2005). The CDF of the GR distribution is (
F (x; α, θ) = 1 − e
−αx2
)θ
for x > 0, where α > 0 and θ > 0. Using the same technique, Nadarajah and Kotz (2006b) introduced the exponentiated gamma (EGam) distribution, the exponentiated Gumbel (EGum) distribution and the exponentiated Fr´echet (EF) distribution. The generalized modified Weibull (GMW) distribution of Carrasco et al. (2008) is an exponentiated distribution. Sarhan and Kundu (2009) introduced a three-parameter distribution called the generalized linear failure rate (GLFR) distribution with CDF ( ) 2 θ F (x) = 1 − e−αx−βx for x > 0, where α > 0, β > 0 and θ > 0. Recently, different versions of exponentiated distributions have been introduced by several authors: Sarhan and Apaloo (2013), El-Gohary et al. (2013) and Sarhan et al. (2013) introduced the exponentiated modified Weibull extension (EMWEx) distribution, the generalized Gompertz (GG) distribution and the exponentiated generalized linear exponential (EGLE) distribution, respectively.
1.2 Historical and Background Information
38
The unimodal or modified unimodal hazard rate function has many applications in reliability and survival analysis as described earlier. The HFs of the GMW and EW distributions can exhibit unimodal shapes. There are other distributions exhibiting unimodal HFs: the inverse Weibull (IW) distribution, Kumaraswamy inverse Weibull (KumIW) distribution due to Shahbaz et al. (2012), the beta inverse Weibull (BIW) distribution due to Hanook et al. (2013), the generalized Weibull (GW) distribution due to Mudholkar and Kollia (1994), the extended Weibull distribution due to Marshall and Olkin (1997), and the beta Weibull distribution due to Famoye et al. (2005) among others. In reliability and lifetime analysis, when the failures (lifetimes) are truly discrete, continuous models may not be appropriate. Discrete models will be consistent with such data. Example of discrete data include: the number of rounds fired by a weapon till the first failure; the number of deaths at a given place over a given period; the number of cycles prior to the first failure when devices work in cycles; the number of periods successfully completed without failure when devices are observed just once a week, a month or a year. Sometimes continuous data are grouped as discrete because the amount of data is huge or the individual observations are either unknown or their ranges are more important than the values. During the last few decades, a large number of continuous lifetime distributions has been proposed and some of them have been extensively studied and modified. On the other hand, although the number of discrete distributions has increased slightly during the last a few years, more studies are needed in this area. It is well known that the geometric distribution is the discrete analogue of the exponential distribution, while the negative binomial distribution is the discrete analogue of the gamma distribution. Nakagawa and Osaki (1975), Stein and Dattero (1984) and Padgett and Spurrier (1985) proposed three different discrete versions of the Weibull distribution which were further studied by Khan et al (1989) and Kulasekera (1994). A two-parameter discrete gamma distribution (DGD) was introduced by Yang (1994). Chakraborty and Chakravarty (2012) recently discussed its parameter estimation using different methods. Roy (2003) and Roy(2004) proposed the discrete normal distribution (DND) and the discrete Rayleigh distribution (DRD). The discrete Burr distribution (DBD) and the discrete Pareto distribution (DPD) were proposed by
1.3 Research Motivations
39
Krishna and Singh (2009). Lai and Wang (1995) introduced a finite range simple discrete life distribution (SDD). Jazi et al. (2010) discretized the inverse Weibull (DIW) distribution while Gomez-Deniz et al. (2011) introduced a new discrete distribution with actuarial applications. A discrete analogue of the continuous modified Weibull distribution of Lai et al (2003) (DMW) was introduced by Noughabi et al. (2011). Recently, Bebbington et al. (2012), Al-Huniti and Al-Dayian (2012) and Bakouch et al. (2014) introduced the discrete additive Weibull (DAddW), discrete Burr type III (DB3) and discrete Lindley (DLD) distributions, respectively.
1.3
Research Motivations
The main purpose of the modification and extension forms of the Weibull distribution is to describe and fit the data sets with non-monotonic hazard rate, such as the bathtub, unimodal and modified unimodal hazard rate. Many modifications of the Weibull distribution have achieved the above purpose. On the other hand, unfortunately, the number of parameters has increased, the forms of the survival and hazard functions have been complicated and estimation problems have risen. Moreover, some of the modifications do not have a closed form for their CDFs. As we have seen, the bathtub and the modified unimodal shapes have three phases: initially decreasing phase, relatively constant phase and then an increasing phase for the bathtub shape and the phases of the modified unimodal shape are initially increasing, then decreasing, then increasing again. The main weakness of some modified Weibull distributions is that they are unable to fit the last phase of the bathtub and the modified unimodal shapes, which are essential parts, as well as the first and middle phases. Extensive reviews of some of these modifications have been presented, for example, see Rajarshi and Rajarshi (1988) and Murthy et al (2003). Pham and Lai (2007) and Lai et al (2011) introduced a brief review about the Weibull models. Most of the modifications of the Weibull distribution (both continuous and discrete) have been introduced in the last five years or so. In contract, the most recent intensive review was introduced before more than ten years. Also, most of them focused on the continuous distribution more than the discrete ones. So, it is timely that a review is written of the known modifications of the Weibull distribution. Chapter 2 provides an extensive
1.3 Research Motivations
40
review of the continuous and discrete modifications of the Weibull distributions. This Chapter could serve as an important reference and encourage further modifications of the Weibull distribution (and could be a useful reference complementing the book of Murthy et al (2003)). To address some of the previous problems that appeared with some modifications of the Weibull, a new modification of the Weibull is provided in Chapter 3. The new modification is based on the Weibull distribution and one of the most interesting of its modifications. The new model is applied to two of the well known, popular and widely used lifetime data sets. Usually, most researchers compared their new modifications with its sub-models that have fewer parameters including the Weibull distribution. As an expected result, the new modification provides a better fit than its sub-models. They did not consider, or ignored, some other modifications that have the same number of parameters, have some similar properties or those which have the same purpose and are flexible enough to provide a good fit for this kind of data sets. The author believes, that is unfair to compare a distribution with its sub-models that have fewer parameters, it is just like when a football team with 11 players plays against its incomplete reserve team with 9 players or less. The proposed distribution in Chapter 3 will compare with its sub-models, other modifications of the Weibull distribution and with one of the best modifications of the Weibull that has the same number of parameters. The majority of researches tend to increase the number of parameters to provide a better fit without considering the complexity or the problems of estimation. Rarely, researches tried to reduce the number of the parameters while maintaining the flexibility and the ability to fit data so well. The main purpose of Chapter 4 is to simplify the proposed model, that was introduced in the previous chapter, by reducing the number of parameters to address these problems while maintaining mach of the same flexibility and ability to fit data so well. To cater to the need to model unimodal and modified unimodal shaped hazard rate lifetime data and to address the inability of some modifications of the Weibull to fit the third phase of the modified unimodal well, Chapter 5 introduces a four-parameter generalization distribution that can accommodate monotonically increasing, unimodal, modified unimodal and bathtub shaped hazard rate functions. The new distribution
1.4 Organization of the thesis
41
will be compared to other distributions including those having four parameters. Many continuous Weibull distributions with bathtub shaped hazard rate functions have been introduced and studied. However, only a few discrete distributions have bathtub shaped hazard rate functions are introduced. The ones we are aware of are the discrete modified Weibull and the discrete additive Weibull distributions. This is the main motivation for Chapter 6 to introduce a new discrete distribution allowing for bathtub shaped hazard rate functions. In recent years, many modifications of the Weibull distribution have been proposed. The author believes that there are some modified Weibull distributions with a small number of parameters which have not received the attention they deserve. Also, there are some modified Weibull distributions with a large number of parameters which need to be revalued with respect to what they really contribute. Some of these modifications have a large number of parameters and so their real benefits over simpler modifications are questionable. Chapter 7 shows that by considering the generalized modified Weibull distribution of Carrasco et al. (2008), a widely cited paper, and the exponentiated Weibull (EW) distribution of Mudholkar et al. (1995, 1996).
1.4
Organization of the thesis
This thesis contains eight chapters and proposes four new models, related to the Weibull distribution and its modifications, to improve the fitting of different kinds of lifetime data sets and to avoid some problems of some other modifications. This thesis is organized as the following: • An intensive review of discrete and continuous versions of the modifications of the Weibull distribution is given in Chapter 2. This review includes the latest modifications that have been proposed in the last five years. The first part reviews continuous modifications of the Weibull distribution, including their probability density and hazard functions. The second part reviews discrete analogues of the Weibull distribution and their modifications, the probability mass and the hazard functions of those distributions are presented and their shapes are presented. Estimation methods, graphical tools for data analysis and goodness of fit are discussed.
1.4 Organization of the thesis
42
• Chapter 3 introduces a new modification of the Weibull distribution, to be known as new modified Weibull distribution (NMW). The sub-models of this new distribution are presented and the shapes of its probability density and hazard rate functions are investigated. Two different methods to simulate a random sample from this distribution are presented. Some of the mathematical properties of the NMW are studied including moments, moment generating function and order statistics. The estimation of its unknown parameters by maximum likelihood is discussed. The new modified Weibull distribution is applied to several real data sets and compared with some other modified Weibull distributions. • Chapter 4 proposes a new simple method to reduce the number of parameters of the new modified Weibull of Chapter 3 from five to three parameters. The resulting distribution is to called reduced new modified Weibull distribution (RNMW) has been introduced. The shape of the hazard rate function is derived analytically. Some mathematical properties of the reduced model have been studied and maximum likelihood estimation is discussed. Four applications of complete and censored real data sets are used to compare the reduced version with the NMW. • Chapter 5 introduces a new model, referred to as exponentiated reduced modified Weibull (ERMW), to fit the data with unimodal modified unimodal hazard rate. First, the definition, interpretation and special cases of the proposed model are presented. The shapes of the probability density and hazard rate function are shown. We derive expressions for its mathematical properties and maximum likelihood estimation. Using a simulation study the performance of the maximum likelihood estimates (MLEs) with respect to biases and mean squared errors is studied. Two applications with different hazard rate shapes are provided to show how the proposed distribution work in practice using real data sets. • Chapter 6 proposes a new discrete model with three parameters to be called the new discrete modified Weibull distribution and noted as (DRMW). The new distribution has a bathtub or increasing hazard rate function. The definition of the new discrete distribution is given and a series expansion for its survival function is derived. The shapes of its probability mass function are shown and the shape
1.5 Publications and conferences
43
of the hazard rate function are derived analytically. Some mathematical properties of the DRMW are studied including moments and order statistics. The point and interval estimators of the unknown parameters of the DRMW distribution are derived using the maximum likelihood method. Then, assessment of the performance of the MLEs with respect to sample size n are presented using a simulation study. The proposed distribution is applied to four applications with a bathtub and increasing hazard rate and compared with other discrete modified Weibull distributions. • Chapter 7 uses two data sets with modified unimodal (unimodal followed by increasing) hazard function for comparing the exponentiated Weibull and generalized modified Weibull distributions. In a related issues, this chapter points out some incorrect results with regard to the generalized Weibull distribution of Carrasco et al. (2008), in the applications to the Serum-reversal and Radiotherapy data. The correct results are provided. • Chapter 8 concludes the thesis and presents possible future work.
1.5
Publications and conferences
1. The intensive review that has been introduced in Chapter 2 was published in Reliability Engineering & System Safety in April 2014. The article entitled “Modifications of the Weibull Distribution: A review”. 2. The main contribution in Chapter 3 was published in Reliability Engineering & System Safety in March 2013. The title of this article is “A New Modified Weibull Distribution”. 3. The main contribution that is presented in Chapter 4 has been accepted to be published in Communications in Statistics-Theory and Methods. The final version of the paper has been forwarded to the publisher for copy editing and typesetting. The title of this paper is “A Reduced New Modified Weibull Distribution”.
1.5 Publications and conferences
44
Also, this work was presented as a talk in the 8th World Congress in Probability and Statistics that was held in Istanbul, Turkey 2012. 4. The main results of Chapter 5 has been submitted to Communications in StatisticsTheory and Methods and it is under consideration. The article is entitled “Exponentiated Reduced Modified Weibull Distribution”. 5. The new proposed discrete model in Chapter 6 has been published in IEEE TRANSACTIONS ON RELIABILITY. It is titled as “A New Discrete Modified Weibull Distribution”. 6. Chapter 7 has been submitted to IEEE TRANSACTIONS ON RELIABILITY and now it is under consideration. It is titled as “Comparing The Exponentiated and Generalized Modified Weibull Distributions”.
Chapter 2 Review of Modifications of the Weibull Distribution 2.1
Introduction
The Weibull distribution was introduced by the Swedish physicist Waloddi Weibull (Weibull, 1951). This work is one of the most widely cited papers. It has been used in many different areas such as material science, reliability engineering, physics, chemistry, medicine, psychology, pharmacy economics, quality control, maintenance and replacement, inventory control, biology, forestry, geology, geography, astronomy and other fields. A huge number of applications in the above areas have been listed in Rinne (2008), Section 7.1, Tables 7.1-7.12. Murthy et al (2003) (Table 1.1 page 12) presented more than 40 applications of the Weibull distribution with references. Moreover, as an extreme value distribution it has been used to model climate and weather data such as rainfall (Revfeim, 1983), floods (Boes et al, 1989 and Heo et al, 2001) and wind speeds (Conradsen et al, 1984 and Carroll 2003). The two-parameter Weibull distribution that is specified by the CDF in (1.2) has been extensively modified using different methods by different authors and there is a discrete version. The aim of this chapter is to provide a review of the modifications of the Weibull distribution. The continuous modifications of the continuous Weibull distribution are reviewed in Section 2.2. The discrete modifications of the discrete Weibull distribution are reviewed in Section 2.3. Maximum likelihood estimation, goodness of fit and information criteria are discussed in Section 2.4-2.7.
2.2 Continuous modifications of the Weibull distribution
2.2
46
Continuous modifications of the Weibull distribution
In this section, some modifications of the continuous Weibull distribution are presented. Because of space limitations, we have not presented all of the known modifications of the continuous Weibull distribution. Some important modifications not presented include those due to Elbatal (2011), Provost et al. (2011), Razaq and Memon (2011), and Flaih et al. (2012b).
2.2.1 If Y =
Inverse Weibull distribution 1 X
and X follows the Weibull distribution, then Y has the inverse Weibull (IW)
distribution. The CDF, the PDF, and the HF of an IW distribution are −θ
F (y; α, θ) = e−αy ,
y > 0, −θ
f (y; α, θ) = αθy −θ−1 e−αy ,
(2.1)
y>0
and h(y; α, θ) = αθy −θ−1 ,
y > 0,
where α, θ > 0. The HF of the IW distribution has a unimodal shape, see Figure 2.1. This distribution is also called the reverse Weibull distribution (Simiu and Heckert, 1996), the complementary Weibull distribution (Drapella, 1993) and the reciprocal Weibull distribution (Mudholkar and Kollia, 1994). Some properties of order statistics of the IW distribution are derived in Razaq and Memon (2011). A generalization of the IW distribution referred to as the Kumaraswamy IW, (KumIW), distribution was studied by Shahbaz et al. (2012). Its PDF and CDF are given by [ ] −θ b F (y) = 1 − 1 − e−ay ,
y>0
and f (y) = abθy −θ−1 e−ay
−θ
[ ] −θ b−1 1 − e−ay ,
y > 0,
2.2 Continuous modifications of the Weibull distribution
(a)
47
(b)
Figure 2.1: PDF and HF of the inverse Weibull distribution where θ, a, b > 0, The particular case for a = b = 1 is the IW distribution. A generalization of the IW distribution referred to as the beta inverse Weibull (BIW) distribution was studied by Hanook et al. (2013). Its CDF and PDF are given by F (y) = Ie−y−θ (a, b),
y>0
and f (y) =
[ ] θ −θ −θ b−1 y −(θ+1) e−ay 1 − e−y , B(a, b)
y > 0,
where θ, a, b > 0, B(a, b) denotes the beta function defined by ∫ 1 B(a, b) = ta−1 (1 − t)b−1 dt, 0
and Ix (a, b) denotes the incomplete beta function ratio defined by ∫ x 1 ta−1 (1 − t)b−1 dt. Ix (a, b) = B(a, b) 0 The particular case for a = b = 1 is the IW distribution. The particular case of for b = 1 is the exponentiated IW distribution due to Flaih et al. (2012a). Hanook et al. (2013) showed that the BIW distribution can exhibit monotonic increasing and unimodal HFs. De Gusmao et al. (2011) claimed to have proposed another generalization of the IW distribution. But it turns out to be a simple reparameterization of the IW distribution. Sultan et al. (2007) proposed a mixture of two IW distributions.
2.2 Continuous modifications of the Weibull distribution
2.2.2
48
Log-Weibull distribution
Let X be a Weibull random variable with parameters α and θ. Then
Y −a b
= log (αX θ )
has the log-Weibull (LogW) distribution (extreme-value distribution Type I). It is due to Gumbel (1958). Its CDF and PDF are { } y−a ( ) b F (y; θ, a, b) = 1 − exp −e ,
−∞ < y < ∞
and { } y−a 1 y−a f (y; θ, a, b) = e( b ) exp −e( b ) , b
−∞ < y < ∞,
where −∞ < a < ∞ and b > 0. This distribution is also called the type I extreme value distribution. The HF of the LogW distribution is 1 y−a h(y; θ, a, b) = e( b ) , b an increasing function of y. The PDFs and the HFs of the LogW distribution for a = 0 and b = 1, 1.5, 3, 4.5 are shown in Figure 2.2.
(a)
(b)
Figure 2.2: PDF and HF of the log-Weibull distribution White (1969) derived expressions for the moments of a LogW random variable.
2.2.3
Reflected Weibull distribution
By considering the transformation Y = −X, where X is a Weibull random variable, Cohen (1973) introduced the reflected Weibull (RefW) distribution. The CDF and
2.2 Continuous modifications of the Weibull distribution
49
the PDF of the RefW distribution are given by F (y; α, θ) = e−α(−y) , θ
−∞ < y < 0
and f (y; α, θ) = αθ(−y)θ−1 e−α(−y) , θ
−∞ < y < 0,
where α, θ > 0. The HF of the RefW distribution is αθ(−y)θ−1 e−α(−y) h(y; α, θ) = , 1 − e−α(−y)θ θ
an increasing function of y. Figure 2.22 shows the PDF and the HF of the RefW distribution.
(a)
(b)
Figure 2.3: PDF and HF of the reflected Weibull distribution
2.2.4
Gamma Weibull distribution
A modification of the Weibull distribution due to Stacy (1962) uses the gamma distribution. It is a three-parameter generalized gamma distribution. Its PDF and CDF are f (x) =
θαk kθ−1 −αxθ x e , x>0 Γ(k)
and ( ) γ k, αxθ F (x) = , x > 0, Γ(k)
2.2 Continuous modifications of the Weibull distribution
50
where α, θ, k > 0 and γ(a, x) denotes the incomplete gamma function defined by ∫ x γ(a, x) = ta−1 e−t dt. 0
The particular case for k = 1 gives the Weibull distribution. The particular case for θ = 1 gives the gamma distribution. The particular case for k =
r θ
+ 1 is the weighted
Weibull distribution due to Tzavelas and Panagiotakos (2013). Stacy and Mihram (1965) introduced a further generalization of the gamma distribution by letting θ to take any real value. The PDF and the CDF of this distribution are f (x) = and
|θ| αk k|θ|−1 −αx|θ| x e , x>0 Γ(k)
( ) γ k, αx|θ| F (x) = , x > 0, Γ(k)
where α, k > 0. The particular case for k = 1 is the Weibull distribution. Other particular cases include the exponential, gamma, chi-squared and Rayleigh distributions. The latest studies about the generalized gamma distribution include Noufaily and Jones (2013a) and Noufaily and Jones (2013b). Harter (1967) obtained a four-parameter generalized gamma distribution by adding a location parameter to the generalized gamma distribution of Stacy (1962). Its PDF and CDF are f (x) = and
θαk θ (x − γ)kθ−1 e−α(x−γ) , x > γ ≥ 0 Γ(k)
( ) γ k, α(x − γ)θ F (x) = , x > γ ≥ 0, Γ(k)
where α, θ, k > 0 and −∞ < γ < ∞. Cordeiro et al. (2011a) introduced the four-parameter exponentiated generalized gamma distribution given by the PDF [ ( ) ] { ( ( ) )}λ−1 λβ ( x )βk−1 x β x β , x > 0, f (x) = exp − γ1 k, αΓ(k) α α α where α, β, k, λ > 0, and γ1 (a, x) is the incomplete gamma ratio defined by γ1 (a, x) = γ(a, x)/Γ(a). It allows for bathtub shaped, monotonically decreasing, monotonically increasing, and upside down bathtub shaped HFs.
2.2 Continuous modifications of the Weibull distribution
51
Cordeiro et al. (2013a) introduced a five-parameter beta generalized gamma distribution. In addition to the exponentiated generalized gamma distribution, it contains many other distributions as particular cases. These include the gamma, chi-square, exponential, Weibull, Rayleigh, Maxwell, folded normal, log-normal, exponentiated gamma, exponentiated chi-square, exponentiated exponential, exponentiated Weibull, exponentiated Rayleigh, exponentiated Maxwell, exponentiated folded normal, exponentiated log-normal, beta gamma, beta chi-square, beta exponential, beta Weibull, beta Rayleigh, beta Maxwell, beta folded normal and beta log-normal distributions. Pascoa et al. (2011) introduced the five-parameter Kumaraswamy-generalized gamma distribution given by the PDF [ ( x )τ ] { ( ( x )τ )}λ−1 ( { ( ( x )τ )}λ )ψ−1 λψτ ( x )τ k−1 f (x) = exp − 1 − γ1 k, γ1 k, , αΓ(k) α α α α where x, α, λ, k, ψ, τ > 0. It allows for constant, bathtub shaped, monotonically decreasing, monotonically increasing, and upside down bathtub shaped HFs. Al-Saleh and Agarwal (2006) proposed an extended Weibull type distribution given by the PDF mcm xm−1 e−(cx)
m
f (x) =
Γδ (1, 1) [(cx)m + 1]δ
x > 0,
where m, c > 0, −∞ < δ < ∞ and Γδ (m, n) denotes the generalized gamma function defined by ∫ Γδ (m, n) = 0
∞
xm−1 e−x dx. (x + n)δ
The corresponding CDF and HF are F (x) = Γ(cx)m ,δ (1, 1), x > 0 and mcm xm−1 e−(cx) h(x) = [ x > 0, ] 1 − Γ(cx)m ,δ (1, 1) [(cx)m + 1]δ m
where Γx,δ (j, 1) denotes the incomplete generalized gamma function defined by ∫ x j−1 −u u e du. Γx,δ (j, 1) = δ 0 (u + 1) The Weibull distribution is contained as the particular case for δ = 0. Al-Saleh and Agarwal (2006) have shown that the HF can exhibit unimodal and bathtub shapes.
2.2 Continuous modifications of the Weibull distribution
2.2.5
52
Kies and Phani’s modified Weibull distributions
In some applications in the area of material science like strength of brittle materials such as glass and fiber, the strength values are limited where the Weibull distribution requires unlimited value. So, to address the limitation, Kies (1958) introduced a modification of the Weibull distribution by adding lower and upper limits to the random variable. Its CDF is
[
F (x; α, β, a, b) = 1 − exp −α
(
x−a b−x
)β ] ,
where 0 < a ≤ x ≤ b < ∞ and α, β, γ > 0. The Kies’s distribution is limited because it has just one shape parameter. To give more flexibility, Phani (1987) proposed a distribution by adding another shape parameter β2 . Its CDF is given by [ ] (x − a)β1 F (x; α, β1 , β2 , a, b) = 1 − exp −α , (b − x)β2 where 0 < a ≤ x ≤ b < ∞ and α, β1 , β2 > 0. The corresponding PDF and HF are { } α(x − a)β1 −1 [(bβ1 − aβ2 ) + (β2 − β1 ) x] (x − a)β1 f (x; α, β1 , β2 , a, b) = exp α (b − x)β2 +1 (b − x)β2 and h (x; α, β1 , β2 , a, b) =
α(x − a)β1 −1 [(bβ1 − aβ2 ) + (β2 − β1 ) x] , (b − x)β2 +1
where 0 < a ≤ x ≤ b < ∞. The HF has a bathtub shape when 0 < β1 , β2 < 1 and increases otherwise. Figures 2.5 and 2.4 show the PDF and the HF of the distributions due to Kies and Phani.
2.2.6
Exponentiated Weibull distribution
A simple modification of the two-parameter Weibull distribution, called the exponentiated Weibull, EW, distribution, was proposed by Mudholkar and Srivastava (1993) and further studied by Mudholkar et al. (1995) and Mudholkar and Hutson (1996) with applications to bus-motor failure data and flood data. They added a new shape parameter λ to the Weibull distribution. The PDF and the CDF of the EW distribution are f (x; α, θ, λ) = λαθxθ−1 e−αx
θ
(
1 − e−αx
θ
)λ−1 ,
x>0
2.2 Continuous modifications of the Weibull distribution
(a)
(b)
Figure 2.4: PDF and HF of Kies distribution
(a)
(b)
Figure 2.5: PDF and HF of Phani distribution
53
2.2 Continuous modifications of the Weibull distribution
54
and ( ) θ λ , F (x; α, θ, λ) = 1 − e−αx
x > 0,
(2.2)
where α, θ, λ > 0, α is a scale parameter and θ and λ are shape parameters. The particular case for λ = 1 is the Weibull distribution. The particular case for θ = 2 is the generalized Rayleigh distribution, GR, due to Surles and Padgett (2001). The particular case for θ = 1 is generalized exponential distribution, GE, due to Kundu and Gupta (1999). The particular cases for λ = 1 and θ = 1, 2 are the exponential and Rayleigh distributions. The HF of the EW distribution is h(x; α, θ, λ) = αθλxθ−1 e−αx
θ
(
1 − e−αx
θ
)−1
,
which is monotonically increasing when θ > 1 and θλ > 1, monotonically decreasing when θ < 1 and θλ < 1, bathtub shaped when θ > 1 and θλ < 1 and unimodal shaped when θ < 1 and θλ > 1. Figures 2.6 (a) and (b) show possible shapes of the PDF and the HF of the EW distribution.
(a)
(b)
Figure 2.6: PDF and HF of the exponentiated Weibull distribution Pal et al. (2006) re-introduced the EW distribution in more details. Aryal and Tsokos (2011) proposed an extension of the Weibull distribution and compare its fit with the EW distribution. Unfortunately, however, its hazard function cannot exhibit non-monotonic shapes.
2.2 Continuous modifications of the Weibull distribution
2.2.7
55
Generalized Weibull distribution
Mudholkar and Kollia (1994) extended the Weibull distribution to a generalized Weibull GW distribution by adding a new parameter to the quantile function. Mudholkar et al. (1996) used this distribution to model two real survival data sets with bathtub shaped and unimodal shaped failure rates. The quantile function of the GWF distribution is [ ]1 1 − (1 − u)λ θ Q(u) = , αλ where −∞ < λ < ∞. If λ → 0 we obtain the quantile function of the Weibull distribution. The CDF of the GWF distribution is [ ]1 F (x; α, θ, λ) = 1 − 1 − αλxθ λ ,
x > 0,
where α, θ > 0 and −∞ < λ < ∞. The domain of the CDF is (0, ∞) for λ ≤ 0 and (0, (αλ)− θ ) for λ > 0. The PDF of the GWF distribution is 1
[ ] 1 −1 f (x; α, θ, λ) = αθxθ−1 1 − αλxθ λ
x > 0.
[ ]−1 h(x; α, θ, λ) = αθxθ−1 1 − αλxθ
x > 0.
Its HF is
The HF can take the following shapes: • Increasing if θ ≥ 1 and λ > 0; • Decreasing if θ ≤ 1 and λ ≤ 0; • Bathtub shaped if θ < 1 and λ > 0; • Unimodal shaped θ > 1 and λ < 0. Figure 2.7 shows the different shapes of the PDF and the HF of the GWF distribution.
2.2.8
Additive Weibull distribution
Xie and Lai (1996) introduced the additive Weibull distribution, AddW, with bathtub shaped HF obtained as the sum of two HFs of the Weibull distribution. The PDF, the CDF and the HF of the AddW distribution are ( ) θ γ f (x; α, β, θ, γ) = αθxθ−1 + βγxγ−1 e−αx −βx ,
x > 0,
2.2 Continuous modifications of the Weibull distribution
(a)
56
(b)
Figure 2.7: PDF and HF of the exponentiated Weibull distribution F (x; α, β, θ, γ) = 1 − e−αx
θ −βxγ
,
x>0
(2.3)
and h(x; α, β, θ, γ) = αθxθ−1 + βγxγ−1 ,
x > 0,
where α, β, θ > 0 and γ < 1. The HF increases when the shape parameters, θ and γ, are greater than one. The HF decreases when the shape parameters are less than one. The particular case for α = 0 or β = 0 is the Weibull distribution. The particular case for γ = 2 is the linear failure rate distribution due to Bain (1974). The particular case for θ = 1 and γ > 0 is the modified Weibull distribution of Sarhan and Zaindin (2009) to be discussed later. Some possible shapes of the HF and the PDF of the AddW distribution are shown in Figure 2.8. Bebbington et al. (2006) considered a particular case of the AddW distribution with real data applications. A discrete analog of the AddW distribution is proposed in Bebbington et al. (2012).
2.2.9
Extended Weibull distribution
Marshall and Olkin (1997) proposed a general method to modify any distribution by adding a new parameter. Let Fw (·) denote the CDF of a two-parameter Weibull distribution with scale parameter α and shape parameter θ. Using Marshall and Olkin (1997)’s method, Zhang and Xie (2007) proposed an extended Weibull (ExW)
2.2 Continuous modifications of the Weibull distribution
(a)
57
(b)
Figure 2.8: PDF and HF of the additive Weibull distribution distribution specified by the CDF F (x; α, θ, λ) =
Fw (x) 1 − λF w (x)
1 − e−αx = , 1 − λe−αxθ θ
x > 0,
(2.4)
where λ = 1 − λ and F w (x) = 1 − Fw (x). The WG distribution of Barreto-Souza et al. (2011) is a particular case of this distribution for 0 < λ < 1. The PDF and the HF of the ExW distribution are αθλxθ−1 e−αx f (x; α, θ, λ) = [ ]2 , 1 − λe−αxθ θ
x>0
(2.5)
and h(x; α, θ, λ) =
αθλxθ−1 1 − λe−αxθ
x > 0.
(2.6)
The HF in (2.6) increases when θ, λ ≥ 1, decreases when θ, λ ≤ 1, unimodal followed by increasing when θ > 1 and decreasing followed by unimodal when θ < 1. The different shapes of the PDF and the HF of the ExW distribution are shown in Figure 2.9. Ghitany et al. (2005) suggested an extension of Marshall and Olkin (1997)’s method for generating new distributions. For a given CDF Fw (·), they suggest defining F (x; α, λ, β) =
αF w (x) , 1 − αF w (x)
2.2 Continuous modifications of the Weibull distribution
(a)
58
(b)
Figure 2.9: PDF and HF of the extended Weibull distribution where α > 0 and α = 1 − α. By taking Fw (·) to be a two-parameter Weibull CDF, Ghitany et al. (2005) generalized (2.4), (2.5) and (2.6) to αe−(λx) F (x; α, λ, β) = 1 − , 1 − αe−(λx)β β
x > 0,
αβλ(λx)β−1 e−(λx) f (x; α, λ, β) = [ ]2 , 1 − αe−(λx)β β
x>0
and βλ(λx)β−1 h(x; α, λ, β) = , 1 − αe−(λx)β
x > 0,
respectively, where α, β, λ > 0. Ghitany et al. (2005) established that the following shapes are possible for the HF: • Increasing if either α ≥ 1 and β ≥ 1 or α ≤ 1, β > 1 and β − 1 − αe−1/β ≥ 0; • Decreasing if either α ≤ 1 and β ≤ 1 or α ≥ 1, β < 1 and β − 1 − αβe−1/β ≤ 0; • Increasing followed by decreasing followed by increasing if α ≤ 1, β > 1 and β − 1 − αe−1/β < 0; • Decreasing followed by increasing followed by decreasing if α ≥ 1, β < 1 and β − 1 − αβe−1/β > 0. Particular cases of this distribution include Gompertz (1825)’s distribution for β = 1 and Chen (2000)’s distribution for λ = 1. Some possible shapes of the PDF and the HF of Ghitany et al.’s distribution are shown in Figure 2.10.
2.2 Continuous modifications of the Weibull distribution
(a)
59
(b)
Figure 2.10: PDF and HF of Ghitany et al.’s distribution
2.2.10
Power Lindley distribution
Ghitany et al. (2013) proposed the power Lindley (PL) distribution specified by the CDF
( F (x; α, β) = 1 − 1 +
) β α α x e−βx , β+1
x > 0,
where α > 0 and β > 0. The corresponding PDF and HF are f (x; α, β) =
αβ 2 α (1 + xα ) xα−1 e−βx , β+1
x>0
and h(x; α, β) =
(1 + xα ) xα−1 , β + 1 + βxα
x > 0.
This distribution was obtained by power transformation of a Lindley random variable (Lindley, 1958). It can also be obtained as a mixture of Weibull and generalized gamma distributions. The Weibull distribution arises as the limiting case for β → 0. Ghitany et al. (2013) established the following shapes for the PDF of the PL distribution: • Decreasing if either 0 < α ≤ 1/2 and β > 0 or 1/2 < α < 1 and β ≥ { } √ 1 − 2 α(1 − α) /α or α = 1 and β ≥ 1; • Unimodal if either α = 1 and 0 < β < 1 or α > 1 and β > 0; • Decreasing followed by increasing followed by decreasing if 1/2 < α < 1 and { } √ 0 < β < 1 − 2 α(1 − α) /α.
2.2 Continuous modifications of the Weibull distribution
60
Moreover, the following shapes were established for the HF: • Decreasing if either 0 < α ≤ 1/2 and β > 0 or 1/2 < α < 1 and β ≥ (2α − 1)2 / {4α(1 − α)}; • Increasing if either α ≥ 1 and β > 0; • Decreasing followed by increasing followed by decreasing if 1/2 < α < 1 and 0 < β < (2α − 1)2 / {4α(1 − α)}. Some possible shapes of the PDF and the HF of the PL distribution are shown in Figure 2.11.
(a)
(b)
Figure 2.11: PDF and HF of the power Lindley distribution
2.2.11
Modified Weibull distribution
Lai et al. (2003) proposed a modification by multiplying the Weibull cumulative HF, αxθ , by eλx . This three-parameter distribution is known as modified Weibull distribution, MW. Lai et al. (2003) studied some of its properties and estimation by maximum likelihood and Weibull probability plot methods. The CDF of the MW distribution is F (x; β, γ, λ) = 1 − e−βx
γ eλx
,
x > 0,
(2.7)
where β > 0, γ, λ ≥ 0 and at most one of γ, λ is equal to zero. The particular case for λ = 0 is the Weibull distribution. The particular case for γ = 0 is the type I extreme
2.2 Continuous modifications of the Weibull distribution
61
value distribution. The PDF of the MW distribution is f (x; β, γ, λ) = β (γ + λx) xγ−1 eλx e−βx
γ eλx
,
x > 0.
(2.8)
The corresponding HF is h(x; β, γ, λ) = β (γ + λx) xγ−1 eλx ,
(2.9)
x > 0.
The PDF of the MW distribution can be decreasing, unimodal or decreasing followed by unimodal. The HF can be increasing or bathtub shaped. Some possible shapes of the PDF and the HF of the MW distribution are shown in Figure 2.12.
(a)
(b)
Figure 2.12: PDF and HF of the modified Weibull distribution The MW distribution is one of the most important modifications of the Weibull distribution and also among the lifetime distributions. Many authors have proposed generalizations of the MW distribution: the generalized modified Weibull distribution due to Carrasco et al. (2008); the beta modified Weibull distribution due to Silva et al. (2010); and the Kumaraswamy modified Weibull distribution due to Cordeiro et al. (2014b). Many authors have also studied estimation issues of the MW distribution: based on progressively type-II censored data, Ng (2005) and Jiang et al. (2010) studied estimation of the parameters of the MW distribution using maximum likelihood and least-squares methods; Carrasco et al. (2008) proposed a regression model called logregression modified Weibull model for lifetime data following the MW distribution and affected by some explanatory variables; Preda et al. (2010) obtained Bayes estimators of the MW distribution based on the Lindley approximation method; Soliman et al.
2.2 Continuous modifications of the Weibull distribution
62
(2012) obtained Bayesian estimators of the MW distribution for progressive censored data by using Markov chain Monte Carlo (MCMC).
2.2.12
Generalized power Weibull distribution
A three-parameter distribution, called a generalized power Weibull (GPW) distribution, was proposed by Nikulin and Haghighi (2006). Its CDF and PDF are { ( )1 } θ λ F (x; α, θ, λ) = 1 − exp 1 − 1 + αx , x>0 and { ( ) 1 −1 ( )1 } f (x; α, θ, λ) = αθλ−1 xθ−1 1 + αxθ λ exp 1 − 1 + αxθ λ ,
x > 0,
where α, θ, λ > 0. The particular case for λ = 1 is the Weibull distribution. The HF of the GPW distribution is ( ) 1 −1 h(x; α, θ, λ) = αθλ−1 xθ−1 1 + αxθ λ ,
x > 0.
It has the following possible shapes: • Increasing if θ ≥ 1 and θ > λ; • Decreasing if θ ≤ 1 and θ < λ; • Bathtub shaped if 0 < λ < θ < 1; • Unimodal shaped λ > θ > 1. Some possible shapes of the PDF and the HF of the GPW distribution are shown in Figure 2.13.
2.2.13
Modified Weibull extension
The modified Weibull extension (MWEx) with bathtub shaped failure rate function was proposed by Xie et al. (2002). The PDF and the CDF of this distribution are ( )] [ θ−1 −αxθ θ−1 αxθ − θ1 ( ) θ f (x; α, θ, λ) = λα 1−e , x>0 x e exp λα and [ ( )] 1 θ F (x; α, θ, λ) = 1 − exp λα− θ 1 − e−αx ,
x > 0,
2.2 Continuous modifications of the Weibull distribution
(a)
63
(b)
Figure 2.13: PDF and HF of the generalized power Weibull distribution where α, θ, λ > 0. The Weibull distribution can be obtained as a special case of this distribution when α is so small that (1 − e−αx ) is approximately equal to −αxθ . The θ
particular case of the MWEx distribution for α = 1 is Chen (2000)’s distribution. The HF of the MWEx distribution is h(x; α, θ, λ) = λα(
θ−1 θ
) xθ−1 eαxθ ,
which depends only on the shape parameter θ. The HF increases if θ ≥ 1 and is bathtub shaped if θ < 1. Some possible shapes of the PDF and the HF of the MWEx distribution are shown in Figure 2.14.
(a)
(b)
Figure 2.14: PDF and HF of the modified Weibull extension Sarhan and Apaloo (2013) generalized the MWEx distribution via exponentiation and referred to the generalization as exponentiated modified Weibull extension,
2.2 Continuous modifications of the Weibull distribution
64
EMWEx. Sarhan and Apaloo’s distribution admits increasing and bathtub shaped HFs. It can also be shown to have a bathtub shaped HF with long useful period. Figure 2.15 shows possible shapes of the PDF and the HF of the EMWEx distribution. Much researches have been performed with respect to the MWEx distribution, see, for example, Xie et al. (2002), Tang et al. (2003), Yong (2004), Nadarajah (2005), Elshahat (2007), Gupta et al. (2008), and El-Fotouh and Nassar (2011).
(a)
(b)
Figure 2.15: PDF and HF of the exponentiated modified Weibull extension
2.2.14
Beta Weibull distributions
The four-parameter beta Weibull (BW) distribution was proposed by Famoye et al. (2005). Its PDF and CDF are f (x; a, b, α, θ) =
( ) 1 θ a−1 θ αθxθ−1 1 − e−αx e−αbx , B(a, b)
x>0
and F (x; a, b, α, θ) = I1−e−αxθ (a, b),
x > 0,
where α, θ, a, b > 0. The particular case for a = b = 1 is the Weibull distribution. Other particular cases include the beta exponential distribution due to Maynard (2003) and Nadarajah and Kotz (2006a), the GE distribution due to Gupta and Kundu (1999) and the EW distribution due to Mudhalkar and Srivastava (1993). The HF of the beta Weibull distribution increases if θ ≥ 1 and aθ ≥ 1, decreases if θ ≤ 1 and aθ ≤ 1, bathtub shaped if θ > 1 and aθ < 1 and unimodal shaped if θ < 1 and aθ > 1. The
2.2 Continuous modifications of the Weibull distribution
65
PDF and the HF of the BW distribution for some selected parameter values are shown in Figure 2.16.
(a)
(b)
Figure 2.16: PDF and HF of the beta Weibull distribution The distribution of Famoye et al. (2005) was re-introduced by Cordeiro et al. (2009) and Wahed et al. (2009) without acknowledging the original source. Lee et al. (2007) applied the BW distribution to censored data sets. Cordeiro et al. (2011b) derived a closed form expressions for the moments of a BW random variable. Cordeiro et al. (2013c) derived further properties, including closed form expressions for moment generating function, the behaviors of the extreme values, mean deviations, Bonferroni curves and Lorenz curves. Ortega et al. (2013) introduced a regression model, the logbeta Weibull regression model, to analyze lifetime data following the BW distribution. Mahmoud and Mandouh (2012) studied parameter estimation of the BW distribution for censored data. The beta modified Weibull distribution, BMW, with five parameters was introduced by Silva et al. (2010). The PDF and the CDF of this distribution are ( )a−1 γ−1 λx −βxγ eλx 1−e 1 β (γ + λx) x e , x>0 f (x; a, b, β, γ, λ) = B(a, b) eβbxγ eλx and F (x; a, b, β, γ, λ) = I1−e−βxγ eλx (a, b),
x > 0,
where a, b, β, γ > 0 and λ ≥ 0. The particular case for a = b = 1 and λ = 0 is the Weibull distribution. Other particular cases include the generalized modified Weibull
2.2 Continuous modifications of the Weibull distribution
66
distribution due to Carrasco et al. (2008) for b = 1, the MW distribution due to Lai et al. (2003) for a = b = 1, the BW distribution due to Famoye et al. (2005) for λ = 0, the EW distribution due to Mudholkar and Srivastava (1993) for b = 1 and λ = 0, and others. The BMW distribution allows the following shapes for its HF: increasing, decreasing, bathtub shape and unimodal shape. Figure 2.17 shows some possible shapes of the PDF and the HF of the BMW distribution.
(a)
(b)
Figure 2.17: PDF and HF of the beta modified Weibull distribution A detailed account of mathematical properties of the BMW distribution was given by Nadarajah et al. (2011). Closed form expressions were derived for moments, moment generating function, asymptotic distributions of the extreme values, mean deviations, Bonferroni and Lorenz curves, reliability and entropies. Procedures for estimation were also derived by the methods of moments and maximum likelihood. A five-parameter distribution called beta exponentiated Weibull (BEW) distribution was proposed independently by Alexander et al. (2012), Singla et al. (2012) and Cordeiro et al. (2013b). This distribution generalizes many well known distributions like the beta generalized exponential (BGE) distribution due to Barreto-Souza et al. (2010), the GE distribution, the BW distribution, the EW distribution and the GR distribution. The PDF and the CDF of the BEW distribution are ( )aλ−1 { ( )λ }b−1 1 θ θ−1 −αxθ −αxθ αθλx 1−e f (x; a, b, α, θ, λ) = 1− 1−e e−αx , x > 0 B(a, b)
and F (x; a, b, α, θ, λ) = I 1−e−αxθ λ (a, b), x > 0, ( )
2.2 Continuous modifications of the Weibull distribution
67
where a, b, α, β, λ > 0. The HF of the BEW distribution can be increasing, decreasing, bathtub shaped or unimodal shaped, as illustrated in Figure 2.18.
(a)
(b)
Figure 2.18: PDF and HF of the beta exponentiated Weibull distribution A generalization of the BEW distribution is discussed in Cordeiro et al. (2014).
2.2.15
Odd Weibull distribution
Another modification of the Weibull distribution, referred to as the odd Weibull (OddW) distribution, was presented by Cooray (2006). It has three parameters and was obtained by considering the distribution of the odds of the Weibull and inverse Weibull distributions. The CDF of the OddW distribution is [ ( θ )λ ]−1 αx F (x; α, θ, λ) = 1 − 1 + e − 1 , x > 0, where α > 0, θλ > 0, the shape parameters being θ and λ. The particular case for λ = 1 is the Weibull distribution. The particular case for λ = −1 is the IW distribution. The PDF and the HF of the OddW distribution are ( θ )λ−1 [ ( θ )λ ]−2 θ−1 αxθ αx αx , x>0 f (x; α, θ, λ) = αθλx e e −1 1+ e −1 and h(x; α, θ, λ) = αθλx
θ−1 αxθ
e
(
αxθ
e
)λ−1 [ ( θ )λ ]−1 αx , x > 0. −1 1+ e −1
The HF can take the following shapes: • Increasing if θ > 1 and θλ > 1;
2.2 Continuous modifications of the Weibull distribution
68
• Decreasing if θ < 1 and θλ < 1; • Unimodal shaped if either θ, λ < 0 or θ < 1 and θλ ≥ 1; • Bathtub shaped if θ > 1 and θλ ≤ 1. Figures 2.19 (a) and (b) show possible shapes of the PDF and the HF of the OddW distribution. Further studies about the OddW distribution can be found in Jiang et al. (2008) and Cooray (2012).
(a)
(b)
Figure 2.19: PDF and HF of the odd Weibull distribution
2.2.16
Flexible Weibull extension
With a simple HF that can be increasing, bathtub shaped or unimodal shaped, Bebbington et al. (2007) proposed an interesting distribution with just two parameters. It is called the flexible Weibull extension (FlxWE). Its CDF, PDF and HF are ] [ β F (x; α, β) = 1 − exp −eαx− x ,
x > 0,
( ) [ ] β αx− β αx− β x x f (x; α, β) = α + 2 e exp −e , x
x>0
and ( ) β β h(x; α, β) = α + 2 eαx− x , x
x > 0,
where α, β > 0. Some possible shapes of the PDF and the HF are illustrated in Figure 2.20.
2.2 Continuous modifications of the Weibull distribution
(a)
69
(b)
Figure 2.20: PDF and HF of the flexible Weibull extension
2.2.17
Generalized modified Weibull distribution
As mentioned before, Carrasco et al. (2008) generalized the MW distribution of Lai et al. (2003) by adding another shape parameter. We refered to the generalization as the GMW distribution. Its CDF is (
−βxγ eλx
F (x; β, γ, λ, θ) = 1 − e
)θ , x > 0,
(2.10)
where β, θ > 0, γ, λ ≥ 0 and at most one γ, λ is equal to zero. The GMW distribution has one scale parameter, β, one acceleration parameter, λ, and two shape parameters, γ and θ, giving it more flexibility. The particular case for λ = 0 and θ = 1 is the Weibull distribution. The particular case for γ = 0 and θ = 1 is the type I extreme value distribution. The particular case for θ = 1 is the MW distribution. The particular case for λ = 0 is the EW distribution. The PDF and the HF of the GMW distribution are f (x; β, γ, λ, θ) = βθxγ−1 (γ + λx) eλx−βx
γ eλx
[ ] γ λx θ−1 1 − e−βx e , x>0
and βθx h(x; β, γ, λ, θ) =
γ−1
[
(γ + λx) e 1−e ( )θ 1 − 1 − e−βxγ eλx λx−βxγ eλx
−βxγ eλx
]θ−1 , x > 0.
The HF exhibits the following shapes: • Increasing if either γ ≥ 1, θ < 1 and γθ > 1 or γ > 1 and θ > 1;
(2.11)
2.2 Continuous modifications of the Weibull distribution
70
• Decreasing if γ > 1, λ = 0 and γθ < 1; • Bathtub shaped if either γ < 1 and γθ < 1 or γ ≥ 1, θ < 1 and γθ < 1; • Unimodal shaped if γ < 1 and θ → ∞. Figure 2.21 shows possible shapes of the PDF and the HF of the GMW distribution.
(a)
(b)
Figure 2.21: PDF and HF of the generalized modified Weibull distribution Ortega et al. (2011) developed a regression model where the lifetimes follow the GMW distribution affected by some explanatory variables.
2.2.18
Sarhan and Zaindin’s modified Weibull distribution
Sarhan and Zaindin (2009) introduced a three-parameter distribution, known as modified Weibull distribution, SZMW. This distribution is the same as the β distribution of Bousquet et al. (2006). Its PDF and CDF are ) ( γ f (x; α, β, γ) = α + βγxγ−1 e−αx−βx ,
x>0
and F (x; α, β, γ) = 1 − e−αx−βx , γ
x > 0,
where α, β, γ > 0. This distribution can be obtained as a particular case of the AddW distribution by setting one of its two shape parameters, θ and γ, in (2.3) to be one.
2.2 Continuous modifications of the Weibull distribution
71
The exponential, Rayleigh, linear failure rate and Weibull distributions are particular cases of the SZMW distribution. The HF of the SZMW distribution is h(x; α, β, γ) = α + βγxγ−1 ,
x > 0.
Unfortunately, the HF cannot exhibit non-monotonic shapes like the bathtub shape or the unimodal shape. It is monotonically increasing if γ > 1 and monotonically decreasing if γ < 1, as shown in Figure 2.22. The same distribution had proposed in (2006) by Bousquet et al., it called the β distribution, Bousquet et al. (2006). The SZMW distribution was generalized by Zaindin and Sarhan (2011), allowing the HF to exhibit increasing, decreasing, bathtub and unimodal shapes as well as giving the PDF more flexibility, as shown in Figure 2.23. Further studies of the SZMW distribution can be found in Zaindin and Sarhan (2009), Al-Hadhrami (2010), Zaindin (2010) and Gasmi and Berzig (2011).
(a)
(b)
Figure 2.22: PDF and HF of Sarhan and Zaindin’s modified Weibull distribution
2.2.19
Kumaraswamy Weibull distribution
Cordeiro et al. (2010) introduced the Kumaraswamy Weibull (KumW) distribution. The KumW distribution has four parameters three of which are shape parameters, adding great flexibility. The CDF, the PDF and the HF of the KumW distribution are [
(
−αxθ
F (x; α, θ, a, b) = 1 − 1 − 1 − e
)a ] b ,
x > 0,
2.2 Continuous modifications of the Weibull distribution
(a)
72
(b)
Figure 2.23: PDF and HF of Sarhan and Zaindin’s generalized modified Weibull distribution f (x; α, θ, a, b) = abαθxθ−1 e−αx
θ
[ ] [ ( ) ]b−1 θ a−1 θ a 1 − e−αx 1 − 1 − e−αx ,
x>0
and [ ]a−1 −αxθ abθx e 1−e [ ]a h(x; α, θ, a, b) = , 1 − 1 − e−αxθ θ−1 −αxθ
x > 0,
where α, θ, a, b > 0, the shape parameters being a, b and θ. The HF can be constant, increasing, decreasing, bathtub shaped and unimodal shaped. Particular case of the KumW distribution include the EW distribution due to Mudhalkar and Srivastava (1993), the GE distribution due to Gupta and Kundu (1999), the GR distribution due to Surles and Padgett (2001), the Kumaraswamy exponential (KumE) distribution, the Kumaraswamy Rayleigh distribution (KumR), the Weibull distribution, the Rayleigh distribution and the exponential distribution. Lemonte et al. (2013) proposed the five-parameter exponentiated Kumaraswamy Weibull (EKum) distribution given by the CDF { [ ( ( )) ] }γ θ α β F (x) = 1 − 1 − 1 − exp −δx ,
x > 0,
where α, β, γ, δ, θ > 0. This distribution contains the KumW distribution as the particular case for γ = 1.
2.2 Continuous modifications of the Weibull distribution
(a)
73
(b)
Figure 2.24: PDF and HF of Kumaraswamy Weibull distribution
2.2.20
Kumaraswamy modified Weibull distribution
Cordeiro et al. (2014b) proposed a modification of the Weibull distribution called Kumaraswamy modified Weibull (KumMW) distribution. Its CDF, PDF and HF are { [ ( )]a }b F (x; α, θ, λ, a, b) = 1 − 1 − 1 − exp −αxθ eλx , x > 0, ( )[ ( )]a−1 f (x; α, θ, λ, a, b) = abαxθ−1 (θ + λx) exp λx − αxθ eλx 1 − exp −αxθ eλx { [ ( )]a }b−1 , x>0 1 − 1 − exp −αxθ eλx and ( )[ ( )]a−1 abαxθ−1 (θ + λx) exp λx − αxθ eλx 1 − exp −αxθ eλx h(x; α, θ, λ, a, b) = , x > 0, {1 − [1 − exp (−αxθ eλx )]a } where α, θ, λ, a, b > 0. Particular cases include the GMW distribution, the MW distribution, the LogW distribution and the KumW distribution. As shown in Figure 2.25, the PDF of the KumMW distribution can be very flexible and its HF can be increasing, decreasing, bathtub shaped and unimodal shaped. Cordeiro et al. (2014b) provided a thorough study of the mathematical properties of the KumMW distribution. They derived expressions for its moments, moment generating function, order statistics, reliability, mean deviations, Bonferroni curve and Lorenz curve as well as considered maximum likelihood estimation and a log-KumMW regression model using censoring data.
2.3 Discrete Weibull distributions
74
(a)
(b)
Figure 2.25: PDF and HF of Kumaraswamy modified Weibull distribution
2.3
Discrete Weibull distributions
This section reviews discrete analogues of the Weibull distribution and their modifications including shapes of their probability mass functions, PMFs, and HFs.
2.3.1
Discrete Weibull distribution I
The first discrete analogue of the two-parameter continuous Weibull distribution was introduced by Nakagawa and Osaki (1975). It was called type I discrete Weibull (DW(I)) distribution. The survival function (SF), the PMF and the HF of the DW(I) distribution are θ
S(x; q, θ) = q x ,
θ
θ
p(x; q, θ) = q x − q (x+1) , and θ −xθ
h(x; q, θ) = 1 − q (x+1)
for x = 0, 1, . . ., 0 < q < 1 and θ > 0. The HF increases when θ > 1, decreases when θ < 1 and constant when θ = 1. Figure 2.26 shows possible shapes of the PMF and the HF.
2.3 Discrete Weibull distributions
75
(a)
(b)
Figure 2.26: PMF and HF of the discrete Weibull distribution I
2.3.2
Discrete Weibull distribution II
Stein and Dattero (1984) proposed another discrete Weibull distribution, later called type II discrete Weibull (DW(II)) distribution, by considering lifetimes as the integer part of the continuous Weibull distribution. The HF of the DW(II) distribution is αθxθ−1 , for x=1,2, . . . , m, h(x; α, θ) = 0, for x=0, where hx ≤ 1 and m is a positive integer defined as { } int α−(θ−1)−1 , if m= +∞, if
θ > 1, θ ≤ 1.
The PMF and the HF of the DW(II) distribution are plotted for selected parameter values in Figure 2.27.
2.3.3
Discrete Weibull distribution III
The third discrete version of the Weibull distribution was suggested by Padgett and Spurrier (1985). It can exhibit increasing, decreasing and constant HFs. It is called type III discrete Weibull (DW(III)) distribution and its HF is { } h(x; α, θ) = 1 − exp −α(x + 1)θ ,
x = 0, 1, 2, . . . ,
where α > 0 and −∞ < θ < ∞. The PMF is ∑x ( { }) θ p(x; α, θ) = 1 − exp −α(x + 1)θ e−α j=1 j ,
x = 0, 1, 2, . . . .
2.3 Discrete Weibull distributions
76
(a)
(b)
Figure 2.27: PMF and HF of the discrete Weibull distribution II The HF increases if θ > 0 and decreases if θ < 0. The distribution reduces to the geometric distribution if θ = 1. Figures 2.28 (a) and (b) show the PMF and the HF for selected parameter values.
(a)
(b)
Figure 2.28: PMF and HF of the discrete Weibull distribution III
2.3.4
Discrete inverse Weibull distribution
Jazi et al. (2010) introduced the discrete inverse Weibull (DIW) distribution with two parameters, by considering a characteristic property of the continuous inverse Weibull distribution. The CDF and the PMF of the DIW distribution are −θ
F (x; q, θ) = q x ,
x = 1, 2, . . . ,
2.3 Discrete Weibull distributions and
77
q, if p(x; q, θ) = q x−θ − q (x−1)−θ , if
x = 1, x = 2, 3, . . . ,
where 0 < q < 1 and θ > 0. The standard HF defined by h1 (x; q, θ) =
Pr(X = x) Pr(X ≥ x)
takes the form −θ
−θ
q x − q (x−1) h1 (x; q, θ) = , 1 − q (x−1)−θ
x = 1, 2, . . . .
The alternative HF defined by [
Pr(X > x − 1) h2 (x; q, θ) = log Pr(X > x)
]
(see equation (8) in Jazi et al. (2010)) takes the form ( ) −θ 1 − q (x−1) h2 (x; q, θ) = log , x = 1, 2, . . . . 1 − q x−θ If (1−q)−1 ≥
√
1 − q 2−θ , the alternative HF of the DIW distribution will be decreasing
and otherwise it will take a unimodal shape. Figure 2.29 shows the PMF and the alternative HF for selected parameter values.
(a)
(b)
Figure 2.29: PMF and HF of the discrete inverse Weibull distribution
2.3 Discrete Weibull distributions
2.3.5
78
Discrete modified Weibull distribution
An interesting discrete distribution related to the Weibull distribution is the discrete modified Weibull (DMW) distribution proposed by Nooghabi et al. (2011). This distribution is the discrete analogue of the modified Weibull distribution of Lai et al. (2003). The SF of the DMW distribution is S(x; q, θ, c) = q x
θ cx
,
x = 0, 1, 2, . . .
while its PMF and HF are p(x; q, θ, c) = q x
θ cx
− q (x+1)
θ cx+1
,
x = 0, 1, 2, . . . ,
and h(x; q, θ, c) = 1 − q(x + 1)θ cx+1 − xθ cx , where 0 < q < 1, θ > 0 and c ≥ 0. The PMF of the DMW distribution can take different shapes: decreasing, unimodal or decreasing followed by unimodal. Its HF increases when θ < 1 and c2b−1 < 1 and is bathtub shaped otherwise. The shapes of the PMF and HF are shown in Figure 2.30 for selected parameter values.
(a)
(b)
Figure 2.30: PMF and HF of the discrete modified Weibull distribution
2.3.6
Discrete additive Weibull distribution
Bebbington et al. (2012) introduced the discrete additive Weibull (DAddW) distribution with four parameters. The SF, the PMF and the HF of the DAddW distribution
2.4 Maximum likelihood estimation
79
are γ
θ
S (x; q1 , q2 , θ, γ) = q1x q2x , θ
x = 0, 1, 2, . . . ,
γ
(x+1)θ (x+1)γ q2 ,
p (x; q1 , q2 , θ, γ) = q1x q2x − q1 and
(x+1)θ −xθ (x+1)γ −xγ q2 ,
h (x; q1 , q2 , θ, γ) = 1 − q1
where 0 < q1 , q2 < 1 and θ, γ > 0. The HF increases if θ ≥ 1 and γ > 1 (θ > 1 and γ ≥ 1), decreases if θ ≤ 1 and γ < 1 (θ < and γ ≤ 1) and is bathtub shaped if θ < 1 < γ (γ < 1 < θ). Figure 2.31 shows the different shapes of the PMF and the HF.
(a)
(b)
Figure 2.31: PMF and HF of the discrete additive Weibull distribution
2.4
Maximum likelihood estimation
Given a random sample x1 , . . . , xn of n independent and identically distributed observations which coming from a lifetime distribution with PDF (PMF) f (x; ϕ), where ϕ = (ϕ1 , ϕ2 , . . . , ϕk ), the joint probability density (mass) function for the above sample is given by f (x1 , . . . , xn |ϕ) =
n ∏ i=1
f (xi ; ϕ).
(2.12)
2.5 Goodness of Fit
80
When x1 , . . . , xn are observed the above joint probability density (mass) function becomes a function in ϕ, which is the likelihood function, denoted L(ϕ) and given by L(ϕ|x1 , . . . , xn ) =
n ∏
f (xi ; ϕ).
(2.13)
i=1
It is more convenient in practice to deal with the logarithm of the likelihood function, the log-likelihood function, denoted as L and given by L(ϕ|x1 , . . . , xn ) =
n ∑
log f (xi ; ϕ).
(2.14)
i=1
The likelihood equations are obtained by setting the first partial derivatives of L with respect to ϕ1 , ϕ2 , . . . , ϕk to zero; that are, ∂(L(ϕ|x1 , . . . , xn )) = 0, ∂ϕi
i = 1, 2, . . . , k.
(2.15)
By solving the above system of nonlinear likelihood equations numerically for ϕ1 , ϕ2 , . . . ϕk , we can obtain maximum likelihood estimators of ϕ1 , ϕ2 , . . . , ϕk . This can be done using R (2013), Matlab and Mathcad, among other packages.
2.5
Goodness of Fit
There are different methods that can be used for testing whether a given random sample x1 , x2 , ..., xn , of n observations, is coming from a specific distribution or for comparing the underlying distribution with other distributions for fitting a given data set. This section contains two different methods of goodness of fit. The first method is the likelihood ratio test and the second one is the Kolmogorov-Smirnov test.
2.5.1
The Log-likelihood Ratio Test
The log-likelihood ratio test (LRT) is one of the popular tools that can be used to compare two models where one of them is nested in the other one, and then determine which one is more appropriate for a given data. Suppose that a given random sample x1 , . . . , xn with probability distribution f (x; ϕ) and we are interested to test the following null and alternative hypotheses H0 : ϕ ∈ Φ0 H1 : ϕ ∈ Φ1
2.6 Total time on test
81
where Φ0 ⊂ Φ1 , Φ0 is the parameter space of the reduced model and Φ1 is the parameter space of the original (full) model. The log-likelihood ratio statistic (ω) is defined as following
( ω = −2 ln
ˆ L0 (ϕ) ˆ L1(ϕ)
) (2.16)
ˆ is the likelihood function of the reduced model, while L1 (ϕ) ˆ is the likeliwhere L0 (ϕ) hood function of the original model. Under the H0 , ω follows a chi square distribution with (k1 − k0 ) degrees of freedom, where k1 and k0 are the number of parameters of the original and reduced models respectively. The full model could be preferred if ω > χ20.95,k1 −k0 .
2.5.2
Kolmogorov−Smirnov test
Kolmogorov (1933) proposed the Kolmogorov−Smirnov test (K-S test) for testing while a given random sample x1 , x2 , ..., xn belongs to a population with a specific distribution. The K-S test calculates the distance between the empirical distribution function of the given sample and the estimated cumulative distribution function of the candidate distribution. The null and alternative hypotheses are H0 : sample follow the specific distribution versus H1 : H0 is false. Let F (xi ) denote the value of the cumulative distribution function of the candidate distribution at xi and Fˆ (xi ) denote the value of the empirical distribution function at xi . The value of the K-S test statistic is define by { } K-S = max |F (xi ) − Fˆ (xi )|, |F (xi ) − Fˆ (xi−1 )| , where Fˆ (xi ) =
#{xj :xj ≤xi } . n
The computed K-S statistic is then compared with the tabulated K-S at a significance level α to decide if the null hypothesis is not rejected. Moreover, if there are more than one distribution to be compared, the distribution with smaller K-S value will be more appropriate to fit the given sample.
2.6
Total time on test
Total time on test transformation, denoted as (TTT-transform), is a graphical technique to provide information about the shape of the hazard rate of a given data. It
2.6 Total time on test
82
was proposed by Barlow and Doksum (1972) for statistical inference problems under order restrictions. For modelling a data set, Barlow and Campo (1975) used this test as a selection method. Aarset (1987) used the TTT-transform to test if a random sample belongs to a life distribution with bathtub shaped hazard rate. The TTT-transform of a distribution with a CDF F is defined as ∫ F −1 (p) −1 H (p) = S(u)du, 0 ≤ p ≤ 1. 0
The scaled TTT-transform of the distribution is φF (p) =
H −1 (p) . H −1 (1)
The curve φF (p) versus 0 ≤ p ≤ 1 is called the scaled TTT-transform curve. It has been proposed by Barlow and Campo (1975), using the scaled TTT-transform curve that the shape of the hazard function of the distribution can be classified as one of the following. • If the scaled TTT-transform curve is concave above the 45◦ line, the hazard rate is increasing. • If the scaled TTT-transform curve is convex below the 45◦ line, then the hazard rate is decreasing. • If the scaled TTT-transform curve is first convex below the 45◦ line then concave above the line the shape of the hazard rate is a bathtub shaped. • The shape of the hazard rate will be unimodal shaped if the scaled TTTtransform curve is first concave above the 45◦ line followed by convex below the 45◦ line. Figure 2.32 summarizes the different shapes of the scaled TTT-transform curve for distributions with increasing, decreasing, bathtub and unimodal hazard rate functions.
For an ordered sample 0 = x0:n , x1:n , x2:n , ..., xn:n , the total time one test statistics are given by T T Ti =
i ∑ j=1
(n − j + 1) (xj:n − xj−1:n ) , i = 1, 2, ..., n.
2.7 Information criterion
83
Figure 2.32: Scaled TTT-transform curve for different distributions. The empirical scaled TTT-transform is T T Ti∗ =
T T Ti , T T Tn
where 0 ≤ T T Tn ≤ 1. The TTT-plot can be provided by plotting
2.7
i n
against T T Ti∗ .
Information criterion
As a consequence of increasing the number of parameters, usually the fitting of the data sets will be improved and of course the likelihood will be increased. A model with too many parameters could be preferred in the comparison using the maximum likelihood. Then, an information criterion can be used to make a comparison between different statistical models which may have different numbers of parameters. The measures Akaike information criterion (AIC), Bayesian information criterion (BIC), corrected Akaike information criterion (AICc), and consistent Akaike information criterion (CAIC) are widely used information criterion for selecting the appropriate model among different others models. The Akaike information criterion due to Akaike (1974) is defined by ( ) b xi + 2k, AIC = −2L ϕ; where x1 , . . . , xn is the given random sample, ϕb is the MLE of ϕ and k is the length of the vector ϕ. The model which has smallest AIC could be the most appropriate
2.8 Summary
84
model to fit the given data set. When the sample size n is not large or if the number of parameters k is large, the probability to select the model with many parameters will be increased using AIC. Therefore, Hurvich and Tsai (1989) has proposed a corrected Akaike information criterion AICc that is defined as AICc = AIC +
2k(k + 1) , n−k−1
(2.17)
where k is the length of the vector ϕ and n is the sample size. When the sample size n is too much larger than k, AICc converges to AIC. It is strongly recommended to use AICc instead of AIC if the sample size is not large or the model has too many parameters, (Burnham and Anderson, 2002). Bozdogan (1987) provided consistent Akaike Information Criterion (CAIC), which is defined by CAIC = −2L + k(ln(n) + 1);
(2.18)
The Bayesian information criteria due to Schwarz (1978) is defined by (
) b BIC = k ln n − 2L ϕ; xi ,
(2.19)
where k is the length of the vector ϕ and n is the sample size. It is also called Schwarz Bayesian criterion (SBC) or (SBIC).
2.8
Summary
This chapter gave a comprehensive review of known discrete modifications and generalizations of the Weibull distribution, a comprehensive review of known continuous modifications and generalizations of the Weibull distribution and some tools and methods that will be used for data analysis in the next chapters. The review part contains over 100 references on modifications/generalizations of the Weibull distribution and more than 55 percent of the cited references appeared in the last 5 years.
Chapter 3 New Modified Weibull Distribution 3.1
Introduction
In this chapter we propose a new lifetime distribution by considering a serial system with one component following a Weibull distribution and another following a modified Weibull distribution. We shall refer to this distribution as New Modified Weibull Distribution (NMW). It contains several popular lifetime distributions as special submodels. We study its mathematical properties including moments, moment generating function and order statistics. The shapes of the probability density function and the hazard function of the NMW, simulation methods and the estimation of parameters by maximum likelihood are discussed. It will be demonstrated that the proposed distribution fits two well-known data sets better than other modified Weibull distributions including the latest beta modified Weibull distribution. The model can be simplified by fixing one of the parameters whilst still providing a better fit than existing models. Among the modifications of Weibull distributions, the additive Weibull distribution of Xie and Lai (1996) has a bathtub-shaped hazard function h(x) = αθxθ−1 + βγxγ−1 , x > 0,
(3.1)
as it combines two Weibull hazard functions, an increasing function αθxθ−1 with θ > 1 and a decreasing function βγxγ−1 with 0 < γ < 1. When θ = 1 and γ > 0 it becomes the modified Weibull distribution of Sarhan and Zaindin (2009) (SZMW) which includes the linear failure rate distribution when γ = 2. The modified Weibull distribution of Lai et al (2003) multiplies the Weibull cumulative hazard function αxβ by
3.2 Definition
86
eλx . These modifications plus the beta modified Weibull distribution (BMW) proposed by Silva et al (2010) are the most important modifications of the Weibull because they are flexible and fit real data sets very well. Unfortunately, these distributions do not fit the last phase of the bathtub shape as well as the first and the middle phases. In this case the BMW fits this kind of the data well. This distribution was shown to be the best lifetime distribution to fit a popular and widely used data sets such as the Aarset data Aarset (1987), the voltage data of Meeker and Escobar (1998), the Kumar (LHD) data of Kumar et al (1989) and Serum-reversal data of Silva (2004). A disadvantage of the BMW is that its CDF does not have a closed form of expression and its hazard rate function is quite complicated.
3.2
Definition
This section provides the definition of the new model. We define a new modified Weibull distribution (NMW) by the following CDF F (x) = 1 − e−αx
θ −βxγ eλx
, x > 0,
(3.2)
where the parameters α, β, θ, γ and λ are non-negative, with θ and γ being shape parameters and α and β being scale parameters and λ is an acceleration parameter. We propose a new lifetime distribution NMW which can fit all three parts of the data very well and at the same time its hazard rate function is simple and its CDF has a closed form. The survival function of this distribution is S(x) = e−αx
θ −βxγ eλx
,
(3.3)
and the hazard function is h(x) = αθxθ−1 + β(γ + λx)xγ−1 eλx , x > 0.
(3.4)
This hazard function can be interpreted as that of a serial system with two independent components, one of which follows the Weibull distribution with parameters α and θ, and the other follows the modified Weibull distribution of Lai et al (2003) with parameters β, γ and λ. This suggests that the distribution can be used when there are two types of failure, as shown in examples later.
3.2 Definition
87
The probability density function (PDF) is ( ) θ γ λx f (x) = αθxθ−1 + β(γ + λx)xγ−1 eλx e−αx −βx e , x > 0.
(3.5)
It can be rewritten as f (x) = [hW (x; α, θ) + hM W (x; β, γ, λ)] SW (x, α, θ)SM W (x; β, γ, λ),
(3.6)
where SW , hW , SM W and hM W are survival and hazard functions of the Weibull and modified Weibull distributions respectively, see equations 1.2, 1.4, 2.7 and 2.9. Fig. 3.1 and 3.2 show the PDFs and the hazard functions for different parameter values. It is clear that the PDF and the hazard function have many different shapes, which allows this distribution to fit different types of lifetime data. The shapes of
3.0
these functions will be discussed in more details later.
1.5 0.0
0.5
1.0
f(x)
2.0
2.5
α = 1.15,β = 0.15,θ = 0.75,γ = 5,λ = 2 α = 0.05,β = 5,θ = 5,γ = 1.25,λ = 0.05 α = 2,β = 5,θ = 1.31,γ = 10,λ = 0.15 α = 5,β = 4,θ = 2.5,γ = 5,λ = 0.15 α = 4,β = 0.5,θ = 0.4,γ = 1.5,λ = 0.75
0.0
0.2
0.4
0.6
0.8
1.0
1.2
1.4
x
Figure 3.1: Probability density functions of the NMW.
88
4
α = 1.2,β = 1.5,θ = 3,γ = 0.5,λ = 0.75 α = 0.05,β = 5,θ = 5,γ = 1.25,λ = 0.05 α = 2,β = 0.75,θ = 1.2,γ = 15,λ = 0.05 α = 5,β = 0.7,θ = 0.15,γ = 0.05,λ = 0 α = 0.5,β = 0.7,θ = 2.5,γ = 5,λ = 0.15 α = 4,β = 0.5,θ = 0.4,γ = 1.5,λ = 0.75
0
2
h(x)
6
8
3.3 Sub-models
0.0
0.5
1.0
1.5
x
Figure 3.2: Hazard functions of the NMW.
3.3
Sub-models
This distribution includes some important sub models that are widely used in survival analysis. In particular, from (3.2) the NMW becomes: 1. The AddW distribution If λ = 0, the NMW distribution reduces to the additive Weibull distribution (Xie et al, 2006) with CDF F (x) = 1 − e−αx
θ −βxγ
.
2. The MW distribution When α = θ = 0, we get the modified Weibull of Lai et al (2003) with the following CDF F (x) = 1 − e−βx
γ eλx
.
3. The extreme-value distribution of Type I The LogW (extreme-value distribution of Type I), Bain (1974), can be obtained from the NMW by setting α = θ = γ = 0 to give F (x) = 1 − e−βe . λx
4. Linear failure rate distribution Setting θ = 1, γ = 2 and λ = 0, the NMW distribution reduces to the linear
3.4 The Shape of the probability density function
89
failure rate distribution of Bain (1974) with CDF F (x) = 1 − e−αx−βx . 2
5. The Weibull distribution: If β = γ = λ = 0 or α = θ = λ = 0, we get the Weibull distribution with parameter α and θ or β and γ respectively. Moreover, the exponential distribution with parameter α, β or (α + β) can be obtained by setting β = γ = λ = 0 and θ = 1, α = θ = λ = 0 and γ = 1 or θ = γ = 1 and λ = 0 respectively. Also the Rayleigh distribution can be obtained if β = γ = λ = 0 and θ = 2, α = θ = λ = 0 and γ = 2 or θ = γ = 2 and λ = 0. Table 3.1 shows a list of models that can be derived from the NMW distribution.
Distribution
α
β
θ
γ
λ
Additive Weibull
-
-
-
-
0
Modified Weibull
0
-
0
-
-
S-Z modified Weibull
-
-
1
-
0
Linear failure rate
-
-
1
2
0
Extreme-value
0
-
0
0
-
Rayleigh
-
0
2
0
0
Weibull
-
0
-
0
0
Exponential
-
0
1
0
0
Table 3.1: The sub-models of the NMW.
3.4
The Shape of the probability density function
In this section the shape of the probability density function of the NMW will be discussed. In order to discuss the shapes of the pdf of the NMW, we first differentiate f (x) with respect to x. The CDF and PDF of the NMW can be rewritten as F (x) = 1 − e−H(x) , f (x) = h(x)e−H(x) ,
(3.7)
3.4 The Shape of the probability density function
90
where h(x) is the hazard function (3.4) and H(x) = αxθ + βxγ eλx is the cumulative hazard. Then [ ′ ] h (x) − h2 (x) e−H(x) [ ′ ] h (x) = f (x) − h(x) , h(x)
f ′ (x) =
where h′ (x) = αθ(θ − 1)xθ−2 − βxγ−2 ((γ − 1)(γ + λx) + λx(1 + γ + λx))eλx . The modes of the PDF of the NMW are the roots of the equation. h′ (x) − h2 (x) = 0.
(3.8)
So, the modes of f (x) at say x = x0 are the roots of (3.8). The mode corresponds to a local maximum if h′ (x) − h2 (x) > 0 for all x < x0 and h′ (x) − h2 (x) < 0 for all x > x0 . The mode corresponds to a local minimum if h′ (x) − h2 (x) < 0 for all x < x0 and h′ (x) − h2 (x) > 0 for all x > x0 . As we can see it is difficult to determine the shapes of the PDF of the NMW from (3.8), but as shown in Figure 3.1 the PDF of the NMW can be monotonically decreasing, unimodal, initially decreasing then increasing-decreasing, unimodal or bimodal. The different shapes of the PDF of the NMW can be discuss from (3.6) by using the shapes of the MW and the Weibull distributions. From Lai et al (2003), the PDF of the MW is monotonically decreasing if 0 < γ < 1 and then increasing-decreasing if 0 < γ < 1 and
β γλ
β γλ
is large, initially decreasing
small or unimodal if γ > 1. It is well
known that the PDF of the Weibull distribution is monotonically decreasing if θ 6 1 and unimodal if θ > 1. The PDF of the NMW takes different shapes and Figure 3.3 and Figure 3.5 show the following cases: • When θ, γ > 1, both the PDF of the MW and the PDF of the Weibull are unimodal, then the PDF of the NMW is either unimodal, see Figure 3.3(a), or if one of the them dominated in the beginning and the other in the middle then the NMW can be bimodal with two different peaks, see Figure 3.4. • When θ, γ < 1, the Weibull is decreasing and the MW decreasing or initially decreasing then increasing-decreasing, then the NMW can be either decreasing
3.5 The shape of the hazard function
91
or initially decreasing then increasing-decreasing, see Figure 3.3 (b), Figure 3.5 (a) and 3.5 (b). • As shown in Figure 3.3 (c), Figure 3.5 (c) and 3.5 (d), if θ > 1 and γ < 1, the shape of the PDF of the NMW can be the same shape as in previous case where the MW is unimodal or decreasing then increasing-decreasing and the Weibull unimodal. • If θ < 1 and γ > 1, the MW is unimodal and the Weibull is decreasing, then the PDF of the NMW can be decreasing, or decreasing then increasing-decreasing, see Figure 3.3 (d).
3.5
The shape of the hazard function
In order to discuss the shape of the hazard function of the NMW we will find the first derivative of h(x), h′ (x) = αθ(θ − 1)xθ−2 + βxγ−2 ((γ − 1)(γ + λx) + λx(1 + γ + λx))eλx .
(3.9)
The modes of h(x) at say x = x0 are the roots of the equation h′ (x) = 0. The mode corresponds to a local maximum if h′ (x) > 0 for all x < x0 and h′ (x) < 0 for all x > x0 . The mode corresponds to a local minimum if h′ (x) < 0 for all x < x0 and h′ (x) > 0 for all x > x0 . The mode corresponds to a point of inflexion if either h′ (x) > 0 for all x ̸= x0 or h′ (x) < 0 for all x ̸= x0 . The equation h′ (x) = 0 cannot be solved analytically. The sign of h′ (x) in (3.9) can be determined by the values of θ and γ and whether if they are greater or less than 1. We discuss the shape of the hazard function of the NMW when θ, γ > 1, θ, γ < 1, θ > 1 and γ < 1 or θ < 1 and γ > 1. Also, it can be figured out using the shapes of the hazard function of the Weibull and the MW where h(x) = [hW (x; α, θ) + hM W (x; β, γ, λ)] . It is well known that hW (x; α, θ) is increasing when θ > 1 and decreasing when θ < 1 and hM W (x; β, γ, λ) is increasing when γ > 1 and bathtub shaped otherwise. Regarding to Lai and Xie (2006), a distribution with a serial system of increasing hazard
3.5 The shape of the hazard function
92
1.5
α = 0.5,β = 1.25,θ = 0.05,γ = 0.75,λ = 1.75 α = 1.5,β = 0.75,θ = 0.35,γ = 0.2,λ = 1.75 α = 0.15,β = 0.5,θ = 0.5,γ = 0.85,λ = 1.75 α = 2,β = 0.5,θ = 0.15,γ = 0.95,λ = 1.75
0.0
0.0
0.5
0.5
f(x)
h(x)
1.0
1.0
1.5
α = 2,β = 0.75,θ = 1.5,γ = 1.25,λ = 0.05 α = 0.75,β = 0.15,θ = 1.5,γ = 1.25,λ = 0.75 α = 1,β = 0.25,θ = 1.05,γ = 1.25,λ = 0.75 α = 0.05,β = 0.05,θ = 2,γ = 2,λ = 0.075 α = 0.5,β = 0.7,θ = 2.5,γ = 5,λ = 0.15
0.5
1.0
3.0
0.0
1.5
2.0
2.5
3.0
3.5
0.0
1.0 x
(a)
(b)
1.5
α = 0.5,β = 0.5,θ = 0.75,γ = 3,λ = 0.25 α = 0.65,β = 0.15,θ = 0.75,γ = 1.25,λ = 2 α = 1.25,β = 0.5,θ = 0.75,γ = 3,λ = 2.25 α = 1.25,β = 0.75,θ = 0.85,γ = 1.5,λ = 0.75 α = 2,β = 0.5,θ = 0.75,γ = 1.2,λ = 1.25
f(x)
1.5
0.0
0.0
0.5
0.5
1.0
f(x)
1.0
2.0
1.5
α = 2,β = 0.5,θ = 2.75,γ = 0.75,λ = 1.25 α = 0.5,β = 1.15,θ = 3,γ = 0.25,λ = 2 α = 0.75,β = 0.5,θ = 3,γ = 0.4,λ = 3 α = 3,β = 0.65,θ = 2,γ = 0.2,λ = 0.5 α = 0.5,β = 1.5,θ = 1.15,γ = 0.75,λ = 1.25
2.5
0.5
x
0.0
0.5
1.0
1.5
0.0
0.5
1.0
x
x
(c)
(d)
1.5
Figure 3.3: Probability density function of NMW: (a): θ, γ > 1, (b): θ, γ < 1, (c): θ > 1, γ < 1, (d): θ < 1, γ > 1.
2.0
3.6 Simulation from the NMW
93
NMW(2.5, 12, 15, 1.2, 1.5) WD(2.5, 1.2) MW(12, 15, 1.5)
f(x) 0
0
1
2
2
f(x)
4
3
6
4
NMWD(2, 5, 1.31, 10, 0.15) WD(2, 1.31) MW(5, 10, 0.15)
0.0
0.5
1.0
1.5
2.0
0.0
0.5
1.0
x
x
(a)
(b)
1.5
Figure 3.4: Probability density function of NMW when θ, γ > 1. rate components has an increasing hazard rate distribution. So if θ, γ ≥ 1, the hazard function of the NMW will be increasing. Figure 3.6 (a)-(d) show the hazard functions of the NMW when θ, γ > 1, θ, γ < 1, θ > 1 and γ < 1 and θ < 1 and γ > 1. It can be seen that the hazard function of the NMW is increasing if θ, γ ≥ 1 and bathtub shaped otherwise. Many different applications in reliability and lifetime analysis require bathtub shaped hazard rate functions with a long useful life period with the middle period of the bathtub shape having a relatively constant hazard rate. For example, electric machine life cycles and electronic devices, cf. Kuo and Zuo (2001). A few distributions have this property, so does the NMW as shown in Figure 3.7.
3.6
Simulation from the NMW
The CDF of the NMW has a closed form which makes the simulation from this distribution easier. In this section two methods will be used to simulate from the NMW. In order to simulate a random sample from this distribution, first 1000 random numbers are generated from the uniform distribution with range (0, 1), these generated random numbers are then transformed using the inverse CDF by solving the equation F (x) = u numerically. Figure 3.8 shows exact probability density functions of the new modified Weibull distribution and histograms of four simulated data sets. It is clear
94
2.5
1.5
3.6 Simulation from the NMW
NMWD(y, 1.15, 0.5, 0.75, 0.65, 1.75) WD(1.15, 0.65) MW(0, 0.5, 0.75, 0, 1.75)
f(x) 0.0
0.0
0.5
0.5
1.0
f(x)
1.5
1.0
2.0
NMWD(0.15, 0.5, 0.75, 0.65, 1.75) WD(0.15, 0.65) MW(0.5, 0.75, 1.75)
0.5
1.0
1.5
2.0
0.0
0.5
1.0
x
(a)
(b)
NMWD(0.75, 0.15, 2, 0.25, 2.5) WD(0.75, 0.25) MW(0.15, 2, 2.5)
2.5
3.0
3 0
0.0
1
2
f(x)
2.0
NMWD(1.75, 0.85, 2, 0.65, 0.75) WD(1.75, 0.65) MW(0.85, 2, 0, 0.75)
1.5 1.0 0.5
f(x)
1.5
x
2.0
0.0
0.0
0.5
1.0
1.5
2.0
2.5
0.0
0.5
1.0
1.5
2.0
x
x
(c)
(d)
2.5
3.0
Figure 3.5: Probability density functions of NMW: (a): θ, γ > 1, (b): θ, γ < 1, (c): θ > 1, γ < 1, (d): θ < 1, γ > 1.
3.5
95
4
2
2
4
f(x)
h(x)
6
6
8
8
3.6 Simulation from the NMW
α = 2,β = 0.75,θ = 1.5,γ = 1.25,λ = 0.05 α = 0.75,β = 0.15,θ = 1.5,γ = 1.25,λ = 0.75 α = 1,β = 0.25,θ = 1.05,γ = 1.25,λ = 0.75 α = 0.05,β = 0.05,θ = 2,γ = 2,λ = 0.075 α = 0.5,β = 0.7,θ = 2.5,γ = 5,λ = 0.15
0
0
α = 0.35,β = 1.25,θ = 0.05,γ = 0.75,λ = 1.75 α = 1.5,β = 0.75,θ = 0.35,γ = 0.2,λ = 1.75 α = 0.15,β = 0.5,θ = 0.5,γ = 0.85,λ = 1.75 α = 2,β = 0.5,θ = 0.15,γ = 0.95,λ = 1.75
1
2
3
4
0.0
0.2
0.4
0.6
x
x
(a)
(b)
0.8
1.0
α = 0.5,β = 0.5,θ = 0.75,γ = 3,λ = 0.25 α = 0.65,β = 0.15,θ = 0.75,γ = 1.25,λ = 2 α = 1.25,β = 0.5,θ = 0.75,γ = 3,λ = 2.25 α = 1.25,β = 0.75,θ = 0.85,γ = 1.5,λ = 0.75 α = 2,β = 0.5,θ = 0.75,γ = 1.2,λ = 1.25
h(x)
3 0
0
α = 2,β = 0.5,θ = 2.75,γ = 0.75,λ = 1.25 α = 0.5,β = 1.15,θ = 3,γ = 0.25,λ = 2 α = 0.75,β = 0.5,θ = 3,γ = 0.4,λ = 3 α = 3,β = 0.65,θ = 2,γ = 0.2,λ = 0.5 α = 0.5,β = 1.5,θ = 1.15,γ = 0.75,λ = 1.25
1
2
2
4
h(x)
4
6
5
6
8
0
0.0
0.2
0.4
0.6
0.8
1.0
0.0
0.2
0.4
0.6
x
x
(c)
(d)
Figure 3.6: Hazard function of NMW: (a): θ, γ > 1, (b): θ, γ < 1, (c): θ > 1, γ < 1, (d): θ < 1, γ > 1.
0.8
1.0
96
0.20
3.7 The moments
0.10 0.00
0.05
h(x)
0.15
α = 3,β = 5e−06,γ = 0.01,θ = 0.05,λ = 0.15 α = 0.25,β = 5e−04,γ = 0.001,θ = 0.5,λ = 0.09 α = 0.11,β = 2.5e−07,γ = 1,θ = 1,λ = 0.12 α = 0.025,β = 5e−07,γ = 1,θ = 1,λ = 0.12
0
20
40
60
80
x
Figure 3.7: Hazard function of the NMW with a long useful life period. that the simulated values are consistent with the new modified Weibull distribution.
Another method can be used to simulate a random sample from the proposed distribution. As shown this distribution can be used to describe a serial system of two independent components, one of which follows the Weibull distribution and the other one follows the MW. The simulation can be done using the following method. Two random samples, Y1 , Y2 , ..., Yn and Z1 , Z2 , ..., Zn , are generated from the Weibull with parameters α and θ and the MW with parameters β, γ and λ respectively, where n=1000. Then, a random sample is given by Xi = min{Yi , Zi }, i = 1, ..., n. The output sample of this method, X1 , X2 , ..., Xn , follows the NMW with parameters α, β, γ, θ and λ. Using the same selected parameters as in the previous method, four random samples are generated, Figure 3.9 shows exact probability density functions of the new modified Weibull distribution and histograms of four simulated data sets using this method.
3.7
The moments
This section derives the theoretical moments of the NMW. The following theorem gives the non-central moments of the distribution. Theorem 1. The non-central moments of the NMW are given by
3.7 The moments
97
1.0
1.5
(b)
0.0
0.5
Density
2.0 1.0 0.0
Density
(a)
0.0
0.2
0.4
0.6
0.8
1.0
0.0
0.4
4
X
0.8
1.2
X
(d)
1.0
Density
2 0
0.0
1
Density
3
2.0
(c)
0.0
0.2
0.4
0.6 X
0.8
1.0
0.0
0.2
0.4
0.6
X
Figure 3.8: PDF of the NMW and the histograms of simulated data (Method 1, n=1000) where (a): α=0.05, β=5, γ=1.25, θ=2 and λ=0.05, (b): α=1.15, β=0.25, γ=5, θ=0.8 andλ=2, (c): α=1.5, β=3, γ=0.85, θ=2.5 and λ=0.5, (d): α=2.5, β=5, γ=9, θ=1.15 and λ=5.
3.7 The moments
98
1.0
1.5
(b)
0.0
0.5
Density
2.0 1.0 0.0
Density
(a)
0.0
0.2
0.4
0.6
0.8
1.0
0.0
0.4
1.2
X
2.0
(d)
1.0
2
Density
3
(c)
0
0.0
1
Density
4
X
0.8
0.0
0.2
0.4 X
0.6
0.8
0.0
0.2
0.4
0.6
X
Figure 3.9: Probability density functions of the NMW and the histograms of simulated data (Method 2, n=1000) where (a):α=0.05, β=5, γ=1.25, θ=2 and λ=0.05, (b):α=1.15, β=0.25, γ=5, θ=0.8 andλ=2, (c):α=1.5, β=3, γ=0.85, θ=2.5 and λ=0.5, (d):α=2.5, β=5, γ=9, θ=1.15 and λ=5.
3.8 The moment generating function
µ′r
99
r ∑ ∑ (−β)n (λn)m − nγ+m+r θ = α Γ θ n=0 m=0 n!m! ∞
∞
(
nγ + m + r θ
) ,
(3.10)
for r = 1, 2, . . ., where Γ(·) is the gamma function.
Proof : Using the identities ∫
x
and e =
∞
xβ−1 e−αx dx = α−β/θ (1/θ)Γ(β/θ), θ
0
∑∞
n
n=0
x /n!, the r-th order non-central moment of the new modified Weibull
distribution is µ′r
∫
∞
= 0
∫
xr dF (x) ∞
= − xr de−αx −βx e ∫ ∞0 θ γ λx = rxr−1 e−αx −βx e dx θ
0
∫
∞
=
rxr−1 e−αx
θ
0
∫
∞ ∑ (−βxγ eλx )n n=0
∞
= 0
∫
γ λx
n!
dx
∞ ∞ ∑ (−β)n xnγ ∑ (λnx)m r−1 −αxθ dx rx e n! m! m=0 n=0
∞ ∑ ∞ ∑ (−β)n (λn)m xnγ+m = dx rx e n!m! 0 n=0 m=0 ∫ ∞ ∑ ∞ ∑ (−β)n (λn)m ∞ r−1 nγ+m −αxθ = rx x e dx n!m! 0 n=0 m=0 ( ) ∞ ∞ nγ + m + r r ∑ ∑ (−β)n (λn)m − nγ+m+r θ = α Γ . θ n=0 m=0 n!m! θ
3.8
∞
r−1 −αxθ
The moment generating function
The moment generating function of the NMW is provided in the next theorem. Theorem 2. The moment generating function of the N M W is ( [ )] ∞ 1 ∑ (−β)n (nλ)m tk+1 − γn+m+k+1 γn + m + k + 1 θ MX (t) = 1 + Γ α , (3.11) θ n,m,k=0 n!m!k! θ
3.9 Order statistics
100
where Γ(·) is the gamma function.
Proof : The moment generating function of the NMW is given by
MX (t) = E(etx ) ∫ ∞ etx f (x)dx = ∫0 ∞ = etx dF (x) 0 ∫ ∞ θ γ λx = 1+ tetx e−αx −βx e dx ∫
0 ∞
= 1+
tx −αxθ
te e 0
∫
∞
= 1+
−αxθ
e 0
∞ ∑ (−β)n (λn)m xnγ+m dx n!m! n,m=0
∞ ∑ (−β)n (λn)m tk+1 xnγ+m+k dx n!m!k! n,m,k=0
∞ ∑ (−β)n (nλ)m tk+1 = 1+ I, n!m!k! n,m,k=0
where I =
∫∞ 0
xγn+m+k e−αx dx. θ
Using gamma-integral formula, we have ( ) γn + m + k + 1 1 I= , γn+m+k+1 Γ θ θ θα then [ ( )] ∞ γn + m + k + 1 1 ∑ (−β)n (nλ)m tk+1 − γn+m+k+1 θ MX (t) = 1 + α Γ . θ n,m,k=0 i!j!k! θ
3.9
Order statistics
It will also be useful to derive the pdf of the rth order statistic X(r) of a random sample X1 , . . . , Xn drawn from the NMW with parameters α, β, θ, γ and λ. From Arnold et al. (2008), the PDF of X(r) is given by fr:n (x) =
F (x)r−1 (1 − F (x))n−r f (x) , B(r, n − r + 1)
(3.12)
3.10 Parameter estimation
101
where B(., .) is the beta function. From (3.7), (1 − F (x))n−r = e−(n−r)H(x) , and r−1
F (x)
(
) −H(x) r−1
= 1−e
(3.13)
) r−1 ( ∑ r−1 = (−1)ℓ e−ℓH(x) . ℓ ℓ=0
(3.14)
Substituting (3.13) and (3.14) into (3.12), we get ) r−1 ( ∑ 1 r−1 fr:n (x) = (−1)ℓ h(x)e−(n+ℓ+1−r)H(x) , B (r, n − r + 1) ℓ=0 ℓ ( ) r−1 ( ) n−1 ∑ r−1 = n (−1)ℓ h(x)e−(n+ℓ+1−r)H(x) , r − 1 ℓ=0 ℓ ( ) r−1 ( ) ( ) n−1 ∑ r−1 = n (−1)ℓ αθxθ−1 + β(γ + λx)xγ−1 eλx r − 1 ℓ=0 ℓ e−(n+ℓ+1−r)(αx +βx e ) , ( ) r−1 ( ) n−1 ∑ r−1 (−1)ℓ = n f (x; αℓ , βℓ , θ, γ, λ), r − 1 ℓ=0 ℓ (n + ℓ + 1 − r) θ
γ λx
where f (x; αℓ , βℓ , θ, γ, λ) is the PDF of the NMW with parameters αℓ = (n+ℓ+1−r)α, βℓ = (n + ℓ + 1 − r)β, θ, γ and λ. Using (3.10), the kth non-central moment of the rth order statistic X(r) is ) ) ∞ ∞ r−1 ( ( ′ (r:n) (−1)ℓ+i β i (iλ)j nk n − 1 ∑ ∑ ∑ r − 1 µk = iγ+j+k iγ+j+k ℓ θ r − 1 i=0 j=0 ℓ=0 (n + ℓ + 1 − r) θ +1−i α θ ( ) iγ + j + k Γ . (3.15) θ
3.10
Parameter estimation
Given a random sample x1 , . . . , xn from the NMW with parameters (α, β, θ, γ, λ), the usual method of estimation is by maximum likelihood, cf. Fisher (1922). Other possible approaches include Bayesian estimation using Lindley approximation ( Lindley, (1980)) or MCMC, cf. Soliman at el (2012) and Upadhyay and Gupta (2010). The log-likelihood function is given by n n n ∑ ∑ ∑ ( ) γ−1 λxi θ−1 θ L = ln β(γ + λxi )xi e + αθxi −α xi − β xγi eλxi . i=1
i=1
i=1
(3.16)
3.11 Applications
102
Setting the first partial derivatives of L with respect to α, β, θ, γ and λ to zero, the likelihood equations are n ∑
∑ θxθ−1 i − xθ = 0, h(xi ; α, β, γ, θ, λ) i=1 i
(3.17)
n n ∑ (γ + λxi )xiγ−1 eλxi ∑ γ λxi − x e = 0, h(xi ; α, β, γ, θ, λ) i=1 i i=1
(3.18)
i=1
n
n ∑ αxθ−1 (1 + θ ln(xi )) i
i=1
h(xi ; α, β, γ, θ, λ)
n ∑ xγ−1 eλxi ((γ + λxi ) ln(xi ) + 1) i
i=1
h(xi ; α, β, γ, θ, λ)
−α
−
xθi ln(xi ) = 0,
(3.19)
xγi eλxi ln(xi ) = 0,
(3.20)
i=1 n ∑ i=1
n ∑ (1 + γ + λxi )xγ eλxi i
i=1
n ∑
h(xi ; α, β, γ, θ, λ)
−
n ∑
xγ+1 eλxi = 0. i
(3.21)
i=1
The maximum likelihood estimates can be obtained by solving the nonlinear equations numerically for α, β, θ, γ and λ. The relatively large number of parameters can cause problems especially when the sample size is not large. A good set of initial values is essential. We have also obtained all the second partial derivatives of the log-likelihood function for the construction of the Fisher information matrix, so that standard errors of the parameter estimates can be obtained in the usual way. These are in Appendix A.
3.11
Applications
In this section we provide results of fitting the NMW to two well-known data sets and compare its goodness-of-fit with other modified Weibull distributions using KolmogorovSmirnov, K-S statistic, as well as Akaike information criterion (Akaike, 1974), Bayesian information criterion (Schwarz, 1978), corrected Akaike information criterion (Hurvich and Tsai, 1989) and consistent Akaike information criterion due to Bozdogan (1987).
3.11 Applications
3.11.1
103
Aarset data
The data below represent the lifetimes of 50 devices (in weeks) (Aarset, 1987). .1
.2
1
1
1
1
1
2
3
6
7
11
12 18
18
18
18
18
21
32
36
40
45
46
47 50
55
60
63
63
67
67
67
67
72
75
79 82
82
83
84
84
84
85
85
85
85
86
Many authors have analysed this data set, including Mudholkar and Srivastava (1993), Xie et al (2006), Lai et al (2003), Sarhan and Zaindin (2009), and Silva et al (2010). The data are known to have a bathtub-shaped failure rate as shown by the scaled TTT-Transform plot, which has a convex shape followed by a concave shape, see Fig 3.10. 1 0.9
Scaled TTT−Transform
0.8 0.7 0.6 0.5 0.4 0.3 0.2 0.1 0
0
0.2
0.4
0.6
0.8
1
X
Figure 3.10: TTT-transform plot for the Aarst. Table 3.2 gives MLEs of parameters of the NMW and sub-models with standard errors in brackets. Goodness of fit statistics are in Table 3.3. We find that the NMW distribution with the same number of parameters provides a better fit than the beta modified Weiull distribution (BMW) which was the best in Silva et al (2010). The BMW had the largest likelihood, and the smallest K-S, AIC, BIC, AICc and CAIC values among those considered in that paper. It is clear in Figure 3.11c that the NMW fits the left and right peaks in the histogram better and its survival function follows the Kaplan-Meier estimate more closely, see Figure 3.11 (d).
3.11 Applications
104
Table 3.2: MLEs of parameters and corresponding standard errors in brackets for the Aarset data. βˆ 7.015 × 10−8 (1.501 × 10−7 ) BMW 0.0002 Silva et al (2010) (6.693 × 10−5 ) MW 0.062 (α = 0, θ = 0) (0.027) AddW 1.133 × 10−8 0.086 (λ = 0) (5.183 × 10−8 ) (0.036) SZMW 0.013 8.408 × 10−9 −3 (θ = 1, λ = 0) (2.819 × 10 ) (4.204 × 10−8 ) Model NMW
α ˆ 0.071 (0.031) a = 0.198 (0.046)
γˆ 0.016 (3.602) 1.377 (0.339) 0.356 (0.113) 0.477 (0.102) 4.224 (1.140)
θˆ 0.595 (0.128) b = 0.165 (0.083)
ˆ λ 0.197 (0.184) 0.054 (0.016) 0.023 (4.845 × 10−3 )
4.214 (1.033)
Table 3.3: Log-likelihood, K-S statistic, AIC, BIC, AICc and CAIC values of models fitted to Aarst data for comparison with beta modified Weibull (Silva et al (2010)). Model NMW MW AddW SZMW BMW
Log-lik -212.90 -227.16 -221.51 -229.88 -220.80
K-S 0.088 0.129 0.127 0.151 0.127
AIC 435.8 460.3 451.0 465.8 451.6
BIC 445.4 466.0 458.7 471.5 461.2
AICc 437.2 460.8 451.9 466.3 453.0
CAIC 450.4 469.1 462.7 474.5 466.2
3.11 Applications
105
1
Scaled TTT−Transform
0.7
0.10
0.15
0.8
0.05
h(x)
0.9
Nonpar NMW MW SZMW AddW BMW
0.6 0.5 0.4 0.3
0.00
0.2 0.1
20
40
60
80
0
0.5 X
(a)
(b)
0
0.1
0.2
0.3
0.4
0.6
0.7
1.0
0.025
0.8
0.9
1
0.6
0.8
Kaplan−Meier NMW MW SZMW AddW BMW
0.4
S(x)
0.015
0.020
NMW MW SZMW AddW BMW
0.0
0.000
0.005
0.2
0.010
f(x)
Empirical NMW
X
0.030
0
0
20
40
60
80
0
20
40
60
x
X
(c)
(d)
80
Figure 3.11: For Aarst data: (a) hazard function (b) TTT-Transform plot (c) pdf and (d) survival function using NMW plus sub models, and beta modified Weibull.
3.11 Applications
3.11.2
106
Meeker and Escobar data
The data are failure and running times of a sample of 30 devices (Meeker and Escobar (1998), p. 383). Two types of failures were observed for this data. It was shown by Nadarajah et al (2011) to be best fit by the beta modified Weibull distribution. The data have a bathtub shaped failure rate as its empirical TTT-plot has an s-shape, see Figure 3.12. Again the NMW distribution (Table 3.4) provides a better fit than the BMW, as can be seen from Table 3.5. Figures 3.13 (a) to (d) show the hazard function, TTT-Transform plot, PDF and the survival function using NMW, its sub models and the BMW distribution. The NMW distribution has the largest likelihood, and the smallest K-S, AIC, BIC, AICc and CAIC values comparing to the BMW and the all other modified Weibull distributions which support that the NMW provides a better fit than all considered distributions. 1 0.9
Scaled TTT−Transform
0.8 0.7 0.6 0.5 0.4 0.3 0.2 0.1 0
0
0.2
0.4
0.6
0.8
1
X
Figure 3.12: TTT-transform plot for the Mekeer data.
3.11 Applications
107
Table 3.4: MLEs of parameters and corresponding standard errors in brackets for the Meeker and Escobar data (1998). βˆ 5.991 × 10−8 (8.164 × 10−8 ) BMW 4.9 × 10−17 Silva et al (2010) (6.693 × 10−5 ) MW 0.018 (α = 0, θ = 0) (0.018) AddW 1.320 × 10−7 0.019 (λ = 0) (7.435 × 10−7 ) (0.018) SZMW 2.939 × 10−3 1.497 × 10−9 −4 (θ = 1, λ = 0) (9.290 × 10 ) (1.114 × 10−8 ) Model NMW
α ˆ 0.024 (0.019) a = 0.068 (0.016)
γˆ 0.012 (1.29) 4.266 (0.011) 0.454 (0.220) 0.604 (0.197) 3.585 (1.314)
θˆ 0.629 (0.15) b = 0.099 (0.049)
ˆ λ 0.056 (0.024) 0.0528 (0.002) 7.133 × 10−3 (2.113 × 10−3 )
2.830 (0.974)
Table 3.5: Log-likelihood, K-S statistic, AIC, BIC, AICc and CAIC values of models fitted to Meeker and Escobar data (1998) Model NMW MW AddW SZMW BMW
Log-lik -166.18 -178.06 -178.11 -177.90 -167.55
K-S 0.148 0.182 0.191 0.186 0.161
AIC 342.4 362.1 364.2 361.8 345.1
BIC 349.4 366.3 369.8 366.0 352.1
AICc 344.9 363.1 365.8 362.7 347.6
CAIC 354.4 369.3 373.8 369.0 357.2
3.11 Applications
108
0.015
1 0.9 0.8
Scaled TTT−Transform
0.7
0.005
h(x)
0.010
Nonpar NMW MW SZMW AddW BMW
0.6 0.5 0.4 0.3
0.000
0.2 0.1
50
100
150
200
250
300
0
Empirical NMW
X
0.5 X
(a)
(b)
0
0.1
0.2
0.3
0.4
0.6
0.7
1.0
0.010
0
0.9
1
0.6
0.8
Kaplan−Meier NMW MW SZMW AddW BMW
0.0
0.000
0.2
0.002
0.4
0.004
f(x)
S(x)
0.006
0.008
NMW MW SZMW AddW BMW
0.8
0
50
100
150
200
250
300
0
50
100
150
x
X
(c)
(d)
200
250
300
Figure 3.13: For Meeker and Escobar data: (a) hazard function (b) TTT-Transform plot (c) pdf and (d) survival function using NMW plus sub models, and beta modified Weibull.
3.12 Sub-model of the NMW with γ = 1
3.12
109
Sub-model of the NMW with γ = 1
To simplify the statistical inference, it is always a good idea to reduce the number of parameters of any distribution and investigate how that affects the ability of the simplified model to fit the data. In this section we reduce the number of parameters from five to four, by setting γ = 1. We test the reduced model (H0 : γ = 1) against the original model (Ha : γ ̸= 1). For each data set, Table 3.6 shows MLEs of the four parameter NMW, the log-likelihood value under H0 , likelihood ratio statistic, LRT with P -value in brackets, AIC, K-S statistic with P -value in brackets . The likelihood ratio statistics against the full model with five parameters are 1.31 (P -value = 0.252) and 2.45 (P -value=0.118) respectively on 1 d.f.. Therefore we can choose the reduced model with 4 parameters. The likelihood and AIC value also points to this model when the modified beta distribution is included in the comparison. Figure 3.14 shows the reduced model is nearly as good as the full model for both data sets. Table 3.6: Results of fitting NMW with γ = 1 to both data sets. Data
α ˆ
βˆ
θˆ
ˆ λ
Log-lik
AIC
LRT
K-S
(P -value)
Aarset
0.092 (0.039) Meeker 0.017 (0.013)
2.2 × 10−8 (2.1 × 10−8 ) 3.5 × 10−8 (4.2 × 10−8 )
0.531 (0.104) 0.675 (0.141)
0.160 -213.56 (0.011) 0.039 -167.40 (4.0 × 10−3 )
435.1 342.8
1.31 (0.252) 2.45 (0.118)
0.105 0.153
Kaplan−Meier NMW 4NMW
0.8
0.025
0.4
S(x)
0.015
0.6
0.020
NMW 4NMW
0.0
0.000
0.005
0.2
0.010
f(x)
110
1.0
0.030
3.12 Sub-model of the NMW with γ = 1
20
40
60
80
0
20
40
x
X
(a)
(b)
60
1.0
0.010
0
0.8
Kaplan−Meier NMW 4NMW
0.0
0.000
0.2
0.002
0.4
0.004
f(x)
S(x)
0.6
0.006
0.008
NMW 4NMW
80
0
50
100
150
200
250
300
0
50
100
150
x
X
(c)
(d)
200
250
300
Figure 3.14: (a) and (b): fitted pdf and survival functions for Aarst data, (c) and (d): those for Meeker and Escobar data, 5 parameters (solid lines) vs 4 parameters (dotted lines).
3.13 Summary
3.13
111
Summary
Chapter 3 introduced a new lifetime distribution by considering a serial system with one component following a Weibull distribution and another following a modified Weibull distribution. We studied its mathematical properties including moments and order statistics. The estimation of parameters by maximum likelihood was discussed. We demonstrated that the proposed distribution fits two well-known data sets better than other modified Weibull distributions including the latest beta modified Weibull distribution. The model can be simplified by fixing one of the parameters, whilst still provides a better fit than existing models.
Chapter 4 Reduced New Modified Weibull Distribution 4.1
Introduction
In chapter 3 we proposed a new modification of the Weibull distribution NMW which generalises several commonly used distributions in reliability and lifetime data analysis. This distribution has five parameters and we have studied some of its properties and estimation of its parameters by using the maximum likelihood method and applied it to real data sets. The NMW could be one of the most important distributions in reliability and life testing due to its properties, its sub-models, its flexibility in fitting real data sets and the interpretation of its survival and hazard functions. It has also been shown to be the best lifetime distribution to date in terms of fitting data sets such as the Aarset data of Aarset (1987) and the voltage data of Meeker and Escobar (1998). Although distributions with four or more parameters are flexible and exhibit bathtub shaped hazard rates, they are also complex (Nelson, (1990)) and cause estimation problems as a consequence of the number of parameters, especially when the sample size is not large. The main purpose of this chapter is to reduce the number of parameters of the NMW so as to address these problems while maintaining the same flexibility and ability to fit data so well. We show this can be achieved by choosing the shape parameters γ = θ = 12 . The new distribution will be called Reduced New Modified Weibull Distribution and be denoted as RNMW.
4.1 Introduction
113
There are various tools to assess the flexibility of a given univariate distribution. One commonly used tool is the skewness-kurtosis plot. Values of (skewness, kurtosis) plotted on the (x, y) plane for all possible values of the parameters of the distribution give what is referred to as the skewness-kurtosis plot. The area or the range covered by the skewness-kurtosis plot is a measure of flexibility of the distribution. If we have more than one distribution, the distribution with the widest range of skewness-kurtosis will be more flexible than others. The skewness-kurtosis plot can be used to choose which distribution is appropriate to fit a given data. Also the relationships between distributions can be seen via a skewness-kurtosis plot, for example the exponential distribution is located at the point of intersection of the gamma and Weibull distributions and it is well known as a special case of both distributions, see Cox (1984) and Hartless and Leemis (1996). We now show the flexibility of the particular case of the NMW, when θ = γ = 1 , 2
by means of skewness-kurtosis plot. The skewness-kurtosis plot for the NMW
distribution is drawn on the left hand side of Figure 4.1. The values of (skewness, kurtosis) were computed over θ = 0.1, 0.2, . . . , 5, γ = 0.1, 0.2, . . . , 5, θ = γ ̸= 12 , α = 0.1, 0.2, . . . , 2, β = 0.1, 0.2, . . . , 2 and λ = 0.1, 0.2, . . . , 2. The skewness-kurtosis plot for the reduced distribution is drawn on the right hand side of Figure 4.1. The values of (skewness, kurtosis) were computed over α = 0.1, 0.2, . . . , 2, β = 0.1, 0.2, . . . , 2 and λ = 0.1, 0.2, . . . , 2. We can see that the particular case θ = γ =
1 2
is a flexible member of the NMW
distribution. The range of kurtosis values is the widest for the case θ = γ = 21 . The range of positive skewness values is also widest for the case θ = γ =
1 , 2
but some
negative skewness values are not accommodated by this case. The rest of this chapter is organized as follows. Sections 4.2-4.7 consider the mathematical properties of the RNMW, including its pdf, hazard function, moments, Renyi entropy and the estimation of its reliability. The distribution of order statistics and moments of data from this distribution are derived in section 4.8. Section 4.9 discusses the maximum likelihood estimates of the unknown parameters. Four real data sets, uncensored and censored, are analyzed in section 4.10. Section 4.11 summarizes the chapter.
4.2 The reduced distribution
114
(a)
(b)
Figure 4.1: Kurtosis-skewness plot for the NMW distribution (left) and its reduced version (right).
4.2
The reduced distribution
The variable X has a reduced new modified Weibull distribution if its CDF given by F (x) = 1 − e−α
√ √ x−β xeλx
, x > 0.
(4.1)
where α, β and λ are non-negative, with α and β being scale parameters and λ an acceleration parameter. This reduced version of the new modified Weibull (NMW) distribution has a bathtub-shaped hazard function, as will be shown later, is called reduced new modified Weibull and is denoted by RNMW. From the CDF of the RNMW in (4.1), the corresponding survival function and density function are S(x) = e−α and
√
√ x−β xeλx
,
√ √ λx ) 1 ( f (x) = √ α + β(1 + 2λx)eλx e−α x−β xe , x > 0, 2 x
(4.2)
(4.3)
where α, β and λ > 0. Figure 4.2 shows that the reduced distribution is nearly as flexible as the NMW distribution.
4.3 The hazard rate function
115
1
α=0.05, β=0.00025, λ=2.2
0.9 α=1, β=0.7, λ=0.15 0.8
The probability density function
α=0.5, β=0.015, λ=2.75 0.7 α=0.15, β=0.025, λ=1.5
0.6
0.5
0.4
0.3
0.2
α=0.75, β=0.05, λ=1
0.1
0
0
0.5
1
1.5
2
2.5 X
3
3.5
4
4.5
5
Figure 4.2: Probability density function of the reduced distribution.
4.3
The hazard rate function
The hazard rate function of the RNMW distribution is ] 1 [ h(x) = √ α + β(1 + 2λx)eλx , x > 0. 2 x
(4.4)
To derive the shape of h(x), we obtain the first derivative of log {h(x)}: d 1 βλ(2λx + 3)eλx log {h(x)} = − + . dx 2x α + β(2λx + 1)eλx
(4.5)
Setting this to zero, we have −
βλ(2λx + 3)eλx 1 + = 0. 2x α + β(2λx + 1)eλx
(4.6)
Let x0 denote the root of (4.6). Using the limit of (4.5) when x → 0 and x → ∞, it can be deduced that d dx
d dx
log {h(x)} < 0 for x ∈ (0, x0 ),
d dx
log {h(x0 )} = 0, and
log {h(x)} > 0 for x > x0 . So, h(x) initially decreases before increasing. Hence, we
have a bathtub shape. Where x0 denote the solution of (4.6); that is, the solution of (
) 4βλx2 + 4βλx − β eλx = α.
(4.7)
The left hand side of (4.7) is eλx multiplied by the quadratic function 4βλx2 +4βλx−β. Then, x0 can be obtained from the vertical projection from the intersection point between y = (4βλx2 + 4βλx − β) eλx and y = α, hence the value x0 is unique and positive as shown in Figure 4.3.
4.3 The hazard rate function
116
6
8 α=0.75 β=0.5 λ=1.25
7
α=2 β=0.05 λ=0.75
5
(4β λx2+4βλx−β) exp(λ x)
6
2
(4β λx +4βλx−β) exp(λ x)
4
5 3
Y
Y
4
y=α
3
2
2 1
1 y=α
0
0 −1
0
x0
0.5
1
1.5
−1
0
0.5
1
1.5 x
0
X
(a)
2
2.5 X
3
3.5
4
4.5
5
(b)
Figure 4.3: The hazard function of the RNMW and the root of
log {h(x0 )} = 0.
d dx
Plots of the hazard rate function of the RNMW distribution are shown in Figure 4.4 (a). As mentioned in the previous chapter the bathtub shaped hazard function of the NMW distribution has shown to have a long useful life period, and so does the RNMW distribution, as Figure 4.4(b) shows. −3
2
7
1.8
α=0.75, β=0.7, λ=.5
6
x 10
α=0.25, β=0.015, λ=2.5
α=0.003, β=5x10−6 , λ=0.025
1.6
−8
α=0.002, β=2.5x10 , λ=0.05 α=0.005, β=1.5x10−4, λ=0.012
1.4 The hazard function
The failure rate function
5
4
3 α=0.15, β=0.00015, λ1=2
1 0.8 0.6
α=2.5, β=0.05, λ=0.5
2
1.2
0.4 1
0.2 α=1.5, β=0.001, λ=1 0
0
1
2
3
4 X
(a)
5
6
0
0
50
100
150 X
(b)
Figure 4.4: Hazard function of the RNMW distribution.
200
250
4.4 The moments
4.4
117
The moments
The r-th moment of the RNMW is represented in this section. Corollary 1. The non-central r-th moment of a random variable X that follows the reduced distribution RN M W (α, β, λ) is given by µ′r = 2r
∞ ∑ ∞ ∑ (−β)n (λn)m Γ (n + 2(m + r)) , (n+2(m+r)) n!m! α n=0 m=0
(4.8)
for r = 1, 2, . . .. The first eight moments of the RNMW α = 2, β = 0.15 and λ = 7.4 × 10−4 are obtained using (4.8) and the numerical integration. Table 4.1 shows that the results of both of them, given to eight decimal places, are the same; but using (4.8) we need just around 0.17 seconds for each moment to calculate while the moment using numerical integration require more than 2.1 seconds. Matlab code is used to calculate the moments of the proposed distribution. r 1 2 3 4 5 6 7 8
µ′r Numerical Inte. Time(sec) 0.28475750 7.3 0.48630879 2.4 2.07478272 2.6 16.50652427 2.4 210.77542527 2.3 3941.05391664 2.2 101406.81407589 2.2 3433153.21006252 2.1
µ′r Using (4.8) 0.28475750 0.48630879 2.07478272 16.50652427 210.77542527 3941.05391664 101406.81407589 3433153.21006251
Time(sec) 0.18 0.18 0.17 0.17 0.18 0.17 0.17 0.17
Table 4.1: The first 8-th moments of the RNMW using (4.8) and numerical integration.
4.5
The moment generating function
The moment generating function of the RNMW is provided in the this section. Theorem 3. If X is a random variable following the RNMW, then the moment generating function is given by ] [ ∞ ∑ (−β)n (nλ)m tk+1 Γ (n + 2(m + k) + 2) MX (t) = 1 + 2 . n+2(m+k)+2 n!m!k! α n,m,k=0
(4.9)
4.6 Renyi entropy
118
Proof : The moment generating function is defied by MX (t) = E(etx ) ∫ ∞ = etx f (x)dx ∫0 ∞ etx dF (x) = 0 ∫ ∞ √ √ λx = 1+ tetx e−α x−β xe dx 0
∞ ∑ (−β)n (nλ)m tk+1 = 1+ I, n!m!k! n,m,k=0
where I =
∫∞ 0
x 2 +m+k e−α n
√
x
(4.10)
dx and using gamma-integral formula the moment gener-
ating function the RNMW is given by [ ] ∞ ∑ (−β)n (nλ)m tk+1 Γ (n + 2(m + k) + 2) MX (t) = 1 + 2 . n!m!k! αn+2(m+k)+2 n,m,k=0 Using (4.9), the first four moments of the RNMW is [ ] ∞ ∑ (−β)n (nλ)m Γ (n + 2m + 2) ′ ′ MX (0) = µ1 = 2 , n!m! αn+2m+2 n,m=0 [ ] ∞ ∑ (−β)n (nλ)m Γ (n + 2m + 4) ′′ ′′ , MX (0) = µ2 = 4 n!m! αn+2m+4 n,m=0 [ ] ∞ ∑ (−β)n (nλ)m Γ (n + 2m + 6) (3) (3) MX (0) = µ3 = 6 , n!m! αn+2m+6 n,m=0 [ ] ∞ ∑ (−β)n (nλ)m Γ (n + 2m + 8) (4) (4) MX (0) = µ2 = 8 . n!m! αn+2m+8 n,m=0 This is consistent with the formal of the moment in (4.8).
4.6
Renyi entropy
In information theory, if X is a random variable with density function f (x), the Renyi entropy is a measure of the uncertainty of the random variable. Theorem 4. For X RN M W (α, β, λ), the Renyi entropy is given by (∑ ∑ 1 ∑∞ (p)( l ) β l+i λm (−p)i (λ(l+i))j Γ(2(j+m)+i−p+2) ) l p log H(p) = , i,j=0 l m m=0 l=0 2p−m−1 i!j! (pα)2(j+m−p+1)+i+l) 1−p (4.11) where Γ(·) is the gamma function.
4.7 Reliability
119
Proof : The Renyi entropy is given by {∫ ∞ } 1 p log {f (x; α, β, λ)} dx . H(p) = 1−p 0
(4.12)
Using the Taylor and binomial expansions, { }p √ √ 1 p λx −α x−β xeλx √ (α + β(1 + 2λx)e )e [f (x)] = , 2 x p l ∑ ∞ ( )( ) l+i m ∑ ∑ p l β λ (−p)i (λ(l + i))j j+m+ i−p −αp√x 2 e = . x p−m αl−p )i!j! l m (2 l=0 m=0 i,j=0 (4.13) Substituting (4.13) into the integral part in (4.12), we have ∫∞ p
[f (x)] dx = 0
∫∞ ∑ p l ∑ ∞ ( )( ) l+i m ∑ l β λ (−p)i (λ(l + i))j p 0
=
l=0 m=0 i,j=0
∫∞
l
(2p−m αl−p )i!j!
p l ∑ ∞ ( )( ) l+i m ∑ ∑ p l β λ (−p)i (λ(l + i))j l=0 m=0 i,j=0
where I =
m
xj+m+
i−p 2
√
e−αp
x
l
(2p−m αl−p )i!j!
m
xj+m+
i−p 2
√
e−αp
x
dx,
I,
dx.
0
Using the Gamma integral ∫ ∞
xb−1 e−ax dx = a−b/c (1/c)Γ(b/c), c
0
I=
2Γ(2(j + m) + i − p + 2) . (pα)2(j+m)+i−p+2)
So, the Renyi entropy is (∑ ∑ 1 ∑∞ (p)( l ) β l+i λm (−p)i (λ(l+i))j Γ(2(j+m)+i−p+2) ) p l , H(p) = log l=0 m=0 i,j=0 l m 2p−m−1 i!j! (pα)2(j+m−p+1)+i+l) 1−p
4.7
Reliability
The estimation of reliability is important in stress-strength models. If X is the strength of a component and Y is the stress, the component fails when Y >X. Then, the estimation of the reliability of the component R is P r(Y < X). Theorem 5. If X and Y are independent random variables following the same distribution RN M W (α, β, λ), then the estimation of reliability R is given by ( ∞ ∑ ∑ (−2β)i R = 1− α ∞ j=0 i! i=0
(iλ)j Γ(2j+i+1) j! (2α)2j+i+1
+β
∑∞
(λ(i+1))k k=0 k!
(
Γ(2k+i+1) (2α)2k+i+1
+
2λΓ(2(k+1)+i+1) (2α)2(k+1)+i+1
))
(4.14)
.
4.8 Order statistics
120
Proof : The reliability R can be written as ∫ ∞ R = f (x)F (x)dx.
(4.15)
0
Then, ∫ R = 1− = 1−
∞
0 ∞ ∑ i=0
f (x)S(x)dx, { ∞ } ∞ ∑ (iλ)j ∑ (−2 β)i (λ(i + 1))k α I1 + β × (I2 + 2λI3 ) , 2(i!) j! k! j=0 k=0
where ∫
∞
I1 =
i−1 +j 2
x
i−1 +k 2
x
i−1 +k+1 2
∫0 ∞ I2 = ∫
0
I3 =
e−2α
x
∞
√
e−2α
x
dx,
√ x
e−2α
dx,
√ x
dx.
0
Using the Gamma integral, I1 = I2 = I3 =
2Γ (2j + i + 1) , (2 α)2j+i+1 2Γ (2k + i + 1) , (2 α)2k+i+1 2Γ (2k + i + 3) , (2 α)2k+i+3
then
R = 1−
4.8
∞ ( ∑ (−2β)i ( ∑∞ (iλ)j Γ(2j+i+1) ∑ (λ(i+1))k Γ(2k+i+1) α j=0 j! (2α)2j+i+1 + β ∞ + k=0 k! (2α)2k+i+1 i! i=0
2λΓ(2(k+1)+i+1) (2α)2(k+1)+i+1
))
Order statistics
This section discusses order statistics, which have many applications in reliability and lifetime analysis. We derive the probability density function of the order statistic X(r) , and its moments, where X1 , . . . , Xn are drawn fron the RN M W (α, β, λ). If X1 , X2 , · · · , Xn are a random sample from the RN M W (α, β, λ) with CDF (4.1) and pdf (4.3), and X(1) ≤ X(2) ≤ · · · ≤ X(n) are the order statistics from this sample, then, from Arnold el at (2008), the pdf of the r-th statistic X(r) is given by
.
4.9 Parameter estimation
121
From (3.12), (3.13) and (3.14), where h(x) is the hazard function (4.4) and H(x) = √ √ α x + β xeλx is the cumulative hazard. we get ) r−1 ( ∑ 1 r−1 fr:n (x) = (−1)ℓ h(x)e−(n+ℓ+1−r)H(x) , B (r, n − r + 1) ℓ=0 ℓ ( )∑ ( ) r−1 n−1 r−1 = n (−1)ℓ h(x)e−(n+ℓ+1−r)H(x) , r − 1 ℓ=0 ℓ ) ( ) r−1 ( ) ( n−1 ∑ r−1 1 λx ℓ √ (α + β(1 + 2λx)) e × = n (−1) r − 1 ℓ=0 ℓ 2 x √
√
e−(n+ℓ+1−r)(α x+β x) , ( ) r−1 ( ) n−1 ∑ r−1 (−1)ℓ = n f (x; αℓ , βℓ , λ), r − 1 ℓ=0 ℓ (n + ℓ + 1 − r) where f (x; αℓ , βℓ , λ) is the PDF of the RNMW with parameters αℓ = (n + ℓ + 1 − r)α, βℓ = (n + ℓ + 1 − r)β and λ. Using (4.8), the kth non-central moment of the rth order statistic is then ) ( ) ∞ ∞ r−1 ( ′ (r:n) n − 1 ∑ ∑ ∑ r − 1 (−1)ℓ+i β i (iλ)j Γ (i + 2(j + k) + 1) µk = 2nk . ℓ r − 1 i=0 j=0 ℓ=0 αi (α (n + ℓ + 1 − r))2(j+k)+1 (4.16) .
4.9
Parameter estimation
In this section, point and interval estimators of the unknown parameters of the RNMW distribution are derived using the maximum likelihood method. We consider both complete data and censored data, then assess the finite sample performance of the MLEs with respect to sample size n.
4.9.1
Complete data
The PDF of the RNMW distribution can be rewritten as f (x) = h (x; ϑ) e−α
√
√ x−β xeλx
for x > 0, where h (x; ϑ) is the hazard rate function in (4.4) and ϑ = (α, β, λ) is a vector of parameters.
4.9 Parameter estimation
122
Let x1 , . . . , xn denote a random sample of complete data from the RNMW distribution. Then, the log-likelihood function is n ∑ ] [ √ √ L (ϑ) = log (h (xi ; ϑ)) − α xi − β xi eλxi . i=1
The likelihood equations are obtained by setting the first partial derivatives of ℓ with respect to α, β and λ to zero; that is, n ∑ i=1
∑√ 1 ( √ )− xi = 0, h (xi ; α, β, λ) 2 xi i=1 n
n n ∑ ∑ √ (0.5 + λxi ) eλxi eλxi xi = 0, √ − h (xi ; α, β, λ) xi i=1 i=1 (3 ) λx √ n n √ i ∑ xi + λxi e ∑ 2 − eλxi x3i = 0. h (xi ; α, β, λ) i=1 i=1
4.9.2
(4.17) (4.18) (4.19)
Censored data
Here, we consider maximum likelihood estimation for censored data without replacement. Let Xi and Ci denote the lifetime and the censoring time for tested individual i, i = 1, . . . , n. Suppose Xi and Ci are independent random variables. The failure times are xi = min(Xi , Ci ), i = 1, . . . , n. Then, the log-likelihood function is L (ϑ) =
d ∑
[ ] ∑[ √ ] √ √ √ log h (xi ; ϑ) − α xi − β xi eλxi − α xi + β xi eλxi ,
i=1
i∈C
where d is the number of failures and C contains indices of the censored observations. Setting the first partial derivatives of L (ϑ) with respect to α, β and λ to zero, the likelihood equations are obtained as } { d ∑√ ∑ √ 1 ( √ ) − xi − xi = 0, h (xi ; α, β, λ) 2 xi i=1 i∈C } ∑ d { ∑ √ λxi (0.5 + λxi ) eλxi λxi √ xi − xi e = 0, √ −e h (xi ; α, β, λ) xi i=1 i∈C {√ ( ) d √ } ∑ √ ∑ xi 32 + λxi eλxi − eλxi x3i − eλxi x3i = 0. h (xi ; α, β, λ) i=1 i∈C
(4.20)
(4.21)
(4.22)
By solving the systems of nonlinear likelihood equations, (4.17), (4.18), (4.19) and (4.20), (4.21), (4.22), numerically for α, β and λ, we can obtain maximum likelihood estimates for complete and censored data.
4.9 Parameter estimation
123
In order to find the interval estimation of α, β and λ, the observed information matrix is obtained since the expected information matrix is very complicated. The observed information matrix J(ϑ) is J(ϑ) = −
Lαα Lαβ Lαλ Lββ Lβλ Lλλ
,
where the elements of this matrix are given in Appendix B Under conditions that are fulfilled for parameters in the interior of the param) √ (b eter space but not on the boundary, the asymptotic distribution of n ϑ − ϑ is N3 (0, I(ϑ)−1 ), where I(ϑ) is the expected information matrix. This asymptotic behavb i.e., the observed information matrix evaluated ior is valid if I(ϑ) is replaced by J(ϑ), b The asymptotic multivariate normal N3 (0, J(ϑ) b −1 ) distribution can be used to at ϑ. construct approximate confidence intervals and confidence regions for the individual parameters.
4.9.3
Simulation study
Here, we assess the performance of the MLEs with respect to sample size n. The assessment is based on a simulation study: 1. First, ten thousand samples of size n are generated from (4.1). We used the inversion method to generate samples, which was done for the RNMW distribution by solving √ √ α X + β XeλX = − ln(1 − U ), where U ∼ U (0, 1) is a uniform variate on the unit interval. ( 2. Obtain the MLEs for the ten thousand generated samples,
bi α bi , βbi , λ
) for i =
1, 2, . . . , 10000. ( ) 3. For the generated samples, compute the standard errors, say sαbi , sβbi , sλbi for i = 1, 2, . . . , 10000. The standard errors are computed by using the observed information matrices.
4.10 Applications
124
4. The biases and mean squared errors of the MLEs can be computed as the following, biash (n) =
10000 ) 1 ∑ (b hi − h , 10000 i=1
MSEh (n) =
10000 )2 1 ∑ (b hi − h 10000 i=1
for h = α, β, λ. The above steps were repeated for n = 10, 11, . . . , 100 with α = 1, β = 1 and λ = 1, then, we computed biash (n) and MSEh (n) for h = α, β, λ and n = 10, 11, . . . , 100. Figure 4.5 shows the biases of the MLEs of (α, β, λ) versus n = 10, 11, . . . , 100 when (α, β, λ) = (0.1, 0.1, 0.1). It can be seen that the biases for the three parameters are small and vary with respect to the samples sizes. The mean squared errors of the MLEs of each parameters are shown in Figure 4.6, which are vary with respect to the samples sizes. The broken line in Figure 4.5 indicates to the distance between the biases and the zero. The broken line in Figure 4.6 indicates to the distance between the mean squared errors and the zero. From these figures the following observations can be made. The biases of the MLEs of the parameters α and β are generally negative; the biases of the MLEs of the parameter λ are generally positive; the biases of the MLEs of the parameter β are the smallest; the biases of the MLEs of the parameter λ are the largest; the biases of the MLEs of the parameters α and β increase to zero as n → ∞ where the biases for the parameter λ decrease to zero as n → ∞; the mean squared errors of the MLEs of the parameter β are the smallest; the mean squared errors of the MLEs of the parameter α are the the largest; the mean squared errors for the three parameters decrease to zero as n → ∞; The above observations are observed by choosing (α, β, λ) = (0.1, 0.1, 0.1). A similar results were found for other choices.
4.10
Applications
This section provides four applications, two of them are for complete (uncensored) data sets and the others are for censored data sets, to show how the RNMW distribution can be applied in practice. It has been shown in chapter 3 that the NMW distribution
125
−1e−04 −5e−04
0
20
40
60
80
0
20
40
60
80
n
0.002
0.006
0.010
0.014
n
Bias of MLE of lambda
−3e−04
Bias of MLE of beta
0.004 0.000 −0.004
Bias of MLE of alpha
0.008
4.10 Applications
0
20
40
60
80
n
Figure 4.5: Biases of the MLEs of (α, β, λ) versus n = 10, 11, . . . , 100 ((α, β, λ) = (0.1, 0.1, 0.1)).
0
20
40
60
80
3.0e−05 1.5e−05
0
20
40
60
80
0.0006
0.0012
n
0.0000
MSE of MLE of lambda
n
0.0e+00
0.006
MSE of MLE of beta
0.010
126
0.002
MSE of MLE of alpha
4.10 Applications
0
20
40
60
80
n
Figure 4.6: Mean squared errors of the MLEs of (α, β, λ) versus n = 10, 11, . . . , 100 (α, β, λ) = (0.1, 0.1, 0.1).
4.10 Applications
127
fits several data sets better than existing modifications of the Weibull distribution like the BMW distribution, the AddW distribution, the MW distribution and the SZMW distribution. So, we shall compare the fits of the RNMW and NMW distributions to see if the former can perform as well as the NMW distribution. The Kolmogorov-Smirnov test, AIC, BIC, AICc and CAIC are used to compare the candidate distributions. The log-likelihood ratio test is used to compare the NMW and RNMW distributions by testing the hypotheses: H0 : θ = γ =
1 2
versus H1 : H0 is false. The likelihood ratio
test statistic for testing H0 against H1 is ω = 2(LN M W − LRN M W ), which follows a χ2 distribution with two degrees of freedom under H0 . This section presents four real data applications. The sample size for the first data set is fifty. The sample size for the second data set is forty four. The sample size for the third data set is eighty two. The sample size for the fourth data set is one hundred b can be expected to be less than 0.003, and forty eight. Hence, the biases for α b, βb and λ 2 × 10−4 and 0.003, respectively, for the first two data sets and to be less than 0.002, 1 × 10−4 and 0.002, respectively, for the other two data sets. The mean squared errors b can be expected to be less than 0.003, 5×10−6 and 3×10−4 respectively, for α b, βb and λ for first two data sets and be less than 0.002 5 × 10−6 and 2 × 10−4 respectively, for the other two data sets.
4.10.1
Complete data
In this section, we show how the RNMW distribution can be applied in practice for two complete (uncensored) real data sets. Aarset data The Aarset data (Aarset, 1987), consisting of lifetimes of fifty devices, which has been presented in the previous chapter, exhibits a bathtub shaped hazard rate. Both the NMW and RNMW distributions are now fitted to this data set. Table 4.2 gives the MLEs of the parameters, the corresponding standard errors, AIC, BIC, AICc and CAIC. Table 4.3 provides the K-S test statistics. Figures 4.7a and 4.7b show the histogram of the data, PDFs of the fitted NMW and RNMW distributions, the empirical survival function, and the survival functions of the fitted NMW and RNMW distributions.
4.10 Applications
128
Table 4.2: MLEs of parameters, standard errors, AIC, BIC, AICc and CAIC for Aarset data. Model NMW RNMW
α b βb 0.071 7.015 × 10−8 (0.031) (1.501 × 10−7 ) 0.102 3.644 × 10−8 (0.019) (6.089 × 10−8 )
b γ b θb λ AIC BIC AICc CAIC 0.016 0.595 0.197 435.8 445.4 437.2 450.4 (3.602) (0.128) (0.184) 1 1 0.180 433.1 439.0 433.8 442.0 2 2 − − (0.020)
Table 4.3: K-S statistics for models fitted to Aarset data. Model NMW RNMW
K-S 0.088 0.092
It is clear that both the NMW and RNMW distributions provide adequate fits. Both have very small K-S values (0.088 and 0.092, respectively). The NMW distribution has the larger log-likelihood of -212.9. However, the RNMW distribution has the smaller values for AIC, BIC, AICc and CAIC. The likelihood ratio test statistic for testing H0 : θ = γ =
1 2
versus H1 : H0 is false takes the value 1.436 and the correspond-
ing p-value is 0.488, so there is no significant evidence to reject H0 . Hence, the NMW distribution does not improve significantly on the fit of the RNMW distribution. The plots of the empirical TTT-transform, TTT-transforms of the fitted NMW and RNMW distributions, the nonparametric hazard rate function, and the hazard rate functions of the fitted NMW and RNMW distributions are shown in Figures 4.7c and 4.7d. It is clear that the RNMW distribution provides as good a fit as the NMW distribution. The variance-covariance matrix for the estimated parameters of the RNMW may be approximated as J −1 , 5.203 × 10−4 −3.697 × 10−9 1.214 × 10−3 J −1 = −3.697 × 10−9 9.078 × 10−14 −2.994 × 10−8 1.214 × 10−3 −2.994 × 10−8 9.882 × 10−3
.
So, approximate 95 percent confidence intervals for the parameters α, β and λ are [0.064, 0.14], [0, 1.558 × 10−7 ] and [0.219 × 10−5 , 0.142], respectively.
129
0.025
1.0
0.030
4.10 Applications
Kaplan−Meier RNMW NMW
0.4
S(x) 0.0
0.000
0.2
0.005
0.010
f(x)
0.015
0.6
0.020
0.8
RNMW NMW
0
20
40
60
80
0
40 X
(a)
(b)
60
80
60
80
0.15
1 0.9
Nonpar RNMW NMW 0.10
0.8 0.7 0.6
h(x)
0.5
0.05
Scaled TTT−Transform
20
x
0.4 0.3
Empirical RNMW NMW
0.1 0
0.00
0.2
0
0.1
0.2
0.3
0.4
0.5 X
(c)
0.6
0.7
0.8
0.9
0 1
20
40 X
(d)
Figure 4.7: For Aarst data: (a) Histogram and fitted PDFs; (b) Empirical and fitted survival functions; (c) Empirical and fitted TTT-transforms; (c) Nonparametric and fitted hazard rate functions.
4.10 Applications
130
Table 4.4: MLEs of parameters, standard errors, AIC, BIC, AICc and CAIC for Kumar data. Model NMW RNMW
b α b βb γ b θb λ AIC BIC AICc CAIC 0.034 4.588 × 10−4 0.423 0.657 0.071 410.0 418.9 411.6 423.9 (0.022) (3.794 × 10−3 ) (2.351) (0.18) (0.034) 1 1 0.055 5.852 × 10−4 0.065 406.9 412.2 407.5 415.2 2 2 (0.017) (6.523 × 10−4 ) − − (0.012)
Kumar data Kumar et al. (1989) presented data consisting of times between failures (TBF) in days of load-haul-dump machines (LHD) used to pick up rock or waste. As shown in Figure 4.8, the scaled TTT-Transform plot of this data has a convex shape followed by a concave shape. That corresponds to a bathtub shaped hazard function for this data set. 1 0.9
Scaled TTT−Transform
0.8 0.7 0.6 0.5 0.4 0.3 0.2 0.1 0
0
0.2
0.4
0.6
0.8
1
X
Figure 4.8: TTT-transform plot for the Kumar. Tables 4.4 and 4.5 show the MLEs of the parameters, corresponding standard errors, AIC, BIC, AICc, CAIC and the K-S test statistic. Both distributions (NMW and RNMW) provide adequate fits. The log-likelihood value is larger for the NMW distribution. That for the RNMW distribution is only slightly smaller. The K-S statistic is larger for the NMW distribution, and for the reduced model it is very small at 0.055. However, the RNMW distribution has the smaller AIC, BIC, AICc and CAIC values.
4.10 Applications
131
Table 4.5: K-S statistics for models fitted to Kumar data. Model NMW RNMW
K-S 0.068 0.061
Figures 4.9 (a) and (d) show that both distributions fit the data adequately. However, the log-likelihood ratio statistic for testing H0 : θ = γ =
1 2
versus H1 : H0 is false
is ω = 0.895 with the corresponding p-value of 0.639. Hence, again there is no evidence that the NMW distribution provides a better fit than the RNMW distribution. The variance-covariance matrix for the estimated parameters of the RNMW may be approximated as J −1 , 2.839 × 10−4 −3.968 × 10−6 6.731 × 10−5 J −1 = −3.968 × 10−6 4.254 × 10−7 −7.836 × 10−6 6.731 × 10−5 −7.836 × 10−6 1.498 × 10−4
.
So, approximate 95 percent confidence intervals for the parameters α, β and λ are [0.022, 0.088], [0, 1.864 × 10−3 ] and [0.041, 0.089], respectively.
4.10.2
Censored data
In this section, we show how the RNMW distribution can be applied in practice for two real censored data sets, one of which is presented here for the first time. Drug data This data set was collected from a prison in the Middle East in 2011. It represents a sample of eighty two prisoners convicted of using or selling drugs. They were all released as part of a general amnesty for prisoners. We consider the time from release to re-offending to be the failure time. Of the eighty two prisoners, sixty six were arrested again for abuse or sale of drugs. After one hundred and eleven weeks, the others were considered to be censored. Again, regarding to the TTT-transform plot in Figure 4.10, the data has a bathtub shaped hazard rate. Both the NMW and RNMW distributions were fitted to the data. Tables 4.6 and 4.7 show the MLEs of the parameters, corresponding standard errors, AIC, BIC, AICc,
132
1.0
0.020
4.10 Applications
0.8
Kaplan−Meier RNMW NMW
0.0
0.000
0.2
0.005
0.4
S(x)
f(x)
0.010
0.6
0.015
RNMW NMW
20
40
60
80
100
0
40 X
(a)
(b)
1 0.9
60
80
100
60
80
100
Nonpar RNMW NMW
0.20
0.8
0.15
0.7 0.6
h(x) 0.10
0.5 0.4
0.05
Scaled TTT−Transform
20
x
0.25
0
0.3
Empirical RNMW NMW
0.1 0
0.00
0.2
0
0.2
0.4
0.6
0.8
0
1
20
40
X
X
(c)
(d)
Figure 4.9: For Kumar data: (a) Histogram and fitted PDFs; (b) Empirical and fitted survival functions; (c) Empirical and fitted TTT-transforms; (c) Nonparametric and fitted hazard rate functions.
4.10 Applications
133
1 0.9
Scaled TTT−Transform
0.8 0.7 0.6 0.5 0.4 0.3 0.2 0.1 0
0
0.2
0.4
0.6
0.8
1
X
Figure 4.10: TTT-transform plot for the drug data. Table 4.6: MLEs of parameters, standard errors, AIC, BIC, AICc and CAIC for drug data. α b βb γ b θb 0.019 2.954 × 10−3 0.484 0.735 (9.426 × 10−3 ) (3.656 × 10−3 ) (0.504) (0.159) 1 1 RNMW 0.038 5.863 × 10−3 2 2 −3 (0.017) (6.584 × 10 ) − − Model NMW
b λ AIC BIC AICc CAIC 0.031 700.9 713.0 701.7 718.0 (0.019) 0.026 698.4 705.6 698.7 708.7 (9.319 × 10−3 )
CAIC and the K-S test statistics. We see that the RNMW distribution has the smaller AIC, BIC, AICc and CAIC values. The K-S statistic values for both distributions are approximately equal to 0.055. Figures 4.11 (a)-(d) show the histogram of the data, PDFs of the fitted NMW and RNMW distributions, the empirical survival function, the survival functions of the fitted NMW and RNMW distributions, the empirical TTT-transform, TTT-transforms of the fitted NMW and RNMW distributions, the nonparametric hazard rate function, and the hazard rate functions of the fitted NMW and RNMW distributions. We can see that the RNMW distribution fits the data as well as the NMW distribution. The log-likelihood ratio statistic for testing H0 : θ = γ =
1 2
versus H1 : H0 is false is
ω = 1.496 with the corresponding p-value of 0.473. Hence, again there is no evidence that the NMW distribution provides a better fit than the RNMW distribution. The variance-covariance matrix for the estimated parameters of the RNMW may
4.10 Applications
134
Table 4.7: K-S statistics for models fitted to the drug data. K-S 0.0550 0.0553
0.03
0.8
0.01
0.4
0.02
h(x)
0.6
S(x)
Nonpar RNMW NMW
0.04
1.0
0.05
Model NMW RNMW
0.00
0.2
Kaplan−Meier RNMW NMW
0
20
40
60
80
100
0
20
40
60
x
X
(a)
(b)
80
100
Figure 4.11: For drug data: (a) Empirical and fitted survival functions; (b) Nonparametric and fitted hazard rate functions. be approximated as J −1 , 2.801 × 10−4 −8.519 × 10−5 1.138 × 10−4 J −1 = −8.519 × 10−5 4.335 × 10−5 −6.037 × 10−5 1.138 × 10−4 −6.037 × 10−5 8.684 × 10−5
.
So, approximate 95 percent confidence intervals for the parameters α, β and λ are [5.553 × 10−3 , 0.071], [0, 0.019] and [8.137 × 10−3 , 0.045], respectively. Serum-reversal data The Serum-reversal data consists of serum-reversal time in days of one hundred and forty eight children contaminated with HIV from vertical transmission at the university hospital of the Ribeiro Preto School of Medicine (Hospital das Clnicas da Faculdade de Medicina de Ribeiro Preto) from 1986 to 2001, cf. Perdona (2006) and Silva (2004). The scaled TTT-Transform plot for this data is shown in Figure 4.12, which takes a convex shape followed by a concave shape. This corresponds to a bathtub shaped
4.10 Applications
135
Table 4.8: MLEs of parameters, standard errors, AIC, BIC, AICc and CAIC for serumreversal data. b α b βb γ b θb λ AIC BIC AICc CAIC 1.74 × 10−3 6.141 × 10−4 0.542 0.438 0.015 783.8 798.8 784.4 803.8 (3.115 × 10−3 ) (2.274 × 10−3 ) (0.507) (0.763) (3.764 × 10−3 ) 1 1 RNMW 1.799 × 10−3 5.955 × 10−4 0.014 780.1 789.1 780.3 792.1 2 2 (1.971 × 10−3 ) (4.174 × 10−4 ) − − (2.061 × 10−3 ) Model NMW
Table 4.9: K-S statistics for models fitted to serum-reversal data. Model NMW RNMW
K-S 0.115 0.107
HF. 1 0.9
Scaled TTT−Transform
0.8 0.7 0.6 0.5 0.4 0.3 0.2 0.1 0 0
0.1
0.2
0.3
0.4
0.5 X
0.6
0.7
0.8
0.9
1
Figure 4.12: TTT-transform plot for the serum-reversal data. Tables 4.8 and 4.9 show the MLEs of the parameters, corresponding standard errors, AIC, BIC, AICc, CAIC and the K-S test statistics. We see that the RNMW distribution has smaller values for AIC, BIC, AICc and CAIC. The K-S statistic is only slightly larger for the NMW distribution. Figures 4.13a-d show that both distributions fit the data adequately. However, the log-likelihood ratio statistic for testing H0 : θ = γ =
1 2
versus H1 : H0 is false is
ω = 0.194 with the corresponding p-value of 0.908. Hence, again there is no evidence that the NMW distribution provides a better fit than the RNMW distribution. The variance-covariance matrix for the estimated parameters of the RNMW may
136
Nonpar RNMW NMW
0.005
0.4
0.010
h(x)
S(x)
0.6
0.015
0.8
0.020
1.0
0.025
4.11 Summary
0.0
0.000
0.2
Kaplan−Meier RNMW NMW
0
50
100
150
200
250
300
350
0
100
200
x
X
(a)
(b)
300
Figure 4.13: For serum data: (a) Empirical and fitted survival functions; (b) Nonparametric and fitted hazard rate functions. be approximated as J −1 , 3.886 × 10−6 −4.245 × 10−7 1.990 × 10−6 J −1 = −4.245 × 10−7 1.742 × 10−7 −8.445 × 10−7 1.990 × 10−6 −8.445 × 10−7 4.246 × 10−6
.
So, approximate 95 percent confidence intervals for the parameters α, β and λ are [0, 5.662 × 10−3 ], [0, 1.414 × 10−3 ] and [0.010, 0.080], respectively.
4.11
Summary
In this chapter, we reduced the number of parameters of the new modified Weibull distribution introduced in chapter 3 from five to three parameters to simplify the distribution. We studied the mathematical properties of the reduced distribution, including the hazard function, moments, order statistics and Renyi entropy. The estimation of the reliability P (X < Y ) was studied. The maximum likelihood estimation of the parameters was discussed. Two applications of complete and censoring data were presented and it has shown that the reduced distribution fits the data as good as the original new modified Weibull distribution, but better than its sub-models.
Chapter 5 Exponentiated Reduced Modified Weibull Distribution 5.1
Introduction
Chapter 4 introduced a three-parameter modified Weibull distribution called the reduced new modified Weibull (RNMW) distribution. Its CDF, PDF and HF are given in (4.1), (4.3) and (4.4) respectively. The RNMW distribution can exhibit bathtub shaped HFs but not more other complicated shapes. The aim of this chapter is to introduce a four-parameter generalization that can accommodate monotonically increasing, bathtub shaped, unimodal and modified unimodal HFs. The new distribution will be called the Exponentiated Reduced Modified Weibull Distribution and abbreviated ERMW. The contents of this chapter are organized as follows. The new distribution is introduced in Section 5.2. Some special cases of the ERMW distribution are presented in Section 5.3. The shapes of the PDF and the HF of the ERMW distribution are studied in Section 5.4. The moments of the ERMW distribution are given in Section 5.5. Section 5.6 and 5.7 discuss order statistics and maximum likelihood estimates of the unknown parameters of the ERMW distribution including a simulation study to assess the performance of the MLEs. Two real data applications of the ERMW distribution are given in Sections 5.8. One of these data sets has a bathtub shaped HF and the other has a unimodal HF. Section 5.9 summaries the chapter.
5.2 The ERMW distribution
5.2
138
The ERMW distribution
Let X denote a random variable having the ERMW distribution. Its CDF is defined by exponentiating the CDF of the RNMW distribution. That is, we take the CDF of X as [ √ √ λx ]θ F (x) = 1 − e−α x−β xe , x>0
(5.1)
where α > 0, β > 0, λ > 0 and θ > 0. Here, α and β are scale parameters, λ is an acceleration parameter and θ is a shape parameter. The corresponding PDF and HF are ]θ−1 √ √ √ λx √ ][ θ [ λx −α x−β xeλx f (x) = √ α + β(1 + 2λx)e 1−e e−α x−β xe , x > 0 (5.2) 2 x and √ √ λx ]θ−1 √ λx √ [ ][ θ α + β(1 + 2λx)eλx 1 − e−α x−β xe e−α x−β xe { h(x) = , x>0 [ ]θ } √ √ √ −α x−β xeλx 2 x 1− 1−e
(5.3)
where α > 0, β > 0, λ > 0 and θ > 0. If the parameter θ is a positive integer, the ERMW distribution can be interpreted as the lifetime distribution of a parallel system of θ independent and identically distributed components, where each component is a serial system with two independent components: one of which follows the Weibull distribution with parameters α and 1 , 2
and the other follows the modified Weibull distribution of Lai et al. (2003) with
parameters β,
1 2
and λ.
Using the series expansion of (1 − x)θ−1 , we have (
)θ−1 √ √ −α x−β xeλx
1−e
=
∞ ∑ (−1)j Γ(θ) j=0
Γ(θ − j)j!
e−jα
√
√ x−jβ xeλx
,
(5.4)
the PDF in (5.2) can be expressed as ∞ ∑ (−1)j Γ(θ + 1) f (x) = fRNMW (x; αj+1 , βj+1 , λ), Γ(θ − j)(j + 1)! j=0
(5.5)
for x > 0, where ϕj+1 = (j + 1)ϕ and fRNMW (x; α, β, λ) is the PDF of the RNMW in (4.3). So, the PDF of the ERMW distribution is a linear combination of the PDFs of the RNMW distribution.
5.3 Special cases
139
The PDF in (5.2) can also be expressed as f (x) = hRNMW (x) e−α
√
√ x−β xeλx
(
1 − e−α
√
)θ−1 √ x−β xeλx
,
(5.6)
for x > 0, where hRNMW (x) is the HF of the RNMW distribution in (4.4). Figure 5.1 shows possible shapes of the PDF in (5.2). We can see that monotonically decreasing, unimodal and monotonically decreasing followed by unimodal shapes are possible for the PDF. Monotonically decreasing shapes correspond to small values of θ. Unimodal shapes correspond to large values of θ. The location and the magnitude of the mode become larger as θ becomes larger. Figure 5.2 shows possible shapes of the HF in (5.3). We can see that monotonically increasing, bathtub, unimodal and modified unimodal shapes are possible for the HF.
1.5 0.0
0.5
1.0
f(x)
2.0
2.5
α = 5,β = 0.5,λ = 0.5,θ = 15 α = 2,β = 0.5,λ = 2,θ = 15 α = 2,β = 0.5,λ = 2,θ = 0.5 α = 0.25,β = 0.5,λ = 2,θ = 0.75 α = 0.1,β = 0.05,λ = 5,θ = 0.5 α = 2,β = 0.5,λ = 2,θ = 5
0.0
0.5
1.0
1.5
x
Figure 5.1: PDF of the ERMW distribution for selected α, β, λ and θ.
5.3
Special cases
The ERMW distribution includes as special cases distributions which are special cases of several distributions widely used in survival analysis:
140
6 4
h(x)
8
10
12
5.3 Special cases
0
2
α = 5,β = 0.5,λ = 0.1,θ = 5 α = 3,β = 3,λ = 0.5,θ = 5 α = 1.5,β = 0.75,λ = 1.5,θ = 15 α = 2,β = 0.5,λ = 1,θ = 0.5 α = 2.5,β = 0.5,λ = 2.5,θ = 5
0.0
0.5
1.0
1.5
2.0
2.5
x
Figure 5.2: The HF of the ERMW distribution. 1. The reduced generalized modified Weibull (RGMW) distribution: If α = 0, the ERMW distribution reduces to the RGMW distribution specified by the CDF ( √ λx )θ F (x) = 1 − e−β xe , a special case of the GMW distribution of Carrasco et al. (2008) when its first shape parameter is equal to
1 . 2
The RGMW distribution has just three
parameters. Its HF can be monotonically increasing, bathtub shaped, unimodal or unimodal following by increasing. Not many distributions have this property, especially with three parameters. Figure 5.3 shows possible shapes of the PDF and the HF of the RGMW distribution. 2. The reduced exponentiated Weibull (REW) distribution: When α = λ = 0 or β = λ = 0, the ERMW distribution reduces to the REW distribution specified by the CDF ( √ )θ F (x) = 1 − e−α x , a special case of the EW distribution due to Mudholkar and Srivastava (1993). The PDFs and the HFs of the REW distribution are shown in Figure 5.4. 3. The reduced Lai et al.’s modified Weibull (RMW) distribution: For α = 0 and θ = 1, the ERMW distribution reduces to the RLMW distribution
15
141
3.5
5.3 Special cases
10
1.0
5
1.5
f(x)
h(x)
2.0
2.5
3.0
β = 1,λ = 2,θ = 15 β = 4,λ = 0.75,θ = 5 β = 5,λ = 0.05,θ = 15 β = 0.25,λ = 2,θ = 0.75 β = 0.1,λ = 5,θ = 0.5 β = 1,λ = 0.5,θ = 0.5
0
0.0
0.5
β = 6,λ = 0.25,θ = 5 β = 12,λ = 0.05,θ = 5 β = 3,λ = 1,θ = 1 β = 1,λ = 0.7,θ = 0.5 β = 1.5,λ = 0.75,θ = 5 β = 3,λ = 0.75,θ = 7
0.0
0.5
1.0
1.5
0.0
0.5
1.0
1.5
x
x
(a)
(b)
2.0
2.5
3.5
Figure 5.3: (a) The PDF of the RGMW distribution, (b) The HF of the RGMW distribution.
5
β = 6,θ = 5 β = 2.5,θ = 5 β = 2,θ = 1.5 β = 5,θ = 20 β = 1,θ = 0.755
3 0
0.0
0.5
1
1.0
2
1.5
f(x)
h(x)
2.0
4
2.5
3.0
β = 6,θ = 10 β = 2,θ = 0.75 β = 5,θ = 25 β = 0.75,θ = 0.25
0.0
0.5
1.0
1.5
0
2
4
x
x
(a)
(b)
6
8
Figure 5.4: (a) The PDF of the REW distribution, (b) The HF of the REW distribution.
5.4 Shape
142
specified by the CDF F (x) = 1 − e−β
√
xeλx
,
a special case of the MW distribution due to Lai et al. (2003). 4. The reduced Weibull (RW) distribution: By setting β = λ = 0 and θ = 1, we can reduce the ERMW distribution to the RW distribution specified by the CDF F (x) = 1 − e−α
√
x
.
We can also get a RW distribution by setting λ = 0 and θ = 1.
5.4
Shape
Here, we discuss shapes of the PDF in (5.2) and the HF in (5.3). The derivative of log f (x) with respect to x is [ ] (θ − 1) α + β(1 + 2λx)eλx d log f (x) βλ(3 + 2λx)eλx ) = + √ ( √ √ dx α + β(1 + 2λx)eλx 2 x eα x+β xeλx − 1 −
α β(1 + 2λx)eλx 1 √ − √ − . 2x 2 x 2 x
So, the modes of f (x) at say x = x0 are the roots of to a local maximum (see Figure 5.1) if
d log f (x) dx
d log f (x) dx
= 0. A mode corresponds
> 0 for all x < x0 and
all x > x0 . A mode corresponds to a local minimum (see Figure 5.1) if all x < x0 and
d log f (x) dx
d log f (x) dx d log f (x) dx
< 0 for < 0 for
> 0 for all x > x0 .
The derivative of log h(x) with respect to x is )θ−1 √ √ [ ]( −α x−β xeλx λx 1−e d log f (x) θ α + β(1 + 2λx)e d log h(x) ] . [ = + √ √ √ ( √ √ λx )θ λx dx dx x+β xe −α x−β xe α 1− 1−e 2 xe So, the modes of h(x) at say x = x0 are the roots of
d log h(x) dx
= 0. The mode corresponds
to a local maximum (see, for example, the top left plot in Figure 5.6) if all x < x0 and
d log h(x) dx
d log h(x) dx
> 0 for
< 0 for all x > x0 . The mode corresponds to a local minimum
(see, for example, Figure 5.5) if
d log h(x) dx
< 0 for all x < x0 and
d log h(x) dx
> 0 for all
x > x0 . The mode corresponds to a point of inflexion (see, for example, the bottom
h(x)
0.04 0.00
0.02
h(x)
0.06
0.08
α = 0.2,β = 5e−04,λ = 0.005,θ = 0.5 α = 0.25, 0.28, 0.31, . . ., 0.49 β = 8e−04, 9e−04, 10e−04,. . ., 16e−04 λ = .0065,0.0067,0.0069,...0.0081
0
200
400
600
800
1000 1200
0.000 0.005 0.010 0.015 0.020 0.025
143
0.10
5.4 Shape
θ = 1,2,3,4,5,10,20,30,120
0
200
400
600
X
X
(a)
(b)
800
1000
Figure 5.5: The HF of the ERMW distribution as α changes. right plot in Figure 5.6) if either
d log h(x) dx
> 0 for all x ̸= x0 or
d log h(x) dx
< 0 for all
x ̸= x0 . The property of a long useful lifetime period, exhibited by the bathtub shaped HF seen in the NMW and RNMW distributions, which are presented in Chapter 3 and Chapter 4, also holds for the ERMW distribution, see Figure 5.5 (a). Figure 5.5 (a) shows how the bathtub shaped HF of the ERMW distribution is affected by the parameters β, λ and α. The curve of open red circles is the bathtub shaped HF when α = 0.2, β = 5 × 10−4 , λ = 0.005, θ = 0.5. The blue curves in this figure are the HF at the same values of α, β and λ, while α increases from 0.25 to 0.49 in steps of 0.03. Increasing the value of this parameter has the effect of scaling the bathtub shape slightly up. The green dash curves and the pink dot curves are, respectively, the HF when β = 8 × 10−4 , 9 × 10−4 , . . . , 16 × 10−4 and λ = 0.0065, 0.0067, . . . , 0.0081. Increasing the value of these parameters has the effect of shortening the useful life period. That is, increasing the value of β and λ reduces the survival time of the system. Figure 5.5 (b) shows the role of the shape parameter θ and how it turns the HF from being bathtub shaped to unimodal and to increasing. The HF is bathtub shaped when θ ≤ 2. It is unimodal when θ > 2. The HF increases for large values of θ. Figures 5.6 (a), (b), (c), (d) show how the unimodal HFs of the ERMW distribution are affected by the parameters β, λ, θ and α. (Here, by unimodal HF we mean HF taking a unimodal shape followed by a monotonic increasing shape.) The curve of open
α = 0.1,β = 1e−07,λ = 0.007,θ = 3.5 α = 0.11, 0.12, 0.13, . . ., 0.19 β = 2e−07, 3e−07, 4e−07,. . ., 10e−07 λ = .0095,0.0097,0.0099,...0.0111
h(x) 500
1000
0
1500
500
1000
X
X
(a)
(b)
1500
0.00
β = 0.025,0.050,0.075,...,0.225
0
50
100 150 200 250 300 350 X
(c)
0.004
λ = 0.125,0.150,0.175,...,0.330
0.000
0.02
0.002
h(x)
0.04
0.06
0.006
0
h(x)
0.002
0.004
θ = 1,2,3,4,5,10,20,30,40
0.000
h(x)
144
0.000 0.002 0.004 0.006 0.008 0.010
5.4 Shape
0
20
40
60
80
100
120
X
(d)
Figure 5.6: The HF of the ERMW distribution as θ changes. red circles in Figure 5.6 (a) is a unimodal HF of the ERMW distribution. Increasing the value of α has the effect of scaling the unimodal shape. A slight increase of β and λ has the effect giving an earlier start for the monotonic increasing part of the HF. That is, the survival time of the system decreases as β and λ increase slightly. A sharp increase of β and λ has the effect of turning the unimodal HF into an increasing HF, see Figures 5.6 (c) and 5.6 (d). Increasing values of θ have the effect of changing the HF from being bathtub shaped to unimodal to increasing, see Figure 5.6 (b).
5.5 Moments
5.5
145
Moments
Let X denote an ERMW random variable. Using (5.5), the rth raw moment of X say ′
µr can be expressed as ∞ ∑ (−1)j Γ(θ + 1) ′ µr = µ (j + 1)!Γ(θ − j) r,RNMW(αj+1 ,βj+1 ,λ) j=0 ′
(5.7)
′
for r ≥ 1, where µr,RNMW(α,β,λ) denotes the rth raw moment of a random variable having the RNMW distribution with parameters (α, β, λ). Using (5.7) and expressions ′
for µr,RNMW(α,β,λ) given in (4.8), one can obtain expressions for the mean, variance, 0.25 0.20
λ = 0.5 λ=1 λ=2 λ=5
0.15
Variance
0.3 0.0
0.00
0.1
0.05
0.2
Mean
0.4
0.5
λ = 0.5 λ=1 λ=2 λ=5
0.10
0.6
skewness and kurtosis of X.
0.0
0.5
1.0
1.5
2.0
2.5
3.0
0.0
0.5
1.0
2.5
3.0
2.5
3.0
200
θ
λ = 0.5 λ=1 λ=2 λ=5
0
0
50
5
Kurtosis
Skewness
150
λ = 0.5 λ=1 λ=2 λ=5
10
2.0
100
15
θ
1.5
0.0
0.5
1.0
1.5
2.0
2.5
3.0
0.0
0.5
1.0
θ
1.5
2.0
θ
Figure 5.7: Mean, variance, skewness and kurtosis of the ERMW distribution versus θ for selected λ and α = β = 1. Figures 5.7 and 5.8 show how the mean, variance, skewness and the kurtosis of the ERMW distribution vary with respect to λ and θ for α = β = 1. We can observe the following from the figures: mean is a monotonic increasing function of θ and a monotonic decreasing function of λ; variance is a monotonic increasing function of θ and a monotonic decreasing function of λ; skewness is a monotonic decreasing function of θ and a monotonic decreasing function of λ; kurtosis is a monotonic decreasing function of θ and a monotonic decreasing function of λ.
5.6 Order statistics
146
1.5
2.0
2.5
3.0
θ = 0.5 θ=1 θ=2 θ=5
1.0
Variance
1.0
0.0
0.5
0.5
Mean
1.5
θ = 0.5 θ=1 θ=2 θ=5
0.0
0.5
1.0
1.5
2.0
2.5
3.0
0.0
0.5
1.0
2.5
3.0
2.5
3.0
θ = 0.5 θ=1 θ=2 θ=5
60 40
4
Kurtosis
80
θ = 0.5 θ=1 θ=2 θ=5
6
2.0
λ
0
0
20
2
Skewness
1.5
100
λ
0.0
0.5
1.0
1.5
2.0
2.5
3.0
0.0
λ
0.5
1.0
1.5
2.0
λ
Figure 5.8: Mean, variance, skewness and kurtosis of the ERMW distribution versus λ for selected θ and α = β = 1.
5.6
Order statistics
This section discusses the order statistic, which have many applications in reliability and lifetime analysis. We derive the probability density functions of the order statistics X(r) , and its moments, for the ERMW distribution. If X1 , X2 , · · · , Xn are a random sample from the ERMW with CDF (5.1) and pdf (5.2), and X(1) ≤ X(2) ≤ · · · ≤ X(n) are the order statistics from this sample, then, from Arnold el at (2008), using (3.12) the pdf of the r-th statistic X(r) is given by ) n−r ( ∑ 1 n−r fr:n (x) = (−1)ℓ f (x)F (x)ℓ+r−1 , B (r, n − r + 1) ℓ=0 ℓ ( ) n−r ( ) n − 1 ∑ n − r (−1)ℓ f (x; α, β, λ, θℓ+r ), = n (ℓ + r) r − 1 ℓ=0 ℓ where B(., .) is the beta function and f (x; α, β, λ, θℓ+r ) is the pdf of the ERMW with parameters α, β, λ and (ℓ + r)θ. Using (5.7), the kth non-central moment of the rth order statistic is then
5.7 Estimation
′ (r:n)
µk
147
′ ) ( ) n−r ∞ ( ℓ+j n − 1 ∑ ∑ n − r (−1) Γ(θℓ+r )µk,RNMW(αj+1 ,βj+1 ,λ) =n , r − 1 ℓ=0 j=0 ℓ (ℓ + r)(j + 1)!Γ(θℓ+r − j)
(5.8)
′
where µk,RNMW(α,β,λ) denotes the kth raw moment of a random variable having the RNMW distribution given in (4.8) and θℓ+r = (ℓ + r)θ.
5.7
Estimation
Suppose x1 , x2 , . . . , xn is a random sample from the ERMW distribution with unknown parameters (α, β, λ, θ). Section 5.7.1 estimates these parameters by the method of maximum likelihood. Section 5.7.2 assesses the finite sample performance of the MLEs with respect to sample size n.
5.7.1
Maximum likelihood estimation
Given the data x1 , . . . , xn , the log-likelihood function of (α, β, λ, θ) is n ∑ ] [ √ √ L (α, β, λ, θ) = n log(θ) + log (hRNMW (xi )) − α xi − β xi eλxi i=1
+(θ − 1)
n ∑
[ √ √ λx ] log 1 − e−α xi −β xi e i .
i=1
By setting the first partial derivatives of L with respect to α, β, λ and θ to zero, we obtain the normal equations √ n n ∑ ∑ (θ − 1) xi √ 1 ( √ )− = 0, (5.9) xi + √ √ λx h (xi ; α, β, λ) 2 xi eα xi +β xi e i − 1 i=1 RNMW i=1 i=1 √ n n n ∑ ∑ ∑ (θ − 1) xi eλxi (0.5 + λxi ) eλxi λxi √ e xi + = 0,(5.10) √ √ λx √ − h (xi ; α, β, λ) xi eα xi +β xi e i − 1 i=1 RNMW i=1 i=1 ( ) √ n n √ n √ ∑ ∑ ∑ xi 32 + λxi eλxi (θ − 1) x3i eλxi λxi 3 −β e = 0,(5.11) β xi + √ √ α xi +β xi eλxi − 1 h (x ; α, β, λ) e RNMW i i=1 i=1 i=1 n [ ] ∑ √ √ n λx + log 1 − e−α xi −β xi e i = 0. (5.12) θ i=1 n ∑
The MLEs can be obtained by solving the nonlinear equations, (5.9)-(5.12), numerically for α, β, λ and θ. To obtain confidence intervals for α, β, λ and θ, we use the observed information matrix since the expected information matrix is very complicated and the MLEs of
5.7 Estimation
148
the unknown parameters cannot be obtained analytically. The observed information matrix J(ϑ) is J(ϑ) = −
Lαα Lαβ Lαλ Lαθ
Lββ Lβλ Lβθ . Lλλ Lλθ Lθθ
where ϑ = (α, β, λ, θ) and the explicit expressions for the elements of this matrix are given in the appendix C. Under conditions that are fulfilled for parameters in the interior of the param) √ (b eter space but not on the boundary, the asymptotic distribution of n ϑ − ϑ is N4 (0, I(ϑ)−1 ), where I(ϑ) is the expected information matrix. This asymptotic behavb i.e., the observed information matrix evaluated ior is valid if I(ϑ) is replaced by J(ϑ), b The asymptotic multivariate normal N4 (0, J(ϑ) b −1 ) distribution can be used to at ϑ. construct approximate confidence intervals and confidence regions for the individual parameters.
5.7.2
Simulation study
Here, we assess the performance of the MLEs with respect to sample size n. The assessment is based on a simulation study: 1. First, ten thousand samples of size n are generated from (5.1). Using the inversion method samples were generated, that was done for the ERMW distribution by solving (
1 − e−α
√
)θ √ X−β XeλX
= U,
where U ∼ U (0, 1) is a uniform variate on the unit interval. ) ( bi , θbi for 2. Obtain the MLEs for the ten thousand generated samples, say α bi , βbi , λ i = 1, 2, . . . , 10000. 3. For the generated samples, compute the standard errors of the MLEs, say ( ) sαbi , sβbi , sλbi , sθbi for i = 1, 2, . . . , 10000. The standard errors computed by using the observed information matrices.
5.7 Estimation
149
4. The biases and mean squared errors of the MLEs can be computed as the following, biash (n) =
10000 ) 1 ∑ (b hi − h , 10000 i=1
10000 )2 1 ∑ (b MSEh (n) = hi − h , 10000 i=1
for h = α, β, λ, θ. The above steps were repeated n = 10, 11, . . . , 100 with α = 1, β = 1, λ = 1 and θ = 1, so computing biash (n) and MSEh (n) for h = α, β, λ, θ and n = 10, 11, . . . , 100. Figure 5.9 shows the biases of the MLEs of (α, β, λ, θ) versus n = 10, 11, . . . , 100, and it can be seen that the biases for the four parameters are small and vary with respect to the samples sizes. The mean squared errors of the MLEs of each parameters are shown in Figure 5.10, which are vary with respect to the samples sizes. The broken line in Figure 5.9 indicates to the distance between the biases and the zero. The broken line in Figure 5.10 indicates to the distance between the mean squared errors and the
0.00 −0.02 −0.06
−0.04
Bias of MLE of beta
0.020 0.010 0.000
Bias of MLE of alpha
0.030
zero.
20
40
60
80
100
20
40
80
100
60
80
100
0.04 0.02 0.00
0.02
0.04
0.06
Bias of MLE of theta
0.08
0.06
n
0.00
Bias of MLE of lambda
n
60
20
40
60 n
80
100
20
40 n
Figure 5.9: Biases of the MLEs of (α, β, λ, θ) = (1, 1, 1, 1) versus n = 10, 11, . . . , 100.
150
0.0030 0.0010
0.0020
MSE of MLE of beta
0.008 0.006 0.004 0.002
MSE of MLE of alpha
0.010
0.0040
5.8 Applications
20
40
60
80
100
20
40
80
100
60
80
100
0.010 0.000
0.005
MSE of MLE of theta
0.15 0.10 0.05 0.00
MSE of MLE of lambda
60 n
0.015
n
20
40
60 n
80
100
20
40 n
Figure 5.10: Mean squared errors of the MLEs of (α, β, λ, θ) = (1, 1, 1, 1) versus n = 10, 11, . . . , 100. From these figures the following observations can be made. The biases of the MLEs of the parameters α, λ and θ are generally positive; the biases of the MLEs of the parameter β are generally negative; among the four biases, the biases of the MLEs of the parameter α are the smallest; the biases of the MLEs of the parameter λ are the largest; the biases of the MLEs of the parameters α, λ and θ decrease to zero as n → ∞; the biases of the MLEs of the parameter β increase to zero as n → ∞; the mean squared errors for the parameter β are the smallest; the mean squared errors for the parameter λ are the largest; the mean squared errors for all four parameters decrease to zero as n → ∞; The above observations are observed by choosing (α, β, λ, θ) = (1, 1, 1, 1). A similar results were found for other choices.
5.8
Applications
This section uses two well-known data sets to show how the proposed distribution can be applied in practice to provide good fits. The HF of the first data set is modified
5.8 Applications
151
unimodal shape. That of the second data set is bathtub shaped. The proposed distribution will be compared to the four-parameter GMW distribution, the three-parameter RGMW distribution, the two-parameter REW distribution and the three-parameter EW distribution. The sample size for the first data set is seventy two. The sample size for the second data set is forty four. b λ b and θb can be expected to be less than 0.01, 0.02, 0.02 Hence, the biases for α b, β, b λ b and and 0.02, respectively, for both data sets. The mean squared errors for α b, β, θb can be expected to be less than 0.005, 0.003, 0.02 and 0.005, respectively, for both data sets. Hence, the point estimates given in Section 5.8 can be considered accurate enough for both data sets. The likelihood ratio test will be used to compare the GMW distribution against the RGMW distribution by testing the hypotheses H0 : γ =
1 2
versus H1 : H0 is false.
Under the null hypothesis, the likelihood ratio test statistic ω = 2 (LGMW − LRGMW ) has an asymptotic χ2 distribution with one degree of freedom. The EW distribution will be compared against the REW distribution by testing the hypotheses H0 : γ =
1 2
versus H1 : H0 is false. Under the null hypothesis, the likelihood ration test statistic ω = 2 (LEW − LREW ) has an asymptotic χ2 distribution with one degree of freedom.
5.8.1
Infected pigs data
The data in Table 5.1 are survival times (in days) of seventy two pigs infected by virulent tubercle bacilli (Greenwich, 1992). The TTT plot in Figure 5.11 shows a concave shape and then a convex shape followed by a concave shape. This corresponds to the HF being modified unimodal shape. Hence, the ERMW distribution is suitable for this data, see Section 5.2. Table 5.1: Infected pigs data (in days). 43 81 101 137 243
45 82 102 138 249
53 83 102 139 329
56 83 102 144 380
56 84 103 145 403
57 88 104 147 511
58 66 67 73 74 79 80 80 81 81 89 91 91 92 92 97 99 99 100 100 107 108 109 113 114 118 121 123 126 128 156 162 174 178 179 184 191 198 211 214 522 598
5.8 Applications
152
1 0.9
Scaled TTT−Transform
0.8 0.7 0.6 0.5 0.4 0.3 0.2 0.1 0
0
0.2
0.4
0.6
0.8
1
X
Figure 5.11: TTT-transform plot for the infected pigs data. Table 5.2 shows the MLEs of the parameters, their standard errors, AIC values, BIC values, AICc values and CAIC values for the fitted ERMW, GMW, RGMW, REW and EW distributions. The ERMW distribution has the smallest negative log-likelihood of 399.898. The negative log-likelihood of the GMW distribution is 400.350. The REW distribution has the smallest values for the AIC, the BIC the AICc and the CAIC. Given these observations, one could be tempted to say that the REW distribution provides the best fit. Table 5.3 shows the K-S test statistics for the fitted distributions. The values of K-S statistics are nearly the same for all fitted distributions. All of them are about 0.11. Figure 5.12 (a) shows the histogram of the data and the estimated PDFs. Figure 5.12 (b) shows empirical survival function of the data and the estimated ones. Figure 5.12 (d) shows the nonparametric HF of the data and the estimated HFs. Figures 5.12a and 5.12b show that all of the distributions provide good fits. Figure 5.12d shows that all of the distributions provide good fits to the first and middle parts of the nonparametric HF. But the GMW, RGMW, REW and the EW distributions do not appear to capture the last part of the nonparametric HF well. Only the ERMW distribution appears to provide a good fit to the last part of the nonparametric HF. Since the differences in the likelihood and the differences in the AIC, BIC, AICc and CAIC measures are small among the fitted distributions, we conclude that the ERMW
5.8 Applications
153
Table 5.2: MLEs of parameters, standard errors, AIC, BIC, AICc and CAIC for the distributions fitted to the infected pigs data set. α b 0.412 (0.042) RGMW 0 − REW 0.423 0.042 GMW − − EW − − Model ERMW
b βb γ b λ 6.396 × 10−8 − 0.022 (7.109 × 10−7 ) − (0.019) 0.422 − 1.108 × 10−8 (0.108) − 4.885 × 10−4 0 − 0 − − − 0.496 0.470 4.639 × 10−9 (0.247) (0.008) 4.573 × 10−4 0.471 0.478 0 (0.254) 0.081 −
θb 57.562 (22.924) 63.403 (50.557) 36.517 (25.683) 69.877 (50.012) 65.135 (49.625)
AIC BIC AICc CAIC 807.8 816.9 808.4 820.9 807.2 814.0 807.5
817.0
805.2 809.7 805.3
811.7
808.7 817.8 809.3
821.8
806.9 813.7 807.2
816.7
Table 5.3: K-S statistics for the distributions fitted to the infected pigs data set. Model ERMW RGMW REW GMW EW
K-S 0.112 0.110 0.111 0.114 0.110
distribution gives the best fit. The ERMW distribution is the only one that captures the nonparametric HF well in all three parts. The variance-covariance matrix for the fitted ERMW distribution may be approximated as J −1 , 1.739 × 10−3 −4.108 × 10−10 −1 J = 4.366 × 10−6 0.913
−10
−4.108 × 10
5.054 × 10−13 −1.351 × 10−8 −2.119 × 10−7
4.366 × 10
−6
0.913
−1.351 × 10−8 −2.119 × 10−7 . −4 −3 3.655 × 10 2.195 × 10 −3 2.195 × 10 525.529
So, approximate ninety five percent confidence intervals for the parameters α, β, λ and θ are [0.331, 0.494], [0, 1.457 × 10−6 ], [0, 0.06] and [12, 102], respectively. Finally, we give results of likelihood ratio tests. The log-likelihood ratio statistic for testing H0 : γ =
1 2
in (2.10) versus H1 : H0 (testing the GMW against the RGMW)
is false is ω = 0.445 and the corresponding p-value is 0.505. So, there is no evidence to reject the null hypothesis at any reasonable level of significance. Therefore, the RGMW distribution can be chosen as an alternative to the GMW distribution for modeling the data set.
154
0.0
0.000
0.2
0.002
0.4
0.004
f(x)
S(x)
0.6
ERMW GMW RGMW REW EW
0.006
Nonpar ERMW GMW RGMW REW EW
0.8
0.008
1.0
0.010
5.8 Applications
0
100
200
300
400
500
600
100
200
300
x
400
500
600
x
(a)
(b)
0.025
1
0.020
0.9
0.8
0.010
0.015
0.6
h(x)
0.5
0.4
0.005
Scaled TTT−Transform
0.7
Nonpar ERMW GMW RGMW REW EW
0.3
0.000
0.2
0.1 Empirical ERMW 0
0
0.1
0.2
0.3
0.4
0.5 X
(c)
0.6
0.7
0.8
0.9
100
200
300
400
500
600
1
X
(d)
Figure 5.12: For infected pigs data: (a) Histogram and fitted PDFs; (b) Empirical and fitted survival functions; (c) Empirical and fitted TTT-transforms; (d) Nonparametric and fitted HFs.
5.8 Applications
155
The log-likelihood ratio statistic for testing H0 : γ =
1 2
in (1.6) versus H1 : H0
(testing the EW against the REW) is false is ω = 0.294 and the corresponding pvalue is 0.588. So, the null hypothesis could not be rejected. Therefore, the REW distribution can be chosen as an alternative to the EW distribution for modeling the data set.
5.8.2
Kumar data
Kumar et al. (1989) presented data consisting of times between failures (TBF) in days of load-haul-dump machines (LHD) used to pick up rock or waste. The TTT plot in Figure 5.13 shows a convex shape followed by a concave shape. This corresponds to a bathtub shaped HF. Hence, the ERMW, GMW, RGMW and the EW distributions are appropriate for modeling this data. The REW distribution is not appropriate as it does not exhibit a bathtub shaped HF. 1 0.9
Scaled TTT−Transform
0.8 0.7 0.6 0.5 0.4 0.3 0.2 0.1 0
0
0.2
0.4
0.6
0.8
1
X
Figure 5.13: TTT-transform plot for Kumar data. Tables 5.4 and 5.5 show the MLEs of the parameters, their standard errors, AIC values, BIC values, AICc values, CAIC values and K-S test statistics for the fitted ERMW, GMW, RGMW, REW and EW distributions. The ERMW distribution has the smallest negative log-likelihood of -199.882, the smallest AIC value, the smallest BIC value, the smallest AIC value, the smallest CAIC value and the smallest K-S test statistic. So, the ERMW distribution provides the best fit with respect to these criteria. This observation is confirmed by the diagnostic plots in Figure 5.14.
5.8 Applications
156
Table 5.4: MLEs of parameters, standard errors, AIC, BIC AICc and CAIC for the distributions fitted to Kumar data. b βb γ b λ θb AIC BIC AICc CAIC 4.86 × 10−4 − 0.067 1.476 407.8 414.9 408.8 418.9 (7.593 × 10−4 ) − (0.017) (0.034) 2.919 × 10−3 − 0.046 0.521 414.9 420.3 415.5 423.3 (6.530 × 10−3 ) − 0.023 (0.270) 0 − 0 3.686 450.6 454.1 450.9 456.1 (0) − − (0.880) 4.590 × 10−6 1.578 0.060 0.266 412.7 419.8 413.7 423.8 (7.693 × 10−6 ) 0.463 0.019 (0.061) 1.984 × 10−7 3.460 0 0.310 423.9 429.3 424.5 432.3 (3.158 × 10−7 ) 0.347 − (0.061)
α b 0.099 (0.049) RGMW 0 − REW 0.292 0.041 GMW − − EW − − Model ERMW
Table 5.5: K-S statistics for the distributions fitted to Kumar data. Model ERMW RGMW REW GMW EW
K-S 0.069 0.094 0.234 0.090 0.175
The variance-covariance matrix for the fitted ERMW distribution may be approximated as J −1 , 2.43 × 10−3 −1.575 × 10−5 −1 J = 3.267 × 10−4 0.023
−5
−1.575 × 10
5.766 × 10−7 −1.264 × 10−5 −1.043 × 10−4
3.267 × 10
−4
0.023
−1.264 × 10−5 −1.043 × 10−4 . −4 −3 2.83 × 10 2.176 × 10 2.176 × 10−3 0.282
So, approximate ninety five percent confidence intervals for the parameters α, β, λ and θ are [2.075 × 10−3 , 0.195], [0, 1.974 × 10−3 ], [0.034, 0.100] and [0.436, 2.516], respectively. Finally, we give results of likelihood ratio tests. The log-likelihood ratio statistic for testing H0 : γ =
1 2
in (2.10) versus H1 : H0 (testing the GMW against the RGMW)
is false is ω = 4.227 and the corresponding p-value is 0.04. So, there is evidence that the null hypothesis can be rejected at the five percent significance level. Therefore, the RGMW distribution cannot be chosen as an alternative to the GMW distribution for modeling the data set. As reported before, the REW distribution does not exhibit bathtub shaped HFs.
0.020
0.8
Nonpar ERMW GMW RGMW REW EW
0.4
0.010
S(x)
0.6
0.015
ERMW GMW RGMW REW EW
0.0
0.000
0.2
0.005
f(x)
157
1.0
5.8 Applications
0
20
40
60
80
100
0
20
40
x
(a)
80
(b) 0.25
1
0.9
Nonpar ERMW GMW RGMW REW EW
0.20
0.8
0.15
0.7
0.6
0.10
h(x)
0.5
0.4
0.05
Scaled TTT−Transform
60 x
0.3
0.00
0.2
0.1 Empirical ERMW 0
0
0.1
0.2
0.3
0.4
0.5 X
(c)
0.6
0.7
0.8
0.9
0
20
40
60
80
1
X
(d)
Figure 5.14: For Kumar data: (a) Histogram and fitted PDFs; (b) Empirical and fitted survival functions; (c) Empirical and fitted TTT-transforms; (d) Nonparametric and fitted HFs.
5.9 Summary
158
The following result of the likelihood ratio test is an outcome of this inability. The loglikelihood ratio statistic for testing H0 : γ =
1 2
in (1.6) versus H1 : H0 (testing the EW
against the REW) is false is ω = 28.631 and the corresponding p-value is 8.759 × 10−8 . So, the null hypothesis can be rejected at any level of significance greater than or equal 8.759 × 10−8 .
5.9
Summary
A new four-parameter distribution named the exponentiated reduced modified Weibull distribution has been introduced. It is a generalization of the reduced modified Weibull distribution of Chapter 4. The proposed distribution has the ability to capture monotonically increasing, unimodal and bathtub shaped hazard rates. We derived expressions for its mathematical properties and maximum likelihood estimation. We conducted a simulation study to assess the finite sample performance of the latter. Finally, we show that the proposed distribution gives the best fit for two well-known data sets (when compared to other distributions including those having four parameters).
Chapter 6 A New Discrete Modified Weibull Distribution 6.1
Introduction
In this chapter a three-parameter discrete distribution is introduced. It is based on a recent modification of the continuous Weibull distribution that is presented in Chapter 4. It is one of very few discrete distributions allowing for bathtub shaped hazard rate functions. We study some of its mathematical properties, discuss estimation by the method of maximum likelihood, and describe applications to four real data sets. The new distribution is shown to outperform at least three other models including the ones allowing for bathtub shaped hazard rate functions. The new discrete distribution is based on a five-parameter modification of the continuous Weibull distribution proposed in Chapter 3. The five-parameter distribution is flexible, has a bathtub shaped hazard rate function and fits data better than many other modifications of the Weibull distribution. Chapter 4 developed a three-parameter version retaining much flexibility of the five-parameter modification. This chapter proposes a discrete analogue of the three-parameter version. We shall refer to it as the Discrete reduced modified Weibull distribution and denoted as DRMW. We shall show that the discrete reduced modified Weibull distribution allows for bathtub shaped hazard functions. We shall also show it fits data better than all of the known discrete distributions allowing for bathtub shaped hazard functions.
6.2 The new distribution
160
The contents of this chapter are organized as follows. The new distribution is introduced in Section 6.2. Its hazard function and shape are established in Section 6.3. Series expansions for its survival function, probability mass function and moments are given in Sections 6.4 and 6.5. The Order statistics and the extreme value behavior of the new distribution are established in Section 6.6 and 6.7. Estimation of its parameters by the method of maximum likelihood is presented in Section 6.8. Then, applications to four real data sets are described in Section 6.9. Finally, the chapter is summarized in Section 6.10.
6.2 6.2.1
The new distribution Discrete reduced modified Weibull distribution
By retaining the survival function in (4.2) to integer valued x and setting q = exp{−α}, b = β/α and c = exp{λ}, we can write the survival and the cumulative distribution functions of the DRMW distribution as S(x) = q
√
x(1+bcx )
and F (x) = 1 − q
√ x(1+bcx )
, x = 0, 1, . . .
(6.1)
where 0 < q < 1, b > 0 and c ≥ 1. The particular case of the DRMW distribution with b = 0 is the discrete Weibull distribution DW due to Nakagawa and Osaki (1975). The DW distribution has an attractive physical feature: if X1 , . . . , Xn are independent and identical DW random variables then min (X1 , . . . , Xn ) is also a DW random variable. If X1 , . . . , Xn are the failure times of n independent and identical components of a series system then min (X1 , . . . , Xn ) will denote the failure time of the system. The probability mass function (PMF) of the DRMW distribution is P (x) = q for x = 0, 1, . . ..
√ x(1+bcx )
−q
√ x+1(1+bcx+1 )
6.3 The hazard rate function
161
As shown in Figure 6.1, the DRMW distribution is a flexible distribution. Its PMF can take one of the following shapes: i) a unimodal shape; ii) a monotonic deceasing shape; iii) a decreasing shape followed by an increasing shape followed by a decreasing shape. 0.2
0.2 q=0.95;b=1.5;c=1.15 q=0.9;b=.75;c=1.25
0.16
0.16
0.14
0.14
0.12 0.1 0.08 0.06
0.12 0.1 0.08 0.06
0.04
0.04
0.02
0.02
0
0
2
4
6
8
10 x
12
14
16
18
q=0.9;b=0.95;c=1.15 q=0.85;b=0.015;c=1.5
0.18
Probability mass functions
Probability mass functions
0.18
0
20
0
2
4
6
8
(a)
10 x
12
14
16
18
20
(b)
0.4
0.35
q=0.95;b=1.5;c=1.35 q=0.85;b=1.45;c=1.2
q=0.99;b=1.5;c=1.95 q=0.95;b=0.75;c=2
0.35
0.3
0.25 Probability mass functions
Probability mass functions
0.3
0.25
0.2
0.15
0.2
0.15
0.1
0.1 0.05
0.05
0
0
5
10
15
0
0
1
2
3
4
5
6
7
8
9
10
x
x
(c)
(d)
Figure 6.1: PMFs of the DRMW distribution.
6.3
The hazard rate function
The hazard function of the DRMW distribution is h(x) = 1 − q
√
√ x+1(1+bcx+1 )− x(1+bcx )
for x = 0, 1, . . .. Theorem 1 discuses the shape of the hazard function of the DRMW distribution. Theorem 6. The hazard function of the DRMW distribution is increasing if bc(c − √ √ 2) > 2 − 1 and has bathtub shape otherwise.
6.3 The hazard rate function
162
Proof : Define ψ(x, c, b) = bcx g(x, c) + k(x) for x = 0, 1, . . ., where √ √ √ g(x, c) = c2 x + 2 − 2c x + 1 + x, and √ √ √ x + 2 − 2 x + 1 + x.
k(x) =
It is clear that k(x) is an increasing negative valued function. Its minimum value √ √ is 2 − 2 at x = 0. When x is large k(x) −→ 0. Now, consider g(x, c) = c2 x + 2 − √ √ 2c x + 1 + x and define ∆x (c) as ∆x (c) = g(x, c) − g(x − 1, c) for x = 1, 2, . . .. Then ∆x (c) = c2 δ2 (x) − 2cδ1 (x) + δ0 (x),
(6.2)
where √ √ x − x − 1, √ √ δ1 (x) = x + 1 − x, √ √ δ2 (x) = x + 2 − x + 1. δ0 (x) =
By differentiating ∆x (c) with respect to c, ∂ ∆x (c) = 2cδ2 (x) − 2δ1 (x). ∂c
(6.3)
Setting (6.3) to zero and solving for, we obtain c0 =
δ1 (x) . δ2 (x)
(6.4)
By substituting (6.4) into (6.2), δ12 (x) ∆x (c0 ) = δ0 (x) − δ2 (x) ( δ0 (x) ) δ12 (x) δ1 (x) = −1 . δ2 (x) δ1 (x) δ2 (x)
6.4 A series expansion Since
δ0 (x) δ1 (x)
>
δ1 (x) , δ2 (x)
163
we have ∆x (c0 ) > 0. The value c0 is the minimum of ∆x (c), so
∆x (c) > 0 for x = 1, 2, . . .. So, g(x, c) is an increasing and positive function for x = 1, 2, . . . and g(0, c) > 0 √ √ ) √ ( if c > 2. The function ψ(x, c, b) > 0 for all x if bc c − 2 > 2 − 1 (in other √ ) √ ( words, if bct g(0, c) + k(0) > 0). If bc c − 2 < 2 − 1 there an exist x0 such that ψ(x, c, b) < 0 for x = 0, 1, 2, . . . , x0 and ψ(x, c, b) > 0 for x = x0 + 1, x0 + 2, . . .. Now, define v(x) as v(x) = 1 − h(x), then v(x + 1) = q ψ(x,c,b) . v(x) The proof is complete. Figures 6.2 (a)-6.2 (c) show possible bathtub shaped hazard rates while Figure 6.2d shows possible increasing hazard rates. Figure 6.3 shows that the DRMW distribution has a long useful life period which is desirable in lifetime data analysis.
6.4
A series expansion
Here, we derive a series expansion for the survival function, and hence for the probability mass function. Using the series expansion for the exponential, we can write S(x) = q = q = q
√ √
x(1+bcx ) x(1+b exp(x ln c))
∑ √ ( x 1+b ∞ i=0
(
xi lni c i!
)
( )) ∞ ∑ √ xi lni c = exp ln(q) x 1 + b i! i=0 ( )k k ∞ ∞ ∑ ∑ lnk (q)x 2 xi lni c = 1+b k! i! i=0 k=0 )ℓ (∞ k ∞ k ( ) ∑ lnk (q)x 2 ∑ k ℓ ∑ xi lni c = . b k! ℓ i! i=0 k=0 ℓ=0
(6.5)
6.4 A series expansion
164
1
1 q=0.15;b=0.0025;c=1.45 q=0.95;b=1.45;c=1.22
0.8
0.8
0.7
0.7
0.6 0.5 0.4
0.6 0.5 0.4
0.3
0.3
0.2
0.2
0.1
0.1
0
0
2
4
6
8
q=0.25;b=0.0075;c=1.25 q=0.05;b=0.05;c=1.15
0.9
Hazard functions
Hazard functions
0.9
10 x
12
14
16
18
0
20
0
5
10
(a)
25
1 q=0.5;b=0.075;c=1.12 q=0.85;b=1.45;c=1.15
0.9 0.8
0.8
0.7
0.7
0.6 0.5 0.4
0.6 0.5 0.4
0.3
0.3
0.2
0.2
0.1
0.1
0
5
10
q=0.99;b=1.5;c=1.95 q=0.95;b=0.75;c=2
0.9
Hazard functions
Hazard functions
20
(b)
1
0
15 x
15 x
20
25
0
30
0
1
2
3
4
5
6
7
8
9
10
x
(c)
(d)
Figure 6.2: Hazard rate functions of the DRMW distribution.
0.01
0.05
0.009
0.045
q=0.95; b=0.02; c=1.001
0.008
0.04
Hazard functions
Hazard functions
0.006 0.005 0.004
0.03 0.025 0.02 0.015
0.003 0.002
0.01
0.001
0.005
0
q=0.85; b=.15; c=1.001
0.035
0.007
0
0
500
1000
1500
2000 x
(a)
2500
3000
3500
4000
0
500
1000
1500
2000
2500
x
(b)
Figure 6.3: Hazard rate functions of the DRMW distribution with long useful life period.
6.5 The moments
165
Now using the partial exponential Bell polynomial, Brk (x) (see Comtet, 1974), defined by (∞ ∑
)k r
xr t /r!
/k! =
r=1
∞ ∑
Brk (x)tr /r!
r=k
for x = (x1 , x2 , . . .), we can rewrite (6.5) as k ( ) ∞ ∞ ∑ xm lnk (q)xk/2 ∑ k ℓ ∑ b ℓ! Bml (ln c, ln c, . . .) S(x) = k! ℓ m! m=ℓ k=0 ℓ=0 =
∞ ∑ k ∑ ∞ ∑ lnk (q)bℓ Bml (ln c, ln c, . . .)
(k − ℓ)!m!
k=0 ℓ=0 m=ℓ
k
xm+ 2 .
(6.6)
The representation in (6.6) can be used to derive similar expansions for the probability mass function as the following p(x) =
∞ k ∑ ∞ ∑ ∑ lnk (q)bℓ Bml (ln c, ln c, . . .)
(k − ℓ)!m!
k=0 ℓ=0 m=ℓ ∞ k ∑ ∞ ∑ ∑
−
k=0
k
x 2 +m
k lnk (q)bℓ Bml (ln c, ln c, . . .) (x + 1) 2 +m . (k − ℓ)!m! ℓ=0 m=ℓ
(6.7)
Using the binomial expansion for non-integer powers: p
(A + B) =
∞ ∑
c(p, d)Ap−d B p ,
d=0
where c(p, d) = p(x) =
p(p−1)(p−2)···(p−d+1) , d!
∞ k ∑ ∞ ∑ ∑ lnk (q)bℓ Bml (ln c, ln c, . . .) k=0 ℓ=0 m=ℓ ∞ ∑ ∞ k ∑ ∞ ∑ ∑
−
k=0 ℓ=0 m=ℓ p=0
6.5
one can rewrite (6.7) as (k − ℓ)!m!
k
x 2 +m
c( k2 + m, p) lnk (q)bℓ Bml (ln c, ln c, . . .) k +m−p x2 . (k − ℓ)!m!
The moments
If X is a discrete reduced modified Weibull distribution random variable, then the r-th moment of X is given by r
E(X ) =
∞ ∑ k ∑ ∞ ∑ ∞ ∑ lnk (q)bℓ Bml (ln c, ln c, . . .) k=0 ℓ=0 m=ℓ x=0 ∞ ∑ k ∑ ∞ ∑ ∞ ∑ ∞ ∑ k=0 ℓ=0 m=ℓ p=0 x=0
(k − ℓ)!m!
k
x 2 +m+r −
c( k2 + m, p) lnk (q)bℓ Bml (ln c, ln c, . . .) k +m+r−p x2 . (k − ℓ)!m! (6.8)
6.6 Order statistics
166
Using (6.6) the r − th moment of X can be rewriten as r
E(X ) =
=
∞ ∑
(xr − (x − 1)r )s(x),
x=1 ∞ ∑ k ∑ ∞ ∑ ∞ ∑
lnk (q)bℓ Bml (ln c, ln c, . . .) × (k − ℓ)!m! k=0 ℓ=0 m=ℓ x=1 ) ( r ( ) ∑ k r xm+ 2 +r − (−1)r−n xn . n n=0
(6.9)
The first four moments of the DRMW are E(x) = E(x2 ) = E(x3 ) = E(x4 ) =
∞ ∑ k ∑ ∞ ∑ ∞ ∑ lnk (q)bℓ Bml (ln c, ln c, . . .) k=0 ℓ=0 m=ℓ x=1 ∞ ∑ k ∑ ∞ ∑ ∞ ∑ k=0 ℓ=0 m=ℓ x=1 ∞ ∞ ∑ k ∑ ∞ ∑ ∑ k=0 ℓ=0 m=ℓ x=1 ∞ ∞ ∑ k ∑ ∞ ∑ ∑ k=0 ℓ=0 m=ℓ x=1
6.6
(k − ℓ)!m!
k
xm+ 2 ,
lnk (q)bℓ Bml (ln c, ln c, . . .) m+ k x 2 (2x − 1), (k − ℓ)!m! lnk (q)bℓ Bml (ln c, ln c, . . .) m+ k x 2 (3x2 − 3x + 1), (k − ℓ)!m! lnk (q)bℓ Bml (ln c, ln c, . . .) m+ k x 2 (4x3 − 6x2 + 4x − 1). (k − ℓ)!m!
Order statistics
In this section provides the probability mass function, the cumulative distribution function and the moment of the i-th order statistics Xi:n . Suppose that X1 , X2 , . . . , Xn are a random sample sizs n from the proposed discrete distribution, then the obtained order statistics from this sample are X1:n , X2:n . . . , Xn:n .
6.6 Order statistics
167
The PMF of the i-th order statistics Xi:n is given by ∫ F (x) n! P (Xi:n = x) = ui−1 (1 − u)n−i du, (i − 1)!(n − i)! F (x−1) ) ∫ F (x) n−i ( ∑ n−i n! j = (−1) ui+j−1 du, (i − 1)!(n − i)! j=0 j F (x−1) ) ( n−i ∑ n! n − i (−1)j = × (i − 1)!(n − i)! j=0 j (i + j) [( )i+j ( )i+j ] √ √ x(1+bcx ) x−1(1+bcx−1 ) − 1−q 1−q ) n−i ( ∑ n! n − i (−1)j = × (i − 1)!(n − i)! j=0 j (i + j) [ ∑ ∑ ∑ ∑ i+j (−1)s lnk (q)sk bℓ B ∞ k=0
∑∞ ∑k k=0
∞ m=ℓ
k ℓ=0
ℓ=0
i+j s=0
(s)
(k−ℓ)!m!
∑∞ ∑i+j (i+j (−1)s lnk (q)sk bℓ Bml (ln c,ln c,...) s ) m=ℓ
s=0
(k−ℓ)!m!
) n−i ( ∑ n − i (−1)j n! × = j (i − 1)!(n − i)! j=0 (i + j) [ i+j s k k ℓ ∑ ∑ ∑ ∑ ∞ k=0
ml (ln c,ln c,...)
∞ m=ℓ
( s )(−1)
]
k
xm+ 2 − k
(x − 1)m+ 2
ln (q)s b Bml (ln c,ln c,...) m+ k x 2− (k−ℓ)!m! s+p lnk (q)sk bℓ B ∑∞ ∑k ∑∞ ∑i+j ∑∞ (i+j (−1) (ln c,ln c,...) m+ k −p ) ml s x 2 k=0 ℓ=0 m=ℓ s=0 p=0 (k−ℓ)!m! k ℓ=0
i+j s=0
]
(6.10) and the CDF of the i − th order statistics Xi:n is ∫ F (x) n! P (Xi:n ≤ x) = ui−1 (1 − u)n−i du, (i − 1)!(n − i)! 0 ) ∫ F (x) n−i ( ∑ n−i n! j = (−1) ui+j−1 du, j (i − 1)!(n − i)! j=0 0 ) n−i ( ∑ n − i (−1)j n! = × (i − 1)!(n − i)! j=0 j (i + j) [ ∞ k ∞ i+j ( ] ∑ ∑ ∑ ∑ i + j ) (−1)s lnk (q)sk bℓ Bml (ln c, ln c, . . .) k xm+ 2 , (k − ℓ)!m! s k=0 ℓ=0 m=ℓ s=0 )( ) i+j ( n−i ∑ ∞ ∑ k ∑ ∞ ∑ ∑ n! n − i i + j (−1)j+s = × (i − 1)!(n − i)! j=0 k=0 ℓ=0 m=ℓ s=0 (i + j) j s lnk (q)sk bℓ Bml (ln c, ln c, . . .) m+ k x 2. (k − ℓ)!m!
(6.11)
Then, from (6.10) the r − th moment of the i − th order statistics Xi:n is obtained as
6.7 Extreme value behavior
168
) n−i ( ∑ n − i (−1)j n! E(X ) = × j (i − 1)!(n − i)! j=0 (i + j) [ i+j s k ∑ ∑ ∑ ∑ ∑ r
( s )(−1)
ln (q)sk bℓ Bml (ln c,ln c,...) m+ k +r x 2 − (k−ℓ)!m! s+p lnk (q)sk bℓ B ∑i+j ∑∞ ∑k ∑∞ ∑∞ ∑∞ (i+j (−1) (ln c,ln c,...) m+ k +r−p ) ml s x 2 s=0 k=0 ℓ=0 m=ℓ p=0 x=0 (k−ℓ)!m! i+j s=0
∞ k=0
k ℓ=0
∞ m=ℓ
∞ x=0
.
6.7
]
(6.12)
Extreme value behavior
Suppose X1 , . . . , Xn is a random sample from the DRMW distribution. If X = (X1 + · · · + Xn )/n denotes the mean of the random sample then by the usual central √ √ limit theorem n(X − E(X))/ V ar(X) approaches the standard normal distribution as n → ∞ under suitable conditions. Sometimes one would be interested in the asymptotes of the extreme values Mn = max(X1 , . . . , Xn ) and mn = min(X1 , . . . , Xn ). By Corollary 2.4.1 in Galambos (1987), (Mn − bn )/an admits a non-degenerate limit for suitable constants an > 0, bn ∈ R if and only if P (x) →0 S(x) as x → ∞. For the DRMW distribution, } { √ √ x+1 x P (x) lim = lim 1 − q x+1(1+bc )− x(1+bc ) x→∞ S(x) x→∞ { } }√ {√ x+1 1+bcx+1 x) −1 x(1+bc x x 1+bc = lim 1 − q x→∞ 1, if c < 1, = −∞, if c > 1, 0, if c = 1. Hence, (Mn − bn )/an admits a non-degenerate limit only if c = 1. √
If c = 1 then S(x) = q (1+b)
x
. Note that
S (x + xg(t)) lim = x→∞ S(x) = =
√ q (1+b) t+xg(t) √ lim x→∞ q (1+b) t lim q
x→∞
lim q
] [ √ √ g(t) (1+b) t 1+x t −1 √ (1+b) tg(t)x √ 2 t
x→∞
= exp(−x)
6.8 Estimation
169
√ if g(t) = −2 t/{(1 + b) ln q}. It follows by Chapter 1 in Leadbetter et al. (1987) that the DRMW distribution for c = 1 belongs to the max domain of attraction of the Gumbel extreme value distribution with lim Pr {an (Mn − bn ) ≤ x} = exp {− exp(−x)}
n→∞
for an = −2
√ S −1 (1/n)/{(1 + b) ln q} and bn = S −1 (1/n), where S −1 (·) denotes the
inverse function of S(·).
6.8
Estimation
Suppose x1 , x2 , . . . , xn is a random sample from the DRMW distribution with unknown parameters (q, b, c). Section 6.8.1 estimates these parameters by the method of maximum likelihood. Section 6.8.2 assesses the finite sample performance of the MLEs with respect to biases and mean squared errors.
6.8.1
Maximum likelihood estimation
The point and interval estimators of the unknown parameters of the DRMW distribution are derived using the maximum likelihood method. Let x1 , . . . , xn be a random sample from the DRMW distribution.
Let ϕ =
(ϕ1 , ϕ2 , ϕ3 ) = (q, b, c) denote the vector of unknown parameters. The log-likelihood function is L (ϕ; xi ) =
n ∑
( √ ) √ xi +1 x ln q xi (1+bc i ) − q xi +1(1+bc ) .
i=1
Now define Di (ϕ) = q Axi (b,c) − q Axi +1 (b,c) for i = 1, 2, . . . , n, where Axi (b, c) =
√ xi (1 + bcxi ). So, the log-likelihood function
L(ϕ; xi ) can be rewritten as L (ϕ; xi ) =
n ∑
ln Di (ϕ).
i=1
The first order partial derivatives of L(ϕ; xi ) with respect to the three parameters are Lϕj =
(i) n ∑ Dϕ j i=1
Di (ϕ)
6.8 Estimation
170 (i)
for j = 1, 2, 3, where Dϕj is the first order partial derivative of Di (ϕ) with respect to ϕj , j = 1, 2, 3 and Dq(i) = Axi (b, c)q Axi (b,c)−1 − Axi +1 (b, c)q Axi +1 (b,c)−1 , [ ] (i) (b) Axi (b,c) Axi +1 (b,c) Db = ln(q) A(b) q − A q , xi +1 xi [ ] (c) Axi (b,c) Dc(i) = ln(q) A(c) − Axi +1 q Axi +1 (b,c) , xi q √ √ (b) (c) where Axi = cxi xi and Axi = cxi −1 3 xi are the first order partial derivatives of Axi (b, c) with respect to b and c, respectively. The log-likelihood equations are 0=
(i) n ∑ Dϕj i=1
(6.13)
Di (ϕ)
for j = 1, 2, 3. By solving the above system of three nonlinear equations, we can obtain maximum likelihood estimators (MLEs) of q, b and c. It is clear that the system cannot be solved in closed form. To obtain confidence intervals for q, b and c, we use the observed information matrix since the expected information matrix is very complicated and the MLEs of the unknown parameters cannot be obtained analytically. The observed information matrix J(ϑ) is J(ϑ) = −
Lqq Lqb Lqc Lbb Lbc Lcc
.
where ϑ = (q, b, c) and the elements of this matrix are given in Appendix D. If qb, bb and b c are the MLEs of q, b and c, respectively, then under conditions that are fulfilled for parameters in the interior of the parameter space but not on the boundary, ) √ ( n qb − q, bb − b, b c − c converges in distribution to a trivariate normal random vector with zero means and covariance matrix, I −1 , where I(ϑ) is the expected information matrix. For asymptotic normality, certain regularity conditions must be satisfied, see, for example, Ferguson (1996).
6.8 Estimation
6.8.2
171
Simulation study
In this subsection, we assess the performance of the MLEs with respect to sample size n. The assessment is based on a simulation study: 1. First, ten thousand samples of size n are generated from (6.1). The inversion method used to generate samples, that was done for the DRMW distribution by solving √ ( ) X 1 + bcX ln q = ln(1 − U ), where U ∼ U (0, 1) is a uniform variate on the unit interval. ( 2. Obtain the MLEs for the ten thousand generated samples,
qbi , bbi , b ci
) for i =
1, 2, . . . , 10000. 3. Compute the standard errors of the MLEs for the ten thousand samples, say ( ) sqbi , sbbi , sbci for i = 1, 2, . . . , 10000. The standard errors computed by using the observed information matrices. 4. The biases and mean squared errors of the MLEs can be computed as the following, 10000 ) 1 ∑ (b biash (n) = hi − h , 10000 i=1 10000 )2 1 ∑ (b MSEh (n) = hi − h 10000 i=1
for h = q, b, c. The above steps were repeated n = 10, 11, . . . , 100 with q = exp(−1), b = 1 and c = exp(1), so computing biash (n) and MSEh (n) for h = q, b, c and n = 10, 11, . . . , 100. Figure 6.4 shows the biases of the MLEs of (q, b, c) versus n = 10, 11, . . . , 100, and it can be seen that the biases for the four parameters are small and vary with respect to the samples sizes. The mean squared errors of the MLEs of each parameters are shown in Figure 6.5, which are vary with respect to the samples sizes. The broken line in Figure 6.4 indicates to the distance between the biases and the zero. The broken line in Figure 6.5 indicates to the distance between the mean squared errors and the zero.
172
20
40
60
80
0.00 −0.06 −0.04 −0.02
Bias of MLE of b
0.004 0.000
Bias of MLE of q
0.02
6.8 Estimation
100
20
40
60
80
100
0.02
0.04
0.06
n
0.00
Bias of MLE of c
n
20
40
60
80
100
n
20
40
60
80
100
5e−04
20
40
60
80
100
n
0.00
0.05
0.10
0.15
n
MSE of MLE of c
3e−04 1e−04
MSE of MLE of b
0.005 0.010 0.015 0.020
MSE of MLE of q
Figure 6.4: Biases of the MLEs of (q, b, c) versus n = 10, 11, . . . , 100.
20
40
60
80
100
n
Figure 6.5: Mean squared errors of the MLEs of (q, b, c) versus n = 10, 11, . . . , 100.
6.9 Applications
173
From these figures the following observations can be observed: the biases of the MLEs of the parameters q and c are generally positive; the biases of the MLEs of the parameter b are generally negative; the biases of the MLEs of the parameter q are the smallest; the biases of the MLEs of the parameter c are the largest; the biases for the parameters q and c decrease to zero as n → ∞; the biases for the parameterb increase to zero as n → ∞; the mean squared errors of the MLEs of the parameter b are the smallest; the mean squared errors of the MLEs of the parameter c are the largest; the mean squared errors for all three parameter decrease to zero as n → ∞; The above observations are observed by choosing (q, b, c) = (exp(−1), 1, exp(1)). A similar results were found for other choices.
6.9
Applications
In this section, we illustrate the flexibility of the proposed distribution using four real data sets. Three of these data sets are complete. The sample size for the first data set is fifty. The sample size for the second data set is eighteen. The sample size for the third data set is forty three. The sample size for the fourth data set is one hundred and ninety two. Hence, the biases for qb, bb and b c can be expected to be less than 0.004, 0.04 and 0.04, respectively, for all of the data sets. The mean squared errors for qb, bb and b c can be expected to be less than 0.01, 0.0004 and 0.05, respectively, for all of the data sets. The fourth one is censored. The fit of the proposed distribution will be compared with the DMW, DAddW and DW distributions, see Table 6.1. Note that the DMW and DAddW distributions are the known discrete distributions allowing for bathtub shaped hazard rate functions. Table 6.1: The survival functions of the DMW, DAddW and DW distributions. Model DMW DAddW DW
S(x) θ x qx c θ γ q x +bx θ qx
We will see that the proposed distribution gives the best fit for each data set in
6.9 Applications
174
that it gives the smallest values for AIC, BIC, AICc and CAIC. We will also see that the proposed distribution gives the best fit for each data set in terms of the estimated PMF, the estimated hazard rate function, the estimated survival function, and the estimated Total Time on Test TTT-transform.
6.9.1
Complete data
Three real data sets (complete and uncensored) are considered in this section. Two of them have bathtub shaped hazard rate functions. The other one has an increasing hazard rate function. Discrete Aarset data The data are integer parts of the lifetimes of fifty devices, see section 3.11.1. The data are listed in Table 6.2. Figure 6.6 shows that the TTT-plot provides a convex shape followed by a concave shape which inducts that the hazard rate function of this data exhibits a bathtub-shape. Noughabi et al. (2011) have shown that the DMW distribution provides a good fit for this data. Table 6.2: Aarset data (in weeks). Time of failure No of failure Time of failure No of failure
0 2 47 1
1 5 50 1
2 1 55 1
3 1 60 1
6 1 63 2
7 1 67 4
11 12 18 21 32 36 40 45 1 1 5 1 1 1 1 1 72 75 79 82 83 84 85 86 1 1 1 2 1 3 5 2
46 1
Table 6.3: MLEs of parameters for the discrete Aarset data, standard errors in brackets, and the measures AIC, BIC, AICc and CAIC. bb qb b c θb γ b AIC BIC AICc CAIC −5 0.9137 6.8149 × 10 1.1273 439.8 445.5 440.3 448.5 (0.017) (1.377 × 10−4 ) (0.026) DMW 0.9403 1.0241 0.3450 464.2 469.9 464.7 472.9 (0.026) (0.005) (0.126) DAddW 0.9216 6.0091 × 10−5 0.4541 2.8387 464.4 472.0 465.3 476.1 (0.034) (2.181 × 10−4 ) (0.119) (0.807) DW 0.9805 1.0234 487.2 491.0 487.5 493.0 (0.011) (0.131) Model DRMW
6.9 Applications
175
1 0.9
Scaled TTT−Transform
0.8 0.7 0.6 0.5 0.4 0.3 0.2 0.1 0
0
0.2
0.4
0.6
0.8
1
X
Figure 6.6: TTT-transform plot for the Aarst Discret. The AIC, BIC, AICc and CAIC given in Table 6.3 are smallest for the DRMW distribution with AIC = 439.8, BIC = 445.5, AICc = 440.3 and CAIC = 448.5. The estimated PMF, the estimated hazard rate function, the estimated survival function, and the estimated TTT-transform shown in Figure 6.7 are closest to the empirical versions for the DRMW distribution. The approximate 95 percent confidence intervals for q, b and c are [0.881, 0.946], [0, 3.38 × 10−4 ] and [1.076, 1.178], respectively. Electronic devices The bathtub shaped hazard rate function is required in many applications like failure of electronic components. In this example, times to failure of eighteen electronic devices Wang (2000) are used to show how the proposed distribution can be applied in practice. The data are listed in Table 6.4. The TTT-plot of this data exhibits a convex shape followed by a concave shape and that corresponds to a bathtub shaped hazard function, see Figure 6.8. Table 6.4: Lifetimes of eighteen electronic devices (in days). 5 11 165 196
21 224
31 245
46 75 293 321
98 330
122 145 350 420
The AIC, BIC, AICc and CAIC given in Table 6.5 are smallest for the DRMW distribution with AIC = 223.9, BIC = 226.5, CAIc = 225.6 and CAIC = 229.5.
176
0.20
0.05
6.9 Applications
0.15
Nonpar DRMW DMW DAddW WD
0.00
0.00
0.01
0.05
0.10
h(x) 0.02
p(x)
0.03
0.04
Nonpar DRMW DMW DAddW DW
20
40
60
80
0
20
40
60
x
X
(a)
(b)
1.0
0
1 0.9 0.8
0.6
Scaled TTT−Transform
0.8
Nonpar DRMW DMW DAddW WD
0.2
0.4
S(x)
80
0.7 0.6 0.5 0.4 0.3 Empirical DRMW DMW DAddW DW
0.0
0.2 0.1 0
20
40
60
80
X
0
0
0.2
0.4
0.6
0.8
1
X
(c)
(d)
Figure 6.7: For the discrete Aarset data: (a) The histogram and the estimated PMFs; (b) The empirical and estimated hazard rate functions; (c) The empirical and estimated survival functions; (d) The empirical and fitted scaled TTT-transform plots. Table 6.5: MLEs of parameters for data in Table 6.4, standard errors in brackets, and the measures AIC, BIC, AICc and CAIC. bb qb 0.9658 0.1237 (0.019) (0.236) DMW 0.9465 (0.063) DAddW 0.9771 4.015 × 10−3 (0.027) (0.0187) DW 0.9912 (9.257 × 10−3 ) Model DRMW
b c 1.0086 (3.804 × 10−3 ) 1.0055 (1.905 × 10−3 ) -
θb γ b AIC 223.9 0.3194 225.6 (0.254) 0.5208 1.677 227.9 (0.34638) (0.764) 0.9222 226.1 (0.189) -
BIC AICc CAIC 226.5 225.6 229.5 228.3
227.3
231.3
231.4
230.9
235.4
227.9
226.9
229.9
6.9 Applications
177
1 0.9
Scaled TTT−Transform
0.8 0.7 0.6 0.5 0.4 0.3 0.2 0.1 0
0
0.2
0.4
0.6
0.8
1
X
Figure 6.8: TTT-transform plot for the Discret 18. The estimated PMF, the estimated hazard rate function, the estimated survival function, and the estimated TTT-transform shown in Figure 6.9 are closest to the empirical versions for the DRMW distribution. The approximate 95 percent confidence intervals for q, b and c are [0.928, 1], [0, 0.587] and [1.001, 1.016], respectively. Leukemia data The data set for this example is collected from the Ministry of Health Hospital in Saudi Arabia by Abouammoh et al. (1994). The data are lifetimes in days of forty three blood patients who had leukemia, see Table 6.6. The data set exhibits an increasing hazard rate. As the TTT-transform plot, in Figure 6.10, is concave then the data has an increasing hazard rate. Table 6.6: The leukemia data. 115 865 1277 1603
181 924 1290 1605
255 418 441 461 516 739 743 789 807 983 1025 1062 1063 1165 1191 1222 1222 1251 1357 1369 1408 1455 1478 1549 1578 1578 1599 1696 1735 1799 1815 1852 1899 1925 1965
The AIC, BIC, AICc and CAIC given in Table 6.7 are smallest for the DRMW distribution with AIC = 658.0, BIC = 663.2, CAIc= 658.6 and CAIC = 666.2. The estimated PMF, the estimated hazard rate function, the estimated survival
6.9 Applications
0.020
0.030
Nonpar DRMW DMW DAddW DW
0.010
h(x)
0.004
0.006
Nonpar DRMW DMW DAddW DW
0.000
0.000
0.002
p(x)
178
100
200
300
400
0
100
200
x
X
(a)
(b)
1.0
0
300
400
1 0.9 0.8
0.2
0.4
S(x)
0.6
Scaled TTT−Transform
0.8
Nonpar DRMW DMW DAddW WD
0.7 0.6 0.5 0.4 0.3 Empirical DRMW DMW DAddW DW
0.0
0.2 0.1 0
100
200 X
(c)
300
400
0
0
0.2
0.4
0.6
0.8
1
X
(d)
Figure 6.9: For the electronic devices data: (a) The histogram and the estimated PMFs; (b) The empirical and estimated hazard rate functions; (c) The empirical and estimated survival functions; (d) The empirical and fitted scaled TTT-transform plots. Table 6.7: MLEs of parameters for leukemia data, standard errors in brackets, and the measures AIC, BIC, AICc and CAIC. bb qb b c θb γ b AIC BIC AICc CAIC 0.9966 0.2189 1.0024 658.0 663.2 658.6 666.2 (0.003) (0.217) (4.116 × 10−4 ) DMW 0.9729 1.0024 0.0118 660.0 665.3 660.3 668.3 (0.031) (3.915 × 10−4 ) (0.203) DAddW 0.9981 1.127 × 10−5 0.1680 2.4581 667.1 674.2 668.2 678.2 (0.012) (7.978 × 10−5 ) (0.311) (0.300) DW 0.9999 1.3545 690.7 694.3 691.0 696.3 (2.984 × 10−5 ) (0.072) Model DRMW
6.9 Applications
179
1 0.9
Scaled TTT−Transform
0.8 0.7 0.6 0.5 0.4 0.3 0.2 0.1 0
0
0.2
0.4
0.6
0.8
1
X
Figure 6.10: TTT-transform plot for the Leukamia. function, and the estimated TTT-transform shown in Figure 6.11 are closest to the empirical versions for the DRMW distribution. The approximate 95 percent confidence intervals for q, b and c are [0.992, 1], [0, 0.75] and [1.002, 1.003], respectively.
6.9.2
Censored data
Here, we show how the proposed distribution can be applied in practice for censored (real) data sets. We use an original data presented here for the first time. The data relates to one hundred and ninety two prisoners who were imprisoned because of using or selling drugs. All of the prisoners were released at the same time. About seven tenths of them re-offended. The data set contains the times in months from release to re-imprisonment for the same crime or related one. The prisoners who did not re-offend were considered as censored. The AIC, BIC, AICc and CAIC given in Table 6.8 are smallest for the DRMW distribution with AIC = 1353.9, BIC = 1363.6, CAIc= 1354.0 and CAIC = 1366.6. The estimated hazard rate function and the estimated survival function shown in Figure 6.12 are closest to the empirical versions for the DRMW distribution. The approximate 95 percent confidence intervals for q, b and c are [0.882, 0.924], [0, 0.018] and [1.021, 1.116], respectively.
180
Nonpar DRMW DMW DAddW WD
0.000
0.0000
0.002
0.0004
0.004
h(x)
p(x)
0.0008
0.008
0.010
Nonpar DRMW DMW DAddW DW
0.006
0.0012
6.9 Applications
500
1000
1500
2000
500
1000
x
X
(a)
(b)
1.0
0
2000
1
Nonpar DRMW DMW DAddW WD
0.9 0.8
0.2
0.4
S(x)
0.6
Scaled TTT−Transform
0.8
1500
0.7 0.6 0.5 0.4 0.3 Empirical DRMW DMW DAddW DW
0.0
0.2 0.1
500
1000
1500
2000
X
0
0
0.2
0.4
0.6
0.8
1
X
(c)
(d)
Figure 6.11: For leukemia data: (a) The histogram and the estimated PMFs; (b) The empirical and estimated hazard rate functions; (c) The empirical and estimated survival functions; (d) The empirical and fitted scaled TTT-transform plots. Table 6.8: MLEs of parameters for the drug data, standard errors in brackets, and the measures AIC, BIC, AICc and CAIC. bb qb 0.9029 0.0042 (0.011) (7.352 × 103 ) DMW 0.9410 (0.015) DAddW 0.9372 2.8364 × 10−4 (0.015) (1.085 × 10−3 ) DW 0.9498 (0.012) Model DRMW
b c 1.0689 (0.024) 1.0040 (2.867 × 10−3 ) -
θb γ b AIC 1353.9 0.6445 1357.1 (0.087) 0.6348 2.2669 1357.3 (0.07547) (0.913) 0.7456 1359.2 (0.057) -
BIC 1363.6
AICc 1354.0
CAIC 1366.6
1366.8 1357.2
1369.8
1370.3
1357.5
1374.3
1369.0 1357.2
1372.0
181
1.0
6.10 Summary
h(x)
0.02
0.03
0.04
Nonpar DRMW DMW DAddW WD
0.01
0.6 0.2
0.00
0.4
S(x)
0.8
Nonpar DRMW DMW DAddW DW
0
10
20
30
40
50
60
70
0
10
20
30
40
x
X
(a)
(b)
50
60
70
Figure 6.12: For drug data: (a) Fitted survival functions using the DRMW and other models; (b) Nonparametric and fitted hazard rate functions using the DRMW and other models.
6.10
Summary
A three-parameter discrete distribution is introduced in this chapter based on a recent modification of the continuous Weibull distribution which introduced in chapter 4. It is one of only three discrete distributions allowing for bathtub shaped hazard rate functions. We study some of its mathematical properties, discuss estimation by the method of maximum likelihood, and describe applications to four real data sets. The new distribution is shown to outperform at least three other models including the ones allowing for bathtub shaped hazard rate functions.
Chapter 7 Comparing the exponentiated and generalized modified Weibull distributions 7.1
Introduction
Among the various extensions and modified forms of the Weibull distribution (1951), the modified Weibull MW distribution of Lai et al. (2003) is one of the most important modifications of the Weibull distribution. It multiplies the Weibull cumulative hazard function αxβ by eλx . This distribution was later generalized to exponentiated form by Carrasco et al. (2008) by adding another shape parameter. Carrasco et al. (2008)’s modification is called the generalized modified Weibull GMW distribution. To be consistent with paper of Carrasco et al. (2008), recalled the CDF of the GMW distribution (2) in Carrasco et al. (2008) ( ) γ λx β F (x) = 1 − e−αx e
(7.1)
for x > 0, α > 0, γ ≥ 0, λ ≥ 0 and β > 0. The sub-models of the GMW and the shapes of its HF are represented in Section 2.2.17. It is important to note for latter reasons that CDF, SF, PDF and HF of the GMW are not valid functions if λ < 0. For example, the CDF is not a monotonic increasing function of x if λ < 0. The PDF can take negative values if λ < 0. Also the HF can take negative values if λ < 0.
7.1 Introduction
183
1 0.9
Scaled TTT−Transform
0.8 0.7 0.6 0.5 0.4 0.3 0.2 0.1 0 0
0.1
0.2
0.3
0.4
0.5 X
0.6
0.7
0.8
0.9
1
Figure 7.1: TTT-transform plot for the radiotherapy data. Carrasco et al. (2008) applied the GMW distribution to two well-known censored data sets and compared its goodness-of-fit with its sub-models. The first data set is the serum-reversal data of Silva (2004) and Perdon´a (2006). The TTT-plot for this data is shown in Figure 4.12, which takes a convex shape followed by a concave shape. This corresponds to a bathtub shaped HF. The second data is a radiotherapy data. The TTT-plot for this data is shown in Figure 7.1, which takes a concave shape followed by a convex shape followed by a concave shape. Then, the HF of this data is modified unimodel shape (unimodal followed by increasing). Carrasco et al. (2008) mention that this corresponds to a unimodal HF. There are some other mistakes in the results of both applications in Carrasco et al. (2008). According to Liddle (2004), usually, that will improve the fitting of the data and the maximised likelihood will increase. Sometimes, the new added parameter that is restricted to be positive dose not improve the maximum likelihood function, some models that are proposed by adding a new positive parameter dose not improve the maximum likelihood function. The generalized modified Weibull distribution of Carrasco et al. (2008) has this problem for some modified unimodal data sets. Also, it dose not provide a better fit than the the exponentiated Weibull distribution using this kind of data sets despite the exponentiated Weibull distribution is sub-model of the GMW.
7.2 Applications
184
This chapter shows that no evidence that the generalized modified Weibull distribution can provide a better fit than the exponentiated Weibull distribution for data sets exhibiting the modified unimodal hazard function (the radiotherapy data and the infected pigs data that used in Chapter 5). Also, it shows the incorrect results of the paper of Carrasco et al. (2008) and presents the correct results.
7.2
Applications
This section uses three well-known data sets. The first data set has a bathtub shaped HF and the last data sets has a modified unimodal shaped HF. We will show that the GMW distribution can not provide better fits than the EW distribution for data sets exhibiting modified unimodal HFs. We will also point out incorrect results on the first two data sets presented in Carrasco et al. (2008). The fits are compared using the following measures: K-S statistic, AIC, BIC, CAIC and AICc.
7.2.1
Serum-reversal data
Table 1 in Carrasco et al. (2008) shows the maximum likelihood estimates (MLEs) of the parameters of the GMW distribution and its sub-models (MW, EW, EE, Weibull and GR distributions) for the serum-reversal data. All these results appear correct. It is clear that the GMW distribution presents a very good fit for this data with respect to AIC, BIC and CAIC values. We computed the Kolmogorov-Smirnov (K-S) statistic, the distance between the empirical CDF and the fitted CDF, for the GMW distribution and its sub-models. Again, the GMW distribution has the smallest K-S statistic with the value 0.117, whilst the K-S statistics for the MW, EW, EE, Weibull and GR distributions are 0.155, 0.169, 0.259, 0.182 and 0.247, respectively. The HF for the fitted GMW distribution is plotted in Figure 4c of Carrasco et al. (2008). This figure appears incorrect because it is well known that the HF must be nonnegative everywhere. It appears Carrasco et al. (2008) plotted the HF for the fitted GMW distribution using λ = −0.023, an invalid value for λ, see Section 1. The MLE of λ reported in Table 1 of Carrasco et al. (2008) is 0.023. The HF for the fitted GMW distribution when λ = −0.023 is plotted in Figure 7.2a, just to show that Figure 4c in Carrasco et al. (2008) was plotted using this negative value. Figure 7.2b presents the
7.2 Applications
185
nonparametric HF of the data and the HF for the fitted GMW distribution using the MLEs in Table 1 of Carrasco et al. (2008).
o
0.04
α = 7.4e−06,γ = 0.649,λ = − 0.023,β = 0.491
GMW(α = 7.4e−06,γ = 0.649,λ = 0.023,β = 0.491) Nonpar
0.02 0.00
0e+00
0.01
2e−04
4e−04
h(x)
6e−04
0.03
8e−04
o
0
100
200
300
400
0
100
200
300
400
X
(a)
(b)
Figure 7.2: For the serum-reversal data: (a) HF presented in Carrasco et al. (2008), (b) Nonparametric HF and the HF for the fitted GMW distribution using estimates in Table 1 of Carrasco et al. (2008).
7.2.2
Radiotherapy data
The fitted MLEs for this data are presented in Table 2 of Carrasco et al. (2008). Unfortunately, the MLEs for the GMW and MW distributions and the corresponding AIC, BIC and CAIC measures appear incorrect. We now explain the mistakes. Modified Weibull distribution The MLEs of the parameters of the MW distribution reported in Table 2 of Carrasco b = 0.001. But the reported values of et al. (2008) are α b = 0.001, γ b = 1.245 and λ AIC = 594.4, BIC = 600.1 and CAIC = 594.9 appear to have been computed using λ = −0.001 (an invalid value for λ). These values appear so close to the values of AIC, BIC and CAIC reported in Table 2 of Carrasco et al. (2008) for the GMW distribution. But the shape of the HF of the MW distribution can not be unimodal, so it is surprising that the MW and GMW distributions fit equally well for a data set exhibiting a unimodal HF.
7.2 Applications
186
For the MLEs of the MW distribution reported in Table 2 of Carrasco et al. (2008), b ≈ 0.001. the log-likelihood is −442.45. The log-likelihood is about −294.2 when λ We computed the MLEs of the MW distribution and the corresponding measures AIC, BIC and CAIC. Table 1 shows the MLEs of the MW distribution reported by b = −0.001 and when λ b = 0.001), the MLEs we obtained Carrasco et al. (2008) (when λ (the corresponding standard errors in brackets) and the values of AIC, BIC and CAIC we obtained. The SFs for the fitted MW distribution using the MLEs in Table 2 of b = −0.001 and Carrasco et al. (2008) are shown in Figure 7.3a (red solid line for λ b = 0.001). The corresponding HFs are plotted in Figure 7.3c blue dashed line for λ b = −0.001 and blue open circles for λ b = 0.001). Figures 7.3b and (red solid line for λ 7.3d show the SF and the HF for the MW distribution we fitted. Note from Table 1 that the GMW distribution we fitted is actually a EW distribution since the MLE of λ is zero (that is, the likelihood for the GMW distribution for the given data appears largest when λ = 0). Also the MW distribution we fitted is actually a Weibull distribution since the MLE of λ is zero (that is, the likelihood for the MW distribution for the given data appears largest when λ = 0). So, the added parameter λ does not improve the fit of the GW distribution or the fit of the Weibull distribution. This can happen sometimes when the parameter is restricted to be positive (Liddle, 2004). Generalized modified Weibull distribution According to Table 2 in Carrasco et al. (2008), the MLE of λ is 0.0002. But Figures b = −0.0002 (an invalid value 5b and 5c in Carrasco et al. (2008) appear to have used λ for λ) to plot the SF and the HF for the fitted GMW distribution. Furthermore, the reported AIC, BIC and CAIC measures appear to have used the same negative value. Figure 7.4a shows the SF for the fitted GMW distribution using the MLEs in Table b = −0.0002 and blue dashed line for 2 of Carrasco et al. (2008) (red solid line for λ b = 0.0002). The corresponding HFs are plotted in Figure 7.4c (red solid line for λ b = −0.0002 and blue open circles for λ b = 0.0002). The SF and the HF for the fitted λ b = −0.0002 (in red solid line and blue open circles) appear GMW distribution with λ to be the same as Figures 5b and 5c in Carrasco et al. (2008). We computed the MLEs of the GMW distribution and the corresponding measures
187
1.0
1.0
7.2 Applications
Kablan − Meier Corrected_Estimated_S(x) α = 0.003577,γ = 0.93,λ = 0
0.0
0.0
0.2
0.2
0.4
0.4
S(x)
S(x)
0.6
0.6
0.8
0.8
α = 0.001,γ = 1.245,λ = − 0.001 α = 0.001,γ = 1.245,λ = 0.001
200
400
600
800
1000
1200
1400
0
200
400
600 x
(a)
(b)
1000
1200
1400
Corrected_Estimated_h(x) α = 0.003577,γ = 0.93,λ = 0
0.0030
α = 0.001,γ = 1.245,λ = − 0.001 α = 0.001,γ = 1.245,λ = 0.001
0.0020
h(x)
0.0000
0.000
0.0005
0.002
0.0010
0.0015
0.004
0.0025
0.006
o
h(x)
800
x
0.0035
0
0
200
400
600
800
1000
1200
1400
0
200
400
600
800
x
x
(c)
(d)
1000
1200
1400
Figure 7.3: For radiotherapy data: (a) SF presented in Carrasco et al. (2008), (b) Our SF, (c) HF presented in Carrasco et al. (2008), (d) Our HF using the MW.
188
1.0
1.0
7.2 Applications
α = 0.168,γ = 0.483,λ = − 2e−04,β = 6.326 α = 0.168,γ = 0.483,λ = 2e−04,β = 6.326
0.0
0.0
0.2
0.2
0.4
0.4
S(x)
S(x)
0.6
0.6
0.8
0.8
Kablan − Meier Corrected_Estimated_S(x) α = 0.647,γ = 0.294,λ = 0,β = 18.036
200
400
600
800
1000
1200
1400
0
400
600
800 x
(a)
(b)
1000
1200
1000
1200
1400
h(x)
0.0010
0.0015
0.0020
0.0025
0.0030
0.004 0.003 0.002
α = 0.168,γ = 0.483,λ = − 2e−04,β = 6.326 α = 0.168,γ = 0.483,λ = 2e−04,β = 6.326
Corrected_Estimated_h(x) α = 0.647,γ = 0.294,λ = 0,β = 18.036
0.0000
0.000
o
0.0005
0.001
h(x)
200
x
0.0035
0
0
200
400
600
800
1000
1200
1400
0
200
400
600
800
x
x
(c)
(d)
1400
Figure 7.4: For the radiotherapy data: (a) SF presented in Carrasco et al. (2008), (b) Our SF, (c) HF presented in Carrasco et al. (2008), (d) Our HF using the GMW.
7.2 Applications
189
Table 7.1: MLEs of parameters, standard errors, AIC, BIC, AICc and CAIC for radiotherapy data. b βb γ b λ α b 6.326 0.483 −0.0002 0.168 6.326 0.483 0.0002 0.168 (2.662) (0.297) (0.0001) (0.049) Our GMW 18.036 0.294 0.000 0.647 (32.480) (0.165) (1.593 × 10−4 ) (0.934) MW of 1 1.245 −0.001 0.001 Carrasco et al. (2008) 1 1.245 0.001 0.001 – (0.181) (0.0002) (0.0001) Our MW 1 0.930 0.000 3.577 × 10−3 – (0.171) (1.277 × 10−4 ) (3.345 × 10−2 ) Model GMW of Carrasco et al. (2008)
AIC BIC AICc 593.3 601.0 594.1 611.5 619.3 612.4 – – – 594.1 601.8 595.0 – – – 594.4 600.1 594.9 890.9 896.7 891.4 – – – 599.8 605.6 600.3 – – –
CAIC 605.0 623.2 – 605.8 – 603.1 899.7 – 608.63 –
K-S 0.114 0.170 – 0.119 – 0.130 0.259 – 0.143 –
AIC, BIC and CAIC. Table 1 shows the MLEs of the GMW distribution computed b = −0.0002 and when λ b = 0.0002), the MLEs we by Carrasco et al. (2008) (when λ obtained (the corresponding standard errors in brackets) and the values of AIC, BIC and CAIC we obtained. The SF and the HF for the GMW distribution we fitted are plotted in Figures 7.4b and 7.4d.
7.2.3
Infected pigs data
As shown before, the infected pigs data that presented in Table 5.1 is shown to have modified unimodal shaped. Table 7.2 shows the MLEs of the parameters, their standard errors, AIC values, BIC values, AICc values and CAIC values for the fitted GMW and EW distributions. Table 7.3 shows the K-S test statistics for the two fitted distributions. The negative log-likelihood for the fitted GMW distribution is 400.350. The negative log-likelihood for the fitted EW distribution is 400.427. AIC values, BIC values, AICc values and CAIC values for the fitted GMW and EW distributions are 808.7, 817.8, 809.2, 821.8 and 806.9, 813.7, 807.2, 816.7, respectively. The values of the K-S statistic for the two distributions are 0.114 and 0.11. The EW distribution has the smallest values for the AIC, the BIC the AICc, the CAIC and the K-S. The GMW distribution has the larger log-likelihood. But the likelihood ratio test statistic for testing H0 : λ = 0 versus H1 : H0 is false is 0.154 and the corresponding p-value is 0.695, so there is no evidence to reject H0 . Hence, the GMW distribution does not improve significantly on the fit of the EW distribution. Figure 7.5 (a) shows the histogram of the data and the fitted PDFs. Figure 7.5
7.2 Applications
190
Table 7.2: MLEs of parameters, standard errors, AIC, BIC, AICc and CAIC for the distributions fitted to the infected pigs data set. Model α b βb γ b GMW − 0.496 0.470 − (0.247) (0.008) EW − 0.471 0.478 − (0.254) 0.081
b λ 4.639 × 10−9 4.573 × 10−4 0 −
θb AIC BIC AICc CAIC 69.877 808.7 817.8 809.3 821.8 (50.012) 65.135 806.9 813.7 807.2 816.7 (49.625)
Table 7.3: K-S statistics for the distributions fitted to the infected pigs data set. Model GMW EW
K-S 0.114 0.110
(b) shows the empirical SF of the data and the fitted ones. Figure 7.5 (d) shows the nonparametric HF of the data and the fitted HFs. Figures 7.5a and 7.5b show that both distributions provide good fits. Figure 7.5d shows that both distributions provide good fits to the first and middle parts of the nonparametric HF. But neither of the distributions appear to capture the last part of the nonparametric HF well.
191
Kaplan−Meier GMW EW
0.006
0.8
0.008
1.0
0.010
7.2 Applications
0.0
0.000
0.2
0.002
0.4
0.004
f(x)
S(x)
0.6
GMW EW
0
100
200
300
400
500
600
100
200
300
400
x
x
(a)
(b)
500
600
0.025
1
0.9
0.020
0.8
Nonpar GMW EW
0.015 h(x)
0.6
0.5
0.010
Scaled TTT−Transform
0.7
0.4
0.005
0.3
0.1
0
0.000
0.2
Empirical GMW EW 0
0.1
0.2
0.3
0.4
0.5 X
0.6
0.7
0.8
0.9
1
100
200
300
400
500
600
X
(c)
(d)
Figure 7.5: For infected pigs data: (a) Histogram and fitted PDFs; (b) Empirical and fitted SFs; (c) Empirical and fitted TTT-transforms; (d) Nonparametric and fitted HFs.
7.3 Summary
7.3
192
Summary
This chapter finds no evidence that the generalized modified Weibull distribution can provide a better fit than the exponentiated Weibull distribution for data sets exhibiting the modified unimodal hazard function. Also, it pointed out some of the incorrect results of the published paper of the GMW that proposed by Carrasco et al. (2008), and published by Computational Statistics and Data Analysis. The Figure of estimated hazard of Serum-reversal data set using GMW is incorrect because it is plotted using negative value of λ which should be restricted to positive value. In the radiotherapy data set, although Carrasco et al. (2008) reported positive value for the parameter λ, they used a negative value to plot the fitted SF and HF for the GMW and MW. Also, the AIC, BIC and AICc are calculated using the same negative value. The correct results and figures are presented with the estimated hazard rate function for the serum-reversal data. The added parameter λ to the Weibull distribution by Lai et al. (2003) did not improve the maximum likelihood function of the radiotherapy data for EW and the Weibull as sub-models of the GMW and MW respectively.
Chapter 8 Conclusion, discussion and future work 8.1
Conclusion
Chapter 2 reviewed known discrete and continuous modifications of the two-parameter Weibull distribution. For each modification, we have given expressions for the CDF, the PMF or the PDF and the HF. We have also discussed their shapes. A new distribution, based on the Weibull and the modified Weibull distributions, has been proposed and its properties studied. The idea is to combine two components in a serial system, so that the hazard function is either increasing or more importantly, bathtub shaped. By using a modified Weibull component, the distribution has flexibility to model the second peak in a distribution. We have shown that the new modified Weibull distribution fits certain well-known data sets better than existing modifications of the Weibull distribution. Reducing the number of parameters to four by fixing one of the parameters still provides a better fit than existing models. The new modified Weibull distribution introduced in Chapter 3 has been simplified with its five parameters reduced to three. The simplified distribution has been referred to as the RNMW distribution. We have studied several analytical properties of the reduced distribution and shown that it is a tractable distribution. We have also shown that the reduced distribution provides excellent fits to four real data sets: two of them are complete data sets and the other two are censored. By means of the likelihood ratio test, we have shown that the fit of the NMW distribution is not significantly
8.1 Conclusion
194
better than that of the RNMW distribution. So, the RNMW distribution retains the same flexibility of the NMW distribution and yet the estimation for the former is much easier. In chapter 6, We have generalized the reduced distribution, that presented in chapter 4, by exponentiation to accommodate unimodal and modified unimodal hazard function. The generalized distribution is referred to as the ERMW distribution. It includes as special cases several distributions like the RGMW, REW, RW, RLMW and RW distributions. We have discussed maximum likelihood estimation of the exponentiated distribution and presented two real data applications. One of the data sets has a unimodal HRF and the other has a bathtub shaped HRF. The exponentiated distribution was shown to give the best fit for both data sets. We have introduced a three-parameter modification of the discrete Weibull distribution. We have shown that this distribution exhibits bathtub shaped hazard rates. There are only two other discrete distributions that exhibit bathtub shaped hazard rates. The flexibility of the proposed modification is illustrated using four real data sets: three of them complete and the other censored. For each data set, the proposed modification was shown to give better fit than several other competitors including the two known discrete distributions exhibiting bathtub shaped hazard rates. Finally, we showed that the added parameter λ of the GMW distribution over the EW distribution did not improve the maximum likelihood function for the radiotherapy data. Also, the GMW distribution did not provide a better fit than the EW distribution for the infected pigs data. Both data sets have modified unimodal shaped HFs. Based on this, there is no evidence that the GMW distribution can provide a better fit than the EW distribution for data sets exhibiting modified unimodal HFs. We have pointed out some incorrect results in Carrasco et al. (2008). The fitted HF for the serum-reversal data set using the GMW distribution is incorrect because it is plotted using a negative value of λ. For the radiotherapy data set, although Carrasco et al. (2008) reported a positive value for λ, they used a negative value to plot the fitted SF and HF. Also, the AIC, the BIC, the AICc and the CAIC were calculated using the same negative value.
8.2 Discussion and future work
8.2
195
Discussion and future work
Some important questions with respect to the review part are: Which of the modifications is the “best” for a given data set? How do we select the “best” modification? Two common tools for selection among the modifications are the Weibull Probability Plot (WPP) and the Inverse Weibull Probability Plot (IWPP). Let t1 , t2 , . . . , tn denote a real data set. Let t(1) ≤ t(2) ≤ · · · ≤ t(n) denote the sorted values in ascending order. Then, the WPP (for n not small) is a plot of )] [ ( i yi = log − log 1 − n+1 versus ( ) xi = log t(i) for i = 1, 2, . . . , n. The WPP for n small is a plot of [ ( )] i − 0.3 yi = log − log 1 − n + 0.4 versus ( ) xi = log t(i) for i = 1, 2, . . . , n. The IWPP for n not small is a plot of [ ( yi = log − log
i n+1
)]
versus ( ) xi = log t(i) for i = 1, 2, . . . , n. The IWPP for n small is a plot of [ ( )] i − 0.3 yi = log − log n + 0.4 versus ( ) xi = log t(i) for i = 1, 2, . . . , n.
8.2 Discussion and future work
196
If the data are censored or grouped then appropriate changes should be made to the WPP and the IWPP. Sometimes changes are made to the plots depending on whether n is small, medium or large (Section 4.2, Murthy et al., 2004). For details, we refer the readers to King (1971), Lawless (1982), Nelson (1982), and Meeker and Escobar (1998). The WPP and the IWPP can exhibit a variety of shapes, including straight line, concave, concave with left asymptote vertical, convex, convex with right asymptote vertical, S shaped with parallel asymptotes, S shaped with vertical asymptotes, bell shaped and multiple inflection points, see Table 6 in Murthy et al. (2004). Table 7 in Murthy et al. (2004) and Table 2 in Zhang and Dwight (2013) show how an appropriate modification can be chosen based on the shapes of the WPP and the IWPP. For example, a straight line in the WPP would mean appropriateness of the two-parameter Weibull distribution in (1.2). A convex shape of the WPP would mean appropriateness of the modified Weibull distribution in (2.7) due to Lai et al. (2003). An S shape of the WPP with vertical asymptotes would mean appropriateness of Kies (1958)’s modified Weibull distribution in (2.2). A concave shape of the WPP for θ < 1 and a convex shape of the WPP for θ > 1 would mean appropriateness of the extended Weibull distribution in (2.4) due to Zhang and Xie (2007). A convex shape of the WPP for λ < 1 and a concave shape of the WPP for λ > 1 would mean appropriateness of the exponentiated Weibull distribution in (2.2) due to Mudholkar and Srivastava (1993). An S shape of the WPP with parallel asymptotes would mean appropriateness of a mixture of two two-parameter Weibull distributions with the same shape parameter. A WPP with multiple inflection points would mean appropriateness of a mixture of two two-parameter Weibull distributions with different shape parameters. A straight line in the IWPP would mean appropriateness of the inverse Weibull distribution in (2.1). An S shape of the IWPP with parallel asymptotes would mean appropriateness of a mixture of two two-parameter inverse Weibull distributions with the same shape parameter. An IWPP with multiple inflection points would mean appropriateness of a mixture of two two-parameter inverse Weibull distributions with different shape parameters. For more on how a modification can be chosen based on the shapes of the WPP and the IWPP, we refer the readers to Jiang and Murthy (1995), Jiang et al. (2001a, 2001b), and Murthy et al. (2003).
8.2 Discussion and future work
197
It is possible that the WPP and the IWPP would imply appropriateness more than one modification. In this case, discrimination among the modifications can be based on the difference between the fitted and empirical estimates of the x-intercept of the WPP (Section 6.1, Murthy et al., 2004), the difference between the fitted and empirical estimates of the y-intercept of the WPP (Section 6.1, Murthy et al., 2004), the bootstrap and jackknife approaches as described in Section 6.2.1 of Murthy et al. (2004), the analysis of physics of failure as described in Section 4.1 of Zhang and Dwight (2013), the shape of the PDF, the shape of the PMF or the shape of the HF. The discrimination can also be performed using criteria like the sum of squares of residuals, the Akaike information criterion (Akaike, 1974), the Bayesian information criterion (Schwarz, 1978), the Hannan-Quinn information criterion (Hannan and Quinn, 1979) and the consistent Akaike information criterion (Hurvich and Tsai, 1989). The modification with smaller values of these criteria should be preferred. A future work is to discuss possible applications of these modifications especially to reliability engineering. Other possible future works are to: i) develop tools other than the WPP and the IWPP for choosing among the modifications of the Weibull distribution; ii) provide a review of known modifications of other distributions commonly used in reliability, including the binomial, geometric, exponential, hypoexponential, hyperexponential, Gompertz-Makeham, Birnbaum-Saunders, gamma, Erlang, normal, lognormal, loglogistic, Pareto, Gumbel, Fr´echet, and extreme value distributions; iii) provide a review of bivariate and multivariate versions of distributions commonly used in reliability; iv) provide a review of component mixture, one- or two-sided censored, truncated and transformed distributions commonly used in reliability; v) provide a review of reliability block diagram-based lifetime, fault tree-based lifetime and standby lifetime distributions commonly used in reliability. The NMW distribution is a kind of competing risks model by considering two different distributions. In this case we can defined a new family of the competing risk models to be known as Modified Weibull Competing Risks Model. Definition 8.2.1. Modified Weibull competing risks model: Suppose X1 , X2 , . . . , Xr are independent random variables with a cumulative distribution functions Fi (x), i = 1, 2 . . . , r, where Fi (x) are either the Weibull distribution or one of its modifications or related distributions. If Z = min(X1 , . . . , Xr ) then,
8.2 Discussion and future work
198
the cumulative distribution functions of Z is given by F (x) = 1 −
r ∏
[1 − Fi (x)] ,
(8.1)
i=0
the probability density function is given by f (x) =
r ∑
r ∏
[hi (x)]
i=0
Si (x),
(8.2)
i=0
where Si (x) = 1 − Fi (x) for i = 1, 2 . . . , r, is the survival function, the the hazard function is given by h(x) =
r ∑
[hi (x)] .
(8.3)
i=0
If r = 2, the above definition includes the NMW distribution, that was presented in chapter 3, and several other known distribution such as: 1. The linear failure rate distribution: The LFR involving exponential and Rayleigh distributions and its CDF is given by, F (x) = 1 − e−αx−βx , 2
x>0
(8.4)
2. The additive Weibull model (AddW) of Xie and Lai (1996): That involves two Weibull distributions, with the following CDFk, F (x) = 1 − e−αx
θ −βxγ
,
x>0
(8.5)
3. The β distribution of Bousquet et al. (2006): The β distribution includes the exponential and the Weibull distributions, F (x) = 1 − e−αx−βx , γ
x>0
(8.6)
Sarhan and Zaindin (2009) introduced a three-parameter distribution called as modified Weibull (SZMW) distribution. It is the same as the β distribution of Bousquet et al. (2006). A future work is to study the modified Weibull competing risks model further.
8.2 Discussion and future work
199
The reduced distribution has an exclusive bathtub shaped hazard rate function. Other hazard rates can be obtained from the NMW distribution. For example, setting γ = θ = 2 we obtain h(x) = 2αx + β(2 + λx)xeλx , for x > 0, which is an increasing function of x, see Figure 8.1. Also, a bivariate version of the reduced distribution can be obtained. 15 α=0.01;β=0.02;λ=0.08 α=0.25;β=0.15;λ=0.025 α=0.0005; β=0.05;λ=0.15
The failure rate function
α=0.25;β=0.004;λ=0.007 10
5
0
0
2
4
6
8
10 X
12
14
16
18
20
Figure 8.1: Hazard rate functions of the reduced distribution. Future work includes MCMC methods with censored data, regression problems with covariates and parameter reduction. The drug data can be used in the regression problems. Alternative data which can be used as a lifetime data is that of telecom company data. One of largest mobile telecommunication network company in the Middle East is Saudi Telecom Company (STC). The mobile towers systems can be either serial or parallel systems. Our new lifetime models can be used to describe to fit failures times of the the serial system. Progressively censored data is a type of censored data where after d1 failures n1 subjects are removed from the study then after d2 failures n2 removed from the study, until the end of the study. Based on progressively censored data the maximum likelihood estimates of parameters of the modified Weibull distributions can be computed using EM algorithm and Newton-Raphson algorithm. A simulation study could be conducted in order to identify the appropriate operating conditions of the proposed modifications in terms of the sample size and proportion
8.2 Discussion and future work
200
of censoring for example. We could also compare the proposed models and alternative ones on simulated data. Sometimes extrapolation is more important than finding a best fitting model for the range of the data. So, investigation could also be done to see if the proposed distributions can provide reliable extrapolations.
References Aarset, M. V. (1987). How to identify a bathtub hazard rate. Reliability, IEEE Transactions on, 36(1), 106-108. Abouammoh, A. M., Abdulghani, S. A. and Qamber, I. S. (1994). On partial orderings and testing of new better than renewal used classes. Reliability Engineering and System Safety, 43(1), 37-41. Akaike, H. (1974). A new look at the statistical model identification. Automatic Control, IEEE Transactions on, 19(6), 716-723. Alexander, C., Cordeiro, G. M., Ortega, E. M. and Sarabia, J. M. (2012). Generalized beta-generated distributions. Computational Statistics and Data Analysis, 56(6), 1880-1897. AL-Hadhrami, S. A. (2010). Maximum likelihood estimators for the parameters of modified weibull distribution using median ranked set sampling. Far East Journal of Mathematical Sciences (FJMS), 42(2), 219-228. AL-Huniti, A. A. and AL-Dayian, G. R. (2012). Discrete Burr Type Iii Distribution. American Journal of Mathematics and Statistics, 2(5), 145-152. Almalki, S. J. (2014). Reduced new modified Weibull distribution. Communications in Statistics-Theory and Methods, Accepted. Almalki, S. J. and Nadarajah, S. (2014). A new discrete modified Weibull distribution. Reliability, IEEE Transactions on, 63(1), 68-80. Almalki, S. J. and Nadarajah, S. (2014). Modifications of the Weibull distribution: A review. Reliability Engineering and System Safety, 124, 32-55.
8.2 Discussion and future work
202
Almalki, S. J. and Yuan, J. (2013). The New Modified Weibull distribution, Reliability Engineering and System Safety, 111, 164-170. Almalki, S. J. and Nadarajah, S. (2014). Exponentiated Reduced Modified Weibull Distribution. Communications in Statistics-Theory and Methods, submitted. Almalki, S. (2014). Comparing The Exponentiated and Generalized Modified Weibull Distributions. Reliability, IEEE Transactions on, submitted. AL-Saleh, J. A. and Agarwal, S. K. (2006). Extended Weibull type distribution and finite mixture of distributions. Statistical Methodology, 3, 224-233. Arnold, B. C., Balakrishnan, N. and Nagaraja, H. N. (2008). A first course in order statistics (Vol. 54). Society for Industrial Mathematics. Aryal, G. A. and Tsokos, C. P. (2011). Transmuted Weibull distribution: A generalization of the Weibull probability distribution. European Journal of Pure and Applied Mathematics, 4(2), 89-102. Bain, L. J. (1974). Analysis for the linear failure-rate life-testing distribution. Technometrics, 16(4), 551-559. Bakouch, H.S., Jazi, A. and Nadarajah, S. (2014). A new discrete distribution. Statistics, 48(1), 200-240. Barlow, R. E. and Doksum, K. A. (1972). Isotonic tests for convex orderings. Proceedings 6th Berkeley Symposium, 1, 293323. Barlow, R. E. and Campo, R. A. (1975). Total Time on Test Processes and Applications to Failure Data Analysis (No. ORC-75-8). California Univ Berkeley Operations Research Center. Barreto-Souza, W., De Morais, A. L. and Cordeiro, G. M. (2011). The Weibullgeometric distribution.
Journal of Statistical Computation and Simulation,
81(5), 645-657. Barreto-Souza, W., Santos, A. and Cordeiro G.M. (2010). The beta generalized exponential distribution, Journal of Statistical Computation and Simulation, 80, 159-172.
8.2 Discussion and future work
203
Bebbington, M., Lai, C. D., Wellington, M. and Zitikis, R. (2012). The discrete additive weibull distribution: A bathtub shaped hazard for discontinuous failure data. Reliability Engineering and System Safety. Bebbington, M., Lai, C. D. and Zitikis, R. (2006). Useful periods for lifetime distributions with bathtub shaped hazard rate functions. Reliability, IEEE Transactions on, 55(2), 245-251. Bebbington, M., Lai, C. D. and Zitikis, R. (2007). A flexible Weibull extension. Reliability Engineering and System Safety, 92, 719-726. Bemmaor, A. C. and Glady, N. (2012). Modeling Purchasing Behavior with Sudden Death: A Flexible Customer Lifetime Model. Management Science, 58(5), 10121021. Boes, D. C., Heo, J. H. and Salas, J. D. (1989). Regional flood quantile estimation for a Weibull model. Water Resources Research, 25(5), 979-990. Bousquet, N., Bertholon, H. and Celeux, G. (2006). An alternative competing risk model to the Weibull distribution for modelling aging in lifetime data analysis. Lifetime data analysis, 12(4), 481-504. Bozdogan, H. (1987). Model selection and Akaike’s information criterion (AIC): The general theory and its analytical extensions. Psychometrika, 52(3), 345-370. Burnham, K. P. and Anderson, D. R. (2002). Model selection and multi-model inference: a practical information-theoretic approach. Springer. Carrasco, J. M., Ortega, E. M. and Cordeiro, G. M. (2008). A generalized modified Weibull distribution for lifetime modeling. Computational Statistics and Data Analysis, 53(2), 450-462. Carrasco, J. M., Ortega, E. M. and Paula, G. A. (2008). Log-modified Weibull regression models with censored data: Sensitivity and residual analysis. Computational Statistics and Data Analysis, 52(8), 4021-4039. Carroll, K. J. (2003). On the use and utility of the Weibull model in the analysis of survival data. Controlled Clinical Trials, 24(6), 682-701.
8.2 Discussion and future work
204
Chakraborty, S. and Chakravarty, D. (2012). Discrete gamma distributions: Properties and parameter estimations. Communications in Statistics-Theory and Methods, 41, 3301-3324. Chen, Z. (2000). A new two-parameter lifetime distribution with bathtub shape or increasing failure rate function. Statistics and Probability Letters, 49(2), 155161. Cohen, A. C. (1973). The reflected Weibull distribution. Technometrics, 15(4), 867873. Comtet, L. (1974). Advanced Combinatorics: The art of finite and infinite expansions. Springer. Conradsen, K., Nielsen, L. B. and Prahm, L. P. (1984). Review of Weibull statistics for estimation of wind speed distributions. Journal of Climate and Applied Meteorology, 23(8), 1173-1183. Cooray, K. (2006). Generalization of the Weibull distribution: the odd Weibull family. Statistical Modelling, 6(3), 265-277. Cooray, K. (2012). Analyzing Grouped, Censored, and Truncated Data Using the Odd Weibull Family. Communications in Statistics-Theory and Methods, 41(15), 2661-2680. Cordeiro, G. M., Castellares, F., Montenegro, L. C. and de Castro, M. (2013a). The beta generalized gamma distribution. Statistics, 47(4), 888-900. Cordeiro, G. M., Gomes, A. E., da-Silva, C. Q. and Ortega, E. M. M. (2013b). The beta exponentiated Weibull distribution. Journal of Statistical Computation and Simulation, 83, 114-138. Cordeiro, G. M., Hashimoto, E. M. and Ortega, E. M. M. (2014). The McDonald Weibull model. Statistics, 48(2), 256-278. Cordeiro, G. M., Nadarajah, S. and Ortega, E. M. (2013c). General results for the beta Weibull distribution. Journal of Statistical Computation and Simulation, 83(6), 1082-1114.
8.2 Discussion and future work
205
Cordeiro, G. M., Ortega, E. M. and Nadarajah, S. (2010). The Kumaraswamy Weibull distribution with application to failure data. Journal of the Franklin Institute, 347(8), 1399-1429. Cordeiro, G. M., Ortega, E. M. M. and Silva, G. (2011a). The exponentiated generalized gamma distribution with application to lifetime data. Journal of Statistical Computation and Simulation, 81, 827-842. Cordeiro, G. M., Ortega, E. M. and Silva, G. O. (2014b). The Kumaraswamy modified Weibull distribution: theory and applications. Journal of Statistical Computation and Simulation, 84(7), 1387-1411. Cordeiro, G. M., Simas, A. B. and Stosic, B. D. (2011b). Closed form expressions for moments of the beta Weibull distribution. Anais da Academia Brasileira de Cincias, 83(2), 357-373. Cordeiro, G. M., Simas, A. B. and Stosic, B. D. (2009). The beta Weibull distribution. Journal of Statistical Computation and Simulation, doi: 10.1080/00949650802552402. Cox, D. R. and Oakes, D. (1984). Analysis of survival data (Vol. 21). CRC Press. De Gusmao, F. R. S., Ortega, E. M. M. and Cordeiro, G. M. (2011). The generalized inverse Weibull distribution. Statistical Papers, 52, 591-619. Demicheli, R., Bonadonna, G., Hrushesky, W. J., Retsky, M. W. and Valagussa, P. (2004). Menopausal status dependence of the timing of breast cancer recurrence after surgical removal of the primary tumour. Breast Cancer Res, 6(6), R689-96. Development, R. Core Team, R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing. Austria: Vienna, 2013. Drapella, A. (1993). The complementary weibull distribution: Unknown or just forgotten?. Quality and Reliability Engineering International, 9(4), 383-385. Elbatal, I. (2011). Exponential modified Weibull distribution. Economic Quality Control, 26, 189-200.
8.2 Discussion and future work
206
El-Fotouh, S. A. and Nassar, M. M. A. (2011). Estimation for the parameters of the Weibull Extension model based on generalized order statistics. Int. J. Contemp. Math. Sciences, 6(36), 1749-1760. El-Gohary, A., Alshamrani, A. and Al-Otaibi, A. N. (2013). The generalized Gompertz distribution. Applied Mathematical Modeling, 37 (1-2), 13-24. Elshahat, M. A. T. (2007). Parameters estimation for Weibull extension model, based on progressively type II censored samples. Far East Journal of Theoretical Statistics, 23(2), 201 Famoye, F., Lee, C. and Olumolade, O. (2005). The beta-Weibull distribution. Journal of Statistical Theory and Applications, 4(2), 121-136 Ferguson, T. S., (1996). A Course in Large Sample Theory. London: Chapman and Hall. Fisher, R. A. (1922). On the mathematical foundations of theoretical statistics. Philosophical Transactions of the Royal Society of London, A, 309-368. Flaih, A., Elsalloukh, H., Mendi, E. and Milanova, M. (2012a). The exponentiated inverted Weibull distribution. Applied Mathematics and Information Sciences, 6, 167-171. Flaih, A., Elsalloukh, H., Mendi, E. and Milanova, M. (2012b). The skewed double inverted Weibull distribution. Applied Mathematics and Information Sciences, 6, 269-274. Galambos, J. (1987). The Asymptotic Theory of Extreme Order Statistics, second edition. Robert E. Krieger Publishing Company, Melbourne, Florida. Gasmi, S. and Berzig, M. (2011). Parameters estimation of the modified Weibull distribution based on type I censored samples. Applied Mathematical Sciences, 59(5), 2899-2917. Ghitany, M. E., Al-Hussaini, E. K. and Al-Jarallah, R. A. (2005). Marshall-Olkin extended Weibull distribution and its application to censored data. Journal of Applied Statistics, 32, 1025-1034.
8.2 Discussion and future work
207
Ghitany, M. E., Al-Mutairi, D. K., Balakrishnan, N. and Al-Enezi, L. J. (2013). Power Lindley distribution and associated inference. Computational Statistics and Data Analysis, 64, 20-33. Gomez-Deniz, E., Sarabia, J.M. and Calderin-Ojeda, E. (2011). A new discrete distribution with actuarial applications. Insurance: Mathematics and Economics, 48, 406-412. Gompertz, B. (1825). On the nature of the function expressive of the law of human mortality, and on a new mode of determining the value of life contingencies. Philosophical Transactions of the Royal Society of London, 115, 513-583. Greenwich, M. (1992). A unimodal hazard rate function and its failure distribution. Statistical Papers, 33(1), 187-202. Gumbel, E.J. (1958). Statistics of Extremes, Columbia University Press, New York. Gupta, A., Mukherjee, B. and Upadhyay, S. K. (2008). Weibull extension model: A Bayes study using Markov chain Monte Carlo simulation. Reliability Engineering and System Safety, 93(10), 1434-1443. Gupta, R. D. and Kundu, D. (2001a). Exponentiated exponential family: An alternative to gamma and Weibull distributions. Biometrical Journal, 43, 117-130. Gupta, R. D. and Kundu, D. (2001b). Generalized exponential distribution: Different method of estimations. Journal of Statistical Computation and Simulation, 69(4), 315-337. Gupta, R. D. and Kundu, D. (2007). Generalized exponential distribution: Existing results and some recent developments. Journal of Statistical Planning and Inference, 137(11), 3537-3547. Gupta, R. C., Gupta, P. L. and Gupta, R. D. (1998). Modeling failure time data by Lehman alternatives. Communications in Statistics-Theory and methods, 27(4), 887-904.
8.2 Discussion and future work
208
Gurvich, M. R., Dibenedetto, A. T. and Ranade, S. V. (1997). A new statistical distribution for characterizing the random strength of brittle materials. Journal of Materials Science, 32(10), 2559-2564. Hamedani, G. G. and Ahsanullah, M. (2011). Characterizations of Weibull geometric distribution. Journal of Statistical Theory and Applications, 10, 581-590. Hannan, E. J. and Quinn, B. G. (1979). The determination of the order of an autoregression. Journal of the Royal Statistical Society, B, 41, 190-195. Hanook, S., Shahbaz, M. Q., Mohsin, M. and Golam Kibria, B. M. (2013). A note on beta inverse Weibull distribution. Communications in Statistics-Theory and Methods, 42, 320-335. Harter, H. L. (1967). Maximum-likelihood estimation of the parameters of a fourparameter generalized gamma population from complete and censored samples. Technometrics, 9(1), 159-165. Hartless, G. and Leemis, L. (1996). Computational algebra applications in reliability theory. Reliability, IEEE Transactions on, 45(3), 393-399. Heo, J. H., Boes, D. C. and Salas, J. D. (2001). Regional flood frequency analysis based on a Weibull model: Part 1. Estimation and asymptotic variances. Journal of hydrology, 242(3), 157-170. Hurvich, C. M. and Tsai, C. L. (1989). Regression and time series model selection in small samples. Biometrika, 76(2), 297-307. Jazi, M. A., Lai, C. D. and Alamatsaz, M. H. (2010). A discrete inverse Weibull distribution and estimation of its parameters. Statistical Methodology, 7(2), 121-132. Jiang, R. and Murthy, D. N. P. (1995). Reliability modeling involving 2 Weibulldistributions. Reliability Engineering and System Safety, 47, 187-198. Jiang, R., Murthy, D. N. P. and Ji, P. (2001a). n-fold Weibull multiplicative model. Reliability Engineering and System Safety, 74, 211-219.
8.2 Discussion and future work
209
Jiang, R., Murthy, D. N. P. and Ji, P. (2001b). Models involving two inverse Weibull distributions. Reliability Engineering and System Safety, 73, 73-81. Jiang, H., Xie, M. and Tang, L. C. (2010). On MLEs of the parameters of a modified Weibull distribution for progressively type-2 censored samples. Journal of Applied Statistics, 37(4), 617-627. Jiang, H., Xie, M. and Tang, L. C. (2008). On the odd Weibull distribution. Proceedings of the Institution of Mechanical Engineers, Part O: Journal of Risk and Reliability, 222(4), 583-594. Khan, M.S.A., Khalique, A. and Abouammoh, A.M. (1989). On estimating parameters in a discrete Weibull distribution. Reliability, IEEE Transactions on, 38, 348-350. Kies, J.A. (1958). The strength of glass. Naval Research Lab. Report No. 5093; Washington, D.C. King, J. R. (1971). Probability Charts for Decision Making. Industrial Press, New York. Kolmogorov, A. N. (1933). Sulla determinazione empirica di una legge di distribuzione. na. Krishna, H. and Singh, P. (2009). Discrete Burr and discrete Pareto distributions. Statistical Methodology, 6, 177-188. Kulasekera, K.B. (1994). Approximate MLEs of the parameters of a discrete Weibull distribution with type I censored data. Microelectronics and Reliability, 34, 1185-188. Kumar U., Klefsj B. and Granholm S (1989). Reliability investigation for a fleet of load haul dump machines in a Swedish mine. Reliability Engineering and System Safety, 26(4): 341-361. Kundu, D. and Gupta, R. D. (1999). Generalized exponential distribution. Australian and New Zealand Journal of Statistics, 41, 173-188.
8.2 Discussion and future work
210
Kundu, D. and Gupta, R. D. (2008). Generalized exponential distribution: Bayesian estimations. Computational Statistics and Data Analysis, 52(4), 1873-1883 Kundu, D. and Raqab, M. Z. (2005). Generalized Rayleigh distribution: different methods of estimations. Computational statistics and data analysis, 49(1), 187200. Kumar, U., Klefsj¨o, B. and Granholm, S. (1989). Reliability investigation for a fleet of load haul dump machines in a Swedish mine. Reliability Engineering and System Safety, 26(4), 341-361. Kuo, W. and Zuo, M. J. (2001). Optimal Reliability Modeling: Principles and Applications, Wiley. Lai, C. D. (2013). Constructions and applications of lifetime distributions. Applied Stochastic Models in Business and Industry, 29(2), 127-140. Lai, C. D., Murthy, D. N. P. and Xie, M. (2011). Weibull distributions. Wiley Interdisciplinary Reviews: Computational Statistics, 3(3), 282-287. Lai, C.D. and Wang, D.Q. (1995). A finite range discrete life distribution. International Journal of Reliability, Quality and Safety Engineering, 2, 147-160. Lai, C. D. and Xie, M. (2006). Stochastic ageing and dependence for reliability (p. 420). New York: Springer. Lai, C. D., Xie, M. and Murthy, D. N. P. (2003). A modified Weibull distribution. Reliability, IEEE Transactions on, 52(1), 33-37. Lawless, J. F. (1982). Statistical Models and Methods for Lifetime Data. John Wiley and Sons, New York. Leadbetter, M.R., Lindgren, G. and Rootz´en, H. (1987). Extremes and Related Properties of Random Sequences and Processes. Springer Verlag, New York. Lee, C., Famoye, F. and Olumolade, O. (2007). Beta-Weibull distribution: some properties and applications to censored data. Journal of modern applied statistical methods, 6(1), 173-186.
8.2 Discussion and future work
211
Lemonte, A. J., Barreto-Souza, W. and Cordeiro, G. M. (2013). The exponentiated Kumaraswamy distribution and its log-transform. Brazilian Journal of Probability and Statistics, 27, 31-53. Liddle, A. R. (2004). How many cosmological parameters?. Monthly Notices of the Royal Astronomical Society, 351(3), L49-L53. Lindley, D. V. (1980). Approximate bayesian methods. Trabajos de estadstica y de investigacin operativa, 31(1), 223-245. Lindley, D. V. (1958). Fiducial distributions and Bayes’ theorem. Journal of the Royal Statistical Society, A, 20, 102-107. Mahmoud, R. M. and Mandouh, R. M. (2012). Parameter Estimation of Beta-Weibull Distribution Based on Censored Samples. Journal of Applied Sciences Research, 8(1), 390-400. Marshall, A. W. and Olkin, I. (1997). A new method for adding a parameter to a family of distributions with application to the exponential and Weibull families. Biometrika, 84(3), 641-652. Maynard, J.A. (2003). A class of beta-exponential distributions: Properties, estimation and applications. Unpublished Doctoral Dissertation: Central Michigan University, Mount Pleasant, Michigan. Meeker, W. Q. and Escobar, L. A. (1998). Statistical methods for reliability data (Vol. 78). New York: Wiley. Mudholkar, G. S. and Hutson, A. D. (1996). The exponentiated Weibull family: some properties and a flood data application. Communications in Statistics–Theory and Methods, 25(12), 3059-3083. Mudholkar, G. S. and Kollia, G. D. (1994). Generalized Weibull family: a structural analysis. Communications in statistics-theory and methods, 23(4), 1149-1171. Mudholkar, G. S. and Srivastava, D. K. (1993). Exponentiated Weibull family for analyzing bathtub failure-rate data. Reliability, IEEE Transactions on, 42(2), 299-302.
8.2 Discussion and future work
212
Mudholkar, G. S., Srivastava, D. K. and Freimer, M. (1995). The exponentiated Weibull family: A reanalysis of the bus-motor-failure data. Technometrics, 37(4), 436-445. Mudholkar, G. S., Srivastava, D. K. and Kollia, G. D. (1996). A generalization of the Weibull distribution with application to the analysis of survival data. Journal of the American Statistical Association, 91(436), 1575-1583. Murthy, D. N. P., Bulmer, M. and Eccleston, J. A. (2004). Weibull model selection for reliability modelling. Reliability Engineering and System Safety, 86, 257-267. Murthy, D. P., Xie, M. and Jiang, R. (2003). Weibull models (Vol. 358). WileyInterscience. Nadarajah, S. (2005). On the moments of the modified Weibull distribution. Reliability Engineering and System Safety, 90(1), 114-117. Nadarajah, S. and Kotz, S. (2005). On some recent modifications of Weibull distribution. Reliability, IEEE Transactions on, 54(4), 561-562. Nadarajah, S., Cordeiro, G. M. and Ortega, E. M. (2011). General results for the beta-modified Weibull distribution. J. Stat. Comput. and Simu., 81(10), 12111232. Nadarajah, S. and Kotz, S. (2006a). The beta exponential distribution. Reliability Engineering and System Safety, 91(6), 689-697. Nadarajah, S. and Kotz, S. (2006b). The exponentiated type distributions. Acta Applicandae Mathematica, 92(2), 97-111. Nakagawa, T. and Osaki, S. (1975). The discrete Weibull distribution. Reliability, IEEE Transactions on, 24(5), 300-301. Nelson, W. (1982). Applied Life Data Analysis. John Wiley and Sons, New York. Nelson, W. (1990). Accelerated life testing: statistical models. data analysis and test plans. Wiley, New York.
8.2 Discussion and future work
213
Ng, H. K. T. (2005). Parameter estimation for a modified Weibull distribution, for progressively type-II censored samples. Reliability, IEEE Transactions on, 54(3), 374-380. Nikulin, M. and Haghighi, F. (2006). A chi-squared test for the generalized power Weibull family for the head-and-neck cancer censored data. Journal of Mathematical Sciences, 133(3), 1333-1341 Noughabi, M.S., Roknabady, A.H.R. and Borzadaran, G.R.M. (2011). Discrete modified Weibull distribution. Metron, LXIX, 207-222. Noufaily, A., & Jones, M. C. (2013a). Parametric quantile regression based on the generalized gamma distribution. Journal of the Royal Statistical Society: Series C (Applied Statistics), 62(5), 723-740. Noufaily, A., & Jones, M. C. (2013b). On maximization of the likelihood for the generalized gamma distribution. Computational Statistics, 28(2), 505-517. Ohishi, K., Okamura, H. and Dohi, T. (2009). Gompertz software reliability model: estimation algorithm and empirical validation. Journal of Systems and Software, 82(3), 535-543. Ortega, E. M., Cordeiro, G. M. and Kattan, M. W. (2013). The log-beta Weibull regression model with application to predict recurrence of prostate cancer. Statistical Papers, 54(1), 113-132. Ortega, E. M., Cordeiro, G. M. and Carrasco, J. M. (2011). The log-generalized modified Weibull regression model. Brazilian Journal of Probability and Statistics, 25(1), 64-89. Padgett, W. J. and Spurrier, J. D. (1985). On discrete failure models. Reliability, IEEE Transactions, 34(3), 253-256. Pal, M., Ali, M. M. and Woo, J. (2006). Exponentiated Weibull distribution. Statistica, 66, 139-147.
8.2 Discussion and future work
214
Pascoa, M. A. P., Ortega, E. M. M., Cordeiro, G. M. and Parana´ıba, P. F. (2011). The Kumaraswamy-generalized gamma distribution with application in survival analysis. Statistical Methodology, 8, 411-433. Perdona, G. S. C. (2006). Modelos de Riscos Aplicados Anlise de Sobrevivncia (in Portuguese). Doctoral Thesis, Institute of Computer Science and Mathematics, University of So Paulo, Brasil. Pham, H. (Ed.). (2006). Springer handbook of engineering statistics. Springer Verlag, London (Chapter 2-3, pp. 49-78) Pham, H. and Lai, C. D. (2007). On recent generalizations of the Weibull distribution. Reliability, IEEE Transactions on, 56(3), 454-458. Phani, K. K. (1987). A new modified Weibull distribution function. Journal of the American Ceramic Society, 70(8), C-182. Preda, V., Panaitescu, E. and Constantinescu, A. (2010). Bayes estimators of ModifiedWeibull distribution parameters using Lindley’s approximation. WSEAS Transactions on Mathematics, 9(7), 539-549. Provost, S. B., Saboor, A. and Ahmad, M. (2011). The gamma-Weibull distribution. Pakistan Journal of Statistics, 27, 111-131. Rajarshi, S. and Rajarshi, M.B. (1988). Bathtub distributions: A review. Communications in Statistics-Theory and Methods, 17, 2521-2597. Raqab, M. Z. (2004). Generalized exponential distribution: Moments of order statistics. Statistics, 38(1), 29-41. Razaq, A. and Memon, A. Z. (2011). Some remarks on non-central Weibull distribution. Pakistan Journal of Statistics, 27, 257-267. Revfeim, K. J. A. (1983). On the analysis of extreme rainfalls. Journal of Hydrology, 62(1), 107-117. Rinne, H. (2008). The Weibull distribution: a handbook. Chapman and Hall/CRC.
8.2 Discussion and future work
215
Roy, D. (2003). The discrete normal distribution. Communications in StatisticsTheory and Methods, 32, 1871-1883. Roy, D. (2004). Discrete Rayleigh distribution. Reliability, IEEE Transactions on, 53, 255-260. Sarhan, A. M., Ahmad, A. E. B. A. and Alasbahi, I. A. (2013). Exponentiated generalized linear exponential distribution. Applied Mathematical Modelling, 37(5), 2838-2849 Sarhan, A. M. and Apaloo, J. (2013). Exponentiated modified weibull extension distribution. Reliability Engineering and System Safety, 112, 137-144. Sarhan, A. M. and Kundu, D. (2009). Generalized linear failure rate distribution. Communications in Statistics-Theory and Methods, 38(5), 642-660. Sarhan, A. M. and Zaindin, M. (2009). Modified Weibull distribution. Applied Sciences, 11, 123-136. Schwarz, G. E. (1978). Estimating the dimension of a model. Annals of Statistics, 6, 461-464. Shahbaz, M. Q., Shahbaz, S. and Butt, N. S. (2012). The Kumaraswamy-inverse Weibull distribution. Pakistan Journal of Statistics and Operation Research, 8, 479-489. Silva, G. O., Ortega, E. M. and Cordeiro, G. M. (2010). The beta modified Weibull distribution. Lifetime data analysis, 16(3), 409-430. Silva, A.N.F., (2004). Estudo evolutivo das crianas expostas ao HIV e notificadas pelo ncleo de vigilncia epidemiolgica do HCFMRP-USP. M.Sc. Thesis. University of So Paulo, Brazil. Simiu, E. and Heckert, N. A. (1996). Extreme wind distribution tails: A ”peaks over threshold” approach. Journal of Structural Engineering, 122(5), 539-547. Singla, N., Jain, K. and Kumar Sharma, S. (2012). The Beta Generalized Weibull distribution: Properties and applications. Reliability Engineering and System Safety, 102, 5-15.
8.2 Discussion and future work
216
Soliman, A. A., Abd-Ellah, A. H., Abou-Elheggag, N. A. and Ahmed, E. A. (2012). Modified Weibull model: A Bayes study using MCMC approach based on progressive censoring data. Reliability Engineering and System Safety. Stacy, E. W. (1962). A generalization of the gamma distribution. The Annals of Mathematical Statistics, 33(3), 1187-1192. Stacy, E. W. and Mihram, G. A. (1965). Parameter estimation for a generalized gamma distribution. Technometrics, 7(3), 349-358. Stein, W. E. and Dattero, R. (1984). A new discrete Weibull distribution. Reliability, IEEE Transactions on, 33(2), 196-197. Sultan, K. S., Ismail, M. A. and Al-Moisheer, A. S. (2007). Mixture of two inverse Weibull distributions: Properties and estimation. Computational Statistics and Data Analysis, 51, 5377-5387. Surles, J. G. and Padgett, W. J. (2001). Inference for reliability and stress-strength for a scaled Burr type X distribution. Lifetime Data Analysis, 7(2), 187-200. Surles, J. G. and Padgett, W. J. (2005). Some properties of a scaled Burr type X distribution. Journal of statistical planning and inference, 128(1), 271-280. Tang, Y., Xie, M. and Goh, T. N. (2003). Statistical analysis of a Weibull extension model. Communications in Statistics-Theory and Methods, 32(5), 913-928. Tzavelas, G. and Panagiotakos, D. (2013). Statistical inference for the size-biased Weibull distribution. Journal of Statistical Computation and Simulation, 83(7), 1252-1265. Upadhyay, S. K. and Gupta, A. (2010). A Bayes analysis of modified Weibull distribution via Markov chain Monte Carlo simulation. Journal of Statistical Computation and Simulation, 80(3), 241-254. Wahed, A. S. and Jeong, J. H. (2009). A new generalization of Weibull distribution with application to a breast cancer data set. Statistics in medicine, 28(16), 2077-2094.
8.2 Discussion and future work
217
Wang, F.K. (2000). A new model with bathtub-shaped failure rate using an additive Burr XII distribution. Reliability Engineering and System Safety, 70, 305-312. Weibull, W. (1951). A statistical distribution function of wide applicability. Journal of applied mechanics, 18(3), 293-297. White, J. S. (1969). The moments of log-Weibull order statistics. Technometrics, 11, 373-386. Xie, M. and Lai, C. D. (1996). Reliability analysis using an additive Weibull model with bathtub-shaped failure rate function. Reliability Engineering and System Safety, 52(1), 87-93. Xie, M., Tang, Y. and Goh, T. N. (2002). A modified Weibull extension with bathtubshaped failure rate function. Reliability Engineering and System Safety, 76(3), 279-285. Yang, Z. (1994). Maximum likelihood phylogenetic estimation from DNA sequences with variable rates over sites: Approximate methods. Journal of Molecular Evolution, 39, 306-314. Yong, T. (2004). Extended Weibull distributions in reliability engineering. Ph.D. Thesis, National University of Singapore, Singapore. Zaindin, M. and Sarhan, A. M. (2011). New generalized Weibull distribution. Pakistan Journal of Statistics, 27(1). Zaindin, M. and Sarhan, A. M. (2009). Parameters estimation of the modified Weibull distribution. Applied Mathematical Sciences, 3(11), 541-550. Zaindin, M. (2010). Parameter estimation of the modified Weibull model based on grouped and censored data. International Journal of Basic and Applied Sciences IJBAS-IJENS, 10(2), 122-132. Zajicek, G. (2011). A new kind of medical cancer epidemiology. Available at: http://www.what-is-cancer.com/papers/newmedicine/epidemiologyFrame.htm (Accessed: October 2012)
8.2 Discussion and future work
218
Zhang, T. and Dwight, R. (2013). Choosing an optimal model for failure data analysis by graphical approach. Reliability Engineering and System Safety, 115, 111-123. Zhang, T. and Xie, M. (2011). On the upper truncated Weibull distribution and its reliability implications. Reliability Engineering and System Safety, 96(1), 194-200. Zhang, T. and Xie, M. (2007). Failure data analysis with extended Weibull distribution. Communications in Statistics—Simulation and Computation, 36, 579-592.
Appendix A Appendix for chapter 3 The log-likelihood function of the N M W (α, β, θ, γ, λ) can be written as n ∑ [ ] L(ϑ) = ln (h(xi ; ϑ)) − αxθi − βxγi eλx , i=1
where h(xi ; ϑ) is the hazard rate function (3.4) of the NMW and ϑ = (α, β, θ, γ, λ) is the vector of parameters. The second partial derivatives are as follows Lαα = −
)2 n ( ∑ hα (xi ; ϑ) i=1
Lαβ = −
(h(xi ; ϑ))2
,
n ( ∑ h(xi ; ϑ)hαθ (xi ; ϑ) − hα (xi ; ϑ)hθ (xi ; ϑ) i=1
Lαγ = − Lαλ = − Lββ = −
(h(xi ; ϑ))2
n ∑ hα (xi ; ϑ)hλ (xi ; ϑ) i=1 n ( ∑ i=1
Lβθ = −
(h(xi ; ϑ))2
n ∑ hα (xi ; ϑ)hγ (xi ; ϑ) i=1
(h(xi ; ϑ))2 )2 hβγ (xi ; ϑ) , h(xi ; ϑ)
n ∑ hβ (xi ; ϑ)hθ (xi ; ϑ) i=1
Lβγ =
,
n ∑ hα (xi ; ϑ)hβ (xi ; ϑ) i=1
Lαθ =
h(xi ; ϑ)
(h(xi ; ϑ))2
−
−
xγi eλxi
ln(xi ) ,
, ,
,
n ( ∑ h(xi ; ϑ)hβγ (xi ; ϑ) − hβ (xi ; ϑ)hγ (xi ; ϑ) i=1
) xθi
(h(xi ; ϑ))2
) ln(xi ) ,
220
n ( ∑ h(xi ; ϑ)hβλ (xi ; ϑ) − hβ (xi ; ϑ)hλ (xi ; ϕ)
Lβλ =
i=1 n ∑
Lθθ =
(
i=1
Lθγ = − Lθλ = −
i=1 n ∑
Lγγ =
(
i=1
Lγλ =
i=1
Lλλ =
(h(xi ; ϑ))2
i=1
(
,
,
hθ (xi ; ϑ)hλ (xi ; ϑ) , (h(xi ; ϑ))2
) h(xi ; ϑ)hγγ (xi ; ϑ) − (hγ (xi ; ϑ))2 − βxγi eλxi ln2 (xi ) , 2 (h(xi ; ϑ))
n ( ∑ h(xi ; ϑ)hγλ (xi ; ϑ) − hγ (xi ; ϑ)hλ (xi ; ϑ)
d ∑
−
) h(xi ; ϑ)hθθ (xi ; ϑ) − (hθ (xi ; ϑ))2 − αxθi ln2 (xi ) , 2 (h(xi ; ϑ))
n ∑ hθ (xi ; ϑ)hγ (xi ; ϑ)
i=1
n ∑
(h(xi ; ϑ))2
) eλxi xγ+1 i
(h(xi ; ϑ))2
−
βxγ+1 eλxi i
h(xi ; ϑ)hλλ (xi ; ϑ) − (hλ (xi ; ϑ))2 − βxγ+2 eλxi i 2 (h(xi ; ϑ))
) ,
where hαθ (xi ; ϑ) = xθ−1 (1 + θ ln(xi )), i (1 + (γ + λxi ) ln(xi )) eλxi , hβγ (xi ; ϑ) = xγ−1 i hβλ (xi ; ϑ) = xγi (1 + γ + λxi ) ln(xi )) eλxi , (2 + θ ln(xi )) ln(xi ), hθθ (xi ; ϑ) = αxθ−1 i hγγ (xi ; ϑ) = βxγ−1 (2 + (γ + λxi ) ln(xi )) ln(xi )eλxi , i hγλ (xi ; ϑ) = βxγi (1 + (1 + γ + λxi ) ln(xi )) eλxi , hλλ (xi ; ϑ) = βxγ+1 (2 + γ + λxi ) ln(xi )) eλxi , i , hα (xi ; ϑ) = θxθ−1 i hβ (xi ; ϑ) = xγ−1 (γ + λxi ) ln(xi )eλxi , i hθ (xi ; ϑ) = αhαθ (xi ; ϑ), hγ (xi ; ϑ) = βhβγ (xi ; ϑ), hλ (xi ; ϑ) = βhβλ (xi ; ϑ).
) ln (xi ) , 2
Appendix B Appendix for chapter 4 The observed information matrix for complete data The elements of the observed information matrix J(ϑ) for the RN M W (α, β, λ) for complete data are Lαα = − Lαβ = −
]2 d [ ∑ hα (xi ; ϑ) i=1 d ∑ i=1
Lαλ = − Lββ
,
hα (xi ; ϑ) hβ (xi ; ϑ) , h (xi ; ϑ)2
d ∑ hα (xi ; ϑ) hλ (xi ; ϑ)
h (xi ; ϑ)2 i=1 ]2 d [ ∑ hβ (xi ; ϑ) =− , h (x ; ϑ) i i=1
Lβλ = −
,
( ) d ∑ h (xi ; ϑ) hβλ (xi ; ϑ) − hβ (xi ; ϑ) hλ xi ; ϕ i=1
Lλλ
h (xi ; ϑ)
h (xi ; ϑ)2
,
] [ d √ ∑ h (xi ; ϑ) hλλ (xi ; ϑ) − hλ (xi ; ϑ)2 = − β x5i eλxi , 2 h (x ; ϑ) i i=1
222 where 1 hα (xi ; ϑ) = √ , 2 xi (0.5 + λxi ) eλxi hβ (xi ; ϑ) = , √ xi ) ( √ 3 + λxi eλxi , hλ (xi ; ϑ) = β xi 2 ( ) √ 3 hβλ (xi ; ϑ) = xi + λxi eλxi , 2 ( ) √ 5 hλλ (xi ; ϑ) = β xi + λxi eλxi . 2
The observed information matrix for complete data censored data The elements of the observed information matrix J(ϑ) for the RN M W (α, β, λ) for censored data are Lαα = − Lαβ = −
i=1 d ∑ i=1 d ∑
h (xi ; ϑ)
,
hα (xi ; ϑ) hβ (xi ; ϑ) , h (xi ; ϑ)2
hα (xi ; ϑ) hλ (xi ; ϑ) , 2 h (x ; ϑ) i i=1 ]2 d [ ∑ hβ (xi ; ϑ) =− , h (x ; ϑ) i i=1
Lαλ = − Lββ
]2 d [ ∑ hα (xi ; ϑ)
Lβλ = −
( ) d ∑ h (xi ; ϑ) hβλ (xi ; ϑ) − hβ (xi ; ϑ) hλ xi ; ϕ h (xi ; ϑ)2
i=1
Lλλ =
d ∑
[
h (xi ; ϑ) hλλ (xi ; ϑ) − hλ (xi ; ϑ) −β h (xi ; ϑ)2 i=1 ∑√ −β x5i eλxi , 2
i∈C
√
∑√ x3i eλxi , − i∈C
] x5i eλxi
223 where 1 hα (xi ; ϑ) = √ , 2 xi (0.5 + λxi ) eλxi hβ (xi ; ϑ) = , √ xi ) ( √ 3 + λxi eλxi , hλ (xi ; ϑ) = β xi 2 ( ) √ 3 hβλ (xi ; ϑ) = xi + λxi eλxi , 2 ) √ ( 5 3 hλλ (xi ; ϑ) = β xi + λxi eλxi . 2
Appendix C Appendix for chapter 5 The observed information matrix The elements of the observed information matrix J(ϑ) in Section 5.7.1 are Lαα = −
]2 n [ ∑ hα (xi ; ϑ)
+ (1 − θ)
n ∑
(
xi eα
√ √ xi +β xi eλxi
, √ √ α xi +β xi eλxi − 1) 2 e i=1 i=1 √ √ λx n n ∑ ∑ hα (xi ; ϑ) hβ (xi ; ϑ) xi eα xi +β xi e i +λxi Lαβ = − + (1 − θ) ( α√x +β √x eλxi 2, i i h (xi ; ϑ)2 − 1) i=1 i=1 e √ λx √ n n ∑ ∑ hα (xi ; ϑ) hλ (xi ; ϑ) βx2i eα xi +β xi e i +λxi Lαλ = − + (1 − θ) ( α√x +β √x eλxi 2, i i h (xi ; ϑ)2 − 1) i=1 i=1 e √ n ∑ xi Lαθ = , √ √ λx eα xi +β xi e i − 1 i=1 √ √ λx ]2 n [ n ∑ ∑ hβ (xi ; ϑ) xi eα xi +β xi e i +2λxi Lββ = − + (1 − θ) ( α√x +β √x eλxi 2, h (x ; ϑ) i i i e − 1) i=1 i=1 ( ) n n ∑ ∑ h (xi ; ϑ) hβλ (xi ; ϑ) − hβ (xi ; ϑ) hλ xi ; ϕ Lβλ = − − xi eλxi 2 h (x ; ϑ) i i=1 i=1 {( } √ ) √ √ λx √ n x3i eλxi 1 − β xi eλxi eα xi +β xi e i − 1 ∑ +(θ − 1) , ( α√x +β √x eλxi 2 i i e − 1) i=1 √ λxi n ∑ xi e , Lβθ = √ √ λx α x +β xi e i − 1 e i i=1 h (xi ; ϑ)
225
Lλλ
Lλθ Lθθ
[ ] n √ ∑ h (xi ; ϑ) hλλ (xi ; ϑ) − hλ (xi ; ϑ)2 − β x5i eλxi = 2 h (xi ; ϑ) i=1 {( } √ √ λxi ) α√xi +β √xi eλxi 5 λxi n 1 − β xi e e −1 ∑ xi e +(θ − 1) , ( α√x +β √x eλxi 2 i e i − 1) i=1 √ n ∑ x3i eλxi = , √ √ α xi +β xi eλxi − 1 e i=1 n = − 2, θ
where 1 hα (xi ; ϑ) = √ , 2 xi (0.5 + λxi ) eλxi hβ (xi ; ϑ) = , √ xi ( ) √ 3 hλ (xi ; ϑ) = β xi + λxi eλxi , 2 ( ) √ 3 + λxi eλxi , hβλ (xi ; ϑ) = xi 2 ( ) √ 5 + λxi eλxi , hλλ (xi ; ϑ) = β xi 2 and h (xi ; ϑ) is the HRF of the RNMW distribution.
Appendix D Appendix for chapter 6 The observed information matrix The elements of the observed information matrix J(ϑ) for the DRMW are [ ] (i) Dqq = q −2 Axi (b, c) (Axi (b, c) − 1) q Axi (b,c) − Axi +1 (b, c)(Axi +1 (b, c) − 1)q Axi +1 (b,c) , [ ] (i) (b) Axi (b,c) Axi +1 (b,c) [1 + A (b, c) ln(q)] q Dqb = q −1 A(b) − A [1 + A (b, c) ln(q)] q , x x +1 xi +1 xi i i [ ] (c) (i) Axi (b,c) Dqc = q −1 A(c) − Axi +1 [1 + Axi +1 (b, c) ln(q)] q Axi +1 (b,c) , xi [1 + Axi (b, c) ln(q)] q ] [ ( (b) )2 Ax (b,c) ( (b) )2 Ax +1 (b,c) (i) 2 − Axi +1 q i , Dbb = ln (q) Axi q i ) ] [( ) Ax (b,c) ( (bc) (b) (c) (i) Axi +1 (b,c) (b) (c) (bc) i − Axi +1 + Axi +1 Axi +1 ln(q) q , Dbc = ln(q) Axi + Axi Axi ln(q) q [( ( ) ] ) ( )2 ( (c) )2 (cc) (c) (i) Axi (b,c) + A ln(q) q Dcc = ln(q) A(cc) − A + A ln(q) q Axi +1 (b,c) , xi +1 xi +1 xi xi (ϕ ϕk )
where Axi p
is the second order partial derivative of Axi (b, c) with respect to ϕp and √ √ (cc) (bc) ϕk for p, k = 2, 3. Also, Axi = 3 xi cxi −1 and Axi = b(xi − 1) 3 xi cxi −2 .
View more...
Comments