To elucidate the social effects of an influenza outbreak, the World Health Organization recommends a concept for excess mortality attributable to an influenza outbreak. However, because several models exist to estimate excess mortality, we would like to ascertain the most appropriate of three models: the Center for Disease Control and Prevention (CDC) model, the seasonal autoregressive integrated moving average (SARIMA) model, and the National Institution of Infectious Diseases (NIID) model. Excess mortality is defined as the difference between the actual number of deaths and the epidemiological threshold. The epidemiological threshold is defined as upper bound of 95% confidence interval (CI) of the baseline. The actual number of deaths might be less than the baseline, which implies inconsistent with the definition of baseline. Especially, actual deaths fewer than the lower bound of 95% CI of baseline suggest the inappropriateness of a model of excess mortality. Among 123 months during epidemic periods, the NIID model found excess mortality in 56 months, CDC model in 31 months, and SARIMA model in 35 months. Conversely, the NIID model found negative excess mortality in only 2 months, but the CDC model and SARIMA model found it respectively for 10 and 33 months. Negative excess mortality represents the logical inconsistency of the model. Therefore, NIID model might be the best among the three models considered.
Because published official statistics of causes of death are based only on the most fundamental cause of death, the social impact of influenza cannot be estimated from them. Influenza is classified sometimes as a cause leading directly to death and other causes are classified the most fundamental cause of death. Actually, influenza outbreaks are well known to induce death by stroke or heart attack [
Actually, it should be impossible to laboratory test for all death. Alternatively, estimation of influenza associated death from their last symptoms leads to drastic underestimation. Instead of counting influenza associated death, “excess mortality” was estimated using a statistical model with consideration of the pattern of fluctuation of non influenza associated death. In fact, WHO used Serfling model [
We developed the National Institution of Infectious Diseases (NIID) model, which overcomes some of the shortcomings described above such as necessity of “non-epidemic season.” It does not presume a baseline as reverse pattern in “non-epidemic season.” It is therefore a more appropriate model. Moreover, we have applied the NIID model to the timely situation awareness of influenza associated death project by Ministry of Health, Labour and Welfare (MHLW) and have published the results in Japanese at https://www.niid.go.jp/niid/ja/flu-m/2112-idsc/jinsoku/131-flu-jinsoku.html since 2000.
Actually, the NIID model is a kind of Stochastic Frontier Estimation. We explained its theoretical framework and compared it to other models including the CDC model [
The mortality data used for this study was all caused death in Vital Statistics from January 1987 to March 2017, although CDC model, SARIMA model, and Takahashi model were applied for other types of data in the original research [
Aside from the NIID model, a non-epidemic period and an epidemic period must be defined ex ante for the three models. The definitions of epidemic period mutually differed in their original research [
Excess mortality is defined as the difference between the actual number of deaths and the epidemiological threshold. The epidemiological threshold is defined as the upper bound of 95% confidence interval (CI) of the baseline. The baseline is defined as the number of deaths that are likely to have occurred if an influenza outbreak had not happened. Therefore, if the actual deaths were fewer than the epidemiological threshold, then excess mortality was not observed.
Sometimes the actual number of deaths might be less than the baseline. The baseline was defined as the number of deaths occurring without an influenza outbreak. Therefore, it is inconsistent with the definition of the baseline. Estimation should include measurement error. Therefore, occurrence of fewer death than in the baseline can happen. However, if the actual number of deaths is less than the lower bound of 95% CI, then it must be designated it as negative excess mortality, which reflects an unusually good health condition of the population. Such a shock was not defined in the conceptual framework of excess mortality. Actually, such situations are undesirable because they imply inappropriate use of the model: overestimating the baseline and underestimating excess mortality. Therefore, the frequency and size of negative excess mortality is expected to be an indicator of the estimative capability of the model for excess mortality. We adopt it as the evaluation axis for inter-model comparison.
Our NIID model, the Stochastic Frontier Estimation [
log D t = α + β T t + γ T t 2 + Σ η i M i t + ε t (1)
and
ε t = ν t + | ω t | , (2)
where Dt represents all causes of death in month/year t, Tt denotes the linear time trend, and Mit is the dummy variable for a month, which is one if t is the i-th month and otherwise zero. Moreover, νt and ωt are stochastic variables as νt ~N(0, μ2) and ωt ~N(0, ξ2) and are mutually independent. Although νt is stochastic disturbances, ωt represents non-negative death caused by influenza. These disturbance terms in this model are parameterized by two parameters: ξ/μ and (μ2 + ξ2)0.5. If the null hypothesis ξ/μ = 0 is not rejected, then the Stochastic Frontier Estimation model is inappropriate.
The CDC model was defined originally for weekly data in the non-epidemic season as
log D t = α + β cos 2 π T t / 52 + γ sin 2 π T t / 52 2 + η T t + ε t . (3)
However, we can arrange it for monthly data for comparison as
log D t = α + β cos 2 π T t / 12 + t γ sin 2 π T / 12 + η T t + ε t . (4)
The SARIMA (k, l, m, n) model is represented in non-epidemic season as shown below.
( 1 − φ 1 L − ⋯ − φ k L k ) ( 1 − γ 1 L 12 − ⋯ − γ l L 12 l ) ( 1 − L ) log D t = ( 1 − θ 1 L − ⋯ − θ m L m ) ( 1 − δ 1 L 12 − ⋯ − δ n L 12 n ) ε t (5)
where L is a lag operator. Also, 1 − φ 1 L − ⋯ − φ k L k denotes AR(k) part, 1-L signifies integration, 1 − θ 1 L − ⋯ − θ m L m expresses MA(m) part, 1 − γ 1 L 12 − ⋯ − γ l L 12 l stands for seasonality AR(l) part and 1 − δ 1 L 12 − ⋯ − δ n L 12 n represents the seasonality MA(n) part. The number of lags in each part (k, l, m, n) should be selected using the Akaike Information Criterion which minimize −2log likehood + 2 (number of parameters).
The Takahashi model assumes a baseline as geometric average for each month in the non-epidemic season.
To model performance, we apply the NIID, CDC, SARIMA, and Takahashi models to all causality data in Japan from January 1987 through May 2017. For the CDC, SARIMA and Takahashi model, we assumed the non-epidemic season as April-November in each year. As described above, we adopted the number of negative excess mortality, which is defined as the number of months during which the actual number of deaths is lower than the lower bound of 95% CI of the baseline in epidemic season.
We used only published data. No area of ethical concern is applicable to this study.
The Takahashi model required a non-epidemic season in the same month, for example, in January. Therefore, we declined this model to compare other models under the current assumption of the non-epidemic season.
Explanatory variables | Estimated coefficients | p-value |
---|---|---|
Constant | 11.1257 | <0.0004 |
Time trend | 0.001389 | <0.0004 |
Time trend2 | 0.00000058 | <0.0004 |
January | 0.069472 | <0.0004 |
February | −0.057158 | <0.0004 |
March | −0.012998 | 0.160 |
April | −0.102083 | <0.0004 |
May | −0.122798 | <0.0004 |
June | −0.210181 | <0.0004 |
July | −0.177392 | <0.0004 |
August | −0.173152 | <0.0004 |
September | −0.210230 | <0.0004 |
October | −0.120948 | <0.0004 |
November | −0.089646 | <0.0004 |
ξ/μ | 2.32648 | <0.0004 |
(μ2 + ξ2)0.5 | 0.047928 | <0.0004 |
Note: The number of observations was 365. Log likelihood was 822.690. ξ2 denotes the variance of the non-negative disturbance term. μ2 is the variance of the disturbance term.
Explanatory variables | Estimated coefficients | p-value |
---|---|---|
Constant | 11.0403 | <0.0004 |
Cosine | 0.073132 | <0.0004 |
Sine | 0.068068 | <0.0004 |
Time trend | 0.001591 | <0.0004 |
Note: The number of observations was 273. Log likelihood was −515.693. The coefficient of determination was 0.959138.
Number of parameters | AIC | |||
---|---|---|---|---|
AR | MA | SAR | SMA | |
1 | 0 | 0 | 0 | 6796.8 |
0 | 1 | 0 | 0 | 6765.94 |
0 | 0 | 1 | 0 | 6561.86 |
0 | 0 | 0 | 1 | 6562.24 |
1 | 0 | 1 | 0 | 6346.46 |
0 | 1 | 1 | 0 | 6524.44 |
0 | 0 | 2 | 9 | 6535.94 |
0 | 0 | 1 | 1 | 6549.14 |
2 | 0 | 1 | 0 | 6320.6 |
1 | 1 | 1 | 9 | 6286.42 |
1 | 0 | 2 | 0 | 6318.1 |
1 | 0 | 1 | 1 | 6279.92 |
2 | 0 | 1 | 1 | 6252.74 |
1 | 1 | 1 | 1 | 6204.94 |
1 | 0 | 2 | 1 | 6353.82 |
1 | 0 | 1 | 2 | 6222.52 |
2 | 1 | 1 | 1 | 6185.64 |
1 | 2 | 1 | 1 | 6187.4 |
1 | 1 | 2 | 1 | 6206.26 |
1 | 1 | 1 | 2 | 6201.12 |
3 | 1 | 1 | 1 | 6187.56 |
2 | 2 | 1 | 1 | 6187.56 |
2 | 1 | 2 | 1 | 6186.58 |
2 | 1 | 1 | 2 | 6184.1 |
3 | 1 | 1 | 2 | 6188.38 |
2 | 2 | 1 | 2 | 6188.88 |
2 | 1 | 2 | 2 | 6199.46 |
2 | 1 | 1 | 3 | 6207.86 |
Note: The AR column shows the number of parameters in the autoregressive part, k, in Equation (3). The MA column shows the moving average part, m. The SAR column shows the seasonal autoregressive part, l. The SMA column shows the moving average part, n. AIC is defined as −2 × log of likelihood +2 Number of parameters. Finally, we selected (2, 1, 1, 2) model.
Explanatory variables | Estimated coefficients | p-value |
---|---|---|
φ1 | 1.40103 | <0.0004 |
φ1 | −0.401645 | <0.0004 |
θ1 | 0.849380 | <0.0004 |
γ1 | 0.708207 | <0.0004 |
δ1 | 1.67546 | <0.0004 |
δ2 | −0.756086 | <0.0004 |
Note: The number of observations was 273. Log likelihood was −3086.05. The coefficient of determination was 0.586015. Also, φs are parameters of autoregressive (AR) part, θ is the moving average (MA) part, γ is the seasonal autoregressive (SAR) part, and δs is the seasonal moving average (SMA) part.
This paper presented NIID model which applies the situation in Japan, with results published officially for almost twenty years. Results demonstrate that little negative excess mortality existed in NIID model, but the other two models were adversely affected by several instances of negative excess mortality. Negative excess mortality demonstrates the logical inconsistency of estimation model. Therefore, the NIID model might be the best model among the three models considered. In other words, the baseline is apparently overestimated, i.e. excess mortality seems to underestimate in the other two models.
One benefit of the NIID model was that the arbitrary setting of non-epidemic season is unnecessary, unlike other models. Therefore, we can use all data. In the other models, during the ex post epidemic period, the estimation result is obtained when excess mortality is observed does not necessarily match the ex ante epidemic period as arbitrarily set before estimation. That is apparently an inconsistency in
NIID model | CDC model | SARIMA model | |
---|---|---|---|
No. months excess mortality | 56 | 31 | 32 |
No. months negative excess mortality | 2 | 10 | 33 |
Note: The number of months under consideration was 123.
estimation model. Conversely, the NIID model can avoid such internal inconsistency.
Finally, one must recall that comparison among four models was conducted using the same data: all causes of death. However, the original research of the CDC and SARIMA model used other data for mortality. Moreover, those models including the Takahashi model adopted their unique definition of the non-epidemic period. Therefore, precise comparison including the type of data and definition of non-epidemic period was impossible. To compare those three models, we used common monthly data of mortality and common definition of non-epidemic season for CDC model and SARIMA model in the present study. Therefore, it is noteworthy that we did not compare the benefits and shortcomings of the four original models.
The present study was constrained by some limitations. First, we compare three models using Japanese monthly data and under the same simple assumption of non-epidemic season, even though the original CDC model and SARIMA model used weekly data and a flexible definition of non-epidemic season. If we compare the four models using weekly data and/or with original flexible definition of non-epidemic season might be different from the present study. However, in Japan, weekly mortality data is not available in general. It remains as challenge for future research.
Second, we do not compare the Takahashi model to the other three models because of simple assumption of non-epidemic season. The Takahashi model might be compared to other three models if one were to adopt the original definition of non-epidemic season in the Takahashi model. However, in fact in the last ten years, influenza activity in January or February were quite high and thus those period should be included to epidemic season, the Takahashi model might not work in this period.
Thirdly, although we used only calendar information, recent studies tend to examine virological data specifically [
We demonstrated that the NIID model might be more appropriate than the other two models in the respect of logical adequacy concerning about “negative excess mortality.” The other two models apparently underestimate of excess mortality under the same data and definition of non-epidemic season. It has been used as a procedure for official excess mortality in Japan for almost twenty years and has been applied to large cities, with results of estimated excess mortality published timely as an MHLW project.
We acknowledge Dr. Nobuhiko Okabe, Kawasaki City Institute for Public Health C, Dr. Kiyosu Taniguchi, National Hospital Organization Mie National Hospital, and Dr. Nahoko Shindo, WHO for their helpful support.
The authors have no conflict of interest to declare.
Sugawara, T. and Ohkusa, Y. (2019) Comparison of Models for Excess Mortality of Influenza Applied to Japan. Journal of Biosciences and Medicines, 7, 13-23. https://doi.org/10.4236/jbm.2019.76002