Open Journal of Statistics
Vol.08 No.03(2018), Article ID:85313,22 pages
10.4236/ojs.2018.83037
On the Use of Second and Third Moments for the Comparison of Linear Gaussian and Simple Bilinear White Noise Processes
Christopher Onyema Arimie1, Iheanyi Sylvester Iwueze2, Maxwell Azubuike Ijomah1, Elechi Onyemachi2
1Department of Mathematics and Statistics, University of Portharcourt, Portharcourt, Nigeria
2Department of Statistics, Federal University of Technology, Owerri, Nigeria
Copyright © 2018 by authors and Scientific Research Publishing Inc.
This work is licensed under the Creative Commons Attribution International License (CC BY 4.0).
http://creativecommons.org/licenses/by/4.0/
Received: May 4, 2018; Accepted: June 12, 2018; Published: June 15, 2018
ABSTRACT
The linear Gaussian white noise process (LGWNP) is an independent and identically distributed (iid) sequence with zero mean and finite variance with distribution . Some processes, such as the simple bilinear white noise process (SBWNP), have the same covariance structure like the LGWNP. How can these two processes be distinguished and/or compared? If is a realization of the SBWNP. This paper studies in detail the covariance structure of . It is shown from this study that; 1) the covariance structure of is non-normal with distribution equivalent to the linear ARMA(2, 1) model; 2) the covariance structure of is iid; 3) the variance of can be used for comparison of SBWNP and LGWNP.
Keywords:
White Noise Process, Normality, Stationarity, Invertibility, Covariance Structure
1. Introduction
A stochastic process , where is called a white noise or purely random process, if with finite mean and finite variance, all the autocovariances are zero except at lag zero. In many applications, is assumed to be normally distributed with mean zero and variance, , and the series is called a linear Gaussian white noise process with the following properties [1] - [7] .
(1.1)
(1.2)
(1.3)
(1.4)
(1.5)
where R(k) is the autocovariance function at lag k, rk is the autocorrelation function at lag k and is the partial autocorrelation function at lag k.
In other words, a stochastic process is called a linear Gaussian white noise if is a sequence of independent and identically distributed (iid) random variables with finite mean and finite variance. Under the assumption that the sample is an iid sequence, we compute the sample autocorrelations as
(1.6)
where
(1.7)
The iid hypothesis is always tested with the Ljung and Box [8] statistic
(1.8)
where is asymptotically a chi-squared random variable with m degree of freedom.
Several values of m are often used and simulation studies suggest that the choice of provides better power performance [9] .
If the data are iid, the squared data are also iid [10] . Another portmanteau test formulated by Mcleod and Li [10] is based on the same statistic used for the Ljung and Box [8]
(1.9)
where the sample autocorrelations of the data are replaced by the sample autocorrelations of the squared data, .
As noted by Iwueze et al. [11] , a stochastic process may have the covariance structure (1.1) through (1.5) even when it is not the linear Gaussian white noise process. Iwueze et al. [11] provided additional properties of the linear Gaussian white noise process for proper identification and characterization from other processes with similar covariance structure (1.1) through (1.5).
Let where , be the linear Gaussian white noise process, the mean , the variance , autocovariances were obtained to be [11]
(1.10)
(1.11)
(1.12)
where
(1.13)
It is clear from (1.12) that when are iid, the powers of are also iid. Iwueze et al. [11] also showed the probability density function (pdf) of to be the pdf of a gamma distribution with parameters
. That is, .
when and [11] concluded that all powers of a linear Gaussian white noise process are iid but not normally distributed.
Using the coefficient of symmetry and kurtosis, Iwueze et al. [11] confirmed the non-normality of . Table 1 gives the mean, variance, the coefficient of symmetry ( ) and kurtosis ( ) defined as follows
(1.14)
(1.15)
where
(1.16)
Table 1. Mean, Variance, Coefficient of symmetry ( ) and kurtosis ( ) for , ,when .
Source: Iwueze et al. (2017).
(1.17)
(1.18)
Using the standard deviations when and the kurtosis of , Iwueze et al. [11] determined the optimal value of d to be three ( ). Hence, for effective comparison of the linear Gaussian white noise process with any stochastic process with similar covariance structure, must be used.
The most commonly used white noise process is the linear Gaussian white noise process. The process is one of the major outcomes of any estimation procedure which is used in checking the adequacy of fitted models. The linear Gaussian white noise process also plays significant role as a basic building block in the construction of linear and non-linear time series models. However, the major problem is that there are many non-linear processes that exhibit the same covariance structure (Equation (1.1) through Equation (1.5)) as the linear Gaussian white noise process. One of such non-linear models is the bilinear models.
The study of bilinear models was introduced by Granger and Andersen [12] and Subba Rao [13] . Granger and Andersen [14] established that all series generated by the simple bilinear model
(1.19)
appear to be second order white noise where is a constant and is an independent identically distributed normal random variable with , . Guegan [15] studied the existence problem of a simple bilinear process satisfying
(1.20)
Martins [16] obtained the autocorrelation function of the process for the simple bilinear model defined by (1.19) when is iid with a Gaussian distribution. Again, Martins [16] studied the third order moment structure of (1.19) with non-independent shocks. Recently, properties of the simple bilinear model (1.19) were addressed by Malinski and Bielinska [17] , Malinski and Figwer [18] and Malinski [19] . Iwueze [20] studied the more general bilinear white noise model
(1.21)
where is as defined in (1.19). Iwueze [20] was able to show the following.
1) The series satisfying (1.21) is strictly stationary, ergodic and unique.
2) The series satisfying (1.21) is invertible.
3) The series satisfying (1.21) has the same covariance structure as the linear Gaussian white noise processes.
4) Obtained the covariance structure of (1.21) to be
(1.22)
(1.23)
5) The series satisfying (1.21) is invertible if
(1.24)
For the simple bilinear model (1.19), it follows that
(1.25)
and the invertibility condition is
(1.26)
It is worthy to note that the stationarity condition
(1.27)
is structure (k, n) independent [19] for model (1.19) and our study in this paper will concentrate on model (1.20). The purpose of this paper is to meet the following goals for the simple bilinear model satisfying (1.20).
1) Determine for the simple bilinear model (1.20).
2) Determine the covariance structure of , when satisfies (1.20).
3) Determine for what values of the simple bilinear white noise process will be identified as a Linear Gaussian white noise process.
4) Determine for what values of the simple bilinear model will be normally distributed.
This paper is further divided into four sections in order to establish and achieve these goals. Section 2 discusses the covariance structure of when , , Section 3 presents the methodology, Section 4 is the results and discussion while, Section five is the conclusion.
2. Covariance Structure of , When ,
Theorem 2.1.
Let be the linear Gaussian white noise process with and . Suppose there exists a stationary and invertible process satisfying for every for some constant , then has the following properties:
(2.1)
(2.2)
(2.3)
has the same covariance structure as the linear ARMA(2, 1) process (2.4)
(2.4)
where is the sequence of independent and identically distributed random variable with and .
Proof:
Let
(2.5)
(2.6)
Now,
(2.7)
Hence,
(2.8)
By the assumption of stationarity,
(2.9)
(2.10)
Hence,
(2.11)
(2.12)
Note that
(2.13)
Hence
(2.14)
We have shown that
(2.15)
Similarly;
(2.16)
Generally;
(2.17)
Hence,
(2.18)
and
(2.19)
With this result, it is clear that when is defined by (1.20), has the same covariance structure as the linear ARMA(2, 1) process. Its linear equivalence is
(2.20)
where is the purely random process with and . Table 2 compares with its linear ARMA(2, 1) equivalence.
Theorem 2.2.:
Let be the linear Gaussian white noise process with and . Suppose there exists a stationary and invertible process satisfying for every and some constant , then the mean and variance of are
(2.21)
Table 2. Covariance analysis of when , and its linear ARMA(2, 1) equivalence.
(2.22)
(2.23)
The covariance structure of is that of the linear white noise process.
Proof:
Let (2.24)
(2.25)
(2.26)
(2.27)
(2.28)
(2.29)
Some Results
Proof:
Proof:
Proof:
Proof:
ÞNow
Hence,
Now
But,
Now,
Hence,
, when .
, when .
Generally, , when .
Therefore, given , and , the following are true .
The covariance structure of identifies the process as linear white noise.
3. Methodology
3.1. Normality Checking
The Jarque-Bera (JB) test [21] [22] [23] will be used to determine for which values of a simple bilinear model (1.20) is normally distributed or not. The JB test statistic is
(3.1)
where
(3.2)
(3.3)
n is the sample size while, and are the sample skewness and kurtosis coefficients. The asymptotic null distribution of JB is with 2 degrees of freedom.
3.2. White Noise Test
The modified Ljung-Box test statistic [11] given by
(3.4)
is used to test the iid hypothesis for for the simple bilinear model (1.20). It is important to note from Theorem 2.1 that has ARMA(2, 1) structure while from Theorem 2.2, is iid. This test will look for values where both and are jointly iid. That will help determine the values of for which the simple bilinear model (1.20) is not distinguishable from the linear Gaussian white noise process (LGWNP). Then, the hypothesis of iid data is rejected at level if the observed is larger than the quartile of the distribution, where [9] .
3.3. Use of Chi-Square Test for Comparison of the Simple Bilinear White Noise Process and the Linear Gaussian White Noise Process
From Theorem 2.3, the third power of the simple bilinear process is iid. A test is needed to confirm that the simple bilinear process (1.20) is not a linear Gaussian white noise process (LGWNP). For the LGWNP ; , and . To show that the simple bilinear process (1.20) is not LGWNP, we need to test the hypothesis;
(3.5)
against the alternative hypothesis
(3.6)
The chi-square test [24] [25] can be used to perform the test. The chi-square test statistic is
(3.7)
where is the sample variance of that follows (1.20), is an estimate of the true variance of the simple bilinear process (1.20) and n is the number of observations of the series. The null hypothesis is rejected at level if the observed value of is larger than quartile of the chi-square distribution with .degree of freedom. It should be noted that this test works well when the underlying original population is normally distributed.
4. Results and Discussion
One thousand random digits that met the condition were simulated using Minitab 16 series software. Only one random digit, shown in Appendix I, was used for demonstration in the study because of want of space. The estimates of the descriptive statistics (mean, variance, skewness ( ) and kurtosis ( )) and other tests (Jarque Bera (JB) test, modified Ljung Box test (Q*) and chi-square calculated test statistic) for the powers of the random digit are shown in Table 3. The results obtained using the JB, Q* and the chi-square test indicated as a LGWNP at 5% level of significance.
The LGWNP were used to simulate the SBWNP , for satisfying the existence of using Fortran 77 program. The estimates of the descriptive statistic and that for the test statistic (JB, Q* and the chi-square calculated test statistic) are shown in Table 4. The values of the JB statistic show that the SBWNP are normally distributed for . Similarly, the values of Q* and the chi-square calculated test statistic ( ) show that the SBWNP is iid and can be identified as a LGWNP for some values. The values of where the SBWNP will be identified as an LGWNP are summarized in Table 5.
5. Conclusion
We have been able to establish the covariance structure for
Table 3. Descriptive Statistics and estimate of the test statistic for rejecting the null hypothesis of equality of the variance of higher moment for the simulated series, , as linear Gaussian white noise process.
Table 4. Descriptive statistics and estimate of the test statistic for simulated bilinear series , and .
Table 5. Values of for comparison of SBWNP as a LGWNP at 0.05 and 0.10 levels.
satisfying (1.20). We have also determined the values of for which the simple bilinear model (1.20) is normally distributed and in which the process can be determined as a LGWNP or not. We recommend that for proper comparison of SBWNP with LGWNP, the SBWNP should be considered for normality, white noise test and test of equality of variance of its third moment being equivalent to the theoretical values of the LGWNP.
Cite this paper
Arimie, C.O., Iwueze, I.S., Ijomah, M.A. and Onyemachi, E. (2018) On the Use of Second and Third Moments for the Comparison of Linear Gaussian and Simple Bilinear White Noise Processes. Open Journal of Statistics, 8, 562-583. https://doi.org/10.4236/ojs.2018.83037
References
- 1. Nagpaul, P.S. (2005) Time Series Analysis in Win IDAMS, New Delhi, India. https://pdfs.semanticscholar.org/ddb0/14582fd074d682aec17151ff4d0833aa9b10.pdf
- 2. Greene, W.H. (2005) Econometric Analysis. 5th Edition, Pearson Education Inc., London.
- 3. Brooks, C. (2013) Introductory Econometrics for Finance. 3rd Edition, Cambridge.
- 4. Chatfield, C. (2004) Time Series Forecasting. Chapman & Hall/CRC, New York.
- 5. Pollock, D.S.G. (2008) Stationary Stochastic Processes. Econometric Theory. http://www.le.ac.uk/users/dsgp1/COURSES/MESOMET/ECMETXT/11mesmet.PDF
- 6. Granger, C.W.J. and Newbold, P. (1977) Forecasting Economic Time Series. Academic Press, New York.
- 7. Brockwell, P. and Davies, R.A. (2002) Introduction to Time Series and Forecasting. 2nd Edition, Springer, New York. https://doi.org/10.1007/b97391
- 8. Ljung, G.M. and Box, G.E.P. (1978) On a Measure of Lack of Fit in Time Series Model. Biometrika, 65, 297-303. https://doi.org/10.1093/biomet/65.2.297
- 9. Tsay, R.S. (2002) Analysis of Financial Time Series. John Willey & Sons, New York. https://doi.org/10.1002/0471264105
- 10. McLeod, A.I. and Li, W.K. (1983) Diagnostic Checking ARMA Time Series Models Using Squared-Residual Autocorrelations. Journal of Time Series Analysis, 4, 269-273. https://doi.org/10.1111/j.1467-9892.1983.tb00373.x
- 11. Iwueze, I.S., Arimie, C.O., Iwu, H.C. and Onyemachi, E. (2017) Some Applications of Higher Moments of the Linear Gaussian White Noise Process. Applied Mathematics, 8, 1918-1938. https://doi.org/10.4236/am.2017.812136
- 12. Granger, C.W.J. and Andersen, A.P. (1978a) An Introduction to Bilinear Time Series Models. Vanderhoeck and Reprecht, Gottingen.
- 13. Subba Rao, T. (1978) The Estimation of Parameters of Bilinear Time Series Model. Technical Report, No 79, Department of Mathematics, University of Manchester, Manchester.
- 14. Granger, C.W.J. and Andersen, A. (1978) On the Invertibility of Time Series Models. Stochastic Processes and Their Applications, 8, 87-92. https://doi.org/10.1016/0304-4149(78)90069-8
- 15. Guegan, D. (1981) Etude d’un Modèle non Linéaire, le Modèle Superdiagonal d’Ordre 1. Comptes Rendus de l’Académie des Sciences—Series I, 293, 95-98.
- 16. Martins, C.M. (1999) A Note on the Third-Order Moment Structure of a Bilinear Model with Non-Independent Shocks. Portugaliae Mathematica, 56, 115-125.
- 17. Malinski, L. and Bielinska, E. (2010) Statistical Analysis of Minimum Prediction Error Variance in the Identification of a Simple Bilinear Time Series Model. Advances in System Science, 9, 183-188.
- 18. Malinski, L. and Figwer, J. (2011) On Stationarity of Elementary Bilinear Time-Series. 2011 16th International Conference on Methods and Models in Automation and Robotics (MMAR), Miedzyzdroje, 22-25 August 2011, 157-161.
- 19. Malinski, L. (2016) Identification of Stable Elementary Bilinear Time-Series Model. Archives of Control Sciences, 26, 577-595.
- 20. Iwueze, I.S. (1988) Bilinear White Noise Processes. Nigerian Journal of Mathematics and Applications, 1, 51-63.
- 21. Jarque, C.M. and Bera, A.K. (1980) Efficient Tests for Normality, Homoscedasticity and Serial Independence of Regression Residuals. Economics Letters, 6, 255-259. https://doi.org/10.1016/0165-1765(80)90024-5
- 22. Jarque, C.M. and Bera, A.K. (1981) Efficient Tests for Normality, Homoscedasticity and Serial Independence of Regression Residuals: Monte Carlo Evidence. Economics Letters, 7, 313-318. https://doi.org/10.1016/0165-1765(81)90035-5
- 23. Jarque, C.M. and Bera, A.K. (1987) A Tests for Normality of Observations and Regression Residuals. International Statistical Review, 55, 163-172. https://doi.org/10.2307/1403192
- 24. Snedecor, G.W. and Cochran, W.G. (1989) Statistical Methods. 8th Edition, Iowa State University Press, Ames.
- 25. Milton, J.S. and Jesse, C.A. (1995) Introduction to Probability and Statistics: Principles and Applications for Engineering and the Computing Sciences. McGraw-Hill Inc., New York.
Appendix I
Simulated Random Digits; (Read Across).