Journal of Mathematical Finance
Vol.08 No.02(2018), Article ID:84885,20 pages
10.4236/jmf.2018.82027
Limit Theory of Model Order Change-Point Estimator for GARCH Models
Irene W. Irungu1*, Peter N. Mwita2, Antony G. Waititu3
1Pan-African University Institute of Basic Sciences, Technology and Innovation, Nairobi, Kenya
2Machakos University, Machakos, Kenya
3Jomo Kenyatta University of Agriculture and Technology, Nairobi, Kenya
Copyright © 2018 by authors and Scientific Research Publishing Inc.
This work is licensed under the Creative Commons Attribution International License (CC BY 4.0).
http://creativecommons.org/licenses/by/4.0/
Received: March 16, 2018; Accepted: May 25, 2018; Published: May 28, 2018
ABSTRACT
The limit theory of a change-point process which is based on the Manhattan distance of the sample autocorrelation function with applications to GARCH processes is examined. The general theory of the sample autocovariance and sample autocorrelation functions of a stationary GARCH process forms the basis of this study. Specifically the point processes theory is utilized to obtain their weak convergence limit at different lags. This is further extended to the change-point process. The limits are found to be generally random as a result of the infinite variance.
Keywords:
Autocorrelation Function, Change-Point, Convergence, GARCH, Manhattan Distance, Model Order, Point Process, Regular Variation, Weak Limit
1. Introduction
Empirical observation made in Econometrics and applied financial time series literature for long time horizons reveal that log-returns of various series of share prices, exchange-rates and interest rates depict unique stylized features. These features include: the frequency of large and small values is rather high suggesting that the data do not come from a normal but rather a heavy tailed distribution and that exceedances of high thresholds occur in clusters which indicates that there is dependence in the tails. It is also observed that the sample autocorrelations of data are small whereas the sample autocorrelation of the absolute and squared values is significantly different from zero even for large lags. This behavior suggests that there is some kind of long-range dependence in the data.
Various models have been proposed in order to describe these features. Among these models is the GARCH model which has been found appropriate in capturing volatility dynamics in financial time series particularly in modelling of stock market volatility as seen in [1] and derivative market volatility as utilized by [2] . GARCH (1, 1) in particular is often used in applications as it is believed to capture, despite its simplicity, variety of the empirically observed stylized features of the log-returns. However the log-return data cannot be modelled by one particular GARCH model over a long period of time [3] . They observe that in real financial time series the effect of non-stationarity of log-return series can be seen by considering the sample autocorrelation function of moving blocks of the same length as the estimates seem to differ from block to block. They suggest the use of change-point analysis of financial time series modelled by GARCH processes with parameters varying with time. The likelihood ratio scan method has been proposed by [4] for estimating multiple change points in piecewise stationary processes where they use a scan statistics to reduce the computationally infeasible global multiple change point estimation problem to a number of single change point detection problems in various local windows. The cumulative sum test is considered by [5] in determining volatility shifts in GARCH model against long range dependence. Cumulative sum test has also been used by [6] for change-point detection in copula ARMAGARCH Models. Markov switching GARCH model has been proposed by [7] where the volatility in each state is a convex combination of two different GARCH components with time varying weights making the model have a dynamic behavior to capture the variants of shocks. According to [8] change-point in the series could also be attributed to change in GARCH model order specification. The trio proposes an estimator based on the Manhattan distance of the sample autocorrelation of squared values. This paper aims at furthering the works of [8] by deriving the distributional convergence of the process used in deriving the estimator of change-point . Since is based on Manhattan distance of sample autocorrelation, the limit theory for sums of strictly stationary sequences is utilized. Conditions that ensure that partial sums of strictly stationary processes converge in distribution to an infinite variance stable distribution have provided by [9] . This is achieved by relating the regular variation condition and weak convergence of point processes. This was utilized by [10] in deriving the limit theory for the autocovariance function of linear processes which they later extended to bilinear processes in [11] . Limit theory for sample autocovariance of GARCH processes was also considered by [12] where they used weak convergence of point processes in combination with continuous mapping theorem. Point processes were also utilized by [13] in examining the convergence of the partial sum process of stationary regularly varying GARCH (1, 1) sequences for which the clusters of high thresholds excesses are broken down into asymptotically independent blocks which they established to be a stable Levy’s process. We utilize the point processes theory and restrict ourselves to qualitative results.
The paper is organized as follows. Section 2 outlines the GARCH model specification and change-point estimator with corresponding assumptions utilized. The weak convergence of point processes associated with the sequence is considered in Section 3. In Section 4, the asymptotic behavior of the change-point process is studied. Here the limiting distribution of is derived for a stationary GARCH sequence.
2. Change-Point Estimator
Let be a GARCH process of order given by the equation
(1)
By iterating the defining difference Equation (1) for the GARCH model can be further expressed as a stochastic differential equation as follows:
Let , , then ( ) satisfies the following stochastic differential equation
(2)
Specifically for the GARCH (1, 1) case with and Equation (2) reduces into a one-dimensional SDE
(3)
Assumption 1. (Strictly Stationary)
According to [14] the existence of a unique strictly stationary solution to (1) is the negativity of the top Lyapunov exponent. This however cannot be calculated explicitly but a sufficient condition for this is given by
Assumption 2. (Ergodic Process)
According to [15] standard ergodic theory yields that ( ) is an ergodic process. Thus its properties can be deduced from a single sufficiently large random sample of the sample.
Consider the change-point test hypothesis to be investigated to be defined as:
(4)
Assumption 3. (Weight)
Let the weight be a measurable function that depends on the sample size n and change-point k. It is arbitrarily chosen such that it satisfies the condition that
(5)
Consider Assumption [1] , Assumption [2] and Assumption [3] to be satisfied. According to [8] the change-point estimator as hypothesized in (4) is based on the lower bound of the weighted Manhattan divergence measure of the sample autocorrelation function drawn for the process as
(6)
where and k denote sample autocorrelation function and the unknown change-point respectively which are estimated as:
(7)
Proof. The works of [8] are utilized here. Let be a k dimensional vector and be a dimensional vector. The autocovariance and autocorrelation functions can be expressed in terms of the inner product as
(8)
(9)
where and represents the standard deviation of X and Y respectively which represents an distance from the mean. Applying the Holder’s inequality in Theorem (7) to (8) and (9) yields
(10)
Following (10) we can define a sequence of autocorrelation functions where for fixed , and for fixed , to be such that we have two subsequences and
where and denote the autocorrelation of the sequence and for . A change-point
process quantifying the deviation between and using a divergence measure motivated by the weighted distance, with k denoting the change-point is proposed. Specifically, they assumed the case when resulting into a weighted Manhattan distance and by linearity and absolute value of inequalities of the expectation operator results into
(11)
The change-point estimator is processes is assumed to be the lower bound of the Manhattan divergence measure (11) where the weight is as specified in Assumption 3. The resultant process is as specified in (6). The change-point estimator of a change point is the point at which there is maximal sample evidence for a break in the sample autocorrelation function of the squared returns process. It is therefore estimated as the least value of k that maximizes the value of where is chosen as given in (7).
3. Point Process Theory
Point process techniques are utilized in obtaining the structure of limit variables and limit processes which occur in the theory of summation in time series analysis. The point process theory as developed by [16] is utilized. Consider the state space of the point process where . Let B be the collection of bounded Borel sets in . Let be a collection of bounded non-negative continuous functions on with bounded support and be a collection of bounded non-negative step functions on with bounded support. Write M for the collection of Radon counting measures on with null measure o. This means that if and only if μ is of the form , where , the points are distinct and
and is a Dirac measure at , that is for any . Let be the collection of measures μ such that , so that, . Define and let be the Borel set on .
Consider a strictly stationary sequence of random row vectors with values in , that is, . The characterization of the asymptotic behavior of the tails of the random variable X is examined through the regular variation condition.
Theorem 1. (Regular Variation Condition)
In light of [17] assume
1) there exist a number which is a unique solution of the equation
and there exist a positive constant such that
2) If for some , then
and the vector is jointly regularly varying such that
where denotes vague convergence on the Borel σ-field of the unit sphere S1 of , relative to the norm with
Proof. Following the works of [17] and [18] , assume ξ and η are independent non-negative random variables such that for some slowly varying function L and for some , then as .
Applying Theorem 1 yields
also
which completes proof.
Theorem 2. (Strongly Mixing Condition)
Let ( ) be a sequence of positive numbers such that
(12)
The sequence ( ) can be chosen as the -quantile of . Since is regularly varying, for slowly varying function . The condition (12) holds for ( ) if there exists a sequence of positive integers ( ) such that , as and
(13)
The condition (12) implies by the strong mixing condition of the stationary sequence ( ).
Assume that the joint regular variation in Theorem 1 and strongly mixing conditions in Theorem 2 are satisfied for a stationary sequence ( ), then, the statement can be made for the weak convergence of the sequence of point processes
(14)
Define
(15)
where are independent and identically distributed as . It therefore follows that ( ) converges weakly if and only if does and they have the same limit N. N is identical in law to the point process where is a Poisson process with describing the radial part of the points and is a sequence of independent and identically distributed point processes with describing the spherical part and a joint distribution Q on .
Theorem 3. Assume that ( ) is a stationary sequence of random vectors for which all finite-dimensional distributions are jointly regularly varying index . To be specific, let be the -dimensional random row vector with values in the unit sphere , . Assume that the strongly mixing condition for ( ) and that
Then the limit
exists and is the extremal index of the sequence .
1) If , then
2) If , then
where is a Poisson process on with describing the radial part of the points and is a sequence of independent and identically distributed point processes with describing the spherical part and a joint distribution Q on , where Q is the weak limit of
Theorem 4. Utilizing the theory developed by [3] , let ( ) be a stationary GARCH (1, 1) process and assume that the jointly regularly varying and strongly mixing conditions hold. For fixed , set , then the conditions in the Theorem 2 above are met and hence
(16)
where and are as previously defined.
We now consider the convergence of point processes which are products of random variables, which forms the basis of the results on the weak convergence of sample autocovariance and autocorrelation for stationary processes.
Theorem 5 Let ( ) be a strictly stationary sequence such that satisfying the jointly regularly varying condition for some and further assume that Theorem 2 and Theorem 3 hold, then:
(17)
where the points and are as previously defined, and are point processes on meaning that points are not included in the point processes if or
We study the weak limit behaviour of the sample autocovariance and sample autocorrelation of a stationary sequence ( ). Construct from this process the strictly stationary n-dimensional processes , . Define the sample autocovariance function
(18)
and the corresponding sample autocorrelation function
(19)
Define the deterministic counterparts of the autocovariance and autocorrelation functions as follows
(20)
(21)
Theorem 6. Assume that ( ) is a strictly stationary sequence of random variables and that for a fixed , ( ) satisfies the regular variation condition and where the points and are as previously defined.
1) If , then
where
The vector is jointly stable in .
2) If and for
then
which implies that
4. Limit Theory of Change-Point Estimator
The following proposition is our main result on weak convergence for our proposed change-point process as specified in (6) for GARCH processes based on the point process theory. In addition to the previously stated Theorems are additional Theorems are utilized in the proof of the proposition, see Appendix.
Proposition 2 Let be a strictly stationary sequence of random variables irrespective of the distribution of initial value . Specifically, let be a GARCH (1, 1) process defined in the form of a stochastic differential Equation (3). For fixed , set . Assume that the regular variation conditions hold. Let be a sequence of constants such that the strongly mixing condition is satisfied, then where the points and are as defined in Theorem 2. Thus the conditions in Theorem 5 are met and hence there exists a sequence of bounded constants which converge in distribution to such that the following statements hold:
1) If , then
2) If and for
then
where
Proof. Consider the GARCH (1, 1) model in the context of a stochastic differential Equation (3) defined as , then the necessary and sufficient conditions for stationarity are and where the latter implies that
.
If we assume that the sample vector comes from a stationary model, then the initial values also have a stationary distribution. This means that the distribution of is stationary whatever the distribution of , given the latter is independent of and stationarity conditions. To show this consider two sequences and given the same stochastic differential equation recursion (2) but with initial conditions and Z where both vectors are independent of the future values . Further assume that has stationary distribution. By iteration of stochastic differential Equation (3) we have
Thus for any initial values Z we have the following recursion
Then for any and for GARCH (1, 1) model (3) the top Lyapunov exponent given by
(22)
If , and , then the right hand side is also finite. In addition given the stationary conditions previously stated then for some sufficiently small ε. Thus the left hand side of (22) decays to zero as . Thus we conclude that is stationary irrespective of the distribution of the initial values .
Now, consider the sample autocorrelation function as defined in (19), then the following statements hold,
(24)
(25)
From (23) and (24) it can be asserted that there exists constants and such that the autocorrelation functions and can be expressed in terms of the autocorrelation function as follows:
(25)
and
(26)
The change-point process (6) can be expressed in terms of (25) and (26) as
The weak limits of the process is characterized in terms of the limiting point processes for the sample autocovariance and autocorrelation functions through the application of the Continuous Mapping Theorem 12. To complete the proof we independently prove the convergence of and and apply Theorem 12.
Let , . In order to proof the results, we define several mappings
as follows
The set is bounded for any and thus the mappings are continuous with respect to the limit point processes N. Consequently by Continuous Mapping Theorem 12 we have that
where
The prove of the convergence of is examined for and .
For the case of , the point process results of Theorem 3 holds and a direct application of Theorem 5 yields:
For we commence with the sequence and establish the convergence of . We rewrite using the recurrence structure of the SDE (3) so that and
Now using this representation yields:
(27)
Assuming that the condition is satisfied, we first show that II converges in probability to zero by applying Karamata’s theorem (see [19] ) on the regular variation and tail behavior of a stationary distribution which yields the asymptotic equivalence.
(28)
Now examining I we have
(29)
We utilize the argument given in Theorem 12 where as . Therefore, we finally obtain that:
(30)
In the presence of a change-point k as hypothesized (4) it is evident that for all t but rather
(31)
Thus the convergence of and are respectively given by
(32)
(33)
Following (31), (32) and (33) it is concluded that .
Convergence of is determined in a similar manner where
(34)
Consequently for arbitrary lags we have
In the presence of a change-point k the convergence of and are respectively given by
Now we consider the sequence and establish the convergence of as follows:
(35)
Equation (35) follows directly from Equation (27). In a similar way to Equation (28), .
Now examining III and following the results obtained in Equation (29) we have that III converges as follows
Thus we have that
Similarly it can be shown that the convergence of and are respectively given by
Next we consider the sequence and establish the convergence of as follows:
Now examining VI we have
where is a constant and since is strongly mixing with geometric rate, thus there exist a and a constant K such that and .
Now examining V we have
(36)
By applying Karamata Theorem [19] to (36)
Examining VII we have
Since then for XI we have
Thus we have that
By extending to arbitrary lags the convergence of is given by
Consequently the convergence of is given by
We have been able to examine the limiting behavior of for two cases. In the first case, when , the variance of is infinite and thus has a random limit without any normalization. When , the
process has a finite variance but infinite fourth moment and converges to an -stable distribution. By Theorem 8 convergence of implies that the sequence is bounded with .
We now examine the convergence of . Consider , we can express as follows:
By the Bolzano-Weierstrass theorem, a bounded sequence has always a convergent subsequence. This is further confirmed through the invariance property of subsequences in Theorem 10 which states that if converges, then every subsequence say, and converges. By linearity rule of sequences as prescribed in Theorem 11, converges. This further implies that and are bounded since every convergent sequence is bounded. The subsequences and
are also bounded with and , thus their absolute difference is also bounded as . Further assume that we are considering only significant sample autocorrelation coefficients where , then is also bounded. Applying the quotient property of subsequences, then is also convergent.
Consider the proposed change-point process as defined in (6), then we can derive the limit of as follows:
(37)
Thus applying Theorem 5 to 37 we have
(38)
From (38) above, the sequence converges in distribution to as follows
By application of Continuous Mapping Theorem 12, we have the limiting behavior of the proposed change-point process for the three cases , and as follows.
for and by application of Theorem 5 (i):
for and by application of Theorem 5 (ii):
which completes proof.
5. Conclusion
The asymptotic behavior of the change-point process is established on the basis of examining the asymptotic behavior of the sample autocovariance and sample autocorrelation functions. The limits of the suitably normalized sample autocovariance and sample autocorrelation functions are expressed in terms of the limiting point processes. The limit distributions are the difference of ratios of the infinite variance stable vectors or functions of such vectors. As a result, determination of the quantiles from the limit distributions is difficult. The limits are also generally random as a result of the infinite variance. Future work will be aimed at identifying the limit distributions so as to make the results directly applicable for hypothesis testing purposes.
Acknowledgements
The authors thank the Pan-African University Institute of Basic Sciences, Technology and Innovation (PAUSTI) for funding this research.
Cite this paper
Irungu, I.W., Mwita, P.N. and Waititu, A.G. (2018) Limit Theory of Model Order Change-Point Estimator for GARCH Models. Journal of Mathematical Finance, 8, 426-445. https://doi.org/10.4236/jmf.2018.82027
References
- 1. Chinzara, Z. (2010) Macroeconomic Uncertainty and Emerging Market Stock Market Volatility: The Case for South Africa. Working Paper 187, 1-19.
- 2. Matteo Manera, M.N. and Vignati, I. (2012) Financial Speculation in Energy and Agriculture Futures Markets: A Multivariate Garch Approach. International Association for Energy Economics, 3.
- 3. Mikosch, T. and Starica, C. (2004) Nonstationarities in Financial Time Series, the Long-Range Dependence and the Igarch Effects. Review of Economics and Statistics, 86, 378-390. https://doi.org/10.1162/003465304323023886
- 4. Yau, C.Y. and Zhao, Z. (2015) Inference for Multiple Change Points in Time Series via Likelihood Ratio Scan Statistics. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 78, 895-916. https://doi.org/10.1111/rssb.12139
- 5. Lee, T., Kim, M. and Baek, C. (2014) Tests for Volatility Shifts in Garch against Long Range Dependence. Journal of Time Series Analysis, 36, 127-153. https://doi.org/10.1111/jtsa.12098
- 6. Na, O., Lee, J. and Lee, S. (2011) Change Point Detection in Copula Arma Garch Models. Journal of Time Series Analysis, 33, 554-569. https://doi.org/10.1111/j.1467-9892.2011.00763.x
- 7. Alemohammad, N., Rezakhah, S. and Alizadeh, S.H. (2016) Markov Switching Component Garch Model Stability and Forecasting. Communications in Statistics Theory and Statistics, 45, 4332-4348. https://doi.org/10.1080/03610926.2013.841934
- 8. Irungu, I., Mwita, P. and Waititu, A. (2018) Consistency of the Model Order Change-Point Estimator for Garch Models. Journal of Mathematical Finance, 8, 266-282. https://doi.org/10.4236/jmf.2018.82018
- 9. Bartkiewicz, K., Jakubowski, A., Mikosch, T. and Wintenberger, O. (2011) Stable Limits for Sums of Dependent Infinite Variance Random Variables. Probabability Theory Related Fields, 150, 337-372. https://doi.org/10.1007/s00440-010-0276-9
- 10. Davis, R.A. and Resnick, S.I. (2011) Limit Theory for the Sample Covariance and Correlation Functions of Moving Averages. Annals of Statistics, 14, 533-558. https://doi.org/10.1214/aos/1176349937
- 11. Davis, R.A. and Resnick, S.I. (1996) Limit Theory for Bilinear Processes with Heavy-Tailed Noise. Annals of Statistics, 6, 1191-1210. https://doi.org/10.1214/aoap/1035463328
- 12. Mikosch, T. and Starica, C. (2000) Limit Theory for the Sample Autocorrelations and Extremes of a Garch (1,1) Process. Annals of Statistics, 28, 1427-1451.
- 13. Basrak, B., Krizmanic, D. and Segers, J. (2012) A Functional Limittheorem for Dependent Sequences with Infinite Variance Stable Limits. The Annals of Probability, 40, 2008-2033. https://doi.org/10.1214/11-AOP669
- 14. Bougerol, P. and Picard, N. (1992) Strict Stationarity of Generalized Autoregressive Processes. Annals of Probability, 20, 1714-1730. https://doi.org/10.1214/aop/1176989526
- 15. Krengel, U. (1985) Ergodic Theorems. De Gruyter, Berlin.
- 16. Kallenberg, O. (1983) Random Measures. Akademie-Verlag, Berlin, 3.
- 17. Kesten, H. (1973) Random Difference Equations and Renewal Theory for Products of Random Matrices. Acta Mathematica, 131, 207-248. https://doi.org/10.1007/BF02392040
- 18. Breiman, L. (1965) On Some Limit Theorems Similar to Arc-Sin Law. Theory Probability Applications, 10, 323-331. https://doi.org/10.1137/1110037
- 19. Bingham, N.H., Goldie, C.M. and Teugels, J.L. (1985) Regular Variation. Encyclopedia of Mathematics and Its Applications. Cambridge University Press, Cambridge.
Appendix
Theorem 7. (Holder’s Inequality)
Let I be a finite or countable index set. Given , if and , where then and
Theorem 8. (Convergent sequences are bounded)
Let be a convergent sequence. Then the sequence is bounded and the limit is unique.
Theorem 9. (Bolzano-Weierstrass)
Let be a sequence of real numbers that is bounded. Then there exists a subsequence that converges.
Theorem 10. (Invariance property of subsequences)
If is a convergent sequence, then every subsequence of that sequence converges to the same limit.
Theorem 11. (Algebra on Sequences)
If the sequences converges to L and converges to M then the following hold:
1)
2)
3) for and
Theorem 12. (Continuous Mapping)
Let a function be continuous in every point of a set C such that . Then if then .
Theorem 13. (Algebra on Series)
Let and be two absolutely convergent series. Then:
1) the sum of the two series is again absolutely convergent. Its limit is the sum of the limit of the two series.
2) the difference of the two series is again absolutely convergent. Its limit is the difference of the limit of the two series.
3) the product of the two series is again absolutely convergent. Its limit is the product of the limit of the two series.
Theorem 14. Let be a strictly stationary sequence. Define the partial sums of the sequence by .
1) if then
where has a stable distribution
2) if and for all , then
where S is the distributional limit of
as , μ is the measure in section 2.1 which has a stable distribution.
For every , the mapping from M in section 2.1 into is defined by
and is almost surely continuous with respect to the point process N. Thus by continuous mapping theorem
As , .