 Applied Mathematics, 2011, 2, 836-842 doi:10.4236/am.2011.27112 Published Online July 2011 (http://www.SciRP.org/journal/am) Copyright © 2011 SciRes. AM Analysis of Noise under Regime Switching Ling Bai1, Xiaoyue Li2 1College of Mathematics, Jilin University, Changchun, China 2School of Mathema tics and Statistics, Northeast Normal University, Changchun, China E-mail: bailing@jlu.edu.cn Received March 22, 2011; revised May 17, 2011; accepted May 20, 2011 Abstract In this paper we consider a stochastic nonlinear system under regime switching. Given a system ()((),(),)xtfxtrtt in which fsatisfies so-called one-side polynomial growth condition. We introduce two Brownian noise feedbacks and stochastically perturb this system into d,,dxtxtrttt   rtxtxt Wttxt Wt1dqr 2. It can be proved that appropriate noise intensity may suppress the potentially explode in a finite time and ensure that this system is almost surely exponentially stable although the corresponding system without Brownian noise perturbation may be unstable system. d Keywords: Hybrid System, One-Side Polynomial Growth Condition, Itoˆ Formula, Stochastic Ultimate Boundedness 1. Introduction Recently, there has been increasing attention devoted to the different effects of environmental noise. The first important fact is that noise can be used to stabilize a given unstable system or to make a system even more stable when it is already stable . It is often mentioned that under the local Lipschitz and linear growth condi-tions, a n-dimensional nonlinear system  ,,0; 0nxtfxttt xR (1.1) with f(0,t) = 0 can be stabilized by the Brownian noise [2,3]. Then Appleby and Mao examined the stabilization of noise when f satisfies the one-sided linear growth condition [4,5]. Another important fact is that the noise can suppress the explosions (in a finite time) in population dynamics  which means that this fact guarantees the existence of global solutions. Deng et al. developed a general theory on the suppression of noise when f satisfies the one-sided linear growth condition . Even in this article, authors show that the noise can make a given system whose so-lutions are bounded become a new system whose solu-tions will grow exponentially, namely, the noise can ex-presses exponential growth. However, all of the papers mentioned above only con-sider the perturbation by Brownian noise. From another point of view, let us now take a further step by consider-ing another type of environmental noise, namely, color noise, or say telegraph noise which can be illustrated as a switching between two or more regimes of environment, the regime switching and the environmental noise work together to make the system change. Recently, the re-search in this field we here mention [8,9]. Consider a nonlinear system described by an ordinary differential equation with Markovian switching of the form: ,,,xtfxtrtt here :nnfRSR R  is local Lipschitz continuous and obeys linear growth condition, or f obeys the one-side linear growth condition: 212,,, ,xfxitK Kx the solution of this equation may grow exponentially with probability one. Guangda hu  Theorem 2.2 in-dicates if the noise is sufficiently large, it will suppress this potentially exponential growth at most polynomially. On the other hand, Guangda hu  also reveal that re-gime switching and the environmental white noise will express the exponential growth. Although the one-side linear growth condition allows for a wider class of systems to be studied than the linear growth condition, many simple and important systems are still excluded because the coefficients of system does neither satisfy the linear growth condition nor the one-side linear growth condition. Fuke Wu  have devoted contributions to improve this work which extend the role of Brownian noise for suppression and stabiliza- L. BAI ET AL.837 tion to cover the wider systems than [6,7]. The authors  introduce the following so-called one-side polyno-mial growth condition they give the further assumption for f: Assumption A. There are some nonnegative numbers ,, such that 22,,xfxtxx for all,.nxtRR It is easy to see that 0 we obtain the classical one-side linear growth condition: 2,,xfxtx which means that one-side polynomial growth condition generalize one-side linear growth condition. If f satisfies the one-side polynomial growth condition, the system (1.1) may be explode in finite time. For example, con-sider a simple logistic equation 1xtx x with initial value x(0) = 1, the expression of the solution has 1,12txt e there has only local solution for 1logt2.Usually, only local Lipschitz and linear growth condi-tions guarantee a unique global solution, linear growth condition play an important role to guarantee the exis-tence of global solutions of (1.1). Suppose f only sat-isfy the one-side polynomial condition and local Lipschitz condition, author  introduce Brownian noise feedback to suppress the potential explosion of the deterministic system (1.1) and stabilize the given system. However, little is as yet known about the properties of system satisfying the one-side polynomial growth condi-tion under regime switching, it is therefore the motiva-tion of our present paper to consider the system subjected to both white noise and color telegraph (hybrid system). More precisely, in this paper we will develop the theory presented in  to cope with systems where they are subjected to both white noise and colored noise. Given an unstable hybrid system described by an ordinary dif-ferential equation with Markovian switching  ,,xtfxtrtt (1.2) in which f satisfies the one-side polynomial growth condition under regime switching, we introduce two Brownian noise feedbacks and therefore discuss the fol-lowing nonlinear hybrid system:   1d,,ddxtfxtrtttrtxtxtW t (1.3) or    12d,,dddxtf xtrtttrtxtxtW tqrtxtW t (1.4) The next section we will show that appropriate  may guarantee this system (1.3) or (1.4) exists a unique global solution although the corresponding hybrid sys-tem (1.2) may explode in a finite time. 2. Positive and Global Solution Throughout this paper, unless otherwise specified, we let (, , {t}t ≥ 0, P) be a complete probability space with a filtration {t}t ≥ 0 satisfying the usual conditions (i.e. it is right continuous and 0 contains all P-null sets.) Let W(t), , be the standard Brownian motion defined on this probability space. We also denote by 0tnR :0 for all 1inxRx in and :0nniRxRx for all 1in. Let r(t) be a right-continuous Markov chain on the probability space taking values in a finite state space 1, 2,,SN with the generator uvNN given by , ,1,uvuvPrtvrt uoifuoifuv  ,v where 0. Here uv is the transition rate from u to v and 0uv if uv while .uu uvvu We assume that the Markov chain r(·) is independent of the Brownian motion W(·). It is well known that al-most every sample path of r(·) is a right continuous step function with a finite number of jumps in any finite sub-interval of 0,R. It is well known that local Lipschitz condition guaran-tees the solution of stochastic differential equation exists in 0,t, where lim kk and the stopping time 0inf , .kkTt k:tTxtWe need that f is locally Lipschitz continuous, namely, Assumption B. are locally Lipschitz continuous, that is, for each integer there is a positive number Hk such that f1, 2,,k ,,,, kfxitfyitH xy for all Si, and those 0t,nxyR with xyk . Definition 2.1 Let  be a stopping time such that 0tT a.s. An Rn-valued t-adapted continuous stochastic process 0:xt tt is called a local solution of Equation (1.4) with initial value 0nxtR, Copyright © 2011 SciRes. AM L. BAI ET AL. 838 moreover, there is a nondecreasing sequence 1kkof stopping times such that 0kt a.s., and   000012,,dddkkktktttttxtxtfxsrssrsxsxsWsqrsxsWs s holds for any and with probability 1. If, furthermore, 0,ttT1klim suptxt Whenever T, then it is called a maximal local solution andis called the explosion time. Noting the function  ,gxii xx satisfies locally Lipschitz condition for any 0. This to-gether with Assumption B shows the existence of unique maximal local solution [see 8, p91 Theorem 3.15]. Lemma 2.2 Under Assumption B, for any initial value 0nxtR and 0, Equation (1.4) has a unique maximal local solution on 0,t, where  is the explosion time. In order to have a unique global solution and avoid the linear growth condition, we generalize the one-side polynomial growth condition under regime switching: Assumption C. There are some nonnegative numbers ,,ii such that 22,,, iixfxit xx For all ,, nxitRS R. In addition, consider a nonlinear stochastic differential equation with Markovian switching:   d,,d,,dxtfxtrtttgxtrttWt Throughout this paper, let 2,1;nnCRRSR de-note the family of all positive real-valued functions V(x,t,k) on nnRRS which are continuously twice differentiable in x and once in t. If 2,1;nnVCR R SR, define an operator LV from nnRRS to R by 1,, ,,,,, ,1,,,, ,,2,,txTxxNkllLV xtkVxtkVxtkfxktgxktVxtk g xktVxtl where    2,,,, ,,, ,,,,, ,,,,, .txnnxx ij nnVxtkVxtk tVxtk VxtkVxtk xxVxtkVxtk xx  For the convenience, the reader can refer to [8, p48-49] for the generalized Itô formula and a useful lemma, which often emerge in our later proof. Now we first establish the theorem of the existence of the global solution to Equation (1.4). Theorem 2.3 Under the conditions of Assumption B and Assumption C. If for any given initial data 00x, iS, 0i and 2t, there exists a unique global solution x(t) to (1.4) on 、 0, .Proof: Since the coefficients of (1.4) are locally Lipschitz, there is a unique local maximal solution x(t) on 0, et, where e is the explosion time. To show this solution is actually global and we need to show that e a.s.. Let m0 > 0 be sufficiently large such that every component of x(0) is contained within the interval 001,mm. For each , we define 0mm1inf0, :, 1,2,,.txtmeimforsome inm Clearly mis increasing as and mlim :mme, if we can obtain that  a.s., then e and nxtR a.s. for all . That is, to complete the proof, all we need to show is that 0t a.s.. This also equivalent to prove that, for any t > 0, 0mPt as . For m0, 1p, define a C2-function: nRS Rby  ,pVxkCkxt (2.1) If 1,, TnnxxxRfor t > 0, one can apply Itô formula to compute that for any 0,ett,    12d, ,dddppVxkLVxktpCkkx tWtpCk qkx tWt where LV is defined as Copyright © 2011 SciRes. AM L. BAI ET AL.839    22221,,1212,pp,,pNkllLVxkpC kxx fxktpp qkCkxpp kCk xVxl (2.2) Let ,maxkl SClqCk. For ,klany , we get S ,,ppV xlClxqCkxqV xk  Therefore,  11,,NNkl klllVxl qVxk According to Assumption C, combined with (2.3) we therefore have     22222212221,(1212,121(2pkkppNkllppkNkllLVx kpCkxxxpp Ckqk xpp kCk xVxlpp kCkxpC kxpppC kC k qkkpqCkx) (2.4) Noting that, for any, 0, 1pSi0,i and 0Ci2, by the boundedness of polyno-mial functions, there is a constant kHsuch that ,max:kkkSLVx kHHH , Therefore we get    0,0, 0,d0, 0:mmmTVxTrTVxrLVxs rssVxrHT HT  where TH is independent of m. Let mm for 1, noting that for every Tmmm , there is some m such that ,mmxequals either m or 1/m, hence  1min,,,pmpiSmmmmmmm TPT cimcimPTVxiIVxTrTTVxTrTH  Letting implies that mlim sup0,mmPT  So we must obtain  a.s., as required. The proof is complete. Remark: The key of this proof in Theorem 2.3 is the boundedness of LV (x, k) under the assumption 0i which only depends on the 2. This implies that the Brownian noise  ()rtxtxtdW t1 plays a crucial role to suppress potential explosion of the solu-tion and guarantees the existence of the global solution. Therefore let q(i) = 0 we still obtain the existence of global solution of Equation (1.3). Theorem 2.4 Under the conditions of Assumption B and Assumption C. If for any given initial data 00,xiS, 0i and 2t, there exists a unique global solution x(t) to (1.3) on . 0,3. Stochastic Ultimate Boundedness Theorem 2.3 shows that the solution of SDE (1.4) with a given positive initial value will not explode. This nice property provides us with a great opportunity to discuss how the solution varies in  in more details. In this section, we will give the definition of asymptotically bounded in pth moment and then give some sufficient conditions which guarantee SDE (1.4) is stochastically ultimate boundedness. nRDefinition 3.1 The solutions x(t) of SDE (1.4) are said to be asymptotically bounded in pth moment if there is a positive constant H such that the solution of SDE (1.4) with a given initial value has the property that lim sup.ptxtH  For all,, ntxiRRS. Definition 3.2 SDE (1.4) is said to be stochastically ultimate boundedness if for any , there exist positive constants 0, 1 such that lim sup1tPxt  where x(t) is the solution of SDE (1.4) with any positive initial value. Copyright © 2011 SciRes. AM L. BAI ET AL. 840 In the light of Markov inequality, it is obvious that if a stochastic equation is p-th moment boundedness, its so-lutions must be stochastically ultimately bounded. So we will begin with the following lemma and make use of it to obtain the stochastically ultimate boundedness of SDE (1.4). Lemma 3.3 Under the conditions of Assumption B and C, for any , if for any , 0, 1piS0i and 2, there exists a constant pK such that the global solution x(t) of SDE (1.4) with any given positive initial value has the property that lim suppptxt K (3.1) where pK is dependent on p and independent of the initial value. Proof: First, Theorem 2.3 indicates that the solution x(t) of (1.4) will remain in nR for all with prob-ability 1. For any 0t0,teV x and , applying the Itoˆ formula to and taking expectation yields: 0,p1k0(, )0,0,,tttsVxke VxreEe LVxskVxsksd. (3.2) Here LV(x, k) is defined as (2.2). Therefore, by the Assumption C and (2.4), we have   2221,,1212pkkNpkllLVx kVx kpp Ckk xppC kxpppC kC k qkqCkCkx (3.3) Notice that if and 0, 1p2, (3.3) has upper boundedness which means to  ,,max :pppkSLVx kVx kkk which implies that  0,0,d,tttspEVx keVxreEe s0 Namely,  ,0,01pttEVx keVxreClearly, lim sup,ptVxk  Noting the expression of  ,pVxk Ckxt de-note ˆminkSCCk, which gives lim sup:ˆppptxKC  (3.4) This means that the solution is bounded in the pth moment, the stochastically ultimate boundedness will follow directly. It shows the solution trajectory is bounded with large probability. Theorem 3.4 The solution of Equation (1.4) is sto-chastically ultimately boundedness under the condition Lemma 3.3, that is for any , there is a positive constant 0,1 such that for any positive initial value, the solution of (1.4) has the property that lim sup.tPxt  Proof: This can be easily verified by Chebyshev’s ine-quality and Lemma 3.3 by choosing1ppKsuffi-ciently large because of the following lim suplim sup11ptptExPxt (3.5) as required. Clearly, these boundedness results are also only de-pendent on the choice of  under the condition 0i and independent of q, so there are similar boundedness results for the Equation (1.3). Theorem 3.5 The solution of Equation (1.3) is stocha-sitically ultimately bounded under the condition Lemma 3.3, that is for any 0, 1, there is a positive constant  such that for any positive initial value, the solution of (1.3) has the property (3.5). 4. Stabilization of Noise From Section 2 and 3, we know the Brownian noise   1dixtxt Wt can suppress the potential ex-plosion of the solution and guarantee this global solution to be bounded in the sense of the pth moment. This sec-tion is devoted to consider the effect of noise 2dqixtWt , we will show that some sufficiently large q(i) may stabilize the system (1.4).  Especially, the hybrid system always switch from any regime to another regime, so it is reasonable to assume that the Markov chain r(t) is irreducible, which equiva-lent to the condition that irreducible Markov chain has a Copyright © 2011 SciRes. AM L. BAI ET AL.841 unique stationary probability distribution 112ππ,π,,πNNR which can be determined by solving the following linear equation subject to π01π1Nkk and for any , where π0kkS is generator uvNN . Theorem 4.1 Suppose the Markov chain r (t) is irre-ducible, under Assumption B and C, if for 0,1, , and kS0k2, the solution x(t) of SDE (1.4) with any positive initial value has the property 211lim suplogπ..2Njjjtjqxtat s (4.1) where   2201max .2kxkxskxsk (4.2) In particular, the nonlinear hybrid system (1.4) is al-most surely exponentially stable if 21π0.2Njjjjq Proof: By Theorem 2.3, the solution x(t) with positive initial value will remain in nR for all . Applying the Itoˆ formula to the function log|x(t)| leads to 0t      202220120loglog 0,,,d1d2ddtttxt xxtxsf xsrsssrsxsq rssrsxsW sqrsWs Define  10d,tMtrsxsWs Clearly M(t) is a continuous local martingale with the quadratic variation  220,dt.MtMtrs xss For any , choose 0,10 such that 1 and each positive integer n > 0, the exponential martin-gale inequality yields  2200supd log21ttnMtrsxssn Since 1,nnby the Borel-Cantelli lemma, there exists an 0 with 01such that for any 0, there exists an integer n, where nn and 1ntn ,   220dlog1.2tMtrsxsstn(4.3)  This, together with Assumption C, noting the defini-tion of (4.2), we therefore have   220221loglog 02d2log 1trsxt xxsqrsrs xsrssqW tt  where :maxkSqqk. Applying the strong law of large number  to the Brownian motion, we therefore have 2lim0. .tWt ast  (4.5) Moreover, by the ergodic property of the Markov chain, we have 20211lim d2π..2ttNjjjjqrsrs stqas (4.6) Combined (4.5) and (4.6), it follows from (4.4) 211lim suplogπ...2Njjjtjqxtat s Thus the assertion (4.1) follows. Clearly, if 21,π02Njjjjq (4.7) System (1.4) is almost surely exponentially stable, the proof is complete. Remark: The condition (4.7) show the overall behav-ior as the result of Markovian switching, system (1.4) will be almost surely exponentially stable, but for any subsystem of (1.4), i.e.   12d,,dddxtf xtittixtxt WtqixtW t Copyright © 2011 SciRes. AM L. BAI ET AL. Copyright © 2011 SciRes. AM 842  X. Mao, G. Marion and E. Renshaw, “Environmental Brownian Noise Suppresses Explosions in Population Dynamics,” Stochastic Processes and Their Applications, Vol. 97, No. 1, 2002 pp. 95-110. doi:10.1016/S0304-4149(01)00126-0 may be written as  1d12ddxtxt xtxtWtt (4.8)  F, Q. Deng, Q. Luo; X. R. Mao and S. L. Pang, “Noise Suppresses or Expresses Exponential Growth,” Systems Control Letters, Vol. 57, No. 3, 2008. doi:10.1016/j.sysconle.2007.09.002 with x(0) = 1 when . Applied the condition (4.2) with q(i) = 0, 0t1iiiii to the system (4.8) yields 0132max1 ,22xixx  X. Mao and C. Yuan, “Stochastic Differential Equations with Markovian Switching,” Imperial College Press, London, 2006. Satisfying  202qii. In , it shows that the trajectory of (4.8) will not tend to 0 although it has global solution.  X. R. Mao; G. G. Yin and C. G. Yuan, “Stabilization and Destabilization of Hybrid Systems of Stochastic Differ-ential Equations,” Vol. 43, No. 2, 2007, pp. 264-273. doi:10.1016/j.automatica.2006.09.006  G. D. Hu, M. Z. Liu, X. R. Mao and M. H. Song, “Noise Expresses Exponential Growth under Regime Switch-ing,” Systems Control Letters, Vol. 58, No. 9, 2009, pp. 691-699. doi:10.1016/j.sysconle.2009.06.006 5. References  R. Z. Hasminskii, “Stochastic Stability of Differetial Equations,” Sijthoff and Noordhoof, Alphen, 1980.  G. D. Hu, M. Z. Liu, X. R. Mao and M. H. Song, “Noise Suppresses Exponential Growth under Regime Switch-ing,” Journal of Mathematical Analysis and Applications, Vol. 355, No. 2, 2009, pp. 783-795. doi:10.1016/j.jmaa.2009.02.009  X. Mao, “Exponential Stability of Stochastic Differential Equations,” Dekker, New York, 1994.  X. Mao, “Stochastic Differential Equations and Their Applications,” Horwood Publishing, Chichester, 1997.  F. Wu and S. G. Hu, “Suppression and Stabilization of Noise,” International Journal of Control, Vol. 82, No. 11, 2009, pp. 2150-2157.  X. Mao, “Stability and Stabilizition of Stochastic Dif-feretnial Delay Equations,” Proceeding of IET on Control and Theory and Application, November 2007, pp. 1551-1566. doi: 10.1049/iet-cta:20070006  C. Zhu and G. Yin, “Asymptotic Properties of Hybrid Dif-fusion Systems,” SIAM Journal on Control and Optima-zation, Vol. 46, No. 4, 2007, pp. 1155-1179. doi:10.1137/060649343 J. A. D. Appleby, X. R. Mao and A. Rodkina, “Stabiliza-tion and Destabilization of Nonlinear Differential Equa-tions by Noise,” IEEE Transactions on Automatic Con-trol, Vol. 53, No. 3, 2008, pp. 683-691. doi:10.1109/TAC.2008.919255