Applied Mathematics
Vol.4 No.11A(2013), Article ID:40118,7 pages DOI:10.4236/am.2013.411A1006

Stabilization of Functional System with Markovian Switching

Lizhu Feng, Qiong Cai

School of Mathematics and Computer Science, Jianghan University, Wuhan, China

Email: fengliahu11@163.com

Copyright © 2013 Lizhu Feng, Qiong Cai. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Received October 14, 2013; revised November 14, 2013; accepted November 21, 2013

Keywords: Stochastic Functional System; Brownian Noise; Markovian Switching; Boundedness; Stabilization

ABSTRACT

There are many papers related to stability, some on suppression or on stabilization are one type of them. Functional differential systems are common and important in practice. They are special situations of neutral differential systems and generalization of ordinary differential systems. We discussed conditions on suppression on functional system with Markovian switching in our previous work: “Suppression of Functional System with Markovian Switching”. Based on it, by slightly modifying and adding some conditions, we get this paper. In this paper, we will study a functional system whose coefficient satisfies the local Lipschitz condition and the one-sided polynomial growth condition under Markovian switching. By introducing two appropriate intensity Brownian noise, we find the potential explosion system stabilized.

1. Introduction

There are many papers which discuss stability of systems. It is called a stabilization problem when we impose such conditions on a given unstable system to make it stable. There have been rich literatures on this topic, here we only mention [1-4]. It is talked about suppression of noise in [1,2]. It is showed similar stabilization phenomena in stochastic systems as those in deterministic systems in [3,4]. They all indicate clearly that different structures of environmental noise may have different effects on the deterministic system. On the other hand, there are also many papers related to stabilization of functional systems, such as [5-8]. [5] investigates a stochastic Lotka-Volterra system with infinite delay, whose initial data come from an admissible Banach space C, and show that its unique global positive solution has asymptotic boundedness property by using the exponential martingale inequality. [6] studies existence and uniqueness of the global positive solution of stochastic functional Kolmogorov-type system and its asymptotic bound properties and moment average boundedness in time under the traditionally diagonally dominant condition. [7] studies the same problems as [6] under some other conditions. [8] discusses stabilization of a given unstable nonlinear functional system by introducing two Brownian noise.

Many practical systems may experience abrupt changes in their structure and parameters caused by phenomena such as component failures or repairs, changing subsystem interconnections, and abrupt environmental disturbances. The hybrid systems have been used to desribe such situations. Along the trajectories of the Markovian jump system, the mode switches from one value to another in a random way are governed by a Markov process with discrete state space. [9,10] studied the stability of a jump system. Feng et al. [11] systematically studied stochastic stability properties of jump linear systems and the relationship among various moment and sample path stability properties. Shen and Wang [12] presented new exponential stability results for recurrent neural networks with Markovian switching. Wang et al. [13] dealt with the problem of state estimation for a class of delayed neural networks with Markovian jumping parameters without the traditional monotonicity and smoothness assumptions on the activation function.

Taking both the environmental noise and jump into account, the system under consideration becomes a stochastic differential system with Markovian switching (SDSwMS), which has received a lot of attention (see [14-24]) recently. [17] provided some useful conditions on the exponential stability for general nonlinear SDSwMSs, which was improved by himself in Mao et al. [19]. Yuan and Lygeros [20] investigated almost sure exponential stability for a class of switching diffusion processes. [25] discusses the asymptotic stability and exponential stability of SDSwMSs, whose coefficients are assumed to satisfy the local Lipschitz condition and the polynomial growth condition.

Motivated by [25,26] and some other literatures, we will investigate suppression and stabilization by noise of functional differential system with Markov chains, whose coefficient satisfies the local Lipschitz condition and the one-sided polynomial growth condition. For a given unstable functional system with Markovian switching

(1)

where

is defined by, by introducing two independent scalar Brownian noise under some conditions, we get a stochastic functional system which admits a unique global positive solution. Furthermore, choosing appropriate intensity noise, we can get an exponential stable stochastic functional system

(2)

on, where is a scalar Brownian motion, and

In the next section we will give some necessary notations and lemmas. In Section 3, we will give the main results of this paper.

2. Preliminaries

Throughout this paper, unless otherwise specified, let be the Euclidean norm in. If is a vector or matrix, its transpose is denoted by. If is a matrixits trace norm is denoted by. Denote the inner product of by or. Let be positive integers. Let denote the maximum of and, while the minimum of and. Let . Denote by the family of continuous functions from to Rn with the normwhich forms a Banach space. Let and. Let denote the family of functions on which are continuously twice differentiable in and once in.

Let be a complete probability space with a filtration satisfying the usual conditions (i.e. it is increasing and right continuous while contains all -null sets). Let denote the family of -valued -measurable random variables with. Denote the family of Rn-valued bounded -measurable random variables by. If is an Rn-valued process on, let

.

If is a continuous local martingale, denote the quadratic variation of by. Let

be independent scalar Brownian motion defined on the probability space. Let be a right-continuous Markov chain on the probability space taking values in a definite state space with the generator given by

where is the transition rate from to and if while. We assume that the Markov chain is independent of the Brownian motion. For any initial value denote the solution of the corresponding initial value problem by or simply on.

In order to obtain the main results, we need the following assumptions.

(H1) There are some nonnegative constants such that

(3)

for all, where is a probability measure on and means some functions satisfying.

(H2) For every integer, there is a such that

(4)

for all with.

(H3) There are some nonnegative constants and probability measure such that for any satisfying,

(5)

(6)

(7)

. (8)

Definition 1: The irreducibility of the Markov chain means that the Markov chain has a unique stationary (probability) distribution which can be determined by solving the following linear equation

(9)

subject to

(10)

Lemma 1: [27] Let (H2) hold, for any initial value, system (2) has a unique maximal local strong solution on, where is the explosion time.

3. Main Results

Similar to the proof of Theorem 1 in [28], we slightly modify the condition on the coefficient of (1) and obtain the following theorem.

Theorem 1: Let (H1) - (H3) hold, for any initial value, if andthen there exists a unique global solution of system (2) on all a.s.

Similarly to that in [28], we define the stopping time

(11)

and a C2-function, for any.

Using the Itô formula and the Young inequality, for any, by (H1) and (H3), we get

(12)

where

(13)

These results will be used in the following.

3.1. Boundedness

Theorem 2: Let (H1) - (H3) hold, for any initial value and, if and, then there exists a constant such that the global solution of system (2) has the property that

(14)

where is dependent on and independent of the initial value, that is, is bounded in moment.

Proof: For any, applying the Itô formula to yields

By (12) and (13), we have

By the boundedness of polynomial functions, there exists a constant such that which implies

Then

That is, the global solution of system (2) is bounded in -th moment for any.

Theorem 3: Let (H1) - (H3) hold, if

and

then for any initial value and, the solution of system (2) has the property that

(15)

where

(16)

Proof: By Theorem 1, there a.s. exists a unique global solution to system (2) on a.s. Let, by the Itô formula, we have

where

By (H1) and (H3), we have

Let be the same stopping time as defined in the proof of Theorem 1. By (13) and (14), we have

Then as, we have

That is,

(17)

By the ergodic and irreducibility property of the Markov chain, we have

Hence,

as required.

3.2. Stabilization of Noise

The following lemma can be obtained by slightly modifying the proof of Mao [2].

Lemma 2: Let (H1) - (H3) hold, for any initial value with, the global solution of system (2) has the property that

(18)

where is the explosion time.

Theorem 4: Let (H1) - (H3) hold, assume that

and.

If

(19)

where

(20)

then for any initial value, satisfying, the global solution of system (2) has the property that

(21)

That is, the solution to system (2) is a.s. exponentially stable.

Proof: By Lemma 2 and Theorem 1, a.s. Thus, applying the Itô formula to yields

where is an identity matrix and

Clearly and are continuous local martingales with the quadratic variation

By (H3),

Applying the strong law of large number,

For any and each integer, by the exponential martingale inequality,

Since, by the Borel-Cantelli lemma, there exists an with such that for any, when,

From (H1) and (H3),

where

By the definition of in (20),

Applying the strong law of large number to the Brownian motion,

which implies

4. Conclusion

In this paper, we study a stochastic functional system with Markovian switching. Motivated by [25,26] and other literatures, we introduce two appropriate intensity Brownian noise to perturb the system so as to suppress its potential explosion and stabilize it. Based on [28], we just slightly modify some conditions on its coefficients and add some contents, then we get some new conclusions about boundedness and stabilization of the system.

REFERENCES

  1. X. Mao, G. Marion and E. Renshaw, “Environmental Noise Suppresses Explosion in Population Dynamics,” Stochastic Processes and their Applications, Vol. 97, No. 1, 2002, pp. 96-110. http://dx.doi.org/10.1016/S0304-4149(01)00126-0
  2. J. K. Hale and J. Kato, “Phase Space for Retarded Equations with Infinite Delay,” Funkcial Ekvac, Vol. 21, 1978, pp. 11-41.
  3. X. Mao, S. Sabanis and E. Renshaw, “Asymptotic Behaviour of the Stochastic Lotka-Volterra Model,” Journal of Mathematical Analysis and Applications, Vol. 287, No. 1, 2003, pp. 141-156. http://dx.doi.org/10.1016/S0022-247X(03)00539-0
  4. Y. Song and C. T. H. Baker, “Qualitative Behaviour of Numerical Approximations to Volterra Integro-Differential Equations,” Journal of Computational and Applied Mathematics, Vol. 172, No. 1, 2004, pp. 101-115. http://dx.doi.org/10.1016/j.cam.2003.12.049
  5. F. Wu and S. Hu, “Positive Solution and Its Asymptotic Behaviour of Stochastic Functional Kolmogorov-Types System,” Journal of Mathematical Analysis and Applications, Vol. 364, No. 1, 2012, pp. 104-118. http://dx.doi.org/10.1016/j.jmaa.2009.10.072
  6. Y. Xu, F. Wu and Y. Tan, “Stochastic Lotka-Volterra System with Infinite Delay,” Journal of Computational and Applied Mathematics, Vol. 232, No. 2, 2009, pp. 472-480. http://dx.doi.org/10.1016/j.cam.2009.06.023
  7. F. Wu, X. Mao and S. Hu, “Stochastic Suppression and Stabilization of Functional Differential Equations,” Systems & Control Letters, Vol. 59, No. 12, 2010, pp. 745- 753. http://dx.doi.org/10.1016/j.sysconle.2010.08.011
  8. F. Wu and S. Hu, “Stochastic Functional KolmogorovType Population Dynamics,” Journal of Mathematical Analysis and Applications, Vol. 347, No. 2, 2008, pp. 534-548. http://dx.doi.org/10.1016/j.jmaa.2008.06.038
  9. Y. Ji and H. J. Chizeck, “Controllability, Stabilizability and Continuous-Time Markovian Jump Linear Quadratic Control,” IEEE Transaction on Automatic Control, Vol. 35, No. 7, 1990, pp. 777-788. http://dx.doi.org/10.1109/9.57016
  10. M. Marition, “Jump Linear Systems in Automatic Control,” Marcel Dekker, New York, 1990.
  11. X. Feng, K. A. Loparo, Y. Ji and H. J. Chizeck, “Stochastic Stability Properties of Jump Linear Systems,” IEEE Trans. Automat. Control, Vol. 31, 1992, pp. 38-53. http://dx.doi.org/10.1109/9.109637
  12. Y. Shen and J. Wang, “Almost Sure Exponential Stability of Recurrent Neural Networks with Markovian Switching,” IEEE Transaction on Neural Network, Vol. 20, No. 5, 2009, pp. 840-855. http://dx.doi.org/10.1109/TNN.2009.2015085
  13. Z. Wang, Y. Liu and X. Liu, “State Estimation for Jumping Recurrent Neural Networks with Discrete and Distributed Delays,” Neural Networks, Vol. 22, No. 1, 2009, pp. 41-48. http://dx.doi.org/10.1016/j.neunet.2008.09.015
  14. P. Bolzern, P. Colaneri and G. De Nicolao, “On Almost Sure Stability of Continuous-Time Markov Jump Linear Systems,” Automatica, Vol. 42, No. 6, 2006, pp. 983-988. http://dx.doi.org/10.1016/j.automatica.2006.02.007
  15. Z. Fei, H. Gao and P. Shi, “New Results on Stabilization of Markovian Jump Systems with Time Delay,” Automatica, Vol. 45, No. 10, 2009, pp. 2300-2306. http://dx.doi.org/10.1016/j.automatica.2009.06.020
  16. L. Huang, X. Mao and F. Deng, “Stability of Hybrid Stochastic Retarded Systems,” IEEE Transactions on Circuits and Systems I: Regular Papers, Vol. 55, No. 11, 2008, pp. 3413-3420. http://dx.doi.org/10.1109/TCSI.2008.2001825
  17. X. Mao, “Stability of Stochastic Differential Equations with Markovian Switching,” Stochastic Processes and their Applications, Vol. 79, No. 1, 1999, pp. 45-67. http://dx.doi.org/10.1016/S0304-4149(98)00070-2
  18. X. Mao and C. Yuan, “Stochastic Differential Equations with Markovian Switching,” Imperial College Press, London, 2006. http://dx.doi.org/10.1142/p473
  19. X. Mao, G. G. Yin and C. Yuan, “Stabilization and Destabilization of Hybrid Systems of Stochastic Differential Equations,” Automatica, Vol. 43, No. 2, 2007, pp. 264- 273. http://dx.doi.org/10.1016/j.automatica.2006.09.006
  20. C. Yuan and J. Lygeros, “On the Exponential Stability of Switching Diffusion Processes,” IEEE Transaction on Automatic Control, Vol. 50, No. 9, 2005, pp. 1422-1426. http://dx.doi.org/10.1109/TAC.2005.854641
  21. C. Yuan and J. Lygeros, “Stabilization of a Class of Stochastic Differential Equations with Markovian Switching,” Systems Control Letters, Vol. 54, No. 9, 2005, pp. 819-833. http://dx.doi.org/10.1016/j.sysconle.2005.01.001
  22. C. Yuan and G. Yin, “Stability of Hybrid Stochasti Delay Systems Whose Discrete Components Have a Large State Space: A Two-Time-Scale Approach,” Journal of Mathematical Analysis and Applications, Vol. 368, No. 1, 2010, pp. 103-119. http://dx.doi.org/10.1016/j.jmaa.2010.02.053
  23. Y. Yang, J. Li and G. Chen, “Finite-Time Stability and Stabilization of Nonlinear Stochastic Hybrid Systems,” Journal of Mathematical Analysis and Applications, Vol. 356, No. 1, 2009, pp. 338-345. http://dx.doi.org/10.1016/j.jmaa.2009.02.046
  24. L. Zhao and F. Xi, “Explicit Conditions for Asymptotic Stability of Stochastic Linard-Type Equations with Markovian Switching,” Journal of Mathematical Analysis and Applications, Vol. 348, No. 1, 2008, pp. 267-273. http://dx.doi.org/10.1016/j.jmaa.2008.07.030
  25. L. Liu and Y. Shen, “The Asymptotic Stability and Exponential Stability of Nonlinear Stochastic Differential Systems with Markovian Switching and with Polynomial Growth,” Journal of Mathematical Analysis and Applications, Vol. 391, No. 1, 2012, pp. 323-334. http://dx.doi.org/10.1016/j.jmaa.2012.01.058
  26. F. Wu and S. Hu, “Suppression and Stabilisation of Noise,” International Journal of Control, Vol. 82, No. 11, 2009, pp. 2150-2157. http://dx.doi.org/10.1080/00207170902968108
  27. X. Mao, “Exponential Stability of Stochastic Differential Equations,” Dekker, NewYork, 1994.
  28. L. Feng, Y. Shen and Z. Li, “Suppression of Functional System with Markovian Switching,” In: Lecture Notes in Computer Science 7664 of the 19th International Conference on Neural Information Processing, Springer, Doha, Qatar, 2012, pp. 460-466.