Journal of Signal and Information Processing
Vol.06 No.04(2015), Article ID:61097,7 pages
10.4236/jsip.2015.64024

Convolutional Noise Analysis via Large Deviation Technique

Monika Pinchas

Department of Electrical and Electronic Engineering, Ariel University, Ariel, Israel

Copyright © 2015 by author and Scientific Research Publishing Inc.

This work is licensed under the Creative Commons Attribution International License (CC BY).

http://creativecommons.org/licenses/by/4.0/

Received 8 September 2015; accepted 10 November 2015; published 13 November 2015

ABSTRACT

Due to non-ideal coefficients of the adaptive equalizer used in the system, a convolutional noise arises at the output of the deconvolutional process in addition to the source input. A higher convolutional noise may make the recovering process of the source signal more difficult or in other cases even impossible. In this paper we deal with the fluctuations of the arithmetic average (sample mean) of the real part of consecutive convolutional noises which deviate from the mean of order higher than the typical fluctuations. Typical fluctuations are those fluctuations that fluctuate near the mean, while the other fluctuations that deviate from the mean of order higher than the typical ones are considered as rare events. Via the large deviation theory, we obtain a closed-form approximated expression for the amount of deviation from the mean of those fluctuations considered as rare events as a function of the system’s parameters (step-size parameter, equalizer’s tap length, SNR, input signal statistics, characteristics of the chosen equalizer and channel power), for a pre-given probability that these events may occur.

Keywords:

Large Deviation Theory, Blind Equalization, Blind Deconvolution

1. Introduction

In this paper, we deal with the convolutional noise arising at the output from a blind deconvolutional process. A blind deconvolution process arises in many applications such as seismology, underwater acoustic, image restoration and digital communication [1] - [7] . A higher convolutional noise may lead to more errors in the recovering process [8] . According to [9] [10] , the convolutional noise power depends on the step-size parameter, equalizer’s tap length, input signal statistics, channel characteristics, characteristics of the chosen blind equali- zation technique and on the signal to noise ratio (SNR). Thus, those fluctuations of the convolutional noise that are near the mean value are well understood and investigated. By well understood we mean that it is well understood how to control the convolutional noise power (thus also the convolutional noise fluctuation near the mean) via the step-size parameter or equalizer’s tap length for instance. But up to now, those fluctuations of the convolutional noise that are larger than the typical ones (which are near the mean), which occur rarely, were not addressed.

The theory of large deviations is concerned with the exponential decay of probabilities of large fluctuations in random systems. These probabilities are important in many fields of study, including statistics, finance, and engineering, as they often yield valuable information about the large fluctuations of a random system around its most probable state or trajectory [11] . According to [12] , the theory of large deviations deals with the pro- babilities of rare events (or fluctuations) that are exponentially small as a function of some parameters, e.g., the number of random components of a system, the time over which a stochastic system is observed, the amplitude of the noise perturbing a dynamical system or the temperature of a chemical reaction. The reader may refer also to [13] - [17] for further information on the theory of large deviations.

In this paper we address indirectly those fluctuations of the convolutional noise that are larger than the typical ones, which occur very rare. Namely, we consider the fluctuations of the arithmetic average (sample mean) of the real part of consecutive convolutional noises which deviate from the mean of order higher than the typical fluctuations. As already mentioned, typical fluctuations are those fluctuations that fluctuate near the mean, while the other fluctuations that deviate from the mean of order higher than the typical ones are considered as rare events. Via the large deviation theory, we obtain a closed-form approximated expression for the probability that these rare events may occur as a function of the step-size parameter, equalizers’s tap length, SNR, input signal statistics, characteristics of the chosen equalizer (based on a cost function where the error of the equalized output can be expressed as a polynomial function of order up to three), channel power and the amount of deviation from the mean. Based on this new expression we are able to evaluate approximately the amount of deviation from the mean of those fluctuations considered as rare events as a function of the system’s parameters (step-size parameter, equalizers’s tap length, SNR, input signal statistics, characteristics of the chosen equalizer and channel power), for a pre-given probability that these events may occur.

The paper is organized as follows: after having described the system under consideration in Section 2 we evaluate in Section 3 approximately the amount of deviation from the mean of those fluctuations considered as rare events as a function of the systems parameters (step-size parameter, equalizerss tap length, SNR, input signal statistics, characteristics of the chosen equalizer and channel power), for a pre-given probability that these events may occur. Section 4 is our conclusion.

2. System Description

The system under consideration is illustrated in Figure 1, where we make the following assumptions:

1) The input sequence belongs to a two independent quadrature carrier case constellation input with variance where and are the real and imaginary parts of respectively.

2) The unknown channel is a possibly nonminimum phase linear time-invariant filter in which the transfer function has no “deep zeros”, namely, the zeros lie sufficiently far from the unit circle.

3) The equalizer is a tap-delay line.

4) The noise is an additive Gaussian white noise with zero mean and variance

where is the expectation operator.

Figure 1. Block diagram of a baseband communication system.

The transmitted sequence is transmitted through the channel and is corrupted with noise. Therefore, the equalizer’s input sequence may be written as:

(1)

where “” denotes the convolution operation. The equalized output sequence is defined by:

(2)

where is the convolutional noise (convolutional error) due to non-ideal equalizer’s coefficients

and. The update mechanism of the equalizer’s coefficients is given by

[18] :

(3)

where is the step-size parameter, stands for the conjugate operation and is a predefined

cost function that characterizes the intersymbol interference, see [19] - [26] . Minimizing this with

respect to the equalizer parameters will reduce the convolutional error. In the following we deal with those

equalization methods where can be defined as a polynomial function of order up to

three as is in the case of [19] . Thus, in this work we consider the following update mechanism of the equalizer’s coefficients:

(4)

3. The Deviation from the Mean

In this section we obtain a closed-form approximated expression for the amount of deviation from the mean of those fluctuations considered as rare events as a function of the system’s parameters (step-size parameter, equalizers’s tap length, SNR, input signal statistics, characteristics of the chosen equalizer and channel power), for a pre-given probability that these events may occur.

Theorem 1. For the following assumptions:

1) The convolutional noise, is a zero mean, white Gaussian process with variance

, where. is the real part of.

2) The source signal is a complex input where the real part of is independent with the imaginary part of, with known variance and higher moments. The mean of the input sequence is

zero. Namely,.

3) The convolutional noise and the source signal are independent.

4) can be expressed as a polynomial function of the equalized output namely as of

order three.

5) The gain between the source and equalized output signal is equal to one.

6) The convolutional noise is independent with.

The amount of deviation from the mean of those fluctuations considered as rare events as a function of the system’s parameters, given the probability that these events occur can be expressed by:

(5)

where the probability that the fluctuations of the arithmetic average (sample mean) of the real part of consecutive convolutional noises which deviate from the mean of order higher than the typical ones is expressed by:

(6)

and is given according to [27] :

(7)

(8)

xr is the real part of, R is the channel length, N is the equalizer’s tap length,

and, , are properties of the chosen equalizer and found by:

(9)

where is the real part of and, are the real and imaginary parts of the equalized output respectively.

Proof. Let us first define:

(10)

Next, by using assumption 1 from this section, we may write:

(11)

The propability density function (pdf) for (10) is

(12)

since a sum of Gaussian random variables is also exactly Gaussian-distributed. According to [11] , a large deviation approximation is obtained from this exact result by neglecting the term, which is subdominant with respect to the decaying exponential, thereby obtaining [11]

(13)

The Central Limit Theory (CLT) governs random fluctuations only near the mean-deviations from the mean

of the order of [14] . Fluctuations which are of the order of are, relative to typical fluctuations,

much bigger: they are large deviations from the mean [14] . They happen only rarely, and so large deviation theory is often described as the theory of rare events-events which take place away from the mean, out in the tails of the distribution; thus large deviation theory can also be described as a theory which studies the tails of distributions [14] . According to [11] [14] , the probability that

(14)

where according to [11] , is used to stress that as the dominant part of is

the decaying exponential. Thus, based on (14), we may write:

(15)

where

(16)

and

(17)

Thus from (17) and (13) we have:

(18)

Next we turn to find a closed-form approximated expression for. Based on [27] , the expression for the

convolutional noise power for the noisy and non-biased input case is given by (7), (8) and (9). This completes our proof.

4. Conclusion

In this paper we dealt with the fluctuations of the arithmetic average (sample mean) of the real part of consecutive convolutional noises which deviate from the mean of order higher than the typical ones. Via the large deviation theory, we obtained a closed-form approximated expression for the amount of deviation from the mean of those fluctuations considered as rare events as a function of the system’s parameters (step-size pa- rameter, equalizerss tap length, SNR, input signal statistics, characteristics of the chosen equalizer and channel power), for a pre-given probability that these events may occur.

Acknowledgements

We thank the Editor and the referee for their comments.

Cite this paper

Monika Pinchas, (2015) Convolutional Noise Analysis via Large Deviation Technique. Journal of Signal and Information Processing,06,259-265. doi: 10.4236/jsip.2015.64024

References

  1. 1. Wang, J., Huang, H.N., Zhang, C.H. and Guan, J. (2009) A Study of the Blind Equalization in the Underwater Communication. WRI Global Congress on Intelligent Systems, 3, 122-125.
    http://dx.doi.org/10.1109/GCIS.2009.61

  2. 2. Rao, W., Yuan, K.-M., Guo, Y.-C. and Yang, C. (2008) A Simple Constant Modulus Algorithm for Blind Equalization Suitable for 16-QAM Signal. 9th International Conference on Signal Processing, Beijing, 26-29 October 2008, 1963-1966.

  3. 3. Weber, R., Schulz, F. and Bohme, J.F. (2002) Blind Adaptive Equalization of Underwater Acoustic Channels Using Second-Order Statistics. OCEANS’02 MTS/IEEE, 4, 2444-2452.
    http://dx.doi.org/10.1109/OCEANS.2002.1192010

  4. 4. Abrar, S. and Nandi, A.K. (2010) Adaptive Minimum Entropy Equalization Algorithm. IEEE Communications Letters, 14, 966-968.
    http://dx.doi.org/10.1109/LCOMM.2010.083110.101168

  5. 5. Feng, C. and Chi, C. (1999) Performance of Cumulant Based Inverse Filters for Blind Deconvolution. IEEE Transaction on Signal Processing, 47, 1922-1935.
    http://dx.doi.org/10.1109/78.771041

  6. 6. Malik, G. and Sappal, A.S. (2011) Adaptive Equalization Algorithms: An Overview. International Journal of Advanced Computer Science and Applications, 2, 62-67.
    http://dx.doi.org/10.14569/IJACSA.2011.020311

  7. 7. Pinchas, M. and Bobrovsky, B.Z. (2006) A Maximum Entropy Approach for Blind Deconvolution. Signal Processing (Eurasip), 86, 2913-2931.
    http://dx.doi.org/10.1016/j.sigpro.2005.12.009

  8. 8. Pinchas, M. (2013) Symbol Error Rate as a Function of the Residual ISI Obtained by Blind Adaptive Equalizers. Pervasive and Embedded Computing and Communication Systems (PECCS 2013), Barcelona, 19-21 February 2013.

  9. 9. Pinchas, M. (2010) A Closed Approximated Formed Expression for the Achievable Residual Intersymbol Interference Obtained by Blind Equalizers. Signal Processing (Eurasip), 90, 1940-1962.
    http://dx.doi.org/10.1016/j.sigpro.2009.12.014

  10. 10. Pinchas, M. (2010) A New Closed Approximated Formed Expression for the Achievable Residual ISI Obtained by Adaptive Blind Equalizers for the Noisy Case. IEEE International Conference on Wireless Communications, Networking and Information Security WCNIS2010, Beijing, June 2010, 26-30.
    http://dx.doi.org/10.1109/wcins.2010.5541879

  11. 11. Touchette, H. (2009) The Large Deviation Approach to Statistical Mechanics.
    http://arxiv.org/pdf/0804.0327v2.pdf

  12. 12. Touchette, H. (2012) A Basic Introduction to Large Deviations: Theory, Applications, Simulations.
    http://arxiv.org/pdf/1106.4146v3.pdf

  13. 13. Duffy, K. and Metcalfe, A.P. (2004) The Large Deviations of Eestimating Rate-Functions. Applied Probability Trust.
    http://www.hamilton.ie/ken_duffy/Downloads/tldoerf.pdf

  14. 14. Lewis, J.T. and Russell, R. (1997) An Introduction to Large Deviations for Teletraffic Engineers.
    http://www2.warwick.ac.uk/fac/sci/maths/people/staff/oleg_zaboronski/fm/large_deviations_review.pdf

  15. 15. Varadhan, S.R.S. (2008) Large Deviations. The Annals of Probability, 36, 397-419.
    http://dx.doi.org/10.1214/07-AOP348

  16. 16. Shwartz, A. and Weiss, A. Large Deviations for Performance Analysis.
    http://webee.technion.ac.il/~adam/LD/intro.pdf

  17. 17. Dembo, A. and Zeitouni, O. (1998) Large Deviations Techniques and Applications. 2nd Edition, Springer, New York.

  18. 18. Nandi, A.K. (1999) Blind Estimation Using Higher-Order Statistics. Kluwer Academic Publishers, Boston, 66.
    http://dx.doi.org/10.1007/978-1-4757-2985-6

  19. 19. Godard, D.N. (1980) Self Recovering Equalization and Carrier Tracking in Two-Dimensional Data Communication System. IEEE Transactions on Communications, 28, 1867-1875.
    http://dx.doi.org/10.1109/TCOM.1980.1094608

  20. 20. Shalvi, O. and Weinstein, E. (1990) New Criteria for Blind Deconvolution of Nonminimum Phase Systems (Channels). IEEE Transactions on Information Theory, 36, 312-321.
    http://dx.doi.org/10.1109/18.52478

  21. 21. Pinchas, M. (2011) A MSE Optimized Polynomial Equalizer for 16QAM and 64QAM Constellation. Signal, Image and Video Processing, 5, 29-37.
    http://dx.doi.org/10.1007/s11760-009-0138-z

  22. 22. Abrar, S. and Nandi, A.K. (2010) Blind Equalization of Square-QAM Signals: A Multimodulus Approach. IEEE Transactions on Communications, 58, 1674-1685.

  23. 23. Arenas-Garcia, J. and Figueiras-Vidal, A.R. (2006) Improved Blind Equalization via Adaptive Combination of Constant Modulus Algorithms. Proceedings of the IEEE Conference on Acoustics Speech and Signal Processing, Toulouse, 14-19 May 2006, 3.
    http://dx.doi.org/10.1109/ICASSP.2006.1660764

  24. 24. Faruk, M.S. (2014) Modified CMA Based Blind Equalization and Carrier-Phase Recovery in PDM-QPSK Coherent Optical Receivers. Proceedings of the 16th International Conference on Computer and Information Technology, Khulna, 8-10 March 2014, 469-472.
    http://dx.doi.org/10.1109/ICCITechn.2014.6997333

  25. 25. Jiang, Z.X., Zhang, M., Li, Z.C. and Lu, S.L. (2008) A Newly High-Speed MCMA Algorithm for QAM System. Proceedings of the 4th International Conference on Wireless Communications, Networking and Mobile Computing, Dalian, 12-14 October 2008, 1-4.

  26. 26. Liu, Y.Z. and Song, T. (2007) A New CMA Algorithm Based on Modified Conjugate Gradient. Proceedings of the International Conference on Wireless Communications, Networking and Mobile Computing, Shanghai, 21-25 September 2007, 1160-1162.

  27. 27. Pinchas, M. (2015) Under What Condition Do We Get Improved Equalization Performance in the Residual ISI with Non-Biased Input Signals Compared with the Biased Version. Journal of Signal and Information Processing, 6, 79-91.
    http://dx.doi.org/10.4236/jsip.2015.62008