Paper Menu >>
Journal Menu >>
J. Biomedical Science and Engineering, 2009, 2, 80-85 Published Online April 2009 in SciRes. http://www.scirp.org/journal/jbise JBiSE A novel approach in ECG beat recognition using adaptive neural fuzzy filter Glayol Nazari Golpayegani1, Amir Homayoun Jafari1 1Biomedical Engineering Department, Islamic Azad University, Science and Research Branch, Tehran, Iran. Email: Gelayol777@yahoo.com, Amir_j73@yahoo.com Received Jan. 5th, 2009; revised Jan. 16th, 2009; accepted Feb. 10th, 2009 ABSTRACT Accurate and computationally efficient means of electrocardiography (ECG) arrhythmia detec- tion has been the subject of considerable re- search efforts in recent years. Intelligent com- puting tools such as artificial neural network (ANN) and fuzzy logic approaches are demon- strated to be competent when applied individu- ally to a variety of problems. Recently, there has been a growing interest in combining both of these approaches, and as a result, adaptive neural fuzzy filters (ANFF) [1] have been evolved. This study presents a comparative study of the classification accuracy of ECG signals using (MLP) with back propagation training algorithm, and a new adaptive neural fuzzy filter architec- ture (ANFF) for early diagnosis of ECG ar- rhythmia. ANFF is inherently a feed forward multilayered connectionist network which can learn by itself according to numerical training data or expert knowledge represented by fuzzy if-then rules [1]. In this paper we used an adap- tive neural fuzzy filter as an ECG beat classifier. We combined 3 famous wavelet transforms and used them mid 4 the order AR model coefficient as features. Our results suggest that a new proposed classifier (ANFF) with these features can generalize better than ordinary MLP archi- tecture and also learn better and faster. The results of proposed method show high accu- racy in ECG beat classification (97.6%) with 100% specificity and high sensitivity. Keywords: Adaptive Neural Fuzzy Filter, ECG Arrhythmia Classification, Pattern Recognition, Multilayer Perceptron. 1. INTRODUCTION Electrocardiography deals with the electrical activity of the heart. Bio-signals being non-stationary signals, the reflection may occur at random in the time-scale. There- fore, for effective diagnostic, ECG pattern and heart rate variability may have to be observed over several hours. Thus the volume of the data being enormous, the study is tedious and time consuming. Therefore, com- puter-based analysis and classification of cardiac dis- eases can be very helpful in diagnostic [1]. Several algo- rithms have been developed in the literature for detection and classification of ECG beats. One of ECG beat rec- ognition is neural network classification method [2-9]. Multilayer perceptron (MLP), has been shown to be able to recognize and classify ECG signals more accurately. However conventional Neural Networks with Back Propagation algorithm (BPNN) suffers from slow con- vergence to local and global minima and from random settings of initial of weights, which may make the neural networks have very poor mappings from inputs to output. More over in conventional neural networks, users have to determine the structure of network such as the num- bers of hidden layer before training and it is too hard to select proper structure. Another ECG classification method is Fuzzy Hybrid Neural Network [10]. In this structure a FCM algorithm is used to clustering the fea- tures and the center of clusters will be used as the input of MLP neural network. This structure made the results conventional MLP better but because of using MLP as final classifier, the shortcomings of MLP are still exist. To overcome the shortcomings encountered in neural networks, while still keeping their advantages, an adap- tive neural fuzzy filter, (ANFF) has been developed in [1]. The ANFF is a feed forward multilayer network that integrates the basic elements and functions of a tradi- tional fuzzy system into a connectionist structure. An important feature of this adaptive filter is that it can dy- namically partition the input space and output space us- ing irregular fuzzy hyper box [11]. For the adaptation of membership functions in the ANFF, the back propaga- tion algorithm is used to find the optimal parameters under the mean square error (MSE) criterion. Hence, in the ANFF, the Fuzzy ART is used for structure learning and the back propagation algorithm for parameter learn- ing. The ANFF can thus on-line partition the in- put-output spaces, tune membership functions, and find proper fuzzy logic rules dynamically on the fly. Users need not give the initial fuzzy partitions, membership functions, or fuzzy logic rules except for the case that SciRes Copyright © 2009 81 G. N. Golpayegani et al. / J. Biomedical Science and Engineering 2 (2009) 80-85 SciRes Copyright © 2009 JBiSE expert knowledge is available and is used as the initial fuzzy rules. Hence, there are no hidden nodes in the be- ginning of learning; they are created and begin to grow as the training signal arrives. Since the structure of the ANFF is constructed from fuzzy if-then rules, once the input-output relationship is constructed, it will not be destroyed and, thus, no knowledge forgetting may hap- pen while in conventional neural network we might had this event. These properties can make the ANFF more suitable for on-line classification than neural networks. Therefore in this paper we decided to use this filter as a classifier instead of a filter. More over, in this paper we used the fuzzy combination of 3 wavelets which were: Daubechies, Symlet, Biorthogonal mid 4th order AR model coefficients as features. These features beside ANFF had more efficient results than MLP. This algo- rithm was faster and more reliable than MLP and it has high mean accuracy 97.6% and also high sensitivity and specificity. This paper organized as follows. Section 1 describes the basic structure and functions of ANFF in brief. The on-line structure/parameter learning algorithm of the ANFF, which combines fuzzy ART and back propaga- tion learning algorithm under the MSE criterion is pre- sented in Section 3. In Section 4 we describe the feature extraction method. In Section 6 we will show the results of this method and compare this method with conven- tional neural network (MLP). Finally conclusions are summarized in the last section. 2. THE STRUCTURE OF ADAPTIVE NEURAL FUZZY FILTER 2.1. Adaptive Neural Fuzzy Filters In this section, we will describe the structure and func- tions of ANFF briefly. The ANFF (see Figure 1) has five layers with node and link numbering defined by the brackets on the left-hand side of the figure. Layer-1 nodes are input nodes representing input variables. Layer-5 nodes are output nodes representing output variables. Layer-2 and layer-4 nodes are term nodes that act as membership functions representing the terms of respective input and output variables. Each layer-3 node is a rule node representing one fuzzy logic rule. Thus, together all the layer-3 nodes will be as a fuzzy rule base. The links between layers 3 and 4 func- tion as a connectionist inference engine. Layer-3 links define the preconditions of rule nodes, and layer-4 links define the consequents of the rule nodes. Therefore, each rule node has at most one link to some term node of a linguistic node, and may have no such links. This is true both for precondition links (link in layer 3) and conse- quent links (links in layer 4). The links in layers 2 and 5 are fully connected between linguistic nodes and their corresponding term nodes. The arrows indicate the nor- mal signal flow directions when the network is in opera- tion (after it has been built and trained). When we are in structure learning step, ANFF operates in Up-Down mode and when we want to obtain estimated output, ANFF operates in Down-Up mode. The ANFF uses the technique of complement coding from fuzzy ART [12] to normalize the input-output training vectors. Complement coding is a normalization process that rescales an n-dimensional vector, x=(x1, x2… xn), to its 2n-dimensional complement coding such that ( ) () nn c nn cc xxxxxx xxxxxxx −−−≡ ≡ ′ 1,,,,1,,1, ,,,,,, 2211 2211 L L (1) where 12 ( ,,...) n x xxxx x x ′≡== and c i x is the complement of i x , i.e., c ii x x=−1. As mentioned in [11], complement coding helps avoid the problem of category proliferation when using fuzzy ART cluster- ing. It also preserves training vector amplitude infor- mation. In applying the complement coding technique to the ANFF, all training vectors (either input state vectors or desired output vectors) are transformed to their complement coded form in the preprocessing process, and the transformed vectors are then used for training. A typical network consists of nodes with some finite number of fan-in connectionist from other nodes repre- sented by weight values, and fan-out connectionists to other nodes. Associated with the fan-in of a node is an integration function f which combines information, acti- vation, or evidence from other nodes, and provides the net input, i.e., ()()() ()()() 121 2 (,, ...;,,...) kkkk kk pp netinputf zzzwww−= (2) where ( ) ( ) ,... k i Z ip is the ith input to a node in layer k, and w(i) is the weight of the associated link. The super- script in the above equation indicates the layer number. This notation will be also used in the following equa- tions. Each node also outputs an activation value as a function of its net-input. ()outputaf= (3) The description of the functions of nodes in each of five layers of the ANFF can be obtained from Reference [1]. 2.2. The Structure-Learning Step The structure learning step consists of three learning processes: input fuzzy clustering process, output fuzzy clustering process, and mapping process. The first two processes are performed simultaneously on both sides of network, and are described below. 2.2.1. Input Fuzzy Clustering Process For input fuzzy clustering, ANFF uses the fuzzy ART fast learning algorithm [11,12] to find the input mem- bership function parameters )2()2( ,ijij UV . For this purpose, first, the values of choice functions, Tj, for each com- plement coded vector are computed by G. N. Golpayegani et al. / J. Biomedical Science and Engineering 2 (2009) 80-85 82 SciRes Copyright © 2009 JBiSE Figure 1. Structure of Adaptive Neural Fuzzy Filter (ANFF). ( )1,...., j j j x Txj N a ω ω ′∧ ′== + (4) where “Λ” is the minimum operator performed for the pairwise elements of two vectors, α ≥ 0 is a constant, N is the current number of rule nodes, and wj is the com- plement weight vector for each rule node. Note that the choice function value indicates the simi- larity between the input vector x′ and the complement weight vector wj. We then need to find the complement weight vector closest to x′. The chosen category is in- dexed by J, where j t x x ω ρ ′∧≥ (5) where ρ is between 0 and 1 is a vigilance parameter. If the vigilance criterion is not met, we say mismatch reset occurs. In this case, the choice function value TJ is set to zero for the duration of the input presentation to prevent persistent selection of the same category during search (we call this action “disabling J”). A new index J is then chosen using (20). The search process continues until the chosen J satis- fies (21). If no such J is found, then a new input hype box is created by adding a set of n new input term nodes, one for each input linguistic variable, and setting up links be- tween the newly added input term nodes and the input lin- guistic nodes. The complement weight vectors on these new layer-2 links are simply given as the current input vector, x′. These newly added input term nodes and links define a new hyper box, and thus a new category, in the input space. We denote this newly added hyper box as J. Layer 5(Output linguistic nodes) Down-up transmission mode Up-down transmission mode Layer 4(Output term nodes) Layer 3(Rule nodes) Layer 2(Input term nodes) Layer 1(Input linguistic nodes) ),(22 2 c yy y 2 y 1 y ),( 11 1 c yy y ),( )5( 11 )5( 11 yx ),( )5( 12 )5( 12 yx )5( 11 m )5( 12 m ),( )5( 21 )5( 21 yx ),( )5( 22 )5( 22 yx )5( 21 m )5( 22 m … … … … … … ),( )2( 11 )2( 11 yx ),( )2( 13 )2( 13 yx ),( )2( 21 )2( 21 yx ),( )2( 23 )2( 23 yx … 1 11),( x xx c 2 22),( x xx c 83 G. N. Golpayegani et al. / J. Biomedical Science and Engineering 2 (2009) 80-85 SciRes Copyright © 2009 JBiSE 2.2.2. Output Fuzzy Clustering Process The output fuzzy clustering process is exactly the same as the input fuzzy clustering process except that it is performed between layers 4 & 5 which are working in the up-down transmission mode. 2.2.3. Mapping Process After the two hyper boxes in the input and output spaces are chosen in the input and output fuzzy clustering proc- esses, the next step is to perform the mapping process which decides the connections between layer-3 and layer-z4 nodes. This mapping process is described by the following algorithm, wherein connecting rule node J output hyper box K we means connecting the rule node J to the output term nodes that constitutes the hyper box K in the output space. Step 1: IF rule node J is a newly added node THEN connect rule node J to output hyper box K. Step 2: ELSE IF rule node J not connected to output hyper box K originally THEN disable J and perform In- put Fuzzy Clustering Process to find the next qualified J. Step 3: ELSE no structure change is necessary. In the mapping process, hyper boxes J and K are resized ac- cording to the fast learning rule [40] by updating weights, WJ and WK, as )()()()( ,old k new k old J new JWxWWxW ∧ ′ =∧ ′ = (6) 2.3. The Parameter-Learning Step After the network structure has been adjusted according to the current training pattern in the structure-learning step, it is then necessary to fine tune the network pa- rameters using the same training pattern. Basically, the back propagation algorithm is used to find node output errors, which are then analyzed to guide parameter ad- justment. As mentioned above, the goal of training the ANFF is to minimize the error function () () ESKSK ∧ ⎛⎞ =− ⎜⎟ ⎝⎠ 2 1 2 (7) where s(k) is the desired signal, and s ˆ(k) is the filtered signal. Based upon this MSE criterion and in analogy to the back propagation algorithm, we can derive the following w f f E W F F E W E w E KWKWKWKW ∂ ∂ ⋅ ∂ ∂ ⋅ ∂ ∂ −= ∂ ∂ ⋅ ∂ ∂ −= ∂ ∂ − ⎟ ⎠ ⎞ ⎜ ⎝ ⎛ ∂ ∂ −+=Δ+=+ α α η )()()()1( (8) where W is the adjustable parameter in the filter. The adapting equations of the parameters of each layer can be obtained from [1] in more details. 3. DATA ACQUISITION AND FEATURE EXTRACTION METHOD We had 4 kinds of ECG beats. There were: Atrial Fibril- lation beats (AF), Ventricular Tachycardia beats (VT), Super Ventricular Tachycardia Arrhythmia beats (SVA) and Normal beats. We selected 18 signals from each kind of beat from MIT-BIH Arrhythmia database. So we had 72 signals totally. The arrhythmia database of MIT-BIH, have been preprocessed in such away that they are clean from any corrupting noise. Therefore we did not need to do any additional preprocessing on our ECG signals. The sampling frequency of MIT-BIH Arrhythmia database is 250Hz. We used a 1000 point moving window with 200 point overlap between each two windows for each ECG signal. So each ECG signal converted to 24 segments which each segment had 1000 point. Therefore we had 1728 segment totally. We used 80% of these segments for training ANFF and 20% of that to test the perform- ance of ANFF. We used a fuzzy combination of 3 wavelet transform which were: Daubechies (db4), Symlets (sym8) and Biorthoginal (bior4.4). A 4 level decomposition was done with each wavelet transform. And then we selected the maximum value between these 3 wavelets in each level. Therefore, 4 wavelet coefficients were obtained for each segment with this fuzzy combination if wavelet trans- forms. We also used the 4th order AR model coefficients as another feature extraction method so 4 features were obtained for each segment by this method. Therefore finally we had an 8 dimensional feature vector for each segment. Then we used these features as input for ANFF. We also defined the target for each segment and used them as output variable for ANFF. 4. RESULTS We considered following values for the constants in ANFF: learning parameter (η)=0.1, fuzziness parameter (γ)=0.6, choice function parameter (α)=0.7. In the first step of process we used only the Daube- chies wavelet coefficients as ECG features. In the second step of process we used Daubechies wavelet mid 4th order AR model coefficient as ECG features. In third step of process we used only the fuzzy combination of three wavelets as ECG features. And finally we used fuzzy combination of wavelets mid 4th order AR model coeffi- cient as ECG features. Table 1 shows the results of using these features with ANFF separately. Then also did these steps with an MLP with 40 hidden nodes. Table 2 shows the results of using these features with MLP. In both methods (ANFF and MLP) we calculated specificity and sensitivity and accuracy for each kind of features. We selected 1382 segments for training and 346 segments for test randomly. As we can see from Table 1 and Table 2, among 4 kinds of features extracted, the fuzzy combination of 3 pre nominate wavelet transforms mid 4th order AR model coefficients provided best results for both ANFF and MLP structures. Also we can see that in compare with MLP, ANFF had much better results. ANFF had high accuracy about 97.6% and also it had higher speci- ficity and sensitivity than MLP. Furthermore unlike the MLP, ANFF did not need to have pre determined struc- G. N. Golpayegani et al. / J. Biomedical Science and Engineering 2 (2009) 80-85 84 SciRes Copyright © 2009 JBiSE Table 1. Results of ANFF in ECG beat recognition. Classifier Total test segments SE(%) SP(%) Accuracy(%) ANFF with wavelet features 346 92.7% 98.1% 90.33% ANFF with wavelet and AR model coefficients features 346 95.7% 98.4% 94.2% ANFF with fuzzy combination of wavelets 346 96.6% 98.6% 92.1% ANFF with fuzzy combination of wavelets and AR model coefficient and features 346 97.6% 100% 97.6% Table 2. Results multi layer perceptron meural network (MLP) in ECG beat recognition. Classifier Total test segments SE(%) SP(%) Accuracy(%) MLP with wavelet features 346 91.4% 96.7% 86.7% MLP with wavelet and AR model coefficients features 346 93.49% 96.93% 91.3% MLP with fuzzy combination of wavelets 346 95.3% 97.47% 88.7% MLP with fuzzy combination of wavelets and AR model coefficient features 346 94.76% 99.6% 94.2% ture and it will find the best structure during training by itself. 5. CONCLUSION In this paper an ANFF has been developed to classify ECG signals by using 4 different features set. Results show that among these features set, a fuzzy combination of Daubeches, Symlets and Biorthogonal wavelet trans- forms mid 4th order AR model coefficients, had best re- sults. As we know, several algorithms have been developed for ECG beat recognition in literatures. Most of these algorithms have used Neural Networks as their final classifier. There are several kinds of Neural Networks. One of the most useful neural networks in ECG classifi- cation is Multi Layer Perceptron (MLP) neural network. It is easy to use and it has been shown reliable results in ECG beat classification. Therefore we decided to compare the performance of our purposed method with MLPNeu- ral Networks, such as MLP, are capable in classification. They have strong learning and generalization ability but they have some disadvantages. For example: (1) we need iterative training cycles to encode the relation between inputs and outputs into the neural networks, so neural networks have long training time. (2) users have to pre- determine the size and structure of neural networks (such as the numbers of nodes of hidden layers) initially and it is hard for users. (3) we can not use linguistic rules in neural networks directly. Adaptive Neural Fuzzy Filters (ANFF) overcomes these shortcomings. In ANFF, users do not need to pre- determine the numbers of nodes in hidden layer and these nodes are generated automatically during the train- ing process. Since the structure of ANFF is optimum, it takes much shorter to train in compare with neural net- works. More over, we can use linguistic rules, which are obtained from expert knowledge, in ANFF directly. ANFF was introduced by Chin-Teng Lin and Chia-Feng Juang in 1997 [1]. They introduced the structure of ANFF in details and they used ANFF as an adaptive fil- ter for noise cancellation. We decided to use this useful filter as a classifier. Therefore in this paper we used ANFF as an ECG beat classifier and we compared its performance with most commonly used classifier (MLP). On the other hand, wavelet transforms (WT) are must commonly feature extraction method in ECG beat recog- nition algorithms. An over view on previous works in this context shows that AR model beside wavelet trans- form has showed better results in ECG beat classification. More over, there are several mother wavelets which are used for ECG feature extraction. Therefore we decided to combine three mother wavelets which are most common used for ECG feature extraction and we used AR model coefficients beside this combination as our final feature extraction method. A comparative assessment of performance of ANFF with MLP neural networks show that more reliable re- sults are obtained with the ANFF for the classification of ECG signals. MLP neural networks are still able to generalize with good recognition accuracy. However, they take longer to train and users have to predetermine the size and structure of network such as the number of hidden lay- ers and it is truly difficult. The aim in developing ANFF was to achieve more optimum results with relatively few signal features. It has been demonstrated that the training time of ANFF was much shorter than time re- quired by MLP and the accuracy (97.6%), specificity (100%) and sensitivity (97.6%) of ANFF were much 85 G. N. Golpayegani et al. / J. Biomedical Science and Engineering 2 (2009) 80-85 SciRes Copyright © 2009 JBiSE better than those of MLP. Furthermore the ANFF can be trained by numerical data and linguistic information expressed by fuzzy if-then rules. Another key feature of ANFF is that, without any given initial structure, the ANFF can construct itself automatically from numerical training data. The proposed method, which incorporates the tech- niques of Adaptive Neural Fuzzy Filter and back propa- gation learning and combines their advantages, can be said to be more capable of recognizing other biological signals than conventional Neural Networks with Back Propagation algorithm (BPNN) such as Multi Layer Per- ceptron (MLP). REFERENCES [1] C.T. Lin, C.F. Juang, (2001) “An adaptive neural fuzzy filter and its applications,” IEEE Transactions On Systems, MAN, And Cybernetics, VOL. 27, NO. 4, 1103-1110. [2] S. Osowaki, T.H. Linh, (2001) “ECG beat recognition using fuzzy hybrid neural network,” IEEE Trans. Biomed. Eng. 48 (11) 1265-1271. [3] Y. Ozbay, B. Karlik, (2001) “A reconition of ECG arrhythmias using artificial neyral network,” Proceedings of the 23rd Annual Conference, IEEE/EMBS, Istanbul, Turkey, pp. 76-80. [4] Y. Ozbay, “Fast recognition of ECG arrhythmias,” (1999) Ph.D. Yhesis, Institute of Natural and Applied Science, Selcuk Univer- sity,. [5] S.Y. Foo, G. Harvey, A. Meyer-Baese, (2002) “Neural network- based ECG pattern recognition”, Eng. Appl. Artif. Intell. 15, 353-360. [6] V. Pilla, H.S. Lopes, (1999) “Evolutionary training of a neuro-fuzzy network for detection of a P wave of the ECG,” Proceeding of the third international conference on computational intelligence and multimedia applications, New Dehli, India, 102-106. [7] M. Engin, S. Demirag, (2003) “Fuzzy-hybrid neural network based ECG beat recognition using three different types of feature sets,” Cardiovasc. Eng. Int. J. 3 (2) 71-80. [8] S. Hykin, (1994) Neural Networks: A comperhensive Foundation, Macmillan, New York. [9] B. Karlik, m.o. Tokhi, M. Alci, (2003) “A fuzzy clustering neural network architecture for multifunction upper-limb prosthesis,” IEEE Trans. Biomed. Eng. 50 (11), 1255-1261. [10] R. Acharya, P.S. Bhat, S.S. Iyengar, A. Roo, S. Dua, (2001) “Classification of heart rate data using artificial neural network and fuzzy equivalence relation,” J. Pattern Recognition Soc, 4, 238-244. [11] G. A. Carpenter, S. Grossberg, and D. B. Rosen, (2001) “Fuzzy ART: Fast stable learning and categorization of analog patterns by an adaptive adaptive resonance system,” Neural Networks, 4, 759-771. [12] G. A. Carpenter, S. Grossberg, N. Markuzon, J. H. Reynolds, and D. B. Rosen, (2002) “Fuzzy ARTMAP: A neural network architecture for incremental supervised learning of analog multidimensional maps,” IEEE Trans. Neural Networks, vol. 3, pp. 698-712. |