Since the effectiveness of extracting fault features is not high under traditional bearing fault diagnosis method, a bearing fault diagnosis method based on Deep Auto-encoder Network (DAEN) optimized by Cloud Adaptive Particle Swarm Optimization (CAPSO) was proposed. On the basis of analyzing CAPSO and DAEN, the CAPSO-DAEN fault diagnosis model is built. The model uses the randomness and stability of CAPSO algorithm to optimize the connection weight of DAEN, to reduce the constraints on the weights and extract fault features adaptively. Finally, efficient and accurate fault diagnosis can be implemented with the Softmax classifier. The results of test show that the proposed method has higher diagnostic accuracy and more stable diagnosis results than those based on the DAEN, Support Vector Machine (SVM) and the Back Propagation algorithm (BP) under appropriate parameters.
With the wide application of rolling bearings in various mechanical equipment, the problem of mechanical equipment damage caused by faults has become increasingly prominent, which affects the safety of equipment and personnel seriously [
At present, there have been many studies on the diagnosis methods of bearing faults [
In 2006, Professor Hinton proposed the idea of deep learning, which opened up a wave of deep learning in academia and industry [
Deep Auto-Encoder Network (DAEN) is a neural network consisting of a multi-layer auto-encoder AE [
Auto-Encoder (AE) is a three-layer neural network model [
Given the training samples x = { x 1 , x 2 , ... , x N } , (for each sample x i , x i = [ x 1 , x 2 , .. , x D ] T ). The output vector set of the hidden layer is h = { h 1 , h 2 , ... h N } , (for each sample h i , h i = [ h 1 , h 2 , ... , h d ] T ).
h = s f ( W ( 1 ) x + b ( 1 ) ) (1)
s f ( t ) = 1 / ( 1 + e − t ) (2)
where x and h are D-dimensional vectors, W ( 1 ) is a weight matrix that connects the input layer to the hidden layer, b ( 1 ) is the offset matrix between the input layer and the hidden layer, s f is the activation function of the encoder. This paper uses the sigmoid activation function, which is used widely and has good
experimental results. Where t represents the input vector corresponding to each neuron [
The decoder is the inverse of the encoder, the original input vector is reconstructed using the hidden layer output vector obtained by the encoder. Output variable is z = { z 1 , z 2 , ... , z N } , (for each sample z i , z i = [ z 1 , z 2 , ... , z D ] T ) by decoders as follows
z = s f ( W ( 2 ) h + b ( 2 ) ) (3)
where z is a D-dimensional vector. W ( 2 ) is a weight matrix that connects the hidden layer to the output layer. b ( 2 ) is the offset matrix between the hidden layer and the input layer,
The goal of AE training is to optimal set of parameters θ = ( W ( 1 ) , b ( 1 ) , W ( 2 ) , b ( 1 ) ) , so that the error between the output data and the input data is as small as possible [
J MSE ( θ ) = 1 m ∑ i = 1 m L MSE ( x i , z i ) = 1 m ∑ i = 1 m ( 1 2 P z i − x i P 2 ) (4)
It can be known from the above pre-training process that when training the AE parameters of each layer, the other layer parameters are fixed and remain unchanged. Therefore, if you want better results, you can use the tagged data set to adjust all layer parameters of the entire depth self-encoding network to achieve global optimality by BP algorithm after the pre-training is completed. This process becomes fine-tuned. The fine-tuning after the pre-training is completed will directly use the BP algorithm to train the effect on the initial weight of the randomization, because the latter tends to fall into the local optimum [
The input layer of the AE has the same number of nodes as the output layer. The process of encoding and decoding can be regarded as compressing the input data, and representing the high-dimensional original data with a low-dimensional vector, so that the compressed low-dimensional vector can be retained.
In this paper, the CAPSO algorithm is used to optimize the connection weight between each hidden layer and output layer in DAEN. It can find the optimal solution adaptively, reduce the dependence on the weight and improve the convergence speed of the algorithm. The input data for this model is the original time domain signal of the bearing vibration signal.
The hidden layer and the output layer of the AE are connected by weights, and the influence of the output vector of the hidden layer in the network on the output layer vector is different. The connection weight between each hidden layer and output layer in DAEN is mapped into the particles in the CAPSO algorithm, the speed and position of the particle are adjusted continuously, the fitness value is updated, and the global optimal solution is finally output. According to the expression of the loss function in Equation (4), the training error function E in the automatic encoder is the fitness function in the CAPSO algorithm, and the expression is as follows:
E = ∑ i = 1 m ( 1 2 P z i − x i P 2 ) (5)
where x i is the ith training sample of the AE encoder; z i is the ith output vector of the AE encoder.
The specific steps for optimizing the weight between the hidden layer and the output layer in DAEN with CAPSO are as follows, as shown in
Step 1: Determining the network topology of the DAEN, determining the number of cells in each layer in the automatic encoder and initializing related parameters.
Step 2: Initialize the population in the CAPSO algorithm, Set the parameter vector X = {ω, θ} of DAEN as the position x i k of particle i in the kth iteration. Initialize the control coefficients α 1 , α 2 in the CAPSO, the total number N of particle groups, the maximum number of iterations, and the initial value of the convergence angle γ min .
Step 3: The weights between the hidden layer and the output layer in the DAEN are mapped into particle groups in the CAPSO, the position and velocity of the particle group are initialized. Then, the initialized samples are input into the DAEN for adaptive training learning. According to the mode, the fitness function in the middle, constantly updating the fitness value f of the particle iteration position.
Step 4: The particle individual optimal solution and the global optimal solution are updated to determine whether the end condition of the loop is satisfied. If the current number of iterations is the maximum number of iterations or the current error is the minimum error. The optimal network connection weight, is output. If the condition is not met, re-update the position and speed of the particle and execute Step3.
The intelligent fault diagnosis model of rolling bearing based on CAPSO-DAEN is divided into the following steps, as shown in
Step 1: This model uses the original vibration time domain signal of the bearing as input data.
Step 2: The input data of the model is preprocessed. The vibration time domain
signal is obtained by normalizing the original vibration time domain data. If the vibration time domain signal has a data length of m, then there is
x ^ i = x i − x min x max − x min (6)
where x i is the ith data point of the bearing vibration time domain signal x 1 , x min is the minimum data point of the bearing vibration time domain signal x 1 , x min is the maximum data point of the bearing vibration time domain signal x 1 , x ^ i is the ith data point of the vibration time domain signal x 2 , i = 1, 2, 3, ..., m.
Step 3: The samples are divided into training samples and test samples. They are used to train and test CAPSO-DAEN respectively. Among them, the test samples are used to evaluate the effectiveness of CAPSO-DAEN extraction features, and test the accuracy of the model's fault diagnosis.
Step4: Aiming at the fault types of rolling bearings, the fault states of rolling bearings are coded. In the training sample stage. The CAPSO-DAEN training algorithm in
Step5: Sample testing stage. The CAPSO-DAEN trained in step 5 is used in the test work. The test samples are input into the trained CAPSO-DAEN to output the characteristics, and then the characteristics are input to the Softmax classifier. Lastly output the probability value of 7 faults. The state of the maximum probability value is the final fault diagnosis result, and then the classification results are judged. And evaluation of the accuracy of the model.
Sample model of data should endeavor to include all bearing fault characteristics. Vibration signal contains complicated bearing information, thus time domain data of vibration signal are the inputs of network. The experimental data is based on the rolling bearing fault vibration data released by the Case Data Center of Case Western Reserve University. The CAPSO-DAEN method is used to learn the time domain signal of the rolling bearing vibration. In experiment, different degrees of single point damage were produced in the bearing outer ring, rolling body and inner ring by EDM technology.
In the experiment, the acceleration is used to collect the vibration signal, and the sensor is placed on the motor housing by using a magnetic base. The acceleration sensors are respectively placed at the drive end of the motor housing at 12 o'clock. The vibration signal was acquired by a 16-channel DAT recorder. The simulated experimental environment was MATLAB R2016a. The sampling frequency of the digital signal is 12,000 Hz, and the drive end bearing fault data is simultaneously collected at a sampling rate of 48,000 Hz.
In order to test the validity and accuracy of the algorithm, the sample set is divided into training samples and test samples, and 150 sample sets are randomly selected to test the CAPSO-DAEN algorithm, and the remaining sample set is used to train the CAPSO-DAEN algorithm.
The fault diagnosis method of rolling bearing based on CAPSO-DAEN is to solve the problem of multiple classification of faults. It is necessary to diagnose 7 kinds of fault problems of rolling bearings. The diagnosis results can be divided into 7 types, which are normal, outer ring one level fault, outer ring two level fault, rolling body one level fault, rolling body two level fault, inner ring one level fault and inner ring two level fault. As shown in
1) Research on fault diagnosis results of different AE layers
The average accuracy of fault diagnosis was tested when the number of AE layers was 0 - 15. The results are shown in
In order to further verify the extraction capability of the improved depth self coded network, two important components of the fourth layer features of the CAPSO-DAEN algorithm and the DAEN algorithm are analyzed, as shown in
2) Research on fault diagnosis results under different methods.
The fault diagnosis situation of training set is 300, 500, 700, 900, respectively. The results of CAPSO-DAEN and DAEN are shown in
states of rolling bearing | coding |
---|---|
normal | (0,0,0,0,0,0,1) |
outer ring one level fault | (0,0,0,0,0,1,0) |
outer ring two level fault | (0,0,0,0,1,0,0) |
rolling body one level fault | (0,0,0,1,0,0,0) |
rolling body two level fault | (0,0,1,0,0,0,0) |
inner ring one level fault | (0,1,0,0,0,0,0) |
inner ring two level fault | (1,0,0,0,0,0,0) |
Serial number | training set | Test set | CAPSO-DAEN average diagnostic accuracy/% | DAEN average diagnostic accuracy/% |
---|---|---|---|---|
1 | 300 | 150 | 93.26 | 81.31 |
2 | 500 | 150 | 94.47 | 83.76 |
3 | 700 | 150 | 95.78 | 85.81 |
4 | 900 | 150 | 96.01 | 87.23 |
a few training samples, the more training samples, the better the diagnostic performance. Because more samples contain enough fault feature information, it can depict potential information between data, which is more conducive to extract fault characteristics. With the increasing number of training samples, the average accuracy of the two methods of CAPSO-DAEN and DAEN is also increasing. However, the average diagnostic accuracy of DAEN is significantly lower than that of CAPSO-DAEN, and the diagnostic accuracy of CAPSO-DAEN is higher. When the training set reaches 900, the average diagnostic accuracy of CAPSO-DAEN is 96.01%, and the effect is better. Therefore, determining the number of training samples plays a key role in improving the accuracy of fault diagnosis.
In order to further verify the effectiveness of the CAPSO-DAEN algorithm, we compare it with traditional algorithms such as SVM and BP. The initial values of these parameters are determined through extensive experiments. SVM uses the most widely used radial basis kernel (RBF), in which the two most important parameters are the penalty factor and the radius of the kernel function, which are set to 20 and 0.082 respectively. The initial learning rate of BP algorithm is 0.1, and the maximum training iteration number is 500. The above 2 methods use the same vibration signal for training and testing, and the accuracy of the fault diagnosis is shown in
From
When the training sample set is 350, the four methods of CAPSO-DAEN, DAEN, BP and SVM are tested, respectively, of which the number of AE layers in the CAPSO-DAEN method and the DAEN method is 4, and the statistical diagnosis results are shown in
training set | Test set | The BP method diagnoses the average correct rate/% | The SVM method diagnoses the average correct rate/% |
---|---|---|---|
100 | 150 | 55.89 | 57.70 |
150 | 150 | 60.51 | 62.11 |
200 | 150 | 73.73 | 71.25 |
250 | 150 | 78.14 | 79.32 |
Method | Average diagnostic accuracy/% | Standard deviation/% |
---|---|---|
CAPSO-DAEN | 94.46 | 0.79 |
DAEN | 83.75 | 2.70 |
BP | 78.83 | 3.94 |
SVM | 79.94 | 2.15 |
than the accuracy of the other 3 methods. In the standard deviation, the standard deviation of the CAPSO-DAEN method was significantly lower than the other two methods, 0.79%, and the standard deviation of DAEN, BP and SVM were 2.70%, 3.94%, 2.15% respectively. Therefore, the CAPSO-DAEN method has a higher diagnostic accuracy than the DAEN method and the traditional BP and SVM methods, and the stability of the fault diagnosis is higher.
In this paper, an improved deep autoencoder network method is proposed for rotating machinery fault diagnosis. Firstly, the utility model can learn the vibration time domain signal of the rolling bearing directly, which can extract the fault feature automatically and effectively. Therefore, it overcome the problems existing in the traditional method in extracting the fault feature and does not need to manually extract the feature, thereby improving the effectiveness of the fault diagnosis. Secondly, the improved deep autoencoder network algorithm optimizes the connection weight by using the randomness and stability of the CAPSO algorithm search, reduces the constraint on the weight, and improves the learning efficiency of the algorithm.
The proposed method is applied to the fault diagnosis of rolling bearing. The results confirm that the proposed method has higher diagnostic accuracy and more stable diagnosis results than other methods. Besides, the proposed deep autoencoder network method has better classification performance than deep autoencoder network method.
The authors declare no conflicts of interest regarding the publication of this paper.
Di, J. and Wang, L.L. (2018) Application of Improved Deep Auto-Encoder Network in Rolling Bearing Fault Diagnosis. Journal of Computer and Communications, 6, 41-53. https://doi.org/10.4236/jcc.2018.67005