We propose the Forward-Backward Synergistic Acceleration Pursuit (FBSAP) algorithm in this paper. The FBSAP algorithm inherits the advantages of the Forward-Backward Pursuit (FBP) algorithm, which has high success rate of reconstruction and does not necessitate the sparsity level as a priori condition. Moreover, it solves the problem of FBP that the atom can be selected only by the fixed step size. By mining the correlation between candidate atoms and residuals, we innovatively propose the forward acceleration strategy to adjust the forward step size adaptively and reduce the computation. Meanwhile, we accelerate the algorithm further in backward step by fusing the strategy proposed in Acceleration Forward-Backward Pursuit (AFBP) algorithm. The experimental simulation results demonstrate that FBSAP can greatly reduce the running time of the algorithm while guaranteeing the success rate in contrast to FBP and AFBP.
The theory of Compressed Sensing (CS) [
The major research direction of CS includes signal sparse transformation, design of measurement matrix and signal reconstruction algorithm. The reconstruction algorithms are divided into three categories: greedy algorithms, relaxation algorithms and hybrid algorithms. Greedy algorithms are built upon a series of locally optimal single-term updates, including Matching Pursuit (MP) [
FBP is a novel two-stage greedy approach proposed by N. B. Karahanoglu and H. N. Erdogan in reference [
The remainder of the paper is organized as follows. Section 2 briefs the theory of CS and the FBP algorithm. Section 3 introduces the acceleration strategy we used and the specific process of FBSAP. Section 4 presents the simulation results. Finally, conclusion is present in Section 5.
Compressed Sensing aims at restructuring the signal by excavating its sparse feature when the information is sampled in very low sampling rate. The sampling process is represented by
y = Φ x (1)
where x is a K-sparse one-dimensional signal of length N, K is the number of nonzero elements in x . Φ is a M × N two-dimensional observation matrix with K < M < N . y is a one-dimensional measurement vector of length M. The purpose of CS is to obtain the signal x by using the measurement vector y and the observation matrix Φ .
Without the sparsity K to be known a priori, FBP can reconstruct the sparse signal exactly by selecting atoms with fixed forward and backward step size in contrast to other reconstruction algorithms. The pseudo code of the FBP is given in Algorithm 1. It expands the estimated support set by selecting α atoms with highest correlation in the forward step and reduces the size of the estimated support set by eliminating β atoms with smallest contributions to the projection.
The FBP algorithm can be accelerated by two ways: reducing α and enlarging α − β . The strategy mentioned in [
It is not every atom selected in the forward step correct. The wrong atoms are more if the signal is very sparse or after many iterations. A fixed number of atoms are selected in every forward step that increases the computation. We observed the correlation levels of the observation matrix and residuals at first. The results are shown in
present ladder-form. Some atoms have the same correlation level such as atoms 2-5, and there is a big ladder between them and the other atoms. The ladder is especially obvious after some iterations. The correlation level of atom 1 is significantly higher than the others. With the above analysis, it is completely unnecessary selecting α atoms in every iteration. Only need to find the last obvious ladder and choose the atoms before it. We can reduce α by this way and accelerate the algorithm.
We adopt the backward acceleration strategy proposed by [
The details of FBSAP are shown in Algorithm 2. First, Calculate the correlation levels between atoms and residuals and represent them as set m , meanwhile, calculate the corresponding weights of atoms and save them to set w . Then, Calculate the differences between adjacent elements in w and represent as set g . In order to ensure the simplicity and effectiveness of the algorithm, we think there is a ladder between m i and m i + 1 if an element g i in g is greater than threshold γ . If we cannot find any ladder or the index of the last ladder is greater than α , set the forward step size f as fixed step size α . Otherwise, set f as the index of the last ladder. Next, select f atoms into support set and set the backward step size b as f − 1 . In the backward step, we eliminate b atoms from support set which have the smallest projection coefficients. Then reset the atom whose cumulative weight is greater than η into support set.
The reconstruction quality should not be reduced while improve the speed of the algorithm. So the FBSAP is compared with FBP and AFBP in three aspects, exact reconstruction rate, average normalized mean squared error (ANMSE) and running time. The signals we used are Gauss sparse signal and uniform sparse signal. The nonzero entries of Gaussian sparse signals are drawn from the standard Gaussian distribution. Nonzero elements of the uniform sparse signals are distributed uniformly in [ − 1 , 1 ] . A different observation matrix is drawn from the Gaussian distribution with mean 0 and standard deviation 1 / N for each test signal. The simulation system information is as follows. Matlab Version: 2016a, Operating System: Windows 10(64-bit), CPU: Intel(R) Core(TM) i7-6700HQ CPU@2.60 GHz, Memory: 8 GB.
The length of signal is N = 512 . The length of measurement vector is M = 200. The sparsity K is between 10 and 90. We repeat 1000 experiments and use different sparse signal and measurement matrix for each sparsity K . The exact reconstruction rate is the ratio of accurate reconstruction times and total experiment times. The condition of accurate reconstruction is ‖ x − x ^ ‖ 2 ≤ 10 − 2 ‖ x ‖ 2 , where x ^ is the reconstruction vector of x . The ANMSE is represented as
A N M S E = 1 1000 ∑ i = 1 1000 ‖ x i − x ^ i ‖ 2 2 ‖ x i ‖ 2 2 (2)
The running time is represented as the total time of 1000 experiments. We set maximum support set size K max = M / 2 and termination parameter ε = 1 0 − 6 .
It is pointed out in [
running time is obviously shorter than FBP and AFBP. While the signal is very sparse, the running time of AFBP is almost same as FBP. It is mentioned in [
FBSAP is accelerated by shorten forward step size. Therefore, it performs better while the size of signal is large. In order to describe the acceleration effect better, we define acceleration rate as
A r = ∑ i = 1 1000 T a i ∑ i = 1 1000 T o i (3)
where T a i is the ith running time of acceleration algorithm, T o i is the ith running time of original algorithm. The acceleration rate is lower, the acceleration effect is better.
result for uniform sparse signals. The figures show that the acceleration effect of FBSAP is better than AFBP for all signal sizes and sparsity levels. The acceleration effect is particularly evident when the size of signal is large and the sparsity level is low. For example, while N = 768 and K = 30 , the AFPB costs 80 percent of FBP’s running time, But FBSAP only costs 40 percent. With the decrease of sparsity, AFBP gradually loses the acceleration effect, but the effect of FBSAP become more obvious.
The reconstruction effect is influenced by γ . The selection of γ depends on the height of correlation ladder. If the value of γ is too large, we will not find the accurate ladders, lose many correct atoms, and reduce the success rate of reconstruction. If it is very large, we even cannot find any ladder and completely lose the acceleration effect. If it is too small, we will find many no obvious ladders, so that select too many atoms into support set, reduce the algorithm’s speed. Therefore, it is very important to select the appropriate γ .
We propose the Forward-Backward Synergistic Acceleration Pursuit algorithm in this paper. FBSAP is based on FBP and fuses the backward acceleration strategy proposed in AFBP. We adequately explore the correlation between candidate atoms and residuals and innovatively propose forward acceleration strategy. By adaptively adjusting the forward step size, FBSAP solves the problem that FBP can only select a fixed number of atoms in each iteration. We greatly reduce the calculation cost by reducing the number of atoms in forward step and only consume about half the time of FBP while ensuring the accuracy of reconstruction.
This work was supported by Tianjin Key Laboratory of Optoelectronic Sensor and Sensing Network Technology.
Zheng, B.W., Sun, G.L., Geng, T.Y. and Zhao, W.J. (2017) Forward-Backward Synergistic Acceleration Pursuit Algorithm Based on Compressed Sensing. Journal of Computer and Communications, 5, 26-35. https://doi.org/10.4236/jcc.2017.510004