In order to resolve the problem of the image degradation, an image enhancement method based on fractional calculus and Retinex is proposed, which can preserve or enhance texture information and remove the noise of images. The fractional differential is used to preprocess the input image to enhance texture information, and using guided filter to estimate the illumination component, so it has less halo phenomena. The reflection component, obtained according to the Retinex theory, is denoised by fractional integral to remove the noises. The image is equalized by the contrast limited adaptive histogram equalization to improve the image contrast, and a final enhanced image is obtained. The experimental results show that the method can effectively achieve image enhancement, and the enhanced image has better visual effects.
With the acceleration of the digitalization process, digital images have gradually been applied to many fields, such as medical, transportation, monitoring and detection, et al. However, due to environmental and equipment conditions, the captured image will be degraded and distorted, and image enhancement can improve image quality and enrich image information, which is beneficial to further image processing. There are many methods for image enhancement, such as histogram equalization, Retinex, wavelet transform, dark channel prior, and so on.
Image enhancement methods based on Retinex theory are more common. The key is how to estimate the illumination component. Gaussian filtering is usually used to estimate the illumination component. Retinex-based image enhancement methods include single-scale Retinex (SSR) [
The paper proposes an image enhancement method based on fractional calculus and Retinex. The method firstly uses the fractional differential to preprocess the image, and then based on the single-scale Retinex algorithm, uses the guided filter [
Fractional calculus is generalization of classical calculus, the order of fractional calculus can be an arbitrary order. According to the application of fractional calculus in digital images, fractional differential has the ability to detect blurred boundary and weak texture of images, and fractional integration can denoise the image [
For an arbitrary square integrable energy signal f ( t ) ∈ L 2 ( R ) , the v-order fractional derivative is D t v f ( t ) , v ∈ R + , and its Fourier transform:
D t v f ( t ) ⇔ ( D ^ f ) v ( w ) = ( i w ) v f ^ ( w ) = d ^ v ( w ) ⋅ f ^ ( w ) (1)
In the formula (1), d ^ v ( w ) is called v-order differential multiplier function, and its exponential form:
{ d ^ v ( w ) = ( i w ) v = a ^ v ( w ) e i θ ^ v ( w ) a ^ v ( w ) = | w | v , θ ^ v ( w ) = v π 2 sgn ( w ) , v ∈ Z + (2)
Thereby, the amplitude-frequency characteristic curve of the fractional calculus shown in
The Retinex theory, proposed by Edwin H. Land [
log I = log L + log R , and log L = log I − log R ,
then the enhanced image can be obtained by inverse logarithm transform.
Using fractional calculus to process images, one of the key is the design of fractional calculus mask operator. Commonly, the size of fractional differential mask is (2n + 1) × (2n + 1), n is a positive integer, and Tiansi operator [
d v f ( t ) d t v ≈ f ( t ) + ( − v ) f ( t − 1 ) + ( − v ) ( − v + 1 ) 2 f ( t − 2 ) + ⋯ + Γ ( − v + 1 ) n ! Γ ( − v + n + 1 ) f ( t − n ) (3)
so, a 0 = 1 , a 1 = − v , a 2 = ( − v ) ( − v + 1 ) 2 . Tiansi operator has anti-rotation capability and fractional calculus have 8 directions of negative and positive x-coordinate,
negative and positive y-coordinate, left and right upward diagonal, left and right downward diagonal. When using Tiansi operator to improve an image, there will have white lines on the image edges. In order to eliminate the white edge, a fractional calculus mask operator is redesigned. According to the Laplacian operator, the fractional differential is introduced and extended to a 5 × 5 fractional differential mask operator, which structure is shown in
The processing steps of the proposed algorithm are as follows:
1) The original image is preprocessed by the fractional differential, which can enhance the edge of the image and also can enhance the weak texture nonlinearly.
2) Estimate illumination component of the image according to the guided filter.
3) According to the single-scale Retinex algorithm, the preprocessed image is divided by the illumination component to obtain the reflection component.
4) Denoise the image by a fractional integral on the reflected component.
5) Improve the contrast by contrast-limited adaptive histogram equalization and get the final enhanced image.
In order to verify the effectiveness of the proposed algorithm, Histogram equalization (HE), fractional differential (FD), single-scale Retinex algorithm (SSR), multi-scale Retinex algorithm (MSR), fractional differential combined with single-scale Retinex algorithm (FDSSR) and the proposed algorithms are used to enhance images. The experiment environment is as follows: the operating system is Windows 7, the simulation software is MATLAB R2014b, the processor is Intel (R) Core (TM) i5-6500, and the memory is 4 GB.
In the experiment, FD and FDSSR adopt Tiansi operator, and the order of fractional differential is 0.5. The order of fractional calculus in the proposed algorithm is 0.2 and −0.2, respectively.
According to the visual effect of images of each group in
In order to evaluate the effect of enhanced images objectively, the average gradient, the information entropy, the gray mean and the standard deviation are used to make a comprehensive evaluation. Assuming the size of the image is M × N .
1) Average gradient: The average gradient of the image reflects the sharpness and texture change of an image. Generally, the larger the average gradient is, the clearer the image details has. A high average gradient also means the better edge preservation effect of an image, but the increase of noise will increase the average gradient. The average gradient is defined as
A G = 1 M × N ∑ i = 1 M ∑ j = 1 N ( ( ∂ f ∂ x ) 2 + ( ∂ f ∂ y ) 2 ) / 2 (4)
where ∂ f ∂ x is the horizontal gradient, and ∂ f ∂ y is the vertical gradient.
2) Information entropy: Information entropy is an indicator to measure how much information there is in an image. The larger the information entropy is, the
more details and information can be got from the original image. The information entropy E is defined as
E = − ∑ i = 0 L − 1 p i ln ( p i ) (5)
where p i is the probability of gray value of i. Assuming the gray scale of a image is from 0 to L − 1, so i = 0, 1, ⋯ , L − 1.
3) Gray mean: The gray mean reflects the brightness of an image. In a certain range, the larger the image gray mean is, the better the visual effect of the image has. Gray mean can be expressed as
μ = 1 M × N ∑ i = 1 M ∑ j = 1 N g ( i , j ) (6)
where g (i, j) represents the pixel value of a image in the i th row and the j th column.
4) Standard deviation: the standard deviation of a image denotes the dispersion degree between the pixel value and the gray mean of the image. A high standard deviation means a high contrast and the better quality of a image. The standard deviation δ can be defined as follow:
δ = 1 M × N ∑ i = 1 M ∑ j = 1 N ( g ( i , j ) − μ ) 2 (7)
where µ is the gray mean of image.
As can be seen from Tables 1-4, each algorithm can enhance images. HE has an average gray value of nearly 128 when the image is enhanced. This is the result of pixel equalization. The standard deviation of HE is close to 75, which is the largest of all algorithms. Therefore, the enhanced image by HE has the most obvious contrast, which is consistent to the visual effect of the processed image. But the information entropy and average gradient of HE are minimal or close to the minimum, and the information entropy is even smaller than the original image, which indicates that the more details and texture information of images are lost when used the HE algorithm. The average gradient of FDSSR is the largest, which is the result of the enhancement of the fractional differential before SSR, but the information entropy, the gray mean and the standard deviation are small, and the enhanced image is dark and the contrast is small. The proposed algorithm uses fractional integral to denoise the reflection component, so the average gradient is smaller than FDSSR, but it is larger than other algorithms. Also the standard deviation of the proposed method is smaller than HE, and it is larger than other algorithms, which indicates that the image contrast enhancement is obvious. The proposed algorithm has the largest information entropy, which means that the image information is the most abundant, and the detail and texture enhancement effects are the best. The gray mean of the proposed algorithm is the largest except for the image of people. For the image of people, it is obvious that FD has a poor enhancement effect, and a large amount of fog has not been removed, which lead to a higher gray value of the image. SSR, MSR, FDSSR and the proposed algorithm have better defogging effect. The gray mean of the proposed algorithm is the largest of the four methods, which indicates that the enhanced image is brighter and the visual effect is better.
AG | IE | µ | δ | |
---|---|---|---|---|
original image | 4.0865 | 6.8138 | 123.5663 | 40.7859 |
HE | 9.2857 | 5.8695 | 127.6235 | 74.9532 |
FD | 9.9005 | 7.0547 | 124.2478 | 43.5351 |
SSR | 13.3017 | 7.5074 | 140.2352 | 47.0893 |
MSR | 10.0260 | 7.3362 | 114.4096 | 41.3657 |
FDSSR | 20.9871 | 7.3050 | 114.1159 | 40.5345 |
the proposed method | 14.8403 | 7.6541 | 148.2499 | 52.4259 |
AG | IE | µ | δ | |
---|---|---|---|---|
original image | 3.7236 | 6.5994 | 116.2724 | 29.8227 |
HE | 9.9067 | 5.9187 | 127.4481 | 74.7337 |
FD | 9.1291 | 6.9658 | 117.3178 | 34.7969 |
SSR | 10.9007 | 7.7118 | 105.3917 | 54.6149 |
MSR | 10.6647 | 7.7123 | 106.3229 | 54.1543 |
FDSSR | 15.5365 | 7.4431 | 105.3887 | 43.7380 |
the proposed method | 11.3097 | 7.7140 | 106.5820 | 54.7190 |
AG | IE | µ | δ | |
---|---|---|---|---|
original image | 5.5677 | 7.4450 | 124.0459 | 47.8318 |
HE | 8.6265 | 5.9774 | 127.4161 | 74.8292 |
FD | 11.8011 | 7.6339 | 124.6892 | 52.0603 |
SSR | 11.5319 | 7.8885 | 127.8814 | 61.3986 |
MSR | 10.8721 | 7.8662 | 122.3429 | 60.2206 |
FDSSR | 17.7646 | 7.7894 | 118.8989 | 55.6789 |
the proposed method | 12.1078 | 7.9010 | 130.5114 | 62.3295 |
AG | IE | µ | δ | |
---|---|---|---|---|
original image | 11.0425 | 7.1924 | 126.6.30 | 50.4600 |
HE | 19.6910 | 5.9509 | 127.6198 | 74.9264 |
FD | 26.9004 | 7.4893 | 128.0918 | 61.7143 |
SSR | 22.8148 | 7.8285 | 136.8867 | 62.3800 |
MSR | 21.7782 | 7.8313 | 132.5266 | 62.7695 |
FDSSR | 34.8800 | 7.8022 | 115.0143 | 57.7391 |
the proposed method | 23.7058 | 7.8398 | 137.3626 | 62.8206 |
The paper presents an image enhancement method based on fractional calculus and single-scale Retinex. The method uses fractional differential to preprocess the input image. While the image edge information is strengthened, it also can preserve the weak texture and other details of the image non-linearly. Fractional integral is used to denoise the reflection component to reduce and eliminate noise interference. Through experiments, the results show that images enhanced by the proposed method have good visual effects and significantly improve various evaluation indicators.
In future work, adaptive fractional calculus can be introduced into the algorithm to improve the adaptability of the method, but how to determine the correlation factor of the order is difficulty, and improving the versatility of the algorithm also needs further research.
This work is supported by the Fundamental Research Funds for the Central Universities (2018MS072).
The author declares no conflicts of interest regarding the publication of this paper.
Cao, J.G. (2018) An Image Enhancement Method Based on Fractional Calculus and Retinex. Journal of Computer and Communications, 6, 55-65. https://doi.org/10.4236/jcc.2018.611005