Login Register Cart 0
Recent Patents on Engineering

Recent Patents on Engineering

Editor-in-Chief

ISSN (Print): 1872-2121
ISSN (Online): 2212-4047

Back
Journal Home About Journal Editorial Board Journal Insight Current Issue Volumes/Issues
Subscribe
Research Article

Underwater Image Enhancement based on Retinex Decomposition and Unsupervised Generative Adversarial Networks

Author(s): Yong Lai, Xuebo Zhang, Zhouyan He, Yang Song, Ting Luo and Haiyong Xu*

Volume 19, Issue 7, 2025

Published on: 27 October, 2023

Article ID: e271023222797 Pages: 13

DOI: 10.2174/0118722121231723231005112802

Price: $65

Become a Editorial Board Member
Become a Reviewer
Become a Editor
Become a Section Editor

Abstract

Background: Due to the difficulty of obtaining the real dataset of paired underwater images, it is urgent to build an unsupervised underwater image enhancement network.

Objective: To address the problem, a novel underwater image enhancement based on Retinex decomposition and Unsupervised Generative Adversarial Network (RUGAN) is proposed.

Method: A color correction module is proposed considering the different color distortions of underwater images. Further, considering the human visual perception mechanism, the RUGAN network, which is similar to U-Net, is constructed using the characteristics of underwater imaging and Retinex decomposition. Based on Retinex decomposition and the characteristics of underwater imaging, the RUGAN network similar to U-Net is constructed. The reflectance image and illumination image are obtained. The reflectance image with a better effect is taken as the enhancement result. Unlike the previous supervised methods, RUGAN adopts clear air images and distorted underwater images as training. RUGAN adopts the underwater image of the color correction module as pseudo-ground truth to achieve an unsupervised effect.

Results: The superiority of RUGAN network is further supported by extensive experiments that compared it with more methods.

Conclusion: The RUGAN performs well both subjectively and objectively.

Keywords: Retinex decomposition, unsupervised, underwater image enhancement, reflectance image, illumination image, generative adversarial networks.

[1]
B. Fan, Dual refinement underwater object detection network.Computer Vision – ECCV., Springer: Cham, 2020.
[http://dx.doi.org/10.1007/978-3-030-58565-5_17]
[2]
R. Hummel, "Image enhancement by histogram transformation", Comput. Graph. Image Process., vol. 6, no. 2, pp. 184-195, 1977.
[http://dx.doi.org/10.1016/S0146-664X(77)80011-7]
[3]
S.M. Pizer, R.E. Johnston, J.P. Ericksen, B.C. Yankaskas, and K.E. Müller, "Contrast-limited adaptive histogram equalization: Speed and effectiveness", Proceedings of the First Conference on Visualization in Biomedical Computing.
, 1990 Atlanta, GA, USA [http://dx.doi.org/10.1109/VBC.1990.109340]
[4]
L. Yung-Cheng, C. Wen-Hsin, and C. Ye-Quang, "Automatic white balance for digital still camera", IEEE Trans. Consum. Electron., vol. 41, no. 3, pp. 460-466, 1995.
[http://dx.doi.org/10.1109/30.468045]
[5]
C. Ancuti, C.O. Ancuti, T. Haber, and P. Bekaert, "Enhancing underwater images and videos by fusion", 2012 IEEE Conference on Computer Vision and Pattern Recognition.
, 2012 Providence, RI, USA [http://dx.doi.org/10.1109/CVPR.2012.6247661]
[6]
C.O. Ancuti, C. Ancuti, C. De Vleeschouwer, and P. Bekaert, "Color balance and fusion for underwater image enhancement", IEEE Trans. Image Process., vol. 27, no. 1, pp. 379-393, 2018.
[http://dx.doi.org/10.1109/TIP.2017.2759252] [PMID: 28981416]
[7]
C.O. Ancuti, C. Ancuti, C. De Vleeschouwer, and M. Sbert, "Color channel compensation (3C): A fundamental pre-processing step for image enhancement", IEEE Trans. Image Process., vol. 29, pp. 2653-2665, 2020.
[http://dx.doi.org/10.1109/TIP.2019.2951304] [PMID: 31751271]
[8]
H. Kaiming, H. Jian, and T. Xiaoou, "Single image haze removal using dark channel prior", IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 12, pp. 2341-2353, 2011.
[http://dx.doi.org/10.1109/TPAMI.2010.168] [PMID: 20820075]
[9]
P. Drews, E. Nascimento, F. Moraes, S. Botelho, and M. Campos, "Transmission estimation in underwater single images", 2013 IEEE International Conference on Computer Vision Workshops.
, 2013 Sydney, NSW, Australia [http://dx.doi.org/10.1109/ICCVW.2013.113]
[10]
Y.T. Peng, and P.C. Cosman, "Underwater image restoration based on image blurriness and light absorption", IEEE Trans. Image Process., vol. 26, no. 4, pp. 1579-1594, 2017.
[http://dx.doi.org/10.1109/TIP.2017.2663846] [PMID: 28182556]
[11]
Y.T. Peng, K. Cao, and P.C. Cosman, "Generalization of the dark channel prior for single image restoration", IEEE Trans. Image Process., vol. 27, no. 6, pp. 2856-2868, 2018.
[http://dx.doi.org/10.1109/TIP.2018.2813092] [PMID: 29570087]
[12]
D. Berman, D. Levy, S. Avidan, and T. Treibitz, "Underwater single image color restoration using haze-lines and a new quantitative dataset", IEEE Trans. Pattern Anal. Mach. Intell., vol. 43, no. 8, pp. 2822-2837, 2021.
[PMID: 32142424]
[13]
J. Li, K.A. Skinner, R.M. Eustice, and M. Johnson-Roberson, "WaterGAN: Unsupervised generative network to enable real-time color correction of monocular underwater images", IEEE Robot. Autom. Lett., vol. 3, no. 1, pp. 387-394, 2018.
[14]
C. Fabbri, M.J. Islam, and J. Sattar, "Enhancing underwater imagery using generative adversarial networks", 2018 IEEE International Conference on Robotics and Automation (ICRA).
, 2018 Brisbane, QLD, Australia [http://dx.doi.org/10.1109/ICRA.2018.8460552]
[15]
J-Y. Zhu, T. Park, P. Isola, and A-A. Efros, "Unpaired image-to-image translation using cycle-consistent adversarial networks", Proc. Int. Conf. Comput. Vis., 2017pp. 2242-2251 Venice, Italy.
[http://dx.doi.org/10.1109/ICCV.2017.244]
[16]
P. Isola, J-Y. Zhu, T. Zhou, and A-A. Efros, "Image-to-image translation with conditional adversarial networks", Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2017pp. 5967-5976 Hawaii, USA.
[17]
P. Ronneberger, Fischer, and T. Brox, U-Net: Convolutional networks for biomedical image segmentation.Medical Image Computing and Computer-Assisted Intervention, Springer: New York, NY, USA, 2015, pp. 234-241.
[18]
C. Li, S. Anwar, and F. Porikli, "Underwater scene prior inspired deep underwater image and video enhancement", Pattern Recognit., vol. 98, pp. 107038-107049, 2020.
[http://dx.doi.org/10.1016/j.patcog.2019.107038]
[19]
Y. Guo, H. Li, and P. Zhuang, "Underwater image enhancement using a multiscale dense generative adversarial network", IEEE J. Oceanic Eng., vol. 45, no. 3, pp. 862-870, 2020.
[http://dx.doi.org/10.1109/JOE.2019.2911447]
[20]
H. Li, J. Li, and W. Wang, "A fusion adversarial underwater image enhancement network with a public test dataset", arXiv:1906.06819, 2019.
[21]
C. Li, C. Guo, W. Ren, R. Cong, J. Hou, S. Kwong, and D. Tao, "An underwater image enhancement benchmark dataset and beyond", IEEE Trans. Image Process., vol. 29, pp. 4376-4389, 2020.
[http://dx.doi.org/10.1109/TIP.2019.2955241] [PMID: 31796402]
[22]
L. Chongyi, H. Xu, and C. Lin, "Underwater image enhancement via medium transmission-guided multi-color space embedding", In: IEEE Transactions on Image Processing, vol. 30. 2021, pp. 4985-5000.
[23]
C. Li, J. Guo, and C. Guo, "Emerging from water: Underwater image color correction based on weakly supervised color transfer", IEEE Signal Process. Lett., vol. 25, no. 3, pp. 323-327, 2018.
[http://dx.doi.org/10.1109/LSP.2018.2792050]
[24]
Y. Zhibin, H. Ruyue, "Underwater image enhancement method for generating countermeasure network based on conditions", C.N. Patent 111833268A, 2023.
[25]
E.H. Land, and J.J. McCann, "Lightness and retinex theory", J. Opt. Soc. Am., vol. 61, no. 1, pp. 1-11, 1971.
[http://dx.doi.org/10.1364/JOSA.61.000001] [PMID: 5541571]
[26]
A. Galdran, "On the duality between retinex and image dehazing", Proc. IEEE Conf. Comput. Vis. Pattern Recognit, 2018 pp. 8212-8221.
[http://dx.doi.org/10.1109/CVPR.2018.00857]
[27]
Chen Wei, "Deep retinex decomposition for low-light enhancement", arXiv:1808.04560, 2018.
[28]
X. Mao, Q. Li, H. Xie, R-Y. Lau, Z. Wang, and S-P. Smolley, "Least squares generative adversarial networks", Int. Conf. Comput. Vis.. , 2017pp. 2794-2802 Venice, Italy
[29]
J. Deng, W. Dong, R. Socher, L-J. Li, K. Li, and L. Fei-Fei, "ImageNet: A large-scale hierarchical image database", 2009 IEEE Conference on Computer Vision and Pattern Recognition.
, 2009 Miami, FL, USA [http://dx.doi.org/10.1109/CVPR.2009.5206848]
[30]
H. Zhao, G. Orazio, F. Iuri, and K. Jan, "Loss functions for neural networks for image processing", arXiv:1511.08861, 2015.
[31]
D. Kingma, and J. Ba, "Adam: A method for stochastic optimization", 3rd International Conference for Learning Representations. , 2014 San Diego
[32]
M. Yang, and A. Sowmya, "An underwater color image quality evaluation metric", IEEE Trans. Image Process., vol. 24, no. 12, pp. 6062-6071, 2015.
[http://dx.doi.org/10.1109/TIP.2015.2491020] [PMID: 26513783]
[33]
K. Panetta, C. Gao, and S. Agaian, "Human-visual-system-inspired underwater image quality measures", IEEE J. Oceanic Eng., vol. 41, no. 3, pp. 541-551, 2016.
[http://dx.doi.org/10.1109/JOE.2015.2469915]
[34]
J. Canny, "A computational approach to edge detection", IEEE Trans. Pattern Anal. Mach. Intell., vol. PAMI-8, no. 6, pp. 679-698, 1986.
[http://dx.doi.org/10.1109/TPAMI.1986.4767851] [PMID: 21869365]
[35]
H. Peng, B. Li, H. Ling, W. Hu, W. Xiong, and S.J. Maybank, "Salient object detection via structured matrix decomposition", IEEE Trans. Pattern Anal. Mach. Intell., vol. 39, no. 4, pp. 818-832, 2017.
[http://dx.doi.org/10.1109/TPAMI.2016.2562626] [PMID: 28113696]

Rights & Permissions Print Cite
Article Metrics
Pdf icon 26
Html icon 1
Find your institution