Application of deep learning models for image denoising
Keywords:
noise removal, neural networks, autoencoder, U-Net modelAbstract
This paper addresses the issue of image denoising using neural networks. Experimental results of training and testing neural network models on images with artificially added noise are presented. In today's digital world, image quality plays an important role in various fields, including medicine, science, entertainment, and communication. Noise caused by imperfect equipment, problems in transmission channels, or random physical factors significantly reduces the efficiency of image processing and perception. To train and test neural network models, a suitable set of images is required. In this study, we created training, validation, and test sets containing original images and images with added noise. Three sets of images from the www.kaggle.com were used to form them. The first set contained butterfly images, the second set comprised athlete images, and the last set included human face images. The training set was formed as follows. 1000 images were randomly selected from each of the three sets and scaled to a size of 128x128. From these, 30 images were randomly selected and subjected to 10 levels of noise addition, resulting in 300 images for each of the 6 noise levels. In total, the training set contained 1800 images. The validation sample was formed in a similar way, but was half the size. The test set consisted of 100 original images with three noise levels added. The following types of noise were used: Gaussian, Poisson, salt and pepper, Laplace, mixed, and quantization. Three models were trained for image denoising: two convolutional auto-encoder models (with 3 and 6 convolutional layers in the encoder and decoder, respectively) and a modified U-Net model in which the output layer and loss function were adjusted. The performance of the trained models was compared with each other and with classical filters on test images. The experimental results show that the U-Net outperforms autoencoders in noise removal from images. In comparison to classical filters, the U-Net model reveals competitive outcomes. It shows better quality in the case of Gaussian, Laplace, and quantization noise, especially in the context of preserving structural information (higher SSIM).
Downloads
References
Gonzalez, R., & Woods, R. (2017). Digital Image Processing. https://dl.icdst.org/pdfs/files4/01c56e081202b62bd7d3b4f8545775fb.pdf
Szeliski, R. (2022). Computer Vision: Algorithms and Applications (2nd ed). Springer. https://szeliski.org/Book
Elad, M., Kawar, B., & Vaksman, G. (2023). Image Denoising: The Deep Learning Revolution and Beyond – A Survey Paper. SIAM Journal on Imaging Sciences. 16(3). 1594-1654. https://doi.org/10.1137/23M1545859
Chintan, D. (2021, January 23). Image Denoising Using Deep Learning. Medium. https://pub.towardsai.net/image-de-noising-using-deep-learning-1a8334c81f06
Solomon, S. (2021, August 27). Image Denoising using Deep Learning. Medium. https://medium.com/analytics-vidhya/image-denoising-using-deep-learning-dc2b19a3fd54
Butterfly Image Classification. (n.d.). Kaggle. https://www.kaggle.com/datasets/phucthaiv02/butterfly-image-classification
100 Sports Image Classification. (n.d.). Kaggle. https://www.kaggle.com/datasets/gpiosenka/sports-classification/data
UTKFace. (n.d.). Kaggle: https://www.kaggle.com/datasets/jangedoo/utkface-new
Shrivastava, A., Bisen, P., Dubey, M., & Choudhari, M. (2015).
Image Denoising Using Different Filters (A Comparison of Filters). International Journal of Emerging Trends in Science and Technology. 2(4). 2214-2219. https://journals.indexcopernicus.com/api/file/viewByFileId/174827.pdf
Kuo, C. (2019, November 20). Convolutional Autoencoders for Image Noise Reduction. Medium. https://towardsdatascience.com/convolutional-autoencoders-for-image-noise-reduction-32fce9fc1763
Paavani, D. (2019). Image Denoising Using a U-net. https://stanford.edu/class/ee367/Winter2019/dua_report.pdf
Downloads
Published
Issue
Section
License
Copyright (c) 2024 Максим Гавриленко, Ольга Мацуга (Автор)
![Creative Commons License](http://i.creativecommons.org/l/by/4.0/88x31.png)
This work is licensed under a Creative Commons Attribution 4.0 International License.
All articles published in the journal Challenges and Issues of Modern Science are licensed under the Creative Commons Attribution 4.0 International (CC BY) license. This means that you are free to:
- Share, copy, and redistribute the article in any medium or format
- Adapt, remix, transform, and build upon the article
as long as you provide appropriate credit to the original work, include the authors' names, article title, journal name, and indicate that the work is licensed under CC BY. Any use of the material should not imply endorsement by the authors or the journal.