A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospects

Type: Review

Publication Date: 2021-06-10

Citations: 2334

DOI: https://doi.org/10.1109/tnnls.2021.3084827

Abstract

A convolutional neural network (CNN) is one of the most significant networks in the deep learning field. Since CNN made impressive achievements in many areas, including but not limited to computer vision and natural language processing, it attracted much attention from both industry and academia in the past few years. The existing reviews mainly focus on CNN's applications in different scenarios without considering CNN from a general perspective, and some novel ideas proposed recently are not covered. In this review, we aim to provide some novel ideas and prospects in this fast-growing field. Besides, not only 2-D convolution but also 1-D and multidimensional ones are involved. First, this review introduces the history of CNN. Second, we provide an overview of various convolutions. Third, some classic and advanced CNN models are introduced; especially those key points making them reach state-of-the-art results. Fourth, through experimental analysis, we draw some conclusions and provide several rules of thumb for functions and hyperparameter selection. Fifth, the applications of 1-D, 2-D, and multidimensional convolution are covered. Finally, some open issues and promising directions for CNN are discussed as guidelines for future work.

Locations

  • IEEE Transactions on Neural Networks and Learning Systems - View
  • arXiv (Cornell University) - View - PDF
  • Griffith Research Online (Griffith University, Queensland, Australia) - View - PDF
  • PubMed - View

Similar Works

Action Title Year Authors
+ A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospects 2020 Zewen Li
Wenjie Yang
Shouheng Peng
Fan Liu
+ PDF Chat A Comprehensive Survey of Convolutions in Deep Learning: Applications, Challenges, and Future Trends 2024 Abolfazl Younesi
Mohsen Ansari
MohammadAmin Fazli
Alireza Ejlali
Muhammad Shafique
Jörg Henkel
+ An Introduction to Convolutional Neural Networks 2015 Keiron O’Shea
Ryan Nash
+ An Introduction to Convolutional Neural Networks 2015 Keiron O’Shea
Ryan Nash
+ Recent Advances in Convolutional Neural Networks 2015 Jiuxiang Gu
Zhenhua Wang
Jason Kuen
Lianyang Ma
Amir Shahroudy
Bing Shuai
Ting Liu
Xingxing Wang
Li Wang
Gang Wang
+ Deep Neural Networks - A Brief History 2017 Krzysztof J. Cios
+ Review of Deep Learning 2018 Rong Zhang
Weiping Li
Tong Mo
+ Review of Deep Learning. 2018 Rong Zhang
Weiping Li
Tong Mo
+ Recent Advances in Deep Learning: An Overview 2018 Matiur Rahman Minar
Jibon Naher
+ PDF Chat A review of deep learning with special emphasis on architectures, applications and recent trends 2020 Saptarshi Sengupta
Sanchita Basak
Pallabi Saikia
Sayak Paul
Vasilios Tsalavoutis
Frederick Ditliac Atiah
Vadlamani Ravi
Alan Peters
+ A survey of the recent architectures of deep convolutional neural networks 2020 Asifullah Khan
Anabia Sohail
Umme Zahoora
Aqsa Saeed Qureshi
+ Αυτόματη κατάτμηση της περιοχής του ιππόκαμπου από μαγνητικές τομογραφίες με χρήση convolutional neural networks (CNNs) 2017 Δημήτριος Γεωργίου Αταλόγλου
+ Deep learning—a first meta-survey of selected reviews across scientific disciplines, their commonalities, challenges and research impact 2021 Jan Egger
Antonio Pepe
Christina Gsaxner
Yuan Jin
Jianning Li
Roman Kern
+ PDF Chat A Taxonomy of Deep Convolutional Neural Nets for Computer Vision 2016 Suraj Srinivas
Ravi Kiran Sarvadevabhatla
Konda Reddy Mopuri
Nikita Prabhu
Srinivas S S Kruthiventi
R. Venkatesh Babu
+ Deep Learning -- A first Meta-Survey of selected Reviews across Scientific Disciplines, their Commonalities, Challenges and Research Impact. 2021 Jan Egger
Antonio Pepe
Christina Gsaxner
Yuan Jin
Jianning Li
Roman Kern
+ Pooling Methods in Deep Neural Networks, a Review 2020 Hossein Gholamalinezhad
Hossein Khosravi
+ PDF Chat Depthwise Multiception Convolution for Reducing Network Parameters without Sacrificing Accuracy 2020 Guoqing Bao
Manuel B. Graeber
Xiuying Wang
+ Comparison between layer-to-layer network training and conventional network training using Deep Convolutional Neural Networks 2023 B. Kiran Kumar Ashish
WonSook Lee
+ PDF Chat A Survey on Deep Learning and State-of-the-arts Applications 2024 Mohd Halim Mohd Noor
Ayokunle Olalekan Ige
+ 1D Convolutional Neural Networks and Applications: A Survey 2019 Serkan Kıranyaz
Onur Avcı
Osama Abdeljaber
Türker İnce
Moncef Gabbouj
Daniel J. Inman

Works That Cite This (155)

Action Title Year Authors
+ PDF Chat Deep-Learning Channel Estimation for IRS-Assisted Integrated Sensing and Communication System 2022 Yu Liu
Ibrahim Al-Nahhal
Octavia A. Dobre
Fanggang Wang
+ PDF Chat Physics-informed ConvNet: Learning physical field from a shallow neural network 2024 Pengpeng Shi
Zhi Zeng
Tianshou Liang
+ PDF Chat DualFormer: Local-Global Stratified Transformer for Efficient Video Recognition 2022 Yuxuan Liang
Pan Zhou
Roger Zimmermann
Shuicheng Yan
+ PDF Chat Addressing Adversarial Machine Learning Attacks in Smart Healthcare Perspectives 2022 Arawinkumaar Selvakkumar
Shantanu Pal
Zahra Jadidi
+ PDF Chat ReViT: Enhancing vision transformers feature diversity with attention residual connections 2024 Anxhelo Diko
Danilo Avola
Marco Cascio
Luigi Cinque
+ Aligned deep neural network for integrative analysis with high-dimensional input 2023 Shunqin Zhang
Sanguo Zhang
Huangdi Yi
Shuangge Ma
+ Deep convolutional neural networks for short-term multi-energy demand prediction of integrated energy systems 2024 Corneliu Arsene
Alessandra Parisio
+ PDF Chat Hardware and Software Optimizations for Accelerating Deep Neural Networks: Survey of Current Trends, Challenges, and the Road Ahead 2020 Maurizio Capra
Beatrice Bussolino
Alberto Marchisio
Guido Masera
Maurizio Martina
Muhammad Shafique
+ PDF Chat Engineering Semantic Communication: A Survey 2023 Dylan Wheeler
Balasubramaniam Natarajan
+ GENERALIZATION CAPABILITIES OF CONDITIONAL GAN FOR TURBULENT FLOW UNDER CHANGES OF GEOMETRY 2023 Claudia Drygala
Francesca di Mare
Hanno Gottschalk