The IRMA Community
Newsletters
Research IRM
Click a keyword to search titles using our InfoSci-OnDemand powered search:
|
Swarm-Based Nature-Inspired Metaheuristics for Neural Network Optimization
|
|
Author(s): Swathi Jamjala Narayanan (VIT University, India), Boominathan Perumal (VIT University, India)and Jayant G. Rohra (VIT University, India)
Copyright: 2018
Pages: 31
Source title:
Handbook of Research on Modeling, Analysis, and Application of Nature-Inspired Metaheuristic Algorithms
Source Author(s)/Editor(s): Sujata Dash (North Orissa University, India), B.K. Tripathy (VIT University, India)and Atta ur Rahman (University of Dammam, Saudi Arabia)
DOI: 10.4018/978-1-5225-2857-9.ch002
Purchase
|
Abstract
Nature-inspired algorithms have been productively applied to train neural network architectures. There exist other mechanisms like gradient descent, second order methods, Levenberg-Marquardt methods etc. to optimize the parameters of neural networks. Compared to gradient-based methods, nature-inspired algorithms are found to be less sensitive towards the initial weights set and also it is less likely to become trapped in local optima. Despite these benefits, some nature-inspired algorithms also suffer from stagnation when applied to neural networks. The other challenge when applying nature inspired techniques for neural networks would be in handling large dimensional and correlated weight space. Hence, there arises a need for scalable nature inspired algorithms for high dimensional neural network optimization. In this chapter, the characteristics of nature inspired techniques towards optimizing neural network architectures along with its applicability, advantages and limitations/challenges are studied.
Related Content
|
P. Chitra, A. Saleem Raja, V. Sivakumar.
© 2024.
24 pages.
|
|
K. Ezhilarasan, K. Somasundaram, T. Kalaiselvi, Praveenkumar Somasundaram, S. Karthigai Selvi, A. Jeevarekha.
© 2024.
36 pages.
|
|
Kande Archana, V. Kamakshi Prasad, M. Ashok.
© 2024.
17 pages.
|
|
Ritesh Kumar Jain, Kamal Kant Hiran.
© 2024.
23 pages.
|
|
U. Vignesh, R. Elakya.
© 2024.
13 pages.
|
|
S. Karthigai Selvi, R. Siva Shankar, K. Ezhilarasan.
© 2024.
16 pages.
|
|
Vemasani Varshini, Maheswari Raja, Sharath Kumar Jagannathan.
© 2024.
20 pages.
|
|
|