Hybrid Bat and Levenberg-Marquardt algorithms for artificial neural networks learning

Nazri Mohd Nawi, Muhammad Zubair Rehman, Abdullah Khan, Arslan Kiyani, Haruna Chiroma, Tutut Herawan

Research output: Contribution to journalArticle

Abstract

The Levenberg-Marquardt (LM) gradient descent algorithm is used extensively for the training of Artificial Neural Networks (ANN) in the literature, despite its limitations, such as susceptibility to the local minima that undermine its robustness. In this paper, a bio-inspired algorithm referring to the Bat algorithm was proposed for training the ANN, to deviate from the limitations of the LM. The proposed Bat algorithm-based LM (BALM) was simulated on 10 benchmark datasets. For evaluation of the proposed BALM, comparative simulation experiments were conducted. The experimental results indicated that the BALM was found to deviate from the limitations of the LM to advance the accuracy and convergence speed of the ANN. Also, the BALM performs better than the back-propagation algorithm, artificial bee colony trained back-propagation ANN, and artificial bee colony trained LM ANN. The results of this research provide an alternative ANN training algorithm that can be used by researchers and industries to solve complex real-world problems across numerous domains of applications.

Original languageEnglish
Pages (from-to)1301-1324
Number of pages24
JournalJournal of Information Science and Engineering
Volume32
Issue number5
Publication statusPublished - 1 Sep 2016
Externally publishedYes

Keywords

  • Artificial neural networks
  • Bat algorithm
  • Levenberg-Marquardt algorithm
  • Optimization
  • Swarm intelligence

Fingerprint Dive into the research topics of 'Hybrid Bat and Levenberg-Marquardt algorithms for artificial neural networks learning'. Together they form a unique fingerprint.

Cite this