Learning Parameters in Deep Belief Networks Through Firefly Algorithm

Nenhuma Miniatura disponível
Rosa, Gustavo [UNESP]
Papa, Joao [UNESP]
Costa, Kelton [UNESP]
Passos, Leandro
Pereira, Clayton
Yang, Xin-She
Schwenker, F.
Abbas, H. M.
ElGayar, N.
Trentin, E.
Título da Revista
ISSN da Revista
Título de Volume
Restricted Boltzmann Machines (RBMs) are among the most widely pursed techniques in the context of deep learning-based applications. Their usage enables sundry parallel implementations, which have become pivotal in nowadays large-scale-oriented applications. In this paper, we propose to address the main shortcoming of such models, i.e. how to properly fine-tune their parameters, by means of the Firefly Algorithm, as well as we also consider Deep Belief Networks, a stackeddriven version of the RBMs. Additionally, we also take into account Harmony Search, Improved Harmony Search and the well-known Particle Swarm Optimization for comparison purposes. The results obtained showed the Firefly Algorithm is suitable to the context addressed in this paper, since it obtained the best results in all datasets.
Deep Belief Networks, Deep learning, Firefly algorithm
Como citar
Artificial Neural Networks In Pattern Recognition. Berlin: Springer-verlag Berlin, v. 9896, p. 138-149, 2016.