Optimization of convolutional neural network using microcanonical annealing algorithm

Vina Ayumi, L. M.Rasdi Rere, Mohamad Ivan Fanany, Aniati Murni Arymurthy

Research output: Chapter in Book/Report/Conference proceedingConference contribution

11 Citations (Scopus)

Abstract

Convolutional neural network (CNN) is one of the most prominent architectures and algorithm in Deep Learning. It shows a remarkable improvement in the recognition and classification of objects. This method has also been proven to be very effective in a variety of computer vision and machine learning. As in other deep learning, however, training this approach is interesting yet challenging. Recently, some metaheuristic algorithms have been used to optimize CNN using Genetic Algorithm, Particle Swarm Optimization, Simulated Annealing and Harmony Search. In this paper, another type of metaheuristic algorithms with different strategy has been proposed, i.e. Microcanonical Annealing to optimize Convolutional Neural Network. The performance of the proposed method is tested using the MNIST and CIFAR-10 datasets. Although experiment results of MNIST dataset indicate the increase in computation time (1.02x-1.38x), nevertheless this proposed method can considerably enhance the performance of the original CNN (up to 4.60%). On the CIFAR10 dataset, currently, state of the art is 96.53% using fractional pooling, while this proposed method achieves 99.14%.

Original languageEnglish
Title of host publication2016 International Conference on Advanced Computer Science and Information Systems, ICACSIS 2016
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages506-511
Number of pages6
ISBN (Electronic)9781509046294
DOIs
Publication statusPublished - 6 Mar 2017
Event8th International Conference on Advanced Computer Science and Information Systems, ICACSIS 2016 - Malang, Indonesia
Duration: 15 Oct 201616 Oct 2016

Publication series

Name2016 International Conference on Advanced Computer Science and Information Systems, ICACSIS 2016

Conference

Conference8th International Conference on Advanced Computer Science and Information Systems, ICACSIS 2016
CountryIndonesia
CityMalang
Period15/10/1616/10/16

Keywords

  • CIFAR10
  • Convolutional Neural Network
  • MNIST
  • Metaheuristic
  • Microcanonical Annealing

Fingerprint Dive into the research topics of 'Optimization of convolutional neural network using microcanonical annealing algorithm'. Together they form a unique fingerprint.

  • Cite this

    Ayumi, V., Rere, L. M. R., Fanany, M. I., & Arymurthy, A. M. (2017). Optimization of convolutional neural network using microcanonical annealing algorithm. In 2016 International Conference on Advanced Computer Science and Information Systems, ICACSIS 2016 (pp. 506-511). [7872787] (2016 International Conference on Advanced Computer Science and Information Systems, ICACSIS 2016). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICACSIS.2016.7872787