Grid Search Optimization of Novel SNN-ESN Classifier on a Supercomputer Platform

Date
2024-05-24
Authors
Penkov, Dimitar
Koprinkova-Hristova, Petia
Kasabov, Nikola
Nedelcheva, Simona
Ivanovska, Sofiya
Yordanov, Svetlozar
Supervisor
Item type
Conference Contribution
Degree name
Journal Title
Journal ISSN
Volume Title
Publisher
Springer Nature Switzerland
Abstract

This work is demonstrating the use of a supercomputer platform to optimise hyper-parameters of a proposed by the team novel SNN-ESN computational model, that combines a brain template of spiking neurons in a spiking neural network (SNN) for feature extraction and an Echo State Network (ESN) for dynamic data series classification. A case study problem and data are used to illustrate the functionalities of the SNN-ESN. The overall SNN-ESN classifier has several hyper-parameters that are subject to refinement, such as: spiking threshold, duration of the refractory period and STDP learning rate for the SNN part; reservoir size, spectral radius of the connectivity matrix and leaking rate for the ESN part. In order to find the optimal hyper-parameter values exhaustive search over all possible combinations within reasonable intervals was performed using supercomputer Avitohol. The resulted optimal parameters led to improved classification accuracy. This work demonstrates the importance of model parameter optimisation using a supercomputer platform, which improves the usability of the proposed SNN-ESN for real-time applications on complex spatio-temporal data.

Description
Keywords
46 Information and Computing Sciences , 4611 Machine Learning , Neurosciences , Artificial Intelligence & Image Processing , 46 Information and computing sciences
Source
Rights statement
Open Access This chapter is licensed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.