Kasabov, N2015-01-112015-01-1120152015Knowledge-Based Systems (2015), doi: http://dx.doi.org/10.1016/j.knosys. 2014.12.0321793-6411https://hdl.handle.net/10292/8278This paper follows the 25 years of development of methods and systems for knowledge-based neural network systems and more specifically the recent evolving connectionist systems (ECOS). ECOS combine the adaptive/evolving learning ability of neural networks and the approximate reasoning and linguistically meaningful explanation features of symbolic representation, such as fuzzy rules. This review paper presents the classical now hybrid expert systems and evolving neuro-fuzzy systems, along with new developments in spiking neural networks, neurogenetic systems, and quantum inspired systems, all discussed from the point of few of their adaptability, model interpretability and knowledge discovery. The paper discusses new directions for the integration of principles from neural networks, fuzzy systems, bio- and neuroinformatics, and nature in general.Copyright © 2015 Elsevier Ltd. All rights reserved. This is the author’s version of a work that was accepted for publication in (see Citation). Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document.Knowledge-based systemsNeuro-fuzzy systemsEvolving Connectionist SystemsEvolving Spiking Neural NetworksComputational Neurogenetic SystemsQuantum inspired spiking neural networksSpatio-temporal pattern recognitionJournal ArticleOpenAccess10.1016/j.knosys.2014.12.032