Machine Learning With a Snapshot of Data: Spiking Neural Network ‘Predicts’ Reinforcement Histories of Pigeons' Choice Behavior
Loading...
Files
Size: 1.18 MB, File format: Adobe PDF
Date
Authors
Plessas, Anna
Espinosa‐Ramos, Josafath I
Parry, Dave
Cowie, Sarah
Landon, Jason
Supervisor
Item type
Degree name
Journal Title
Journal ISSN
Volume Title
Publisher
Wiley
Abstract
An accumulated body of choice research has demonstrated that choice behavior can be understood within the context of its history of reinforcement by measuring response patterns. Traditionally, work on predicting choice behaviors has been based on the relationship between the history of reinforcement—the reinforcer arrangement used in training conditions—and choice behavior. We suggest an alternative method that treats the reinforcement history as unknown and focuses only on operant choices to accurately predict (more precisely, retrodict) reinforcement histories. We trained machine learning models known as artificial spiking neural networks (SNNs) on previously published pigeon datasets to detect patterns in choices with specific reinforcement histories—seven arranged concurrent variable-interval schedules in effect for nine reinforcers. Notably, SNN extracted information from a small ‘window’ of observational data to predict reinforcer arrangements. The models' generalization ability was then tested with new choices of the same pigeons to predict the type of schedule used in training. We examined whether the amount of the data provided affected the prediction accuracy and our results demonstrated that choices made by the pigeons immediately after the delivery of reinforcers provided sufficient information for the model to determine the reinforcement history. These results support the idea that SNNs can process small sets of behavioral data for pattern detection, when the reinforcement history is unknown. This novel approach can influence our decisions to determine appropriate interventions; it can be a valuable addition to our toolbox, for both therapy design and research.
Description
Keywords
artificial intelligence, choice research, machine learning prediction, reinforcement history, spiking neural networks, 5202 Biological Psychology, 5204 Cognitive and Computational Psychology, 52 Psychology, 5201 Applied and Developmental Psychology, Machine Learning and Artificial Intelligence, Behavioral and Social Science, 1701 Psychology, 1702 Cognitive Sciences, Behavioral Science & Comparative Psychology
Source
Journal of the Experimental Analysis of Behavior, ISSN: 0022-5002 (Print); 1938-3711 (Online), Wiley, 117(3), 301-319. doi: 10.1002/jeab.759
DOI
Publisher's version
Rights statement
© 2022 The Authors. Journal of the Experimental Analysis of Behavior published by Wiley Periodicals LLC on behalf of Society for the Experimental Analysis of Behavior. Open access.
Permanent link
Collections
Endorsement
Review
Supplemented By
Referenced By
Creative Commons license
Except where otherwise noted, this item's license is described as Attribution-NonCommercial-NoDerivatives 4.0 International