Predicting and understanding human action decisions during skillful joint-action using supervised machine learning and explainable-AI

Fabrizia Auletta, Rachel W. Kallen, Mario di Bernardo*, Michael J. Richardson*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

1 Citation (Scopus)
24 Downloads (Pure)

Abstract

This study investigated the utility of supervised machine learning (SML) and explainable artificial intelligence (AI) techniques for modeling and understanding human decision-making during multiagent task performance. Long short-term memory (LSTM) networks were trained to predict the target selection decisions of expert and novice players completing a multiagent herding task. The results revealed that the trained LSTM models could not only accurately predict the target selection decisions of expert and novice players but that these predictions could be made at timescales that preceded a player’s conscious intent. Importantly, the models were also expertise specific, in that models trained to predict the target selection decisions of experts could not accurately predict the target selection decisions of novices (and vice versa). To understand what differentiated expert and novice target selection decisions, we employed the explainable-AI technique, SHapley Additive explanation (SHAP), to identify what informational features (variables) most influenced modelpredictions. The SHAP analysis revealed that experts were more reliant on information about target direction of heading and the location of coherders (i.e., other players) compared to novices. The implications and assumptions underlying the use of SML and explainable-AI techniques for investigating and understanding human decision-making are discussed.

Original languageEnglish
Article number4992
Pages (from-to)1-14
Number of pages14
JournalScientific Reports
Volume13
Issue number1
DOIs
Publication statusPublished - 27 Mar 2023

Bibliographical note

Copyright the Author(s) 2023. Version archived for private and non-commercial use with the permission of the author/s and according to publisher conditions. For further rights please contact the publisher.

Keywords

  • ecological dynamics
  • speech recognition
  • explanations
  • perception
  • model

Fingerprint

Dive into the research topics of 'Predicting and understanding human action decisions during skillful joint-action using supervised machine learning and explainable-AI'. Together they form a unique fingerprint.

Cite this