A fundamental assumption of learning theories is that the credit assigned to predictive 40 cues is not simply determined by their probability of reinforcement, but by their ability to compete with other cues present during learning. This assumption has guided behavioral and neural science research for decades, and tremendous empirical and theoretical advances have been made identifying the mechanisms of cue competition. However, when learning conditions are not optimal (e.g., when training is massed), credit assignment is no longer competitive. This is a catastrophic failure of the learning system 46 that exposes the individual’s vulnerability to form spurious associations in the real world. Here, we uncover that cue competition can be rescued when conditions are suboptimal provided that the individual has agency over the learning experience. Our findings reveal a new connection between agency over learning and credit assignment to cues, and open new avenues of investigation into the underlying mechanisms.

Agency rescues competition for credit assignment among predictive cues from adverse learning conditions / Mihwa, Kang; REVERTE SOLER, Ingrid; Volz, Stephen G.; Keith, Kaufman; Salvatore, Fevola; Anna, Matarazzo; Alhazmi, Fahd H.; Inmaculada, Marquez; Iordanova, Mihaela D.; Esber, Guillem R.. - In: SCIENTIFIC REPORTS. - ISSN 2045-2322. - (2021). [10.1101/2021.02.24.432808]

Agency rescues competition for credit assignment among predictive cues from adverse learning conditions

Ingrid Reverte
Conceptualization
;
2021

Abstract

A fundamental assumption of learning theories is that the credit assigned to predictive 40 cues is not simply determined by their probability of reinforcement, but by their ability to compete with other cues present during learning. This assumption has guided behavioral and neural science research for decades, and tremendous empirical and theoretical advances have been made identifying the mechanisms of cue competition. However, when learning conditions are not optimal (e.g., when training is massed), credit assignment is no longer competitive. This is a catastrophic failure of the learning system 46 that exposes the individual’s vulnerability to form spurious associations in the real world. Here, we uncover that cue competition can be rescued when conditions are suboptimal provided that the individual has agency over the learning experience. Our findings reveal a new connection between agency over learning and credit assignment to cues, and open new avenues of investigation into the underlying mechanisms.
2021
agency; credit assignment; cue competition; reinforcement learning
01 Pubblicazione su rivista::01a Articolo in rivista
Agency rescues competition for credit assignment among predictive cues from adverse learning conditions / Mihwa, Kang; REVERTE SOLER, Ingrid; Volz, Stephen G.; Keith, Kaufman; Salvatore, Fevola; Anna, Matarazzo; Alhazmi, Fahd H.; Inmaculada, Marquez; Iordanova, Mihaela D.; Esber, Guillem R.. - In: SCIENTIFIC REPORTS. - ISSN 2045-2322. - (2021). [10.1101/2021.02.24.432808]
File allegati a questo prodotto
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/1556867
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? 0
social impact