Dynamic Difficulty Adjustment (DDA) within video games aims to avoid frustration or boredom. This paper provides the first framework for designing a Reinforcement Learning (RL) agent with DDA for single-player action video games. The framework includes the definitions of states, actions, and rewards. We propose a 2Q-table system that can provide a better winning/losing ratio and extend the duration of the rounds. We apply the framework to a use case study. We address the challenges that the design and implementation of RL agents with DDA for single-player action video games might present, such as (i) large and/or continuous action–state spaces, (ii) an appropriate definition of the rewards for achieving a correct DDA, (iii) learning from each player online from limited samples and (iv) in an arcade shooter video game. The two evaluations performed (with computer-driven and human players) show that the paper's goals are met since players face personalized challenges according to their playing skills.

A framework for designing Reinforcement Learning agents with Dynamic Difficulty Adjustment in single-player action video games / Climent, L.; Longhi, A.; Arbelaez, A.; Mancini, M.. - In: ENTERTAINMENT COMPUTING. - ISSN 1875-9521. - 50:(2024). [10.1016/j.entcom.2024.100686]

A framework for designing Reinforcement Learning agents with Dynamic Difficulty Adjustment in single-player action video games

Mancini M.
2024

Abstract

Dynamic Difficulty Adjustment (DDA) within video games aims to avoid frustration or boredom. This paper provides the first framework for designing a Reinforcement Learning (RL) agent with DDA for single-player action video games. The framework includes the definitions of states, actions, and rewards. We propose a 2Q-table system that can provide a better winning/losing ratio and extend the duration of the rounds. We apply the framework to a use case study. We address the challenges that the design and implementation of RL agents with DDA for single-player action video games might present, such as (i) large and/or continuous action–state spaces, (ii) an appropriate definition of the rewards for achieving a correct DDA, (iii) learning from each player online from limited samples and (iv) in an arcade shooter video game. The two evaluations performed (with computer-driven and human players) show that the paper's goals are met since players face personalized challenges according to their playing skills.
2024
Dynamic difficulty adjustment and single-player action video games; Reinforcement learning agent
01 Pubblicazione su rivista::01a Articolo in rivista
A framework for designing Reinforcement Learning agents with Dynamic Difficulty Adjustment in single-player action video games / Climent, L.; Longhi, A.; Arbelaez, A.; Mancini, M.. - In: ENTERTAINMENT COMPUTING. - ISSN 1875-9521. - 50:(2024). [10.1016/j.entcom.2024.100686]
File allegati a questo prodotto
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/1712137
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? 0
social impact