The year 2020 saw the covid-19 virus lead to one of the worst global pandemics in history. As a result, governments around the world have been faced with the challenge of protecting public health while keeping the economy running to the greatest extent possible. Epidemiological models provide insight into the spread of these types of diseases and predict the e_ects of possible intervention policies. However, to date, even the most data-driven intervention policies rely on heuristics. In this paper, we study how reinforcement learning (RL) and Bayesian inference can be used to optimize mitigation policies that minimize economic impact without overwhelming hospital capacity. Our main contributions are (1) a novel agent-based pandemic simulator which, unlike traditional models, is able to model _ne-grained interactions among people at speci_c locations in a community; (2) an RL- based methodology for optimizing _ne-grained mitigation policies within this simulator; and (3) a Hidden Markov Model for predicting infected individuals based on partial observations regarding test results, presence of symptoms, and past physical contacts.

Agent-Based Markov Modeling for Improved COVID-19 Mitigation Policies / Capobianco, R.; Kompella, V.; Ault, J.; Sharon, G.; Jong, S.; Fox, S.; Meyers, L.; Wurman, P. R.; Stone, P.. - In: THE JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH. - ISSN 1076-9757. - 71:(2021), pp. 953-992. [10.1613/JAIR.1.12632]

Agent-Based Markov Modeling for Improved COVID-19 Mitigation Policies

Capobianco R.
Primo
;
2021

Abstract

The year 2020 saw the covid-19 virus lead to one of the worst global pandemics in history. As a result, governments around the world have been faced with the challenge of protecting public health while keeping the economy running to the greatest extent possible. Epidemiological models provide insight into the spread of these types of diseases and predict the e_ects of possible intervention policies. However, to date, even the most data-driven intervention policies rely on heuristics. In this paper, we study how reinforcement learning (RL) and Bayesian inference can be used to optimize mitigation policies that minimize economic impact without overwhelming hospital capacity. Our main contributions are (1) a novel agent-based pandemic simulator which, unlike traditional models, is able to model _ne-grained interactions among people at speci_c locations in a community; (2) an RL- based methodology for optimizing _ne-grained mitigation policies within this simulator; and (3) a Hidden Markov Model for predicting infected individuals based on partial observations regarding test results, presence of symptoms, and past physical contacts.
2021
COVID-19; Reinforcement Learning; Markov Modeling
01 Pubblicazione su rivista::01a Articolo in rivista
Agent-Based Markov Modeling for Improved COVID-19 Mitigation Policies / Capobianco, R.; Kompella, V.; Ault, J.; Sharon, G.; Jong, S.; Fox, S.; Meyers, L.; Wurman, P. R.; Stone, P.. - In: THE JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH. - ISSN 1076-9757. - 71:(2021), pp. 953-992. [10.1613/JAIR.1.12632]
File allegati a questo prodotto
File Dimensione Formato  
Capobianco_Agent-Based _2021.pdf

accesso aperto

Tipologia: Versione editoriale (versione pubblicata con il layout dell'editore)
Licenza: Creative commons
Dimensione 1.68 MB
Formato Adobe PDF
1.68 MB Adobe PDF

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/1573775
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 12
  • ???jsp.display-item.citation.isi??? ND
social impact