(abstract of the paper) Bayesian models based on the Dirichlet process and other stick-breaking priors have been proposed as core ingredients for clustering, topic modeling, and other unsupervised learning tasks. However, due to the flexibility of these models, the consequences of prior choices can be opaque. And so prior specification can be relatively difficult. At the same time, prior choice can have a substantial effect on posterior inferences. Thus, considerations of robustness need to go hand in hand with nonparametric modeling. In the current paper, we tackle this challenge by exploiting the fact that variational Bayesian methods, in addition to having computational advantages in fitting complex nonparametric models, also yield sensitivities with respect to parametric and nonparametric aspects of Bayesian models. In particular, we demonstrate how to assess the sensitivity of conclusions to the choice of concentration parameter and stick-breaking distribution for infer- ences under Dirichlet process mixtures and related mixture models. We provide both theoretical and empirical support for our variational approach to Bayesian sensitivity analysis.

A contributed discussion on "Evaluating Sensitivity to the Stick-Breaking Prior in Bayesian Nonparametrics" / Miscouridou, X.; Panero, F.. - In: BAYESIAN ANALYSIS. - ISSN 1936-0975. - (2023), pp. 348-351. [10.1214/22-BA1309]

A contributed discussion on "Evaluating Sensitivity to the Stick-Breaking Prior in Bayesian Nonparametrics"

Panero, F.
2023

Abstract

(abstract of the paper) Bayesian models based on the Dirichlet process and other stick-breaking priors have been proposed as core ingredients for clustering, topic modeling, and other unsupervised learning tasks. However, due to the flexibility of these models, the consequences of prior choices can be opaque. And so prior specification can be relatively difficult. At the same time, prior choice can have a substantial effect on posterior inferences. Thus, considerations of robustness need to go hand in hand with nonparametric modeling. In the current paper, we tackle this challenge by exploiting the fact that variational Bayesian methods, in addition to having computational advantages in fitting complex nonparametric models, also yield sensitivities with respect to parametric and nonparametric aspects of Bayesian models. In particular, we demonstrate how to assess the sensitivity of conclusions to the choice of concentration parameter and stick-breaking distribution for infer- ences under Dirichlet process mixtures and related mixture models. We provide both theoretical and empirical support for our variational approach to Bayesian sensitivity analysis.
2023
Dirichlet process; stick breaking; local robustness; variational Bayes; Fréchet differentiability; fastSTRUCTURE
01 Pubblicazione su rivista::01g Articolo di rassegna (Review)
A contributed discussion on "Evaluating Sensitivity to the Stick-Breaking Prior in Bayesian Nonparametrics" / Miscouridou, X.; Panero, F.. - In: BAYESIAN ANALYSIS. - ISSN 1936-0975. - (2023), pp. 348-351. [10.1214/22-BA1309]
File allegati a questo prodotto
File Dimensione Formato  
Evaluating Sensitivity to the Stick-Breaking Prior in Bayesian Nonparametrics (with Discussion).pdf

accesso aperto

Note: full article
Tipologia: Altro materiale allegato
Licenza: Creative commons
Dimensione 1.95 MB
Formato Adobe PDF
1.95 MB Adobe PDF
Panero_Discussion-StickBreaking_2023.pdf

accesso aperto

Note: discussion only
Tipologia: Versione editoriale (versione pubblicata con il layout dell'editore)
Licenza: Creative commons
Dimensione 136.57 kB
Formato Adobe PDF
136.57 kB Adobe PDF

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/1711891
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact