In this paper, we examine the current state-of-the-art in AMR parsing, which relies on ensemble strategies by merging multiple graph predictions. Our analysis reveals that the present models often violate AMR structural constraints. To address this issue, we develop a validation method, and show how ensemble models can exploit SMATCH metric weaknesses to obtain higher scores, but sometimes result in corrupted graphs. Additionally, we highlight the demanding need to compute the SMATCH score among all possible predictions. To overcome these challenges, we propose two novel ensemble strategies based on Transformer models, improving robustness to structural constraints, while also reducing the computational time. Our methods provide new insights for enhancing AMR parsers and metrics.

AMRs Assemble! Learning to Ensemble with Autoregressive Models for AMR Parsing / Martinez Lorenzo, Abelardo Carlos; Huguet Cabot, Pere Lluís; Navigli, Roberto. - (2023), pp. 1595-1605. (Intervento presentato al convegno Association for Computational Linguistics tenutosi a Toronto, Canada) [10.18653/v1/2023.acl-short.137].

AMRs Assemble! Learning to Ensemble with Autoregressive Models for AMR Parsing

Martinez Lorenzo, Abelardo Carlos
;
Huguet Cabot, Pere Lluís
;
Navigli, Roberto
Supervision
2023

Abstract

In this paper, we examine the current state-of-the-art in AMR parsing, which relies on ensemble strategies by merging multiple graph predictions. Our analysis reveals that the present models often violate AMR structural constraints. To address this issue, we develop a validation method, and show how ensemble models can exploit SMATCH metric weaknesses to obtain higher scores, but sometimes result in corrupted graphs. Additionally, we highlight the demanding need to compute the SMATCH score among all possible predictions. To overcome these challenges, we propose two novel ensemble strategies based on Transformer models, improving robustness to structural constraints, while also reducing the computational time. Our methods provide new insights for enhancing AMR parsers and metrics.
2023
Association for Computational Linguistics
Semantic Parsing; AMR; AMR parsing; AMR ensembling
04 Pubblicazione in atti di convegno::04b Atto di convegno in volume
AMRs Assemble! Learning to Ensemble with Autoregressive Models for AMR Parsing / Martinez Lorenzo, Abelardo Carlos; Huguet Cabot, Pere Lluís; Navigli, Roberto. - (2023), pp. 1595-1605. (Intervento presentato al convegno Association for Computational Linguistics tenutosi a Toronto, Canada) [10.18653/v1/2023.acl-short.137].
File allegati a questo prodotto
File Dimensione Formato  
Lorenzo_AMRs_2023.pdf

accesso aperto

Note: https://aclanthology.org/2023.acl-short.137.pdf
Tipologia: Versione editoriale (versione pubblicata con il layout dell'editore)
Licenza: Creative commons
Dimensione 292.28 kB
Formato Adobe PDF
292.28 kB Adobe PDF

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/1688041
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 5
  • ???jsp.display-item.citation.isi??? 0
social impact