In the last years’ digitalization process, the creation and management of documents in various domains, particularly in Public Administration (PA), have become increasingly complex and diverse. This complexity arises from the need to handle a wide range of document types, often characterized by semi-structured forms. Semi-structured documents present a fixed set of data without a fixed format. As a consequence, a template-based solution cannot be used, as understanding a document requires the extraction of the data structure. The recent introduction of Large Language Models (LLMs) has enabled the creation of customized text output satisfying user requests. In this work, we propose a novel approach that combines the LLMs with prompt engineering and multi-agent systems for generating new documents compliant with a desired structure. The main contribution of this work concerns replacing the commonly used manual prompting with a task description generated by semantic retrieval from an LLM. The potential of this approach is demonstrated through a series of experiments and case studies, showcasing its effectiveness in real-world PA scenarios.

LLM Based Multi-agent Generation of Semi-structured Documents from Semantic Templates in the Public Administration Domain / Musumeci, E., Brienza, M., Suriani, V., Nardi, D., Bloisi, D.D.. - (2024), pp. 98-117. (5th International Conference, AI-HCI 2024, Held as Part of the 26th HCI International Conference, HCII 2024, Washington, DC, USA, June 29–July 4, 2024, Proceedings, Part III Washington DC; USA ) [10.1007/978-3-031-60615-1_7].

LLM Based Multi-agent Generation of Semi-structured Documents from Semantic Templates in the Public Administration Domain

Musumeci E.
Primo
;
Brienza M.
Secondo
;
Suriani V.;Nardi D.
Penultimo
;
Bloisi D. D.
Ultimo
2024

Abstract

In the last years’ digitalization process, the creation and management of documents in various domains, particularly in Public Administration (PA), have become increasingly complex and diverse. This complexity arises from the need to handle a wide range of document types, often characterized by semi-structured forms. Semi-structured documents present a fixed set of data without a fixed format. As a consequence, a template-based solution cannot be used, as understanding a document requires the extraction of the data structure. The recent introduction of Large Language Models (LLMs) has enabled the creation of customized text output satisfying user requests. In this work, we propose a novel approach that combines the LLMs with prompt engineering and multi-agent systems for generating new documents compliant with a desired structure. The main contribution of this work concerns replacing the commonly used manual prompting with a task description generated by semantic retrieval from an LLM. The potential of this approach is demonstrated through a series of experiments and case studies, showcasing its effectiveness in real-world PA scenarios.
2024
5th International Conference, AI-HCI 2024, Held as Part of the 26th HCI International Conference, HCII 2024, Washington, DC, USA, June 29–July 4, 2024, Proceedings, Part III
Human-Centered AI; Public Administration; Task optimization
04 Pubblicazione in atti di convegno::04b Atto di convegno in volume
LLM Based Multi-agent Generation of Semi-structured Documents from Semantic Templates in the Public Administration Domain / Musumeci, E., Brienza, M., Suriani, V., Nardi, D., Bloisi, D.D.. - (2024), pp. 98-117. (5th International Conference, AI-HCI 2024, Held as Part of the 26th HCI International Conference, HCII 2024, Washington, DC, USA, June 29–July 4, 2024, Proceedings, Part III Washington DC; USA ) [10.1007/978-3-031-60615-1_7].
File allegati a questo prodotto
File Dimensione Formato  
Musumeci_preprint_LLM Based_2024.pdf

accesso aperto

Note: https://link.springer.com/chapter/10.1007/978-3-031-60615-1_7
Tipologia: Documento in Pre-print (manoscritto inviato all'editore, precedente alla peer review)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 1.25 MB
Formato Adobe PDF
1.25 MB Adobe PDF
Musumeci_LLM Based_2024.pdf

solo gestori archivio

Tipologia: Versione editoriale (versione pubblicata con il layout dell'editore)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 5.6 MB
Formato Adobe PDF
5.6 MB Adobe PDF   Contatta l'autore

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/1718230
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 21
  • ???jsp.display-item.citation.isi??? 8
social impact