Purpose: Recently, the EAU guidelines presented the EAU guidelines bot to assist urologists in the reading of the guidelines; however, up to date, no external validation is available. The aim of our study is to assess the accuracy, completeness, and clarity of the guideline's bot in testicular cancer. Methods: A total of 36 questions based on the EAU testicular cancer guidelines recommendations were developed. Each question was systematically presented to the EAU guidelines bot and the responses were independently assessed by two expert urologists to assess the accuracy, completeness, and clarity. A 5-point Likert scale was used as a score, and in case of discrepancies, a third urologist was queried. Accuracy, completeness, and clarity were assessed per chapter and per grade of recommendation. All questions and answers were recorded in an Excel file. Results: Overall, 36 questions were developed. In terms of accuracy, 36/36 (100%) were defined as excellent (score 5). In terms of completeness, 23/36 (64%) were defined as totally complete (score = 5), 8/36 (22%) presented a good completeness (score = 4), while 5/36 (14%) were fairly complete (score = 3). Finally, in terms of clarity, 31/36 (86%) were defined as totally clear (score = 5) and 5 /36 (14%) were defined as almost totally clear (score = 4). None of the answers was evaluated as non-accurate, non-complete, or non-clear. Conclusions: EAU guidelines bot represents an accurate tool for testicular cancer management.

Accuracy, readability, and understandability of EAU guidelines bot for testicular cancer / Gallo, Giacomo; Lombardo, Riccardo; Pagliarulo, Vincenzo; Sequi, Manfredi Bruno; Coppola, Ludovica Maria; Rosato, Eleonora; Romagnoli, Matteo; De Cillis, Sabrina; Checcucci, Enrico; Amparore, Daniele; Ragonese, Mauro; Foschi, Nazzario; Santarelli, Valerio; Spatafora, Pietro; Tema, Giorgia; Nacchia, Antonio; Cicione, Antonio; Franco, Antonio; Pastore, Antonio Luigi; Al Salhi, Yazan; Rocco, Bernardo; Gacci, Mauro; Fiori, Cristian; Finazzi Agrò, Enrico; Sciarra, Alessandro; Tubaro, Andrea; De Nunzio, Cosimo; Null, Null. - In: INTERNATIONAL UROLOGY AND NEPHROLOGY. - ISSN 0301-1623. - (2026). [10.1007/s11255-026-05025-3]

Accuracy, readability, and understandability of EAU guidelines bot for testicular cancer

Gallo, Giacomo;Lombardo, Riccardo
;
Sequi, Manfredi Bruno;Coppola, Ludovica Maria;Rosato, Eleonora;Romagnoli, Matteo;Santarelli, Valerio;Tema, Giorgia;Nacchia, Antonio;Cicione, Antonio;Franco, Antonio;Pastore, Antonio Luigi;Al Salhi, Yazan;Rocco, Bernardo;Sciarra, Alessandro;Tubaro, Andrea;De Nunzio, Cosimo;
2026

Abstract

Purpose: Recently, the EAU guidelines presented the EAU guidelines bot to assist urologists in the reading of the guidelines; however, up to date, no external validation is available. The aim of our study is to assess the accuracy, completeness, and clarity of the guideline's bot in testicular cancer. Methods: A total of 36 questions based on the EAU testicular cancer guidelines recommendations were developed. Each question was systematically presented to the EAU guidelines bot and the responses were independently assessed by two expert urologists to assess the accuracy, completeness, and clarity. A 5-point Likert scale was used as a score, and in case of discrepancies, a third urologist was queried. Accuracy, completeness, and clarity were assessed per chapter and per grade of recommendation. All questions and answers were recorded in an Excel file. Results: Overall, 36 questions were developed. In terms of accuracy, 36/36 (100%) were defined as excellent (score 5). In terms of completeness, 23/36 (64%) were defined as totally complete (score = 5), 8/36 (22%) presented a good completeness (score = 4), while 5/36 (14%) were fairly complete (score = 3). Finally, in terms of clarity, 31/36 (86%) were defined as totally clear (score = 5) and 5 /36 (14%) were defined as almost totally clear (score = 4). None of the answers was evaluated as non-accurate, non-complete, or non-clear. Conclusions: EAU guidelines bot represents an accurate tool for testicular cancer management.
2026
artificial intelligence; eau guidelines; large language models; testicular cancer
01 Pubblicazione su rivista::01a Articolo in rivista
Accuracy, readability, and understandability of EAU guidelines bot for testicular cancer / Gallo, Giacomo; Lombardo, Riccardo; Pagliarulo, Vincenzo; Sequi, Manfredi Bruno; Coppola, Ludovica Maria; Rosato, Eleonora; Romagnoli, Matteo; De Cillis, Sabrina; Checcucci, Enrico; Amparore, Daniele; Ragonese, Mauro; Foschi, Nazzario; Santarelli, Valerio; Spatafora, Pietro; Tema, Giorgia; Nacchia, Antonio; Cicione, Antonio; Franco, Antonio; Pastore, Antonio Luigi; Al Salhi, Yazan; Rocco, Bernardo; Gacci, Mauro; Fiori, Cristian; Finazzi Agrò, Enrico; Sciarra, Alessandro; Tubaro, Andrea; De Nunzio, Cosimo; Null, Null. - In: INTERNATIONAL UROLOGY AND NEPHROLOGY. - ISSN 0301-1623. - (2026). [10.1007/s11255-026-05025-3]
File allegati a questo prodotto
File Dimensione Formato  
Gallo_Accuracy_2026.pdf

solo gestori archivio

Tipologia: Versione editoriale (versione pubblicata con il layout dell'editore)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 500.08 kB
Formato Adobe PDF
500.08 kB Adobe PDF   Contatta l'autore

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/1758981
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact