The creation of planning models remains a labor-intensive and error-prone bottleneck in the deployment of Automated Planning solutions in real-world environments. Recent approaches have explored the use of Large Language Models (LLMs) as modelers to generate PDDL specifications from natural language. However, most rely on single-shot generation or limited feedback loops, often failing to enforce semantic correctness and common-sense coherence. In this paper, we present a structured, multi-stage methodology inspired by principles from Requirements Engineering for generating PDDL models. Our approach leverages scenarios and user stories to elicit domain and initial state, which are incrementally refined via syntax validation, state progression through plan execution, and invariants analysis to detect and correct modeling flaws. Indeed, the method’s novelty lies in the integration of automated invariant extraction and LLM-guided model refinement, which significantly improves the semantic robustness and realism of the generated domains. We assume a humanoid agent in the environment, enforcing real world constraints such as limited hand capacity, and we evaluate our methodology on a synthetic dataset of room environments, using both expert judgment and an LLM-as-a-judge approach. Results show that the generated planning domains are syntactically correct, semantically sound, and actionable, enabling real-world deployment in physical agents.

A Requirements Engineering-Driven Methodology for Planning Domain Generation via LLMs with Invariant-Based Refinement / Casciani, Angelo; De Giacomo, Giuseppe; Marrella, Andrea; Weinhuber, Christoph. - (2025). ( Workshop on Planning in the Era of LLMs (LM4Plan) - ICAPS 2025 Melbourne, Australia ).

A Requirements Engineering-Driven Methodology for Planning Domain Generation via LLMs with Invariant-Based Refinement

Angelo Casciani
Primo
;
Giuseppe De Giacomo;Andrea Marrella;
2025

Abstract

The creation of planning models remains a labor-intensive and error-prone bottleneck in the deployment of Automated Planning solutions in real-world environments. Recent approaches have explored the use of Large Language Models (LLMs) as modelers to generate PDDL specifications from natural language. However, most rely on single-shot generation or limited feedback loops, often failing to enforce semantic correctness and common-sense coherence. In this paper, we present a structured, multi-stage methodology inspired by principles from Requirements Engineering for generating PDDL models. Our approach leverages scenarios and user stories to elicit domain and initial state, which are incrementally refined via syntax validation, state progression through plan execution, and invariants analysis to detect and correct modeling flaws. Indeed, the method’s novelty lies in the integration of automated invariant extraction and LLM-guided model refinement, which significantly improves the semantic robustness and realism of the generated domains. We assume a humanoid agent in the environment, enforcing real world constraints such as limited hand capacity, and we evaluate our methodology on a synthetic dataset of room environments, using both expert judgment and an LLM-as-a-judge approach. Results show that the generated planning domains are syntactically correct, semantically sound, and actionable, enabling real-world deployment in physical agents.
2025
Workshop on Planning in the Era of LLMs (LM4Plan) - ICAPS 2025
Automated Planning; Large Language Models; PDDL; Requirements Engineering
04 Pubblicazione in atti di convegno::04b Atto di convegno in volume
A Requirements Engineering-Driven Methodology for Planning Domain Generation via LLMs with Invariant-Based Refinement / Casciani, Angelo; De Giacomo, Giuseppe; Marrella, Andrea; Weinhuber, Christoph. - (2025). ( Workshop on Planning in the Era of LLMs (LM4Plan) - ICAPS 2025 Melbourne, Australia ).
File allegati a questo prodotto
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/1764664
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact