Text-to-sign language motion generation has been dominated by autoregressive (AR) decoders, usually based on transformers. Such architectures incur high inference and training times. We make three contributions. First, we propose a masked iterative non-autoregressive generator that produces full-body sign sequences from free text through parallel decoding. Second, the model predicts sequence length directly from the textual input, removing the need for an external duration model. Third, we introduce a training-free, parameter-free hand-aware refinement stage that asymmetrically allocates additional computation, selectively regenerating only the least-confident hand tokens, so that articulated hand motion is improved without retraining the model. As a result, on CSL-Daily and Phoenix-2014T our method improves pose accuracy over the AR baseline by up to 13.6% on body pose and 14.8% on hand pose. It runs 1.73x to 2.02x faster end-to-end. And it consumes roughly a quarter of the GPU energy per generated sequence.

Efficient Masked Decoding for Sign Motion Generation with Hand-Aware Token Refinement / Cassini, F., Musumeci, E., Suriani, V.. - 17131:(2026), pp. 169-182. (24th International Conference of the Italian Association for Artificial Intelligence (AIxIA 2026) Perugia, Italy ) [10.1007/978-3-032-40774-0_13].

Efficient Masked Decoding for Sign Motion Generation with Hand-Aware Token Refinement

Cassini, Francesco
;
Musumeci, Emanuele;Suriani, Vincenzo
2026

Abstract

Text-to-sign language motion generation has been dominated by autoregressive (AR) decoders, usually based on transformers. Such architectures incur high inference and training times. We make three contributions. First, we propose a masked iterative non-autoregressive generator that produces full-body sign sequences from free text through parallel decoding. Second, the model predicts sequence length directly from the textual input, removing the need for an external duration model. Third, we introduce a training-free, parameter-free hand-aware refinement stage that asymmetrically allocates additional computation, selectively regenerating only the least-confident hand tokens, so that articulated hand motion is improved without retraining the model. As a result, on CSL-Daily and Phoenix-2014T our method improves pose accuracy over the AR baseline by up to 13.6% on body pose and 14.8% on hand pose. It runs 1.73x to 2.02x faster end-to-end. And it consumes roughly a quarter of the GPU energy per generated sequence.
2026
24th International Conference of the Italian Association for Artificial Intelligence (AIxIA 2026)
Sign Language Generation; Non-Autoregressive Decoding; Motion Synthesis
04 Pubblicazione in atti di convegno::04b Atto di convegno in volume
Efficient Masked Decoding for Sign Motion Generation with Hand-Aware Token Refinement / Cassini, F., Musumeci, E., Suriani, V.. - 17131:(2026), pp. 169-182. (24th International Conference of the Italian Association for Artificial Intelligence (AIxIA 2026) Perugia, Italy ) [10.1007/978-3-032-40774-0_13].
File allegati a questo prodotto
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/1778492
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact