Text-to-sign language motion generation has been dominated by autoregressive (AR) decoders, usually based on transformers. Such architectures incur high inference and training times. We make three contributions. First, we propose a masked iterative non-autoregressive generator that produces full-body sign sequences from free text through parallel decoding. Second, the model predicts sequence length directly from the textual input, removing the need for an external duration model. Third, we introduce a training-free, parameter-free hand-aware refinement stage that asymmetrically allocates additional computation, selectively regenerating only the least-confident hand tokens, so that articulated hand motion is improved without retraining the model. As a result, on CSL-Daily and Phoenix-2014T our method improves pose accuracy over the AR baseline by up to 13.6% on body pose and 14.8% on hand pose. It runs 1.73x to 2.02x faster end-to-end. And it consumes roughly a quarter of the GPU energy per generated sequence.
Efficient Masked Decoding for Sign Motion Generation with Hand-Aware Token Refinement / Cassini, F., Musumeci, E., Suriani, V.. - 17131:(2026), pp. 169-182. (24th International Conference of the Italian Association for Artificial Intelligence (AIxIA 2026) Perugia, Italy ) [10.1007/978-3-032-40774-0_13].
Efficient Masked Decoding for Sign Motion Generation with Hand-Aware Token Refinement
Cassini, Francesco
;Musumeci, Emanuele;Suriani, Vincenzo
2026
Abstract
Text-to-sign language motion generation has been dominated by autoregressive (AR) decoders, usually based on transformers. Such architectures incur high inference and training times. We make three contributions. First, we propose a masked iterative non-autoregressive generator that produces full-body sign sequences from free text through parallel decoding. Second, the model predicts sequence length directly from the textual input, removing the need for an external duration model. Third, we introduce a training-free, parameter-free hand-aware refinement stage that asymmetrically allocates additional computation, selectively regenerating only the least-confident hand tokens, so that articulated hand motion is improved without retraining the model. As a result, on CSL-Daily and Phoenix-2014T our method improves pose accuracy over the AR baseline by up to 13.6% on body pose and 14.8% on hand pose. It runs 1.73x to 2.02x faster end-to-end. And it consumes roughly a quarter of the GPU energy per generated sequence.I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.


