The transition toward Industry 5.0 promotes human-centred production systems in which digital technologies augment human capabilities rather than replace them. Within this paradigm, Digital Intelligent Assistants have emerged as promising tools to support operators during complex industrial tasks. Moreover, Generative Artificial Intelligence (GenAI), including Large Language Models and Vision Language Models, enables the development of such systems by combining natural language interaction with visual perception. This exploratory mixed-methods pilot study investigates the impact of a multimodal Digital Intelligent Assistant (M-DIA) designed to support operators during a manual assembly process. A controlled laboratory experiment involving 60 participants compared four conditions: multimodal interaction (voice and camera), voice-only interaction, camera-only interaction, and a manual baseline. The analysis considered process performance, perceived cognitive workload, usability and user experience, and operator behaviour. The results show that M-DIA improves assembly quality by reducing product errors compared with the manual condition, although no reduction in total process time is observed due to interaction-related delays. From a human perspective, the assistant reduces perceived cognitive workload, while higher frustration levels emerge in configurations involving voice interaction. Usability and user experience evaluations are overall positive across all experimental conditions. Behavioural observations further indicate that operators maintain an active supervisory role, critically assessing system outputs and avoiding systematic overreliance on the assistant. These findings provide preliminary empirical evidence on the role of GenAI-based multimodal assistants in human-centred manufacturing and highlight key design implications for their industrial deployment.

Teaming or friction? Human–AI collaboration with a Multimodal Digital Intelligent Assistant in assembly manufacturing / Sabetta, N., Bianchini, F., Calamo, M., Costantino, F., Lorenzo, L., Mecella, M., Rossi, J., Colabianchi, S.. - In: COMPUTERS IN INDUSTRY. - ISSN 0166-3615. - 182:(2027). [10.1016/j.compind.2026.104563]

Teaming or friction? Human–AI collaboration with a Multimodal Digital Intelligent Assistant in assembly manufacturing

Filippo Bianchini;Marco Calamo;Francesco Costantino
;
Letizia Lorenzo;Massimo Mecella;Jacopo Rossi;Silvia Colabianchi
2027

Abstract

The transition toward Industry 5.0 promotes human-centred production systems in which digital technologies augment human capabilities rather than replace them. Within this paradigm, Digital Intelligent Assistants have emerged as promising tools to support operators during complex industrial tasks. Moreover, Generative Artificial Intelligence (GenAI), including Large Language Models and Vision Language Models, enables the development of such systems by combining natural language interaction with visual perception. This exploratory mixed-methods pilot study investigates the impact of a multimodal Digital Intelligent Assistant (M-DIA) designed to support operators during a manual assembly process. A controlled laboratory experiment involving 60 participants compared four conditions: multimodal interaction (voice and camera), voice-only interaction, camera-only interaction, and a manual baseline. The analysis considered process performance, perceived cognitive workload, usability and user experience, and operator behaviour. The results show that M-DIA improves assembly quality by reducing product errors compared with the manual condition, although no reduction in total process time is observed due to interaction-related delays. From a human perspective, the assistant reduces perceived cognitive workload, while higher frustration levels emerge in configurations involving voice interaction. Usability and user experience evaluations are overall positive across all experimental conditions. Behavioural observations further indicate that operators maintain an active supervisory role, critically assessing system outputs and avoiding systematic overreliance on the assistant. These findings provide preliminary empirical evidence on the role of GenAI-based multimodal assistants in human-centred manufacturing and highlight key design implications for their industrial deployment.
2027
Experimental design; Human behaviour; Industrial chatbot; Industry 4.0; Natural Language Processing; Smart manufacturing
01 Pubblicazione su rivista::01a Articolo in rivista
Teaming or friction? Human–AI collaboration with a Multimodal Digital Intelligent Assistant in assembly manufacturing / Sabetta, N., Bianchini, F., Calamo, M., Costantino, F., Lorenzo, L., Mecella, M., Rossi, J., Colabianchi, S.. - In: COMPUTERS IN INDUSTRY. - ISSN 0166-3615. - 182:(2027). [10.1016/j.compind.2026.104563]
File allegati a questo prodotto
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/1779571
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
social impact