An Extended Reality (XR) framework for 3D simulation of Tool-Tissue Interaction in Surgery

Minimally invasive and laparoscopic surgeries often struggle with the lack of a wide field of view across anatomical districts, thus affecting the choice of surgical trajectories. This paper presents the proposal of an innovative Extended Reality (XR) framework prototype for the real-time simulation of tool-tissue interactions during surgery, developed using MATLAB, Simulink 3D Animation and Unity Engine. The proposed framework uses a Modified Mass-Spring-Damper (MMSD) model to simulate the dynamic response of soft tissues, based on data derived from segmented patients’ DICOM images. The simulation is based on patient-specific triangular mesh models and applies mechanical parameters deriving from biomechanical studies. Results show the system’s ability to replicate realistic tissue deformation and the XR reproducibility of the simulation, making it suitable for surgical training, planning and real-time surgical trajectory decision-making.