Cardiac segmentation and motion estimation are two important tasks for the assessment of cardiac structure and function. Studies have demonstrated deep learning segmentation methods considering the valuable dynamics of the heart have more robust and accurate segmentations than those treating each frame independently. The former methods require annotations of all frames for supervised training, while only end-systolic (ES) and end-diastolic (ED) frames are commonly labeled. The issue has been addressed by integrating motion estimation into the segmentation framework and generating annotations for unlabeled frames with the estimated motion. However, the current pair-wise registration method with the ED frame as the template image may result in inaccurate motion estimation for systolic frames. We therefore, propose to use a group-wise registration network where the template image is learned implicitly for optimal registration performance, with the assumption that more accurate motion estimation leads to improved segmentation performance. Specifically, a recurrent U-Net based network is employed for joint optimization of group-wise registration and segmentation of the left ventricle and myocardium, where the dynamic information is utilized for both tasks with the recurrent units. In addition, an enhancement mask covering the heart is generated with the segmentation masks, which is expected to improve the registration performance by focusing the motion estimation on the heart. Experimental results in a cardiac cine MRI dataset including normal subjects and patients show that the group-wise registration significantly outperforms the pair-wise registration which translates to more accurate segmentations. The effectiveness of the proposed enhancement mask is also demonstrated in an ablation study.

Joint Group-Wise Motion Estimation and Segmentation of Cardiac Cine MR Images Using Recurrent U-Net / Qian, P.; Yang, J.; Lio, P.; Hu, P.; Qi, H.. - 13413:(2022), pp. 65-74. (Intervento presentato al convegno 26th Annual Conference on Medical Image Understanding and Analysis, MIUA 2022 tenutosi a Cambridge; UK) [10.1007/978-3-031-12053-4_5].

Joint Group-Wise Motion Estimation and Segmentation of Cardiac Cine MR Images Using Recurrent U-Net

Lio P.;
2022

Abstract

Cardiac segmentation and motion estimation are two important tasks for the assessment of cardiac structure and function. Studies have demonstrated deep learning segmentation methods considering the valuable dynamics of the heart have more robust and accurate segmentations than those treating each frame independently. The former methods require annotations of all frames for supervised training, while only end-systolic (ES) and end-diastolic (ED) frames are commonly labeled. The issue has been addressed by integrating motion estimation into the segmentation framework and generating annotations for unlabeled frames with the estimated motion. However, the current pair-wise registration method with the ED frame as the template image may result in inaccurate motion estimation for systolic frames. We therefore, propose to use a group-wise registration network where the template image is learned implicitly for optimal registration performance, with the assumption that more accurate motion estimation leads to improved segmentation performance. Specifically, a recurrent U-Net based network is employed for joint optimization of group-wise registration and segmentation of the left ventricle and myocardium, where the dynamic information is utilized for both tasks with the recurrent units. In addition, an enhancement mask covering the heart is generated with the segmentation masks, which is expected to improve the registration performance by focusing the motion estimation on the heart. Experimental results in a cardiac cine MRI dataset including normal subjects and patients show that the group-wise registration significantly outperforms the pair-wise registration which translates to more accurate segmentations. The effectiveness of the proposed enhancement mask is also demonstrated in an ablation study.
2022
26th Annual Conference on Medical Image Understanding and Analysis, MIUA 2022
Cine MRI; Deep learning; Nonrigid registration; Segmentation
04 Pubblicazione in atti di convegno::04b Atto di convegno in volume
Joint Group-Wise Motion Estimation and Segmentation of Cardiac Cine MR Images Using Recurrent U-Net / Qian, P.; Yang, J.; Lio, P.; Hu, P.; Qi, H.. - 13413:(2022), pp. 65-74. (Intervento presentato al convegno 26th Annual Conference on Medical Image Understanding and Analysis, MIUA 2022 tenutosi a Cambridge; UK) [10.1007/978-3-031-12053-4_5].
File allegati a questo prodotto
File Dimensione Formato  
Qian_Join_2022.pdf

solo gestori archivio

Tipologia: Documento in Pre-print (manoscritto inviato all'editore, precedente alla peer review)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 9.15 MB
Formato Adobe PDF
9.15 MB Adobe PDF   Contatta l'autore

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/1727974
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 2
  • ???jsp.display-item.citation.isi??? 1
social impact