IFSS-Net: Interactive Few-Shot Siamese Network for Faster Muscle Segmentation and Propagation in Volumetric Ultrasound
- 30 September 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Medical Imaging
- Vol. 40 (10), 2615-2628
- https://doi.org/10.1109/TMI.2021.3058303
Abstract
We present an accurate, fast and efficient method for segmentation and muscle mask propagation in 3D freehand ultrasound data, towards accurate volume quantification. A deep Siamese 3D Encoder-Decoder network that captures the evolution of the muscle appearance and shape for contiguous slices is deployed. We use it to propagate a reference mask annotated by a clinical expert. To handle longer changes of the muscle shape over the entire volume and to provide an accurate propagation, we devise a Bidirectional Long Short Term Memory module. Also, to train our model with a minimal amount of training samples, we propose a strategy combining learning from few annotated 2D ultrasound slices with sequential pseudo-labeling of the unannotated slices. We introduce a decremental update of the objective function to guide the model convergence in the absence of large amounts of annotated data. After training with a few volumes, the decremental update strategy switches from a weak supervised training to a few-shot setting. Finally, to handle the class-imbalance between foreground and background muscle pixels, we propose a parametric Tversky loss function that learns to penalize adaptively the false positives and the false negatives. We validate our approach for the segmentation, label propagation, and volume computation of the three low-limb muscles on a dataset of 61600 images from 44 subjects. We achieve a Dice score coefficient of over 95% and a volumetric error of 1.6035 +/- 0.587%.Keywords
Funding Information
- European Regional Development Fund the Pays de la Loire Region on the Connect Talent scheme (Nantes Métropole)
This publication has 40 references indexed in Scilit:
- Fully-Convolutional Siamese Networks for Object TrackingPublished by Springer Science and Business Media LLC ,2016
- Real-Time Ultrasound Segmentation, Analysis and Visualisation of Deep Cervical Muscle StructureIEEE Transactions on Medical Imaging, 2016
- The Importance of Skip Connections in Biomedical Image SegmentationPublished by Springer Science and Business Media LLC ,2016
- Learning to Refine Object SegmentsPublished by Springer Science and Business Media LLC ,2016
- Identity Mappings in Deep Residual NetworksPublished by Springer Nature ,2016
- U-Net: Convolutional Networks for Biomedical Image SegmentationPublished by Springer Science and Business Media LLC ,2015
- MRI biomarker assessment of neuromuscular disease progression: a prospective observational cohort studyThe Lancet Neurology, 2015
- Standard Plane Localization in Fetal Ultrasound via Domain Transferred Deep Neural NetworksIEEE Journal of Biomedical and Health Informatics, 2015
- 3D Slicer as an image computing platform for the Quantitative Imaging NetworkMagnetic Resonance Imaging, 2012
- Backpropagation through time: what it does and how to do itProceedings of the IEEE, 1990