Poster + Paper
15 February 2021 Multi-needle detection in ultrasound image using max-margin mask R-CNN
Yupei Zhang, Zhen Tian, Yang Lei, Tonghe Wang, Pretesh Patel, Ashesh B. Jani, Walter J. Curran, Tian Liu, Xiaofeng Yang
Author Affiliations +
Conference Poster
Abstract
Digitalizing all the needles in ultrasound (US) images is a crucial step of treatment planning for US-guided high-dose-rate (HDR) prostate brachytherapy. However, current computer-aided technologies are broadly focused on single-needle digitization, while manual digitization of all needles is labor intensive and time consuming. In this paper, we proposed a deep learning-based workflow for fast automatic multi-needle digitization, including needle shaft detection and needle tip detection. The major workflow is composed of two components: a large margin mask R-CNN model (LMMask R-CNN), which adopts the lager margin loss to reformulate Mask R-CNN for needle shaft localization, and a needle-based density-based spatial clustering of application with noise (DBSCAN) algorithm which integrates priors to model a needle in an iteration for a needle shaft refinement and tip detections. Besides, we use the skipping connection in neural network architecture to improve the supervision in hidden layers. Our workflow was evaluated on 23 patients who underwent USguided HDR prostrate brachytherapy with 339 needles being tested in total. Our method detected 98% of the needles with 0.0911±0.0427 mm shaft error and 0.3303±0.3625 mm tip error. Compared with only using mask R-CNN and only using LMMask R-CNN, the proposed method gains a significant improvement of accuracy on both shaft and tip localization. The proposed method automatically digitizes needles per patient with in a second. It streamlines the workflow of USguided HDR prostate brachytherapy and paves the way for the development of real-time treatment planning system that is expected to further elevate the quality and outcome of HDR prostate brachytherapy.
© (2021) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Yupei Zhang, Zhen Tian, Yang Lei, Tonghe Wang, Pretesh Patel, Ashesh B. Jani, Walter J. Curran, Tian Liu, and Xiaofeng Yang "Multi-needle detection in ultrasound image using max-margin mask R-CNN", Proc. SPIE 11602, Medical Imaging 2021: Ultrasonic Imaging and Tomography, 1160216 (15 February 2021); https://doi.org/10.1117/12.2580803
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Ultrasonography

High dynamic range imaging

Prostate

Process modeling

Detection and tracking algorithms

Neural networks

Back to Top