Probe positioning for robot-assisted intraoperative ultrasound imaging using deep reinforcement learning

Y. Hu; Y. Huang; A. Song; C. K. Jones; J. H. Siewerdsen; B. Basar; P. A. Helm; A. Uneri

doi:10.1117/12.3006918

29 March 2024 Probe positioning for robot-assisted intraoperative ultrasound imaging using deep reinforcement learning

Y. Hu, Y. Huang, A. Song, C. K. Jones, J. H. Siewerdsen, B. Basar, P. A. Helm, A. Uneri

Proceedings Volume 12928, Medical Imaging 2024: Image-Guided Procedures, Robotic Interventions, and Modeling; 1292803 (2024) https://doi.org/10.1117/12.3006918
Event: SPIE Medical Imaging, 2024, San Diego, California, United States

Abstract

Purpose. Finding desired scan planes in ultrasound (US) imaging is a critical first task that can be time-consuming, influenced by operator experience, and subject to inter-operator variability. To circumvent these problems, interventional US imaging often necessitates dedicated, experienced sonographers in the operating room. This work presents a new approach leveraging deep reinforcement learning (RL) to assist probe positioning. Methods. A deep Q-network (DQN) is applied and evaluated for renal imaging and is tasked with locating the dorsal US scan plane. To circumvent the need for large labeled datasets, images were resliced from a large dataset of CT volumes and synthesized to US images using Field II, CycleGAN, and U-GAT-IT. The algorithm was evaluated on both synthesized and real US images, and its performance was quantified in terms of the agent’s accuracy in reaching the target scan plane. Results. Learning-based synthesis methods performed better than the physics-based approach, achieving comparable image quality when qualitatively compared to real US images. The RL agent was successful in reaching target scan planes when adjusting the probe’s rotation, with the U-GAT-IT model demonstrating superior generalizability (80.3% reachability) compared to CycleGAN (54.8% reachability). Conclusions. The approach presents a novel RL training strategy using image synthesis for automated US probe positioning. Ongoing efforts aim to evaluate advanced DQN models, image-based reward functions, and support probe motion with higher degrees of freedom.

Conference Presentation

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Y. Hu, Y. Huang, A. Song, C. K. Jones, J. H. Siewerdsen, B. Basar, P. A. Helm, and A. Uneri "Probe positioning for robot-assisted intraoperative ultrasound imaging using deep reinforcement learning", Proc. SPIE 12928, Medical Imaging 2024: Image-Guided Procedures, Robotic Interventions, and Modeling, 1292803 (29 March 2024); https://doi.org/10.1117/12.3006918

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available