TensorRT-based surgical instrument detection assessment for deep learning on edge computing

Abdelkrim Belhaoua; Tom Kimpe

doi:10.1117/12.3004788

29 March 2024 TensorRT-based surgical instrument detection assessment for deep learning on edge computing

Abdelkrim Belhaoua, Tom Kimpe

Proceedings Volume 12928, Medical Imaging 2024: Image-Guided Procedures, Robotic Interventions, and Modeling; 129281O (2024) https://doi.org/10.1117/12.3004788
Event: SPIE Medical Imaging, 2024, San Diego, California, United States

Conference Poster

Abstract

The rise of minimally invasive surgery (MIS) can mainly be attributed to the exponential growth in technology and the evolution of laparoscopic instrumentation over the past two decades. However, advanced technologies in the Operating Theatre, such as imaging systems, robotics, computer assistance, navigation, and monitoring, involve significant effort and a very high level of training and education. Deep Learning has had a major impact on a range of surgical procedures, such as optimizing workflow, surgical training, intraoperative assistance, patient safety, and efficiency. However, it also requires high computational and memory resources. There has been a lot of research into optimizing deep learning models to balance performance and accuracy under limited resources. Techniques like post-training quantization can significantly reduce model size and latency. In this paper, we explore TensorRT-based techniques on edge devices to achieve real-time inference without compromising accuracy under limited compute. For this purpose, a YOLOv5 model is pretrained on M2CAI 2016, to detect and recognize surgical instruments in Laparoscopy and evaluated using mean average precision (mAP) and inference time. We deployed object detection models on an edge device to test real-time performance, exploring the trade-off between accuracy and speed. This paper gives a review looking at how deep learning and edge computing intersect and how to optimize deep learning for edge devices with limited resources.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Abdelkrim Belhaoua and Tom Kimpe "TensorRT-based surgical instrument detection assessment for deep learning on edge computing", Proc. SPIE 12928, Medical Imaging 2024: Image-Guided Procedures, Robotic Interventions, and Modeling, 129281O (29 March 2024); https://doi.org/10.1117/12.3004788

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available