Effective user interaction in online interactive semantic segmentation of glioblastoma magnetic resonance imaging

Jens Petersen; Martin Bendszus; Jürgen Debus; Sabine Heiland; Klaus H. Maier-Hein

doi:10.1117/1.JMI.4.3.034001

22 August 2017 Effective user interaction in online interactive semantic segmentation of glioblastoma magnetic resonance imaging

Jens Petersen, Martin Bendszus, Jürgen Debus, Sabine Heiland, Klaus H. Maier-Hein

Author Affiliations +

Journal of Medical Imaging, Vol. 4, Issue 3, 034001 (August 2017). https://doi.org/10.1117/1.JMI.4.3.034001

Abstract

Interactive segmentation is a promising approach to solving the pervasive shortage of reference annotations for automated medical image processing. We focus on the challenging task of glioblastoma segmentation in magnetic resonance imaging using a random forest pixel classifier trained iteratively on scribble annotations. Our experiments use data from the MICCAI Multimodal Brain Tumor Segmentation Challenge 2013 and simulate expert interactions using different approaches: corrective annotations, class-balanced corrections, annotations where classifier uncertainty is high, and corrections where classifier uncertainty is high/low. We find that it is better to correct the classifier than to provide annotations where the classifier is uncertain, resulting in significantly better Dice scores in the edema (0.662 to 0.686) and necrosis (0.550 to 0.676) regions after 20 interactions. It is also advantageous to balance inputs among classes, with significantly better Dice in the necrotic (0.501 to 0.676) and nonenhancing (0.151 to 0.235) regions compared to fully random corrections. Corrective annotations in regions of high classifier uncertainty provide no additional benefit, low uncertainty corrections perform worst. Preliminary experiments with real users indicate that those with intermediate proficiency make a considerable number of annotation errors. The performance of corrective approaches suffers most strongly from this, leading to a less profound difference to uncertainty-based annotations.

Citation Download Citation

Jens Petersen, Martin Bendszus, Jürgen Debus, Sabine Heiland, and Klaus H. Maier-Hein "Effective user interaction in online interactive semantic segmentation of glioblastoma magnetic resonance imaging," Journal of Medical Imaging 4(3), 034001 (22 August 2017). https://doi.org/10.1117/1.JMI.4.3.034001

Received: 13 February 2017; Accepted: 24 July 2017; Published: 22 August 2017

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available