Identification of superior discriminations during ROC studies

Amy H. Klym; James Ferris; Joan Lacomis; Sara Golla; Thomas Warfel; Barry McCook; Peter Davis; David Gur

doi:10.1117/12.462699

12 April 2002 Identification of superior discriminations during ROC studies

Amy H. Klym, James Ferris, Joan Lacomis, Sara Golla, Thomas Warfel, Barry McCook, Peter Davis, David Gur

Proceedings Volume 4686, Medical Imaging 2002: Image Perception, Observer Performance, and Technology Assessment; (2002) https://doi.org/10.1117/12.462699
Event: Medical Imaging 2002, 2002, San Diego, California, United States

Abstract

One way to increase the efficiency of large-scale observer performance studies that utilize receiver-operator- characteristic (ROC) analysis would be to identify a group of observers whose ROC results consistently reflect a strong sensitivity to imaging mode differences. We reviewed the data of four large ROC studies performed by our group. The primary index used to classify observers was defined as the absolute difference between readers' A_zs for two modes divided by the standard deviation, appropriately corrected for correlation. Using this index, observers were ranked as to their ability to detect differences between modes. We performed four different analyses on data that included 119,550 observations in four studies and 14 different modes performed by 20 readers. With the exception of one data set, there was no correlation between the level of performance of observers, as measured by A_z, and their ability to discriminate between modes. Analyses designed to identify observers who were consistent in their rankings as to their ability to discriminated between modes was also unsuccessful in showing differences. This study suggests that without the use of special procedures or training, it is not likely that most research facilities will be able to select a group of highly experienced observers who consistently detect small differences among modes.

Citation Download Citation

Amy H. Klym, James Ferris, Joan Lacomis, Sara Golla, Thomas Warfel, Barry McCook, Peter Davis, and David Gur "Identification of superior discriminations during ROC studies", Proc. SPIE 4686, Medical Imaging 2002: Image Perception, Observer Performance, and Technology Assessment, (12 April 2002); https://doi.org/10.1117/12.462699

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
7 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Analytical research

Argon

Imaging systems

Research facilities

Statistical analysis

Astatine

Diagnostics

Show All Keywords

Keywords/Phrases

Search In:

Publication Years