Effect of independent multiple reading of mammograms on detection performance

Nico Karssemeijer; Johannes D. Otten; Antonius A. J. Roelofs; Sander van Woudenberg; Jan H. C. L. Hendriks

doi:10.1117/12.535225

4 May 2004 Effect of independent multiple reading of mammograms on detection performance

Nico Karssemeijer, Johannes D. Otten, Antonius A. J. Roelofs, Sander van Woudenberg, Jan H. C. L. Hendriks

Proceedings Volume 5372, Medical Imaging 2004: Image Perception, Observer Performance, and Technology Assessment; (2004) https://doi.org/10.1117/12.535225
Event: Medical Imaging 2004, 2004, San Diego, California, United States

Abstract

The goal of this study was to assess the effect of independent combination of multiple readers in mammography on detection performance, using different rules to combine localized observer responses. A group of 12 radiologists each read a series of 192 screening mammograms, including 96 prior mammograms of breast cancer cases in which a visible sign of abnormality could be identifed in retrospect. The other 96 cases were normal. In total the 12 readers annotated 1890 findings. LROC analysis was used to measure performance. The mean sensitivity in a false positive interval from 2 to 8% was 31.4% for single reading (range: 14.4% - 46.9%). The best rule for combination of observer scores was taking the average of all radiologists, using a zero score for radiologists who did not annotate the finding. With this strategy the average performance of 2 readers combined, in the interval selected, went up to 42.2%. When the interpretations of more readers were independently combined the mean sensitivity further increased, up to a level of 64.8% for the combination of all 12 readers. Using the mean score of only those readers who reported a finding turned out to be a poor strategy, yielding results that were similar or worse than single reading.

Citation Download Citation

Nico Karssemeijer, Johannes D. Otten, Antonius A. J. Roelofs, Sander van Woudenberg, and Jan H. C. L. Hendriks "Effect of independent multiple reading of mammograms on detection performance", Proc. SPIE 5372, Medical Imaging 2004: Image Perception, Observer Performance, and Technology Assessment, (4 May 2004); https://doi.org/10.1117/12.535225

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available