The Lung Image Database Consortium (LIDC) data collection process for nodule detection and annotation

M. F. McNitt-Gray; S. G. Armato III; C. R. Meyer; A. P. Reeves; G. McLennan; R. Pais; J. Freymann; M. S. Brown; R. M. Engelmann; P. H. Bland; G. E. Laderach; C. Piker; J. Guo; D. P. Qing; D. F. Yankelevitz; D. R. Aberle M.D.; E. J. R. van Beek; H. MacMahon; E. A. Kazerooni; B. Y. Croft; L. P. Clarke

doi:10.1117/12.713754

29 March 2007 The Lung Image Database Consortium (LIDC) data collection process for nodule detection and annotation

M. F. McNitt-Gray, S. G. Armato III, C. R. Meyer, A. P. Reeves, G. McLennan, R. Pais, J. Freymann, M. S. Brown, R. M. Engelmann, P. H. Bland, G. E. Laderach, C. Piker, J. Guo, D. P. Qing, D. F. Yankelevitz, D. R. Aberle M.D., E. J. R. van Beek, H. MacMahon, E. A. Kazerooni, B. Y. Croft, L. P. Clarke

Author Affiliations +

Proceedings Volume 6514, Medical Imaging 2007: Computer-Aided Diagnosis; 65140K (2007) https://doi.org/10.1117/12.713754
Event: Medical Imaging, 2007, San Diego, CA, United States

Abstract

The LIDC is developing a publicly available database of thoracic computed tomography (CT) scans as a medical imaging research resource. A unique multi-center data collection process and communication system were developed to share image data and to capture the location and spatial extent of lung nodules as marked by expert radiologists. A two-phase data collection process was designed to allow multiple radiologists at different centers to asynchronously review and annotate each CT image series. Four radiologists reviewed each case using this process. In the first or "blinded" phase, each radiologist reviewed the CT series independently. In the second or "unblinded" review phase, the results from all four blinded reviews are compiled and presented to each radiologist for a second review. This allows each radiologist to review their own annotations along with those of the other radiologists. The results from each radiologist's unblinded review were compiled to form the final unblinded review. There is no forced consensus in this process. An XML-based message system was developed to communicate the results of each reading. This two-phase data collection process was designed, tested and implemented across the LIDC. It has been used for more than 130 CT cases that have been read and annotated by four expert readers and are publicly available at (http://ncia.nci.nih.gov). A data collection process was developed, tested and implemented that allowed multiple readers to review each case multiple times and that allowed each reader to observe the annotations of other readers.

Citation Download Citation

M. F. McNitt-Gray, S. G. Armato III, C. R. Meyer, A. P. Reeves, G. McLennan, R. Pais, J. Freymann, M. S. Brown, R. M. Engelmann, P. H. Bland, G. E. Laderach, C. Piker, J. Guo, D. P. Qing, D. F. Yankelevitz, D. R. Aberle M.D., E. J. R. van Beek, H. MacMahon, E. A. Kazerooni, B. Y. Croft, and L. P. Clarke "The Lung Image Database Consortium (LIDC) data collection process for nodule detection and annotation", Proc. SPIE 6514, Medical Imaging 2007: Computer-Aided Diagnosis, 65140K (29 March 2007); https://doi.org/10.1117/12.713754

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available