scispace - formally typeset
Journal ArticleDOI

ROC analysis in medical imaging: a tutorial review of the literature

Charles E. Metz
- 01 Jan 2008 - 
- Vol. 1, Iss: 1, pp 2-12
TLDR
This paper reviews the importance of sampling cases appropriately, designing an observer study to avoid bias, and collecting data on a useful scale, and a variety of methods for fitting ROC curves to observer data and testing the statistical significance of apparent differences are reported.
Abstract
Receiver operating characteristic (ROC) analysis measures the “diagnostic accuracy” of a medical imaging system, which represents the second level of diagnostic efficacy in the hierarchical model described by Fryback and Thornbury (Med Decis Making 11:88–94, 1991). After describing the historical origins of ROC analysis, this paper reviews the importance of sampling cases appropriately, designing an observer study to avoid bias, and collecting data on a useful scale. A variety of methods for fitting ROC curves to observer data and testing the statistical significance of apparent differences are then reported. Finally, generalized forms of ROC analysis that require lesion localization or allow more than two states of truth are surveyed briefly.

read more

Citations
More filters
Journal ArticleDOI

Mass Spectrometry Imaging: A Review of Emerging Advancements and Future Insights.

TL;DR: The combination of information gained from mass spectrometry (MS) and visualization of spatial distributions in thin sample sections makes this a valuable chemical analysis tool useful for biological specimen characterization.
Journal ArticleDOI

Receiver operating characteristic (ROC) curves: review of methods with applications in diagnostic medicine

TL;DR: The basic study design features of ROC studies are reviewed, sample size calculations are illustrated, statistical methods for measuring and comparing accuracy are presented, and commonly used ROC software is highlighted.
Journal ArticleDOI

Viewing another person's eye movements improves identification of pulmonary nodules in chest x-ray inspection

TL;DR: The results suggest that although the benefits of this form of attentional guidance may be short-lived, novices can scaffold their decisions based on the search behavior of others.
Journal ArticleDOI

Whole-slide imaging: routine pathologic diagnosis.

TL;DR: It is evident that several areas still require attention and careful consideration before more widespread clinical adoption of WSI takes place, including regulatory issues, development of standards of practice and validation guidelines, workflow modifications, as well as defining situations where WSI technology will really improve practice in a cost-effective way.
Journal ArticleDOI

Objective assessment of image quality and dose reduction in CT iterative reconstruction

TL;DR: This review paper seeks to consolidate information relevant to objectively assessing the quality of CT IR images, and thereby measuring the level of dose reduction that a given IR algorithm can achieve, to consolidate recent literature relevant to the development and implementation of task-based methods for the assessment of CTIR image quality.
References
More filters
Journal ArticleDOI

The meaning and use of the area under a receiver operating characteristic (ROC) curve.

James A. Hanley, +1 more
- 01 Apr 1982 - 
TL;DR: A representation and interpretation of the area under a receiver operating characteristic (ROC) curve obtained by the "rating" method, or by mathematical predictions based on patient characteristics, is presented and it is shown that in such a setting the area represents the probability that a randomly chosen diseased subject is (correctly) rated or ranked with greater suspicion than a random chosen non-diseased subject.
Journal ArticleDOI

Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach.

TL;DR: A nonparametric approach to the analysis of areas under correlated ROC curves is presented, by using the theory on generalized U-statistics to generate an estimated covariance matrix.
Book

Signal detection theory and psychophysics

TL;DR: This book discusses statistical decision theory and sensory processes in signal detection theory and psychophysics and describes how these processes affect decision-making.
Journal ArticleDOI

Measuring the accuracy of diagnostic systems

John A. Swets
- 03 Jun 1988 - 
TL;DR: For diagnostic systems used to distinguish between two classes of events, analysis in terms of the "relative operating characteristic" of signal detection theory provides a precise and valid measure of diagnostic accuracy.
Journal ArticleDOI

A method of comparing the areas under receiver operating characteristic curves derived from the same cases.

James A. Hanley, +1 more
- 01 Sep 1983 - 
TL;DR: This paper refines the statistical comparison of the areas under two ROC curves derived from the same set of patients by taking into account the correlation between the areas that is induced by the paired nature of the data.