Arnold Library

Contrasting Two Frameworks for ROC Analysis of Ordinal Ratings.

Morris, Daryl E and Pepe, Margaret Sullivan and Barlow, William E (2010) Contrasting Two Frameworks for ROC Analysis of Ordinal Ratings. Medical decision making : an international journal of the Society for Medical Decision Making. ISSN 1552-681X

[img] Text (Complete manuscript)
MorrisMDMManuscript031610.pdf
Restricted to Repository staff only
Available under License Creative Commons Attribution Non-commercial No Derivatives.

Download (282Kb) | Request a copy

Abstract

BACKGROUND: Statistical evaluation of medical imaging tests used for diagnostic and prognostic purposes often employs receiver operating characteristic (ROC) curves. Two methods for ROC analysis are popular. The ordinal regression method is the standard approach used when evaluating tests with ordinal values. The direct ROC modeling method is a more recently developed approach, motivated by applications to tests with continuous values. OBJECTIVE: . The authors compare the methods in terms of model formulations, interpretations of estimated parameters, the ranges of scientific questions that can be addressed with them, their computational algorithms, and the efficiencies with which they use data. RESULTS: . The authors show that a strong relationship exists between the methods by demonstrating that they fit the same models when only a single test is evaluated. The ordinal regression models are typically alternative parameterizations of the direct ROC models and vice versa. The direct method has two major advantages over the ordinal regression method: 1) estimated parameters relate directly to ROC curves, facilitating interpretations of covariate effects on ROC performance, and 2) comparisons between tests can be done directly in this framework. Comparisons can be made while accommodating covariate effects and even between tests that have values on different scales, such as between a continuous biomarker test and an ordinal valued imaging test. The ordinal regression method provides slightly more precise parameter estimates from data in our simulated data models. CONCLUSION: . Although the ordinal regression method is slightly more efficient, the direct ROC modeling method has important advantages in regard to interpretation, and it offers a framework to address a broader range of scientific questions, including the facility to compare tests.

Item Type: Article
Additional Information: This article is available to subscribers only.
DOI: 10.1177/0272989X09357477
PubMed ID: 20147599
NIHMSID: NIHMS188363
PMCID: PMC2905510
Grant Numbers: R01 CA129934, R01 GM054438, U01CA63740, U01CA86076, U01CA86082, U01CA63736, U01CA70013, U01CA69976, U01CA63731, U01CA70040
Keywords or MeSH Headings: Diagnostic Imaging* Humans ROC Curve*
Subjects: Research Methodologies > Research design
Research Methodologies > Computational Biology > Modeling
Research Methodologies > Mathematics and statistics
Depositing User: Library Staff
Date Deposited: 16 Mar 2010 18:39
Last Modified: 14 Feb 2012 14:43
URI: http://authors.fhcrc.org/id/eprint/408

Repository Administrators Only

View Item View Item
Fred Hutchinson Cancer Research Center
1100 Fairview Ave. N. PO Box 19024
Seattle, WA 98109

a 501(c)(3) nonprofit organization.

© Terms of Use & Privacy Policy