Morris, Daryl E and Pepe, Margaret Sullivan and Barlow, William E (2010) Contrasting Two Frameworks for ROC Analysis of Ordinal Ratings. Medical decision making : an international journal of the Society for Medical Decision Making. ISSN 1552-681X
![[thumbnail of Complete manuscript]](http://authors.fhcrc.org/style/images/fileicons/text.png) |
Text (Complete manuscript)
MorrisMDMManuscript031610.pdf Restricted to Repository staff only Available under License Creative Commons Attribution Non-commercial No Derivatives. Download (289kB) |
Abstract
BACKGROUND: Statistical evaluation of medical imaging tests used for diagnostic and prognostic purposes often employs receiver operating characteristic (ROC) curves. Two methods for ROC analysis are popular. The ordinal regression method is the standard approach used when evaluating tests with ordinal values. The direct ROC modeling method is a more recently developed approach, motivated by applications to tests with continuous values. OBJECTIVE: . The authors compare the methods in terms of model formulations, interpretations of estimated parameters, the ranges of scientific questions that can be addressed with them, their computational algorithms, and the efficiencies with which they use data. RESULTS: . The authors show that a strong relationship exists between the methods by demonstrating that they fit the same models when only a single test is evaluated. The ordinal regression models are typically alternative parameterizations of the direct ROC models and vice versa. The direct method has two major advantages over the ordinal regression method: 1) estimated parameters relate directly to ROC curves, facilitating interpretations of covariate effects on ROC performance, and 2) comparisons between tests can be done directly in this framework. Comparisons can be made while accommodating covariate effects and even between tests that have values on different scales, such as between a continuous biomarker test and an ordinal valued imaging test. The ordinal regression method provides slightly more precise parameter estimates from data in our simulated data models. CONCLUSION: . Although the ordinal regression method is slightly more efficient, the direct ROC modeling method has important advantages in regard to interpretation, and it offers a framework to address a broader range of scientific questions, including the facility to compare tests.
| Item Type: | Article or Abstract |
|---|---|
| Additional Information: | This article is available to subscribers only. |
| DOI: | 10.1177/0272989X09357477 |
| PubMed ID: | 20147599 |
| NIHMSID: | NIHMS188363 |
| PMCID: | PMC2905510 |
| Grant Numbers: | R01 CA129934, R01 GM054438, U01CA63740, U01CA86076, U01CA86082, U01CA63736, U01CA70013, U01CA69976, U01CA63731, U01CA70040 |
| Keywords or MeSH Headings: | Diagnostic Imaging* Humans ROC Curve* |
| Subjects: | Research Methodologies > Research design Research Methodologies > Computational Biology > Modeling Research Methodologies > Mathematics and statistics |
| Depositing User: | Library Staff |
| Date Deposited: | 16 Mar 2010 18:39 |
| Last Modified: | 14 Feb 2012 14:43 |
| URI: | http://authors.fhcrc.org/id/eprint/408 |
Repository Administrators Only
 |
View Item |
