© 1996 by Biometrika Trust
A distribution-free procedure for comparing receiver operating characteristic curves from a paired experiment
Department of Epidemiology and Biostatistics, Memorial Sloan-Kettering Cancer Center 1275 York Avenue, New York, New York 10021, U.S.A.
A distribution-free permutation test procedure is proposed for comparing receiver operating characteristic curves based on continuous data from a paired design. The method tests the hypothesis that the two curves are identical for all operating points, unlike previously proposed methods which test the equivalence of the areas under the curves. The new test is shown by simulation to have very similar operating characteristics to the standard method based on comparisons of the areas when the curves are parallel, but markedly superior power when the curves cross, that is when the curves are different but have similar areas. The prospects of generalising the approach to unpaired experiments and to comparisons of ordinal rating data are discussed.
Key Words: Diagnostic test Exchangeability Paired samples, Permutation test Receiver operating characteristic curve
![]()
CiteULike
Connotea
Del.icio.us What's this?
This article has been cited by other articles:
![]() |
Y. Huang and M. S. Pepe Biomarker evaluation and comparison using the controls as a reference population Biostat., August 28, 2008; (2008) kxn029v1. [Abstract] [Full Text] [PDF] |
||||
![]() |
T. M. Braun and T. A. Alonzo A modified sign test for comparing paired ROC curves Biostat., April 1, 2008; 9(2): 364 - 372. [Abstract] [Full Text] [PDF] |
||||
![]() |
G. P. Fadini, S. V. de Kreutzenberg, A. Coracina, I. Baesso, C. Agostini, A. Tiengo, and A. Avogaro Circulating CD34+ cells, metabolic syndrome, and cardiovascular risk Eur. Heart J., September 2, 2006; 27(18): 2247 - 2255. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. Xiong, D. W. McKeel Jr, J. P. Miller, and J. C. Morris Combining Correlated Diagnostic Tests: Application to Neuropathologic Diagnosis of Alzheimer's Disease Med Decis Making, November 1, 2004; 24(6): 659 - 669. [Abstract] [PDF] |
||||
![]() |
C. Stephan, S. Wesseling, T. Schink, and K. Jung Comparison of Eight Computer Programs for Receiver-Operating Characteristic Analysis Clin. Chem., March 1, 2003; 49(3): 433 - 439. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. E Shapiro The interpretation of diagnostic tests Statistical Methods in Medical Research, April 1, 1999; 8(2): 113 - 134. [Abstract] [PDF] |
||||




