The area above the ordinal dominance graph and the area below the receiver operating characteristic graph

https://doi.org/10.1016/0022-2496(75)90001-2Get rights and content

Abstract

Receiver operating characteristic graphs are shown to be a variant form of ordinal dominance graphs. The area above the latter graph and the area below the former graph are useful measures of both the size or importance of a difference between two populations and/or the accuracy of discrimination performance. The usual estimator for this area is closely related to the Mann-Whitney U statistic. Statistical literature on this area estimator is reviewed. For large sample sizes, the area estimator is approximately normally distributed. Formulas for the variance and the maximum variance of the area estimator are given. Several different methods of constructing confidence intervals for the area measure are presented and the strengths and weaknesses of each of these methods are discussed. Finally, the Appendix presents the derivation of a new mathematical result, the maximum variance of the area estimator over convex ordinal dominance graphs.

References (21)

  • M.M Taylor

    Detectability theory and the interpretation of vigilance data

  • S.S Wilks

    Mathematical statistics

    (1962)
  • Z.W Birnbaum

    On a use of the Mann-Whitney statistic

  • Z.W Birnbaum et al.

    Bounds for the variance of the Mann-Whitney statistic

    Annals of Mathematical Statistics

    (1957)
  • Z.W Birnbaum et al.

    A distribution-free upper confidence bound for Pr{Y < X}, based on independent samples of X and Y

    Annals of Mathematical Statistics

    (1958)
  • H Cramér

    Mathematical methods of statistics

    (1946)
  • R.B Darlington

    Comparing two groups by simple graphs

    Psychological Bulletin

    (1973)
  • Z Govindarajulu

    Distribution-free confidence bounds for P(X < Y)

    Annals of the Institute of Statistical Mathematics

    (1968)
  • D.M Green

    General prediction relating yes-no and forced-choice results

    Journal of the Acoustical Society of America

    (1964)
  • D.M Green et al.

    On the equivalence of two recognition measures of short-term memory

    Psychological Bulletin

    (1966)
There are more references available in the full text version of this article.

Cited by (1128)

  • On the bias in the AUC variance estimate

    2024, Pattern Recognition Letters
  • A novel estimator for the two-way partial AUC

    2024, BMC Medical Informatics and Decision Making
View all citing articles on Scopus
View full text