ROC & Related Programs To Analyze Observer Performance Data

More details about these programs are available once you follow the links. Some links allow you to directly download a program, while others take you to another site where the programs can be downloaded.  The programs are simply listed in alphabetical order.

MRMCaov (Brian Smith, PhD)

Package for multi-reader multi-case analysis of variance using R

https://github.com/brian-j-smith/mrmcaov

MRMCaov.m (Brian Smith, PhD)

Package for multi-reader multi-case analysis of variance using MATLAB

https://github.com/brian-j-smith/mrmcaov.m

CLABROC (Charles Metz, PhD et al.)
Calculates the maximum likelihood of the bivariate bi-normal model for potentially correlated continuous data.
http://xray.bsd.uchicago.edu/krl/index.htm

CORROC2 (Charles Metz, PhD et al.)
Calculates the maximum likelihood of the bivariate bi-normal model for potentially correlated data.
http://xray.bsd.uchicago.edu/krl/index.htm

INDROC (Charles Metz, PhD et al.)
Maximum likelihood estimation for bivariate bi-normal model uncorrelated ordinal data.
http://xray.bsd.uchicago.edu/krl/index.htm

FROC (Dev Chakraborty, PhD)
Jackknifed AFROC program & supporting documents
http://www.devchakraborty.com

LABMRMC (Charles Metz, PhD et al.)
Designed for ROC analysis with multiple readers and treatments. Uses an ANOVA to test for significant differences.
http://xray.bsd.uchicago.edu/krl/index.htm

LABROC1 (Charles Metz, PhD et al.)
Fits the bi-normal ROC to continuous data using maximum likelihood estimation.
http://xray.bsd.uchicago.edu/krl/index.htm

LROC (Richard Swensson, PhD)
Allows you to take target location into account in the ROC data collection and analysis. You need to download & unzip both files here.
lroczip.zip
cygwinb19zip.dll

http://sites.google.com/a/philipfjudy.com/www/Home/lroc-software

MRMC (Donald Dorfman, PhD; Kevin Berbaum, PhD; Charles Metz, PhD)
Designed for ROC analysis with multiple readers and multiple cases. Uses an ANOVA to test for significant differences in treatments, readers and cases.
http://perception.radiology.uiowa.edu

One-Shot MRMC (Matthew A. Kupinski, PhD; Brandon D. Gallas, PhD)

Non-parametric U-statistic approach for variance estimation of reader-averaged AUC from MRMC experiment

http://www.radiology.arizona.edu/CGRI/IQ/page2/page7/page7.html

OR/DBM MRMC Software for SAS (Steve Hillis, Kevin Schartz, Kevin Berbaum)

Fits the Obuchowski-Rockette (OR) & Dorfman-Berbaum-Metz (DBM) procedures to multireader multicase ROC data using SAS

perception.radiology.uiowa.edu

PlotROC.xls (Charles Metz, PhD et al.)
Takes the a and b parameters of an ROC analysis and plots the ROC curve.
http://xray.bsd.uchicago.edu/krl/index.htm

ROCFIT (Charles Metz, PhD et al.)
Fits the bi-normal ROC to ordinal category data using maximum likelihood estimation.
http://xray.bsd.uchicago.edu/krl/index.htm

ROCKIT (Charles Metz, PhD et al.)
Allows for a comparison of partially paired datasets.
http://xray.bsd.uchicago.edu/krl/index.htm

ROCPWRPC (Charles Metz, PhD et al.)
Computes the statistical power of a test given a, b and the correlation parameter output from CLABROC or CORROC2.
http://xray.bsd.uchicago.edu/krl/index.htm

RSCORE (Donald Dorfman, PhD; Kevin Berbaum, PhD; Hatem Abu-Dagga, MS; Kevin Schartz, PhD)
Computes maximum-likelihood estimates of parameters of the bi-normal model.
http://perception.radiology.uiowa.edu

For anyone moving to Windows 7 you may find that some of the older ROC programs do not run anymore (32 vs 64 bit issue and changes in Microsoft in 7).

There is an easy fix however to run them in a "virtual" DOS environment. Go to http://www.dosbox.com/ and download DOSBox.

 

Return to MIPS home page