A general model for finite-sample effects in training and testing of competing classifiers

Sergey V. Beiden, Marcus A. Maloof, Robert F. Wagner

Type: Article

Publication Date: 2003-12-01

Citations: 31

DOI: https://doi.org/10.1109/tpami.2003.1251149

View Publication

Locations

IEEE Transactions on Pattern Analysis and Machine Intelligence - View

Similar Works

Action	Title	Year	Authors
+	<title>Finite-sample effects and resampling plans: applications to linear classifiers in computer-aided diagnosis</title>	1997	Robert F. Wagner Heang‐Ping Chan Berkman Sahiner Nicholas Petrick J.T. Mossoba
+	<title>Components of variance in ROC analysis of CADx classifier performance: II. Applications of the bootstrap</title>	1999	Robert F. Wagner Heang‐Ping Chan Berkman Sahiner Nicholas Petrick J.T. Mossoba
+	Comparison of Non-Parametric Methods for Assessing Classifier Performance in Terms of ROC Parameters	2005	Waleed A. Yousef Robert F. Wagner Murray H. Loew
+	Assessment of Multiple-Biomarker Classifiers: fundamental principles and a proposed strategy	2019	Waleed A. Yousef
+	Comparison of classifier performance estimators: a simulation study	2009	Weijie Chen Robert F. Wagner Waleed A. Yousef Brandon D. Gallas
+	Medidas de acuerdo bajo el modelo estructural multivariado	2022	Julio Cesar Ávila Albornoz
+	Testing the difference between two Kolmogorov–Smirnov values in the context of receiver operating characteristic curves	2010	W. J. Krzanowski David J. Hand
+	Fully non-parametric receiver operating characteristic curve estimation for random-effects meta-analysis	2014	Pablo Martínez‐Camblor
+ PDF Chat	Bootstrap-based procedures for inference in nonparametric receiver-operating characteristic curve regression analysis	2017	María Xosé Rodríguez‐Álvarez Javier Roca‐Pardiñas Carmén Cadarso-Suárez Pablo G. Tahoces
+	Distribution-free multivariate inference about diagnostic classifiers based on partial areas under their receiver operating characteristic curves	2021	Maximilian Wechsung Frank Konietschke
+ PDF Chat	Cross-validation and bootstrapping are unreliable in small sample classification	2008	Anders Isaksson Mikael Wallman H. Göransson Mats G. Gustafsson
+	Optimal ROC-Based Classification and Performance Analysis under Bayesian Uncertainty Models	2015	Lori A. Dalton
+ PDF Chat	Confidence interval estimation for quality factors of binary classifiers - ROC curves, AUC for small samples	2015	С.Ю. Гуськов В.В. Лёвин
+	The Statistical Evaluation of Medical Tests for Classification and Prediction	2003	Margaret S. Pepe
+ PDF Chat	A multiple testing framework for diagnostic accuracy studies with co‐primary endpoints	2022	Max Westphal Antonia Zapf Werner Brannath
+	<title>Effects of finite sample size and correlated/noisy input features on neural network pattern classification</title>	1994	David G. Brown Alexander C. Schneider Mary S. Pastel Robert F. Wagner
+	PRUEBAS DE NO LINEALIDAD: EL MÉTODO DE LOS DATOS SUSTITUTOS	2010	Diego L. Guarín Cristian Harry Padilla Rodríguez Álvaro A. Orozco
+	El problema de Behrens-Fisher en la investigación biomédica. Análisis crítico de un estudio clínico mediante simulación	1997	Esteban Vegas
+	Hierarchical multinomial processing tree models for meta-analysis of diagnostic accuracy studies	2023	Annamaria Guolo
+ PDF Chat	Hierarchical multinomial processing tree models for meta-analysis of diagnostic accuracy studies	2024	Annamaria Guolo

Works That Cite This (10)

Action	Title	Year	Authors
+	Estimating the uncertainty in the estimated mean area under the ROC curve of a classifier	2005	Waleed A. Yousef Robert F. Wagner Murray H. Loew
+	Comparison of Non-Parametric Methods for Assessing Classifier Performance in Terms of ROC Parameters	2005	Waleed A. Yousef Robert F. Wagner Murray H. Loew
+ PDF Chat	Estimation of Channelized Hotelling Observer Performance With Known Class Means or Known Difference of Class Means	2009	Adam Wunderlich Frédéric Noo
+	Classifier variability: Accounting for training and testing	2012	Wei-Jie Chen Brandon D. Gallas Waleed A. Yousef
+	Bayes Optimality in Linear Discriminant Analysis	2008	Onur C. Hamsici Aleix M. Martı́nez
+	Bayes Optimality in Linear	2008	Onur C. Hamsici Aleix M. Martı́nez
+	Assessing Classifiers from Two Independent Data Sets Using ROC Analysis: A Nonparametric Approach	2006	Waleed A. Yousef Robert F. Wagner Murray H. Loew
+ PDF Chat	Controlled physics-informed data generation for deep learning-based remaining useful life prediction under unseen operation conditions	2023	Jiawei Xiong Olga Fink Jian Zhou Yizhong Ma
+	Assessment of Multiple-Biomarker Classifiers: fundamental principles and a proposed strategy	2019	Waleed A. Yousef
+	TimeVAE: A Variational Auto-Encoder for Multivariate Time Series Generation.	2021	Abhyuday Desai Cynthia Freeman Zuhui Wang Ian Beaver

Works Cited by This (9)

Action	Title	Year	Authors
+	<title>Components of variance in ROC analysis of CADx classifier performance: II. Applications of the bootstrap</title>	1999	Robert F. Wagner Heang‐Ping Chan Berkman Sahiner Nicholas Petrick J.T. Mossoba
+	An Introduction to the Bootstrap	1994	Bradley Efron Robert Tibshirani
+	Small sample size effects in statistical pattern recognition: recommendations for practitioners	1991	Šarūnas Raudys Anil K. Jain
+	Components-of-variance models and multiple-bootstrap experiments: An alternative method for random-effects, receiver operating characteristic analysis	2000	Sergey V. Beiden Robert F. Wagner Gregory Campbell
+	Effects of sample size in classifier design	1989	Keinosuke Fukunaga R.R. Hayes
+	Estimating the Error Rate of a Prediction Rule: Improvement on Cross-Validation	1983	Bradley Efron
+	The Jackknife, the Bootstrap and Other Resampling Plans	1982	Bradley Efron
+	Improvements on Cross-Validation: The 632+ Bootstrap Method	1997	Bradley Efron Robert Tibshirani
+	Estimation of classifier performance	1989	Keinosuke Fukunaga R.R. Hayes