Estimating misclassification error with small samples via bootstrap cross-validation

Type: Article

Publication Date: 2005-02-02

Citations: 127

DOI: https://doi.org/10.1093/bioinformatics/bti294

Abstract

Motivation: Estimation of misclassification error has received increasing attention in clinical diagnosis and bioinformatics studies, especially in small sample studies with microarray data. Current error estimation methods are not satisfactory because they either have large variability (such as leave-one-out cross-validation) or large bias (such as resubstitution and leave-one-out bootstrap). While small sample size remains one of the key features of costly clinical investigations or of microarray studies that have limited resources in funding, time and tissue materials, accurate and easy-to-implement error estimation methods for small samples are desirable and will be beneficial.

Locations

  • CiteSeer X (The Pennsylvania State University) - View - PDF
  • PubMed - View
  • Bioinformatics - View - PDF

Similar Works

Action Title Year Authors
+ PDF Chat Estimating misclassification error: a closer look at cross-validation based methods 2012 Songthip Ounpraseuth
Shelly Lensing
Horace J. Spencer
Ralph L. Kodell
+ PDF Chat Cross-validation and bootstrapping are unreliable in small sample classification 2008 Anders Isaksson
Mikael Wallman
H. Göransson
Mats G. Gustafsson
+ PDF Chat Prediction error estimation: a comparison of resampling methods 2005 Annette M. Molinaro
Richard Simon
Ruth M. Pfeiffer
+ PDF Chat Small-Sample Error Estimation for Bagged Classification Rules 2010 T. T. Vu
Ulisses Braga-Neto
+ PDF Chat Joint use of over- and under-sampling techniques and cross-validation for the development and assessment of prediction models 2015 Rok Blagus
Lara Lusa
+ PDF Chat Comparison of Resampling Methods for Bias-Reduced Estimation of Prediction Error: A Simulation Study Based on Real Datasets from Biomarker Discovery Studies 2017 Keiji Kakumoto
Yoshiyuki Tochizawa
+ Sampling uncertainty versus method uncertainty: A general framework with applications to omics biomarker selection 2019 Simon Klau
Marie‐Laure Martin‐Magniette
Anne‐Laure Boulesteix
Sabine Hoffmann
+ PDF Chat Validation in prediction research: the waste by data splitting 2018 Ewout W. Steyerberg
+ Review of Fundamental Statistical Concepts 2010 Francisco Azuaje
+ Correcting the Optimal Resampling‐Based Error Rate by Estimating the Error Rate of Wrapper Algorithms 2013 Christoph Bernau
Thomas Augustin
Anne‐Laure Boulesteix
+ PDF Chat Batch Effect Confounding Leads to Strong Bias in Performance Estimates Obtained by Cross-Validation 2014 Charlotte Soneson
Sarah Gerster
Mauro Delorenzi
+ PDF Chat Sources of variation in false discovery rate estimation include sample size, correlation, and inherent differences between groups 2012 Jiexin Zhang
Kevin R. Coombes
+ PDF Chat Partial Verification Bias Correction Using Inverse Probability Bootstrap Sampling for Binary Diagnostic Tests 2022 Wan Nor Arifin
Umi Kalsom Yusof
+ Bootstrapping the Out-of-sample Predictions for Efficient and Accurate Cross-Validation 2017 Ioannis Tsamardinos
Elissavet Greasidou
Michalis Tsagris
Giorgos Borboudakis
+ Bootstrapping the Out-of-sample Predictions for Efficient and Accurate Cross-Validation 2017 Ioannis Tsamardinos
Elissavet Greasidou
Michalis Tsagris
Giorgos Borboudakis
+ Sample size calculations for evaluating a diagnostic test when the gold standard is missing at random 2011 Andrzej S. Kosinski
Ying Chen
Robert H. Lyles
+ PDF Chat Detecting biased validation of predictive models in the positive-unlabeled setting: disease gene prioritization case study 2023 Ivan Molotkov
Mykyta Artomov
+ Control of Type I Error Rates for Oncology Biomarker Discovery with High‐Throughput Platforms 2013 Jeffrey C. Miecznikowski
Dan Wang
Song Liu
+ The effect of misclassification on sample size for one and two-sample tests with binary endpoints 2024 Péter Hársfalvi
Jenő Reiczigel
+ Addressing the challenges of uncertainty in regression models for high dimensional and heterogeneous data from observational studies 2020 Simon Klau