Confusion Over Measures of Evidence (<i>p</i>'s) Versus Errors (<i>α</i>'s) in Classical Statistical Testing

Raymond Hubbard, M. J. Bayarri

Type: Article

Publication Date: 2003-08-01

Citations: 282

DOI: https://doi.org/10.1198/0003130031856

View

Locations

The American Statistician - View

Similar Works

Action	Title	Year	Authors
+	Recurring controversies about<i>P</i>values and confidence intervals revisited	2014	Aris Spanos
+ PDF Chat	Statistical Significance,<i>p</i>-Values, and the Reporting of Uncertainty	2021	Guido W. Imbens
+ PDF Chat	Three Recommendations for Improving the Use of <i>p</i>-Values	2019	Daniel J. Benjamin James O. Berger
+	Two-Tailed <i>p</i>-Values and Coherent Measures of Evidence	2018	Peter H. Peskun
+	P Values are not Error Probabilities	2003	Raymond Hubbard
+ PDF Chat	<i>P</i> in the right place: Revisiting the evidential value of <i>P</i>‐values	2018	Per Lytsy
+	A critical evaluation of the current “<i>p</i>‐value controversy”	2017	Stefan Wellek
+ PDF Chat	Connecting simple and precise <i>P</i>‐values to complex and ambiguous realities (includes rejoinder to comments on “Divergence vs. decision <i>P‐</i>values”)	2023	Sander Greenland
+ PDF Chat	Valid <i>P</i>-Values Behave Exactly as They Should: Some Misleading Criticisms of <i>P</i>-Values and Their Resolution With <i>S</i>-Values	2019	Sander Greenland
+	On the Use of <i>P</i> Values in Clinical Research	2018	Ross Garberich Larissa Stanberry
+ PDF Chat	Bad statistical practice in pharmacology (and other basic biomedical disciplines): you probably don't know P	2012	Michael J. Lew
+ PDF Chat	The evidence contained in the P-value is context dependent	2022	Florian Härtig Frédéric Barraquand
+	The false evidence rate: An approach to frequentist error rate control conditioning on the observed <i>P</i> value	2025	D. Crouch
+ PDF Chat	A Test by Any Other Name:<i>P</i>Values, Bayes Factors, and Statistical Inference	2016	Hal S. Stern
+ PDF Chat	When to <i>p</i> and when not to <i>p</i>	2023	Shrikant I. Bangdiwala
+ PDF Chat	Simple methods for estimating confidence levels, or tentative probabilities, for hypotheses instead of <i>p</i> values	2019	Michael Wood
+ PDF Chat	Interpretation of and alternatives to p-values in biomedical sciences	2022	A M Grjibovski Anton N. Gvozdeckii
+ PDF Chat	Statistical tests, P values, confidence intervals, and power: a guide to misinterpretations	2016	Sander Greenland Stephen Senn Kenneth J. Rothman John B. Carlin Charles Poole Steven N. Goodman Douglas G. Altman
+	To <i>p</i> or not to <i>p</i>: the use of <i>p</i>-values in analytical science	2020	Analytical Methods Committee AMCTB No.
+ PDF Chat	P-values – a chronic conundrum	2020	Jian Gao

Cited by (138)

Action	Title	Year	Authors
+	Adjusting for Publication Bias in JASP and R: Selection Models, PET-PEESE, and Robust Bayesian Meta-Analysis	2022	František Bartoš Maximilian Maier Daniel Quintana Eric‐Jan Wagenmakers
+ PDF Chat	When null hypothesis significance testing is unsuitable for research: a reassessment	2016	Dénes Szücs John P. A. Ioannidis
+ PDF Chat	A practical solution to the pervasive problems ofp values	2007	Eric‐Jan Wagenmakers
+ PDF Chat	Statistical power of a test – an analysis of a test’s power, its role in the research methodology and the interpretation of (non-)significance in a low- (high-) powered test	2021	Lilianna Jarmakowska-Kostrzanowska
+	To P or not to P: on the evidential nature of P-values and their place in scientific inference	2013	Michael J. Lew
+ PDF Chat	Istotnie statystyczna moc testu – analiza mocy i jej miejsce w przyborniku badacza oraz interpretacja (nie)istotności statystycznej przy małej (dużej) mocy testu	2021	Lilianna Jarmakowska-Kostrzanowska
+	A farewell to P-values?	2004	John L. Moran P. J. Solomon
+	Understanding Business Statistics	2007	Jeffrey C. Sklar
+	Statistics in review Part I: graphics, data summary and linear models	2007	John L. Moran P. J. Solomon
+	Letters to the Editor	2005	Raymond Hubbard M. J. Bayarri
+ PDF Chat	Individual Differences in Learning with Simulation Tool: A Pilot Study	2008	Tzu‐Chien Liu Yi-Chun Lin Kinshuk Kinshuk Maiga Chang
+ PDF Chat	What type of Type I error? Contrasting the Neyman–Pearson and Fisherian approaches in the context of exact and direct replications	2019	Mark Rubin
+ PDF Chat	Null hypothesis significance testing: a short tutorial	2016	Cyril Pernet
+	Pragmatic and Error Statistical Bayesians	2018	Deborah G. Mayo
+	Reverse-Bayes analysis of two common misinterpretations of significance tests	2013	Leonhard Held
+	On stochastic orderings of the Wilcoxon Rank Sum test statistic—With applications to reproducibility probability estimation testing	2011	Lucio De Capitani Daniele De Martini
+	Bayes estimates as an approximation to maximum likelihood estimates	2015	Kohji Yamamura
+	THEORETICAL AND REVIEW A RTICLES A practical solution to the pervasive problems of p values	2007	Eric-Jan W Agenmakers
+ PDF Chat	Comparison of Some Methods of Testing Statistical Hypotheses: (Part I. Parallel Methods)	2014	K. J. Kachiashvili
+ PDF Chat	Popularity leads to bad habits: Alternatives to “the statistics” routine of significance, “alphabet soup” and dynamite plots	2021	R.C. Butler
+	Bayesian Modeling	2011	Peter L. Bonate
+ PDF Chat	Cardiovascular effects of sodium‐glucose co‐transporter‐2 inhibitors and glucagon‐like peptide‐1 receptor agonists: The <i>P</i> value and beyond	2021	David E. Kloecker Melanie J. Davies Kamlesh Khunti Francesco Zaccardi
+ PDF Chat	Adaptations on the Use of p-Values for Statistical Inference: An Interpretation of Messages from Recent Public Discussions	2023	Eleni Verykouki Christos T. Nakas
+	Understanding the Role of <i>P</i> Values and Hypothesis Tests in Clinical Research	2016	Daniel B. Mark Kerry L. Lee Frank E. Harrell
+	REFERENCES	2016	Prakash Gorroochurn
+ PDF Chat	References	2018	Marc S. Paolella
+	A Decision-Theoretic Formulation of Fisher’s Approach to Testing	2010	Kenneth Rice
+ PDF Chat	Three-Decision Methods: A Sensible Formulation of Significance Tests—and Much Else	2022	Kenneth Rice Chloe Krakauer
+ PDF Chat	Experiences with Using Bayes Factors for Regression Analysis in Biostatistical Setting	2017	Tamás Ferenci Levente Kovács
+	Bootstrap Cross-Validation Improves Model Selection in Pharmacometrics	2020	James S. Cavenaugh
+ PDF Chat	Inferência informal e inferência “informal”<br>Informal and “Informal” Inference	2019	Manfred Borovcnik
+	The epistemology of mathematical and statistical modeling: A quiet methodological revolution.	2010	Joseph Lee Rodgers
+	PERSPECTIVE—Researchers Should Make Thoughtful Assessments Instead of Null-Hypothesis Significance Tests	2010	Andreas Schwab Eric Abrahamson William H. Starbuck Fiona Fidler
+ PDF Chat	Concise, Simple, and Not Wrong: In Search of a Short-Hand Interpretation of Statistical Significance	2018	Jeffrey S. Spence David Stanley
+	The researcher and the consultant: a dialogue on null hypothesis significance testing	2013	Andreas Stang Charles Poole
+ PDF Chat	Reproducibility Probability Estimation and RP-Testing for Some Nonparametric Tests	2016	Lucio De Capitani Daniele De Martini
+	Issues and pitfalls in the use of p-values	2020	Michel Jacques Counotte Shannon Axiak Flammer Sonja Hartnack
+ PDF Chat	<b>BFpack</b>: Flexible Bayes Factor Testing of Scientific Theories in <i>R</i>	2021	Joris Mulder Donald R. Williams Xin Gu Andrew J. Tomarken Florian Böing-Messing Anton Olsson-Collentine Marlyne Meijerink-Bosman Janosch Menke Robbie Van Aert Jean‐Paul Fox
+	A note on multiple testing for composite null hypotheses	2009	Stefano Cabras
+ PDF Chat	Divergence versus decision<i>P</i>‐values: A distinction worth making in theory and keeping in practice: Or, how divergence<i>P</i>‐values measure evidence even when decision<i>P</i>‐values do not	2022	Sander Greenland

Citing (20)

Action	Title	Year	Authors
+ PDF Chat	Objective Bayesian Methods for Model Selection: Introduction and Comparison	2001	James O. Berger Luis R. Pericchi
+ PDF Chat	The Behavior of the P-Value When the Alternative Hypothesis is True	1997	Hung Hung Robert T. O’Neill Péter Bauer Karl Kohne
+	Testing a Point Null Hypothesis: The Irreconcilability of<i>P</i>Values and Evidence	1987	James O. Berger Thomas Sellke
+	The problem of inductive inference	1955	Jerzy Neyman
+ PDF Chat	Some Thoughts on Statistical Inference	1962	E. S. Pearson
+ PDF Chat	R. A. Fisher: The Founder of Modern Statistics	1992	C. Radhakrishna Rao
+ PDF Chat	Could Fisher, Jeffreys and Neyman Have Agreed on Testing?	2003	James O. Berger
+	A Note on Information Seldom Reported via the<i>P</i>Value	1999	Rafe Donahue
+	A First Course in Probability.	1984	Malcolm J. Sherman Sheldon M. Ross
+	<i>P</i>Values for Composite Null Models	2000	M. J. Bayarri James O. Berger
+ PDF Chat	Mathematical Statistics and Data Analysis	1989	Larry Rabinowitz John A. Rice
+ PDF Chat	Testing Precise Hypotheses	1987	James O. Berger Mohan Delampady
+	Calibration of<i>ρ</i>Values for Testing Precise Null Hypotheses	2001	Thomas Sellke M. J. Bayarri James O. Berger
+	A comment on replication, <i>P</i>‐values and evidence	1992	Steven N. Goodman
+	Toward Evidence-Based Medical Statistics. 1: The P Value Fallacy	1999	Steven N. Goodman
+	p Values, Hypothesis Tests, and Likelihood: Implications for Epidemiology of a Neglected Historical Debate	1993	Steven N. Goodman
+	IX. On the problem of the most efficient tests of statistical hypotheses	1933	Jerzy Neyman Egon S. Pearson
+	The Fisher, Neyman-Pearson Theories of Testing Hypotheses: One Theory or Two?	1993	E. L. Lehmann
+ PDF Chat	Reconciling Bayesian and Frequentist Evidence in the One-Sided Testing Problem	1987	George Casella Roger L. Berger
+	P Values for Composite Null Models	2000	M. J. Bayarri James O. Berger