manipulating the alpha level cannot cure significance testing

manipulating the alpha level cannot cure significance testing

;David Trafimow;Valentin Amrhein;Valentin Amrhein;Corson N. Areshenkoff;Carlos J. Barrera-Causil;Eric J. Beh;Yusuf K. Bilgiç;Roser Bono;Roser Bono;Michael T. Bradley;William M. Briggs;Héctor A. Cepeda-Freyre;Sergio E. Chaigneau;Daniel R. Ciocca;Juan C. Correa;Denis Cousineau;Michiel R. de Boer;Subhra S. Dhar;Igor Dolgov;Juana Gómez-Benito;Juana Gómez-Benito;Marian Grendar;Marian Grendar;James W. Grice;Martin E. Guerrero-Gimenez;Andrés Gutiérrez;Tania B. Huedo-Medina;Klaus Jaffe;Armina Janyan;Armina Janyan;Ali Karimnezhad;Fränzi Korner-Nievergelt;Fränzi Korner-Nievergelt;Koji Kosugi;Martin Lachmair;Rubén D. Ledesma;Rubén D. Ledesma;Roberto Limongi;Roberto Limongi;Marco T. Liuzza;Rosaria Lombardo;Michael J. Marks;Gunther Meinlschmidt;Gunther Meinlschmidt;Gunther Meinlschmidt;Ladislas Nalborczyk;Ladislas Nalborczyk;Hung T. Nguyen;Raydonal Ospina;Jose D. Perezgonzalez;Roland Pfister;Juan J. Rahona;David A. Rodríguez-Medina;Xavier Romão;Susana Ruiz-Fernández;Susana Ruiz-Fernández;Susana Ruiz-Fernández;Isabel Suarez;Marion Tegethoff;Mauricio Tejo;Rens van de Schoot;Rens van de Schoot;Ivan I. Vankov;Santiago Velasco-Forero;Tonghui Wang;Yuki Yamada;Felipe C. M. Zoppino;Fernando Marmolejo-Ramos
accounts of chemical research 2018 Vol. 9 pp. -
95
trafimow2018frontiersmanipulating

Abstract

We argue that making accept/reject decisions on scientific hypotheses, including a recent call for changing the canonical alpha level from p = 0.05 to p = 0.005, is deleterious for the finding of new discoveries and the progress of science. Given that blanket and variable alpha levels both are problematic, it is sensible to dispense with significance testing altogether. There are alternatives that address study design and sample size much more directly than significance testing does; but none of the statistical tools should be taken as the new magic method giving clear-cut mechanical answers. Inference should not be based on single studies at all, but on cumulative evidence from multiple independent studies. When evaluating the strength of the evidence, we should consider, for example, auxiliary assumptions, the strength of the experimental design, and implications for applications. To boil all this down to a binary decision based on a p-value threshold of 0.05, 0.01, 0.005, or anything else, is not acceptable.

Keywords

Citation

ID: 146105
Ref Key: trafimow2018frontiersmanipulating
Use this key to autocite in SciMatic or Thesis Manager

References

Blockchain Verification

Account:
NFT Contract Address:
0x95644003c57E6F55A65596E3D9Eac6813e3566dA
Article ID:
146105
Unique Identifier:
10.3389/fpsyg.2018.00699
Network:
Scimatic Chain (ID: 481)
Loading...
Blockchain Readiness Checklist
Authors
Abstract
Journal Name
Year
Title
5/5
Creates 1,000,000 NFT tokens for this article
Token Features:
  • ERC-1155 Standard NFT
  • 1 Million Supply per Article
  • Transferable via MetaMask
  • Permanent Blockchain Record
Blockchain QR Code
Scan with Saymatik Web3.0 Wallet

Saymatik Web3.0 Wallet