Justify your alpha

Daniel Lakens; Federico G. Adolfi; Casper J. Albers; Farid Anvari; Matthew A. J. Apps; Shlomo E. Argamon; Thom Baguley; Raymond B. Becker; Stephen D. Benning; Daniel E. Bradford; Erin M. Buchanan; Aaron R. Caldwell; Ben Van Calster; Rickard Carlsson; Sau Chin Chen; Bryan Chung; Lincoln J. Colling; Gary S. Collins; Zander Crook; Emily S. Cross; Sameera Daniels; Henrik Danielsson; Lisa Debruine; Daniel J. Dunleavy; Brian D. Earp; Michele I. Feist; Jason D. Ferrell; James G. Field; Nicholas W. Fox; Amanda Friesen; Caio Gomes; Monica Gonzalez-Marquez; James A. Grange; Andrew P. Grieve; Robert Guggenberger; James Grist; Anne Laura Van Harmelen; Fred Hasselman; Kevin D. Hochard; Mark R. Hoffarth; Nicholas P. Holmes; Michael Ingre; Peder M. Isager; Hanna K. Isotalus; Christer Johansson; Konrad Juszczyk; David A. Kenny; Ahmed A. Khalil; Barbara Konat; Junpeng Lao; Erik Gahner Larsen; Gerine M. A. Lodder; Jiří Lukavský; Christopher R. Madan; David Manheim; Stephen R. Martin; Andrea E. Martin; Deborah G. Mayo; Randy J. McCarthy; Kevin McConway; Colin McFarland; Amanda Q. X. Nio; Gustav Nilsonne; Cilene Lino De Oliveira; Jean-Jacques Orban de Xivry; Sam Parsons; Gerit Pfuhl; Kimberly A. Quinn; John J. Sakon; S. Adil Saribay; Iris K. Schneider; Manojkumar Selvaraju; Zsuzsika Sjoerds; Samuel G. Smith; Tim Smits; Jeffrey R. Spies; Vishnu Sreekumar; Crystal N. Steltenpohl; Neil Stenhouse; Wojciech Świątkowski; Miguel A. Vadillo; Marcel A. L. M. Van Assen; Matt N. Williams; Samantha E. Williams; Donald R. Williams; Tal Yarkoni; Ignazio Ziano; Rolf A. Zwaan

doi:10.1038/s41562-018-0311-x

Justify your alpha

Daniel Lakens, Federico G. Adolfi, Casper J. Albers, Farid Anvari, Matthew A. J. Apps, Shlomo E. Argamon, Thom Baguley, Raymond B. Becker, Stephen D. Benning, Daniel E. Bradford, Erin M. Buchanan, Aaron R. Caldwell, Ben Van Calster, Rickard Carlsson, Sau Chin Chen, Bryan Chung, Lincoln J. Colling, Gary S. Collins, Zander Crook, Emily S. CrossSameera Daniels, Henrik Danielsson, Lisa Debruine, Daniel J. Dunleavy, Brian D. Earp, Michele I. Feist, Jason D. Ferrell, James G. Field, Nicholas W. Fox, Amanda Friesen, Caio Gomes, Monica Gonzalez-Marquez, James A. Grange, Andrew P. Grieve, Robert Guggenberger, James Grist, Anne Laura Van Harmelen, Fred Hasselman, Kevin D. Hochard, Mark R. Hoffarth, Nicholas P. Holmes, Michael Ingre, Peder M. Isager, Hanna K. Isotalus, Christer Johansson, Konrad Juszczyk, David A. Kenny, Ahmed A. Khalil, Barbara Konat, Junpeng Lao, Erik Gahner Larsen, Gerine M. A. Lodder, Jiří Lukavský, Christopher R. Madan, David Manheim, Stephen R. Martin, Andrea E. Martin, Deborah G. Mayo, Randy J. McCarthy, Kevin McConway, Colin McFarland, Amanda Q. X. Nio, Gustav Nilsonne, Cilene Lino De Oliveira, Jean-Jacques Orban de Xivry, Sam Parsons, Gerit Pfuhl, Kimberly A. Quinn, John J. Sakon, S. Adil Saribay, Iris K. Schneider, Manojkumar Selvaraju, Zsuzsika Sjoerds, Samuel G. Smith, Tim Smits, Jeffrey R. Spies, Vishnu Sreekumar, Crystal N. Steltenpohl, Neil Stenhouse, Wojciech Świątkowski, Miguel A. Vadillo, Marcel A. L. M. Van Assen, Matt N. Williams, Samantha E. Williams, Donald R. Williams, Tal Yarkoni, Ignazio Ziano, Rolf A. Zwaan

Research output: Contribution to journal › Comment/opinion

342 Citations (Scopus)

Abstract

In response to recommendations to redefine statistical significance to P ≤ 0.005, we propose that researchers should transparently report and justify all choices they make when designing a study, including the alpha level.

Original language	English
Pages (from-to)	168-171
Number of pages	4
Journal	Nature Human Behaviour
Volume	2
Issue number	3
DOIs	https://doi.org/10.1038/s41562-018-0311-x
Publication status	Published - Mar 2018
Externally published	Yes

Access to Document

10.1038/s41562-018-0311-x

http://eprints.whiterose.ac.uk/128599/8/Justify%20Your%20Alpha.pdfLicence: Unspecified

Cite this

Lakens, D., Adolfi, F. G., Albers, C. J., Anvari, F., Apps, M. A. J., Argamon, S. E., Baguley, T., Becker, R. B., Benning, S. D., Bradford, D. E., Buchanan, E. M., Caldwell, A. R., Van Calster, B., Carlsson, R., Chen, S. C., Chung, B., Colling, L. J., Collins, G. S., Crook, Z., ... Zwaan, R. A. (2018). Justify your alpha. Nature Human Behaviour, 2(3), 168-171. https://doi.org/10.1038/s41562-018-0311-x

@article{e61b3d57a3f047e6a182f9b467676cc3,

title = "Justify your alpha",

abstract = "In response to recommendations to redefine statistical significance to P ≤ 0.005, we propose that researchers should transparently report and justify all choices they make when designing a study, including the alpha level.",

author = "Daniel Lakens and Adolfi, \{Federico G.\} and Albers, \{Casper J.\} and Farid Anvari and Apps, \{Matthew A. J.\} and Argamon, \{Shlomo E.\} and Thom Baguley and Becker, \{Raymond B.\} and Benning, \{Stephen D.\} and Bradford, \{Daniel E.\} and Buchanan, \{Erin M.\} and Caldwell, \{Aaron R.\} and \{Van Calster\}, Ben and Rickard Carlsson and Chen, \{Sau Chin\} and Bryan Chung and Colling, \{Lincoln J.\} and Collins, \{Gary S.\} and Zander Crook and Cross, \{Emily S.\} and Sameera Daniels and Henrik Danielsson and Lisa Debruine and Dunleavy, \{Daniel J.\} and Earp, \{Brian D.\} and Feist, \{Michele I.\} and Ferrell, \{Jason D.\} and Field, \{James G.\} and Fox, \{Nicholas W.\} and Amanda Friesen and Caio Gomes and Monica Gonzalez-Marquez and Grange, \{James A.\} and Grieve, \{Andrew P.\} and Robert Guggenberger and James Grist and \{Van Harmelen\}, \{Anne Laura\} and Fred Hasselman and Hochard, \{Kevin D.\} and Hoffarth, \{Mark R.\} and Holmes, \{Nicholas P.\} and Michael Ingre and Isager, \{Peder M.\} and Isotalus, \{Hanna K.\} and Christer Johansson and Konrad Juszczyk and Kenny, \{David A.\} and Khalil, \{Ahmed A.\} and Barbara Konat and Junpeng Lao and Larsen, \{Erik Gahner\} and Lodder, \{Gerine M. A.\} and Ji{\v r}{\'i} Lukavsk{\'y} and Madan, \{Christopher R.\} and David Manheim and Martin, \{Stephen R.\} and Martin, \{Andrea E.\} and Mayo, \{Deborah G.\} and McCarthy, \{Randy J.\} and Kevin McConway and Colin McFarland and Nio, \{Amanda Q. X.\} and Gustav Nilsonne and \{De Oliveira\}, \{Cilene Lino\} and \{de Xivry\}, \{Jean-Jacques Orban\} and Sam Parsons and Gerit Pfuhl and Quinn, \{Kimberly A.\} and Sakon, \{John J.\} and Saribay, \{S. Adil\} and Schneider, \{Iris K.\} and Manojkumar Selvaraju and Zsuzsika Sjoerds and Smith, \{Samuel G.\} and Tim Smits and Spies, \{Jeffrey R.\} and Vishnu Sreekumar and Steltenpohl, \{Crystal N.\} and Neil Stenhouse and Wojciech {\'S}wi{\c a}tkowski and Vadillo, \{Miguel A.\} and \{Van Assen\}, \{Marcel A. L. M.\} and Williams, \{Matt N.\} and Williams, \{Samantha E.\} and Williams, \{Donald R.\} and Tal Yarkoni and Ignazio Ziano and Zwaan, \{Rolf A.\}",

year = "2018",

month = mar,

doi = "10.1038/s41562-018-0311-x",

language = "English",

volume = "2",

pages = "168--171",

journal = "Nature Human Behaviour",

issn = "2397-3374",

publisher = "Springer, Springer Nature",

number = "3",

}

Lakens, D, Adolfi, FG, Albers, CJ, Anvari, F, Apps, MAJ, Argamon, SE, Baguley, T, Becker, RB, Benning, SD, Bradford, DE, Buchanan, EM, Caldwell, AR, Van Calster, B, Carlsson, R, Chen, SC, Chung, B, Colling, LJ, Collins, GS, Crook, Z, Cross, ES, Daniels, S, Danielsson, H, Debruine, L, Dunleavy, DJ, Earp, BD, Feist, MI, Ferrell, JD, Field, JG, Fox, NW, Friesen, A, Gomes, C, Gonzalez-Marquez, M, Grange, JA, Grieve, AP, Guggenberger, R, Grist, J, Van Harmelen, AL, Hasselman, F, Hochard, KD, Hoffarth, MR, Holmes, NP, Ingre, M, Isager, PM, Isotalus, HK, Johansson, C, Juszczyk, K, Kenny, DA, Khalil, AA, Konat, B, Lao, J, Larsen, EG, Lodder, GMA, Lukavský, J, Madan, CR, Manheim, D, Martin, SR, Martin, AE, Mayo, DG, McCarthy, RJ, McConway, K, McFarland, C, Nio, AQX, Nilsonne, G, De Oliveira, CL, de Xivry, J-JO, Parsons, S, Pfuhl, G, Quinn, KA, Sakon, JJ, Saribay, SA, Schneider, IK, Selvaraju, M, Sjoerds, Z, Smith, SG, Smits, T, Spies, JR, Sreekumar, V, Steltenpohl, CN, Stenhouse, N, Świątkowski, W, Vadillo, MA, Van Assen, MALM, Williams, MN, Williams, SE, Williams, DR, Yarkoni, T, Ziano, I & Zwaan, RA 2018, 'Justify your alpha', Nature Human Behaviour, vol. 2, no. 3, pp. 168-171. https://doi.org/10.1038/s41562-018-0311-x

TY - JOUR

T1 - Justify your alpha

AU - Lakens, Daniel

AU - Adolfi, Federico G.

AU - Albers, Casper J.

AU - Anvari, Farid

AU - Apps, Matthew A. J.

AU - Argamon, Shlomo E.

AU - Baguley, Thom

AU - Becker, Raymond B.

AU - Benning, Stephen D.

AU - Bradford, Daniel E.

AU - Buchanan, Erin M.

AU - Caldwell, Aaron R.

AU - Van Calster, Ben

AU - Carlsson, Rickard

AU - Chen, Sau Chin

AU - Chung, Bryan

AU - Colling, Lincoln J.

AU - Collins, Gary S.

AU - Crook, Zander

AU - Cross, Emily S.

AU - Daniels, Sameera

AU - Danielsson, Henrik

AU - Debruine, Lisa

AU - Dunleavy, Daniel J.

AU - Earp, Brian D.

AU - Feist, Michele I.

AU - Ferrell, Jason D.

AU - Field, James G.

AU - Fox, Nicholas W.

AU - Friesen, Amanda

AU - Gomes, Caio

AU - Gonzalez-Marquez, Monica

AU - Grange, James A.

AU - Grieve, Andrew P.

AU - Guggenberger, Robert

AU - Grist, James

AU - Van Harmelen, Anne Laura

AU - Hasselman, Fred

AU - Hochard, Kevin D.

AU - Hoffarth, Mark R.

AU - Holmes, Nicholas P.

AU - Ingre, Michael

AU - Isager, Peder M.

AU - Isotalus, Hanna K.

AU - Johansson, Christer

AU - Juszczyk, Konrad

AU - Kenny, David A.

AU - Khalil, Ahmed A.

AU - Konat, Barbara

AU - Lao, Junpeng

AU - Larsen, Erik Gahner

AU - Lodder, Gerine M. A.

AU - Lukavský, Jiří

AU - Madan, Christopher R.

AU - Manheim, David

AU - Martin, Stephen R.

AU - Martin, Andrea E.

AU - Mayo, Deborah G.

AU - McCarthy, Randy J.

AU - McConway, Kevin

AU - McFarland, Colin

AU - Nio, Amanda Q. X.

AU - Nilsonne, Gustav

AU - De Oliveira, Cilene Lino

AU - de Xivry, Jean-Jacques Orban

AU - Parsons, Sam

AU - Pfuhl, Gerit

AU - Quinn, Kimberly A.

AU - Sakon, John J.

AU - Saribay, S. Adil

AU - Schneider, Iris K.

AU - Selvaraju, Manojkumar

AU - Sjoerds, Zsuzsika

AU - Smith, Samuel G.

AU - Smits, Tim

AU - Spies, Jeffrey R.

AU - Sreekumar, Vishnu

AU - Steltenpohl, Crystal N.

AU - Stenhouse, Neil

AU - Świątkowski, Wojciech

AU - Vadillo, Miguel A.

AU - Van Assen, Marcel A. L. M.

AU - Williams, Matt N.

AU - Williams, Samantha E.

AU - Williams, Donald R.

AU - Yarkoni, Tal

AU - Ziano, Ignazio

AU - Zwaan, Rolf A.

PY - 2018/3

Y1 - 2018/3

N2 - In response to recommendations to redefine statistical significance to P ≤ 0.005, we propose that researchers should transparently report and justify all choices they make when designing a study, including the alpha level.

AB - In response to recommendations to redefine statistical significance to P ≤ 0.005, we propose that researchers should transparently report and justify all choices they make when designing a study, including the alpha level.

UR - https://www.scopus.com/pages/publications/85042619182

U2 - 10.1038/s41562-018-0311-x

DO - 10.1038/s41562-018-0311-x

M3 - Comment/opinion

AN - SCOPUS:85042619182

SN - 2397-3374

VL - 2

SP - 168

EP - 171

JO - Nature Human Behaviour

JF - Nature Human Behaviour

IS - 3

ER -

Justify your alpha

Abstract

Access to Document

Other files and links

Cite this