The inappropriate use of statistics

Tony C. Badrick, Robert J. Flatman

Research output: Contribution to journalReview articleResearchpeer-review

Abstract

The proliferation of powerful statistical software for personal computers has seen a similar growth in the number of statistical techniques employed in the medical literature. Here we review common problems in the application of these techniques. Basic statistical terminology and techniques are briefly reviewed. Errors in the design and conduct of scientific trials can be grouped into four broad areas: 1. Experimental design and conduct of the trial; 2. Analysis of the data; 3. Interpretation of results, and 4. Presentation of the results. Common problems in trial design and conduct are examined in terms of appropriate sample and control selection (including sample size), collection of data and retrospective study designs. Numerous common analytical errors are presented with more appropriate alternatives. Common errors in the interpretation of statistical results include confusion between clinical and statistical significance, incorrect application of P values, and the belief that statistically significant association provides direct evidence of a causal relationship between the variables concerned. Finally, common data presentation errors and some special problems of interest to clinical scientists are examined (reference intervals and method comparisons). We conclude that the increasing availability of powerful statistical methods is not matched by an equivalent level of understanding in their appropriate application. These increasingly prevalent errors can mislead other investigators, lead to inferior or delayed patient treatments, and perpetuate similar errors in the literature.

LanguageEnglish
Pages95-103
Number of pages9
JournalNew Zealand Journal of Medical Laboratory Science
Volume53
Issue number3
Publication statusPublished - 1999

Fingerprint

Statistics
Microcomputers
Terminology
Sample Size
Research Design
Software
Retrospective Studies
Research Personnel
Growth
Patient treatment
Personal computers
Design of experiments
Statistical methods
Therapeutics
Availability

Keywords

  • Inappropriate statistics
  • Method comparison
  • Reference interval
  • Statistical errors

Cite this

Badrick, T. C., & Flatman, R. J. (1999). The inappropriate use of statistics. New Zealand Journal of Medical Laboratory Science, 53(3), 95-103.
Badrick, Tony C. ; Flatman, Robert J. . / The inappropriate use of statistics. In: New Zealand Journal of Medical Laboratory Science. 1999 ; Vol. 53, No. 3. pp. 95-103.
@article{fd11f774c5ab43eeae9596b30bd6f63a,
title = "The inappropriate use of statistics",
abstract = "The proliferation of powerful statistical software for personal computers has seen a similar growth in the number of statistical techniques employed in the medical literature. Here we review common problems in the application of these techniques. Basic statistical terminology and techniques are briefly reviewed. Errors in the design and conduct of scientific trials can be grouped into four broad areas: 1. Experimental design and conduct of the trial; 2. Analysis of the data; 3. Interpretation of results, and 4. Presentation of the results. Common problems in trial design and conduct are examined in terms of appropriate sample and control selection (including sample size), collection of data and retrospective study designs. Numerous common analytical errors are presented with more appropriate alternatives. Common errors in the interpretation of statistical results include confusion between clinical and statistical significance, incorrect application of P values, and the belief that statistically significant association provides direct evidence of a causal relationship between the variables concerned. Finally, common data presentation errors and some special problems of interest to clinical scientists are examined (reference intervals and method comparisons). We conclude that the increasing availability of powerful statistical methods is not matched by an equivalent level of understanding in their appropriate application. These increasingly prevalent errors can mislead other investigators, lead to inferior or delayed patient treatments, and perpetuate similar errors in the literature.",
keywords = "Inappropriate statistics, Method comparison, Reference interval, Statistical errors",
author = "Badrick, {Tony C.} and Flatman, {Robert J.}",
year = "1999",
language = "English",
volume = "53",
pages = "95--103",
journal = "New Zealand Journal of Medical Laboratory Science",
issn = "1171-0195",
publisher = "New Zealand Institute of Medical Laboratory Science Inc.",
number = "3",

}

Badrick, TC & Flatman, RJ 1999, 'The inappropriate use of statistics', New Zealand Journal of Medical Laboratory Science, vol. 53, no. 3, pp. 95-103.

The inappropriate use of statistics. / Badrick, Tony C. ; Flatman, Robert J. .

In: New Zealand Journal of Medical Laboratory Science, Vol. 53, No. 3, 1999, p. 95-103.

Research output: Contribution to journalReview articleResearchpeer-review

TY - JOUR

T1 - The inappropriate use of statistics

AU - Badrick, Tony C.

AU - Flatman, Robert J.

PY - 1999

Y1 - 1999

N2 - The proliferation of powerful statistical software for personal computers has seen a similar growth in the number of statistical techniques employed in the medical literature. Here we review common problems in the application of these techniques. Basic statistical terminology and techniques are briefly reviewed. Errors in the design and conduct of scientific trials can be grouped into four broad areas: 1. Experimental design and conduct of the trial; 2. Analysis of the data; 3. Interpretation of results, and 4. Presentation of the results. Common problems in trial design and conduct are examined in terms of appropriate sample and control selection (including sample size), collection of data and retrospective study designs. Numerous common analytical errors are presented with more appropriate alternatives. Common errors in the interpretation of statistical results include confusion between clinical and statistical significance, incorrect application of P values, and the belief that statistically significant association provides direct evidence of a causal relationship between the variables concerned. Finally, common data presentation errors and some special problems of interest to clinical scientists are examined (reference intervals and method comparisons). We conclude that the increasing availability of powerful statistical methods is not matched by an equivalent level of understanding in their appropriate application. These increasingly prevalent errors can mislead other investigators, lead to inferior or delayed patient treatments, and perpetuate similar errors in the literature.

AB - The proliferation of powerful statistical software for personal computers has seen a similar growth in the number of statistical techniques employed in the medical literature. Here we review common problems in the application of these techniques. Basic statistical terminology and techniques are briefly reviewed. Errors in the design and conduct of scientific trials can be grouped into four broad areas: 1. Experimental design and conduct of the trial; 2. Analysis of the data; 3. Interpretation of results, and 4. Presentation of the results. Common problems in trial design and conduct are examined in terms of appropriate sample and control selection (including sample size), collection of data and retrospective study designs. Numerous common analytical errors are presented with more appropriate alternatives. Common errors in the interpretation of statistical results include confusion between clinical and statistical significance, incorrect application of P values, and the belief that statistically significant association provides direct evidence of a causal relationship between the variables concerned. Finally, common data presentation errors and some special problems of interest to clinical scientists are examined (reference intervals and method comparisons). We conclude that the increasing availability of powerful statistical methods is not matched by an equivalent level of understanding in their appropriate application. These increasingly prevalent errors can mislead other investigators, lead to inferior or delayed patient treatments, and perpetuate similar errors in the literature.

KW - Inappropriate statistics

KW - Method comparison

KW - Reference interval

KW - Statistical errors

UR - http://www.scopus.com/inward/record.url?scp=0033283250&partnerID=8YFLogxK

M3 - Review article

VL - 53

SP - 95

EP - 103

JO - New Zealand Journal of Medical Laboratory Science

T2 - New Zealand Journal of Medical Laboratory Science

JF - New Zealand Journal of Medical Laboratory Science

SN - 1171-0195

IS - 3

ER -