Creating falseness-How to establish statistical evidence of the untrue
Language: 
English
Abstract: 

Null hypothesis significance testing is the typical statistical approach in search of the truthfulness of hypotheses. This method does not formally consider the prior credence in the hypothesis, which affects the chances of reaching correct conclusions. When scientifically implausible or empirically weakly supported hypotheses are tested, there is an increased risk that a positive finding in a test in fact is false positive. This article argues that when scientifically weakly supported hypotheses are tested repeatedly-such as when studying the clinical effects of homeopathy-the accumulation of false positive study findings will risk providing false evidence also in systematic reviews and meta-analyses. False positive findings are detrimental to science and society, as once published, they accumulate persistent untrue evidence, which risks giving rise to nonpurposive research programmes, policy changes, and promotion of ineffective treatments. The problems with false positive findings are discussed, and advice is given on how to minimize the problem. The standard of evidence of a hypothesis should depend not only on the results of statistical analyses but also on its a priori support. Positive findings from studies investigating hypotheses with poor theoretical and empirical foundations should be viewed as tentative until the results are replicated and/or the hypothesis gains more empirical evidence supporting it as likely to be true.

Author(s): 
Lytsy, Per
Item Type: 
Journal Article
Publication Title: 
Journal of Evaluation in Clinical Practice
Journal Abbreviation: 
J Eval Clin Pract
Publication Date: 
2017-10
Publication Year: 
2017
Pages: 
923-927
Volume: 
23
Issue: 
5
ISSN: 
1365-2753
DOI: 
10.1111/jep.12823
Library Catalog: 
PubMed
Extra: 
PMID: 28960726

Turabian/Chicago Citation

Per Lytsy. 2017-10. "Creating falseness-How to establish statistical evidence of the untrue." Journal of Evaluation in Clinical Practice 23: 5: 923-927. 10.1111/jep.12823.

Wikipedia Citation

<ref> {{Cite journal | doi = 10.1111/jep.12823 | issn = 1365-2753 | volume = 23 | pages = 923-927 | last = Lytsy | first = Per | coauthors = | title = Creating falseness-How to establish statistical evidence of the untrue | journal = Journal of Evaluation in Clinical Practice | date = 2017-10 | pmid = | pmc = }} </ref>