False-Positive Psychology
Undisclosed Flexibility in Data Collection and Analysis Allows Presenting Anything as Significant
Abstract
In this article, we accomplish two things. First, we show that despite empirical psychologists’ nominal endorsement of a low rate of false-positive findings (≤ .05), flexibility in data collection, analysis, and reporting dramatically increases actual false-positive rates. In many cases, a researcher is more likely to falsely find evidence that an effect exists than to correctly find evidence that it does not. We present computer simulations and a pair of actual experiments that demonstrate how unacceptably easy it is to accumulate (and report) statistically significant evidence for a false hypothesis. Second, we suggest a simple, low-cost, and straightforwardly effective disclosure-based solution to this problem. The solution involves six concrete requirements for authors and four guidelines for reviewers, all of which impose a minimal burden on the publication process.
A lawful full-text candidate was found, but the source was temporarily unreachable. The worker can retry later.
No local PDF is available.
GROBID Extracted text; discontinued.
This text is generated from TEI extraction for accessibility, search, and TTS. Formulas, tables, figures, page layout, and references may not perfectly match the original PDF.
No accessible text representation is available. The text extraction service has been discontinued for the time being. If you require this service, for accessibility or any other reason, please submit an issue/request on this page.
Metadata
Full-text discovery attempts
| Provider | Status | Kind | URL | Reason |
|---|---|---|---|---|
| crossref_resource | failed | https://journals.sagepub.com/doi/10.1177/0956797611417632 | Source returned HTTP 403. | |
| crossref_link | failed | https://journals.sagepub.com/doi/pdf/10.1177/0956797611417632 | Source returned HTTP 403. | |
| crossref_link | failed | xml | https://journals.sagepub.com/doi/full-xml/10.1177/0956797611417632 | Source returned HTTP 403. |
| openalex | failed | https://doi.org/10.1177/0956797611417632 | Source returned HTTP 403. | |
| openalex | fetched | https://pubmed.ncbi.nlm.nih.gov/22006061 | text/html | |
| openalex | html_links_extracted | https://pubmed.ncbi.nlm.nih.gov/22006061 | ||
| doi_landing | failed | html | https://doi.org/10.1177/0956797611417632 | Source returned HTTP 403. |
Issues
No public issues have been filed for this DOI.
Submit an issue
Record history
No public record history yet.