p-Hacking by Post Hoc Selection With Multiple Opportunities: Detectability by Skewness Test?: Comment on Simonsohn, Nelson, and Simmons (2014).
Simonsohn, Nelson, and Simmons (2014) have suggested a novel test to detect p-hacking in research, that is, when researchers report excessive rates of "significant effects" that are truly false positives. Although this test is very useful for identifying true effects in some cases, it fails to ident...
| Published in: | Journal of Experimental Psychology. General Vol. 144; no. 6; pp. 1137 - 1146 |
|---|---|
| Main Authors: | , |
| Format: | Article |
| Published: |
American Psychological Association
Dec2015
|
| Subjects: | |
| Online Access: | View this record in EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ssf&AN=111424623&site=ehost-live header: @attributes: shortDbName: ssf uiTerm: 111424623 longDbName: Social Sciences Full Text (H.W. Wilson) uiTag: AN controlInfo: bkinfo: jinfo: jid: 00963445 EPG jtl: Journal of Experimental Psychology. General issn: 00963445 maglogo: N pubinfo: dt: Dec2015 vid: 144 iid: 6 pid: 34 pub: American Psychological Association artinfo: ui: 111424623 10.1037/xge0000086 ppf: 1137 ppct: 9 formats: tig: atl: p-Hacking by Post Hoc Selection With Multiple Opportunities: Detectability by Skewness Test?: Comment on Simonsohn, Nelson, and Simmons (2014). aug: au: Ulrich, Rolf Miller, Jeff affil: University of Tübingen University of Otago su: Skewness (Probability theory) Computer hacking Mathematical statistics sug: subj: Skewness (Probability theory) Computer hacking Mathematical statistics keyword: multiple testing p-curves p-hacking multiple testing p-curves p-hacking ab: Simonsohn, Nelson, and Simmons (2014) have suggested a novel test to detect p-hacking in research, that is, when researchers report excessive rates of "significant effects" that are truly false positives. Although this test is very useful for identifying true effects in some cases, it fails to identify false positives in several situations when researchers conduct multiple statistical tests (e.g., reporting the most significant result). In these cases, p-curves are right-skewed, thereby mimicking the existence of real effects even if no effect is actually present. pubtype: Academic Journal doctype: Article src: R language: English refInfo: copyright: @attributes: flag: N holdings: @attributes: islocal: N |
|---|