Scientific & Statistical Reasoning – Article summary (UNIVERSITY OF AMSTERDAM)
- 2359 keer gelezen
“Simmons, Nelson, & Simonsohn (2011). False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant.” - Article summary
A false positive refers to an incorrect rejection of the null hypothesis. The decisions a researcher can make during the research process is called the researcher degrees of freedom. Four common degrees of freedom are choosing sample size (1), using covariates (2), choosing among dependent variables (3) and reporting subsets of experimental conditions (4). The researcher degrees of freedom can significantly increase the false positive rate.
There are six guidelines for authors to prevent the increased rate of false positives:
- Authors must decide the rule for terminating data collection before data collection begins and report this rule in the article.
- Authors must collect at least 20 observations per cell or else provide a compelling cost-of-data collection justification.
- Authors must list all variables collected in a study.
- Authors must report all experimental conditions, including failed manipulations
- If observations are eliminated, authors must also note what the statistical results are if those observations are included.
- If an analysis includes a covariate, authors must report the statistical results of analysis without the covariate.
There are four guidelines for reviewers to prevent the increased rate of false positives:
- Reviewers should ensure that authors follow the requirements.
- Reviewers should be more tolerant of imperfection in results.
- Reviewers should require authors to demonstrate that their results do not hinge on arbitrary analytic decisions.
- If justifications of data collection or analysis are not compelling, reviewers should require the authors to conduct an exact replication.
Access:
Public
Join WorldSupporter!
Join with a free account for more service, or become a member for full access to exclusives and extra support of WorldSupporter >>
This content is related to:
Scientific & Statistical Reasoning – Article summary (UNIVERSITY OF AMSTERDAM)
Scientific & Statistical Reasoning – Summary interim exam 2 (UNIVERSITY OF AMSTERDAM)
Check more of topic:
This content is used in:
Scientific & Statistical Reasoning – Summary interim exam 2 (UNIVERSITY OF AMSTERDAM)
- Discovering statistics using IBM SPSS statistics by Andy Field, fifth edition – Summary chapter 12
- Discovering statistics using IBM SPSS statistics by Andy Field, fifth edition – Summary chapter 13
- Discovering statistics using IBM SPSS statistics by Andy Field, fifth edition – Summary chapter 14
- Discovering statistics using IBM SPSS statistics by Andy Field, fifth edition – Summary chapter 15
- Discovering statistics using IBM SPSS statistics by Andy Field, fifth edition – Summary chapter 16
- Discovering statistics using IBM SPSS statistics by Andy Field, fifth edition – Summary chapter 17
- Dienes (2008). Understanding psychology as a science.” – Article summary
- “Meltzoff & Cooper (2018). Critical thinking about research: Psychology and related fields.” - Article summary
- “Simmons, Nelson, & Simonsohn (2011). False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant.” - Article summary
- “Nosek, Spies, & Motyl (2012). Scientific utopia: II. Restructuring incentives and practices to promote truth over publishability.” - Article summary
Scientific & Statistical Reasoning – Article summary (UNIVERSITY OF AMSTERDAM)
- Borsboom & Cramer (2013). Network analysis: An integrative approach to the structure of psychopathology.
- Borsboom et al. (2016). Kinds versus continua: a review of psychometric approaches to uncover the structure of psychiatric constructs.
- "Cohen on item response theory” – Article summary
- Cohen on the science of psychological measurement” - Article summary
- Coyle (2015). Introduction to qualitative psychological research.” – Article summary
- Dienes (2008). Understanding psychology as a science.” – Article summary
- Dienes (2011). Bayesian versus orthodox statistics: Which side are you on?” – Article summary
- Eaton et al. (2014). Toward a model-based approach to the clinical assessment of personality psychopathology.” – Article summary
- Foster (2010). Causal inference and developmental psychology.” – Article summary
- “Furr & Bacharach (2014). Estimating practical effects: Binomial effect size display, Taylor-Russell tables, utility analysis and sensitivity / specificity.” – Article summary
- "Furr & Bacharach (2014). Estimating and evaluating convergent and discriminant validity evidence.” - Article summary
- “Furr & Bacharach (2014). Scaling.” - Article summary
- “Gigerenzer & Marewski (2015). Surrogate science: The idol of a universal method for scientific inference.” - Article summary
- “Halpern (2014). Thinking, an introduction.” - Article summary
- “Kievit et al. (2013). Simpson’s paradox in psychological science: A practical guide.” - Article summary
- “LeBel & Peters (2011). Fearing the future of empirical psychology: Bem’s (2011) evidence of psi as a case study of deficiencies in modal research practice.” - Article summary
- “Marewski & Olsson (2009). Formal modelling of psychological processes.” - Article summary
- “Meltzoff & Cooper (2018). Critical thinking about research: Psychology and related fields.” - Article summary
- “Mitchell & Tetlock (2017). Popularity as a poor proxy for utility.” - Article summary
- “Nosek, Spies, & Motyl (2012). Scientific utopia: II. Restructuring incentives and practices to promote truth over publishability.” - Article summary
- “Pearl (2018). Confounding and deconfounding: Or, slaying the lurking variable.” - Article summary
- “Schmittmann et al. (2013). Deconstructing the construct: A network perspective on psychological phenomena.” - Article summary
- “Simmons, Nelson, & Simonsohn (2011). False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant.” - Article summary
- “Shadish (2008). Critical thinking in quasi-experimentation.” - Article summary
- “Dennis & Kintsch (2008). Evaluating theories.” - Article summary
- “Van der Maas, Kan, & Borsboom (2014). Intelligence is what the intelligence test measures. Seriously.” – Article summary
- “Willingham (2007). Decision making an deductive reasoning.” – Article summary
Going abroad?
Study with summaries
Contributions: posts
Help other WorldSupporters with additions, improvements and tips
Spotlight: topics
Check the related and most recent topics and summaries:
Activities abroad, study fields and working areas:
Institutions, jobs and organizations:
This content is also used in .....
Scientific & Statistical Reasoning – Summary interim exam 2 (UNIVERSITY OF AMSTERDAM)
This bundle contains everything you need to know for the fifth interim exam for the course "Scientific & Statistical Reasoning" given at the University of Amsterdam. It contains both articles, book chapters and lectures. It consists of the following materials:
...Scientific & Statistical Reasoning – Article summary (UNIVERSITY OF AMSTERDAM)
This bundle contains all the summaries for the course "Scientific & Statistical Reasoning" given at the University of Amsterdam. It contains the following articles:
- “Borsboom & Cramer (2013). Network analysis: An integrative
Check how to use summaries on WorldSupporter.org
Submenu: Summaries & Activities
Follow the author: JesperN
Work for WorldSupporter
JoHo can really use your help! Check out the various student jobs here that match your studies, improve your competencies, strengthen your CV and contribute to a more tolerant world
Statistics
Add new contribution