“LeBel & Peters (2011). Fearing the future of empirical psychology: Bem’s (2011) evidence of psi as a case study of deficiencies in modal research practice.” - Article summary

Psi refers to the anomalous retroactive influence of future events on an individual’s current behaviour. There are three important deficiencies in modal research practice: an overemphasis on conceptual replication (1), insufficient attention to verifying the integrity of measurement instruments and experimental procedures (2) problems with the implementation of null hypothesis testing (3).

The interpretation bias refers to a bias towards interpretations of data that favour a researcher’s theory. A potential consequence of this is an increased risk of reported false positives and a disregard of true negatives. The knowledge system of psychology consists of theory relevant beliefs (1), this is about the mechanisms that produce behaviour and method-relevant beliefs (2), this is about the procedures through which data is obtained.

Deficiencies in modal research practice bias systematically bias the interpretation of confirmatory data as theory relevant (1) and the interpretation of disconfirmatory data as method relevant (2).

Central beliefs are beliefs on which many other beliefs depend. Conservatism refers to choosing the theoretical explanation consistent with the data that requires the least amount of restructuring of the existing knowledge system.

If method-relevant beliefs are central in a knowledge system, it becomes more difficult to blame methodology related errors for disconfirmatory results. If theory-relevant beliefs become central, it poses the threat of becoming a logical assumption. A hypothesis under test should be described in a way that is falsifiable and not logically necessary.

An overemphasis on conceptual replication at the expense of direct replication weakens method-relevant beliefs in the knowledge system. A statistical significant result is often followed by a conceptual replication. A failure of the conceptual replication leads to the question whether the negative result was due to the falsity of the underlying theory or to methodological flaws introduced by changes in conceptual replication.

The failure to verify the integrity of measurement instruments and experimental procedures weakens method-relevant beliefs and leads to ambiguity in the interpretation of results. The null hypothesis can be viewed as a straw man, as two identical populations are almost not possible. Basing theory choices on null hypothesis significance tests detaches theories from the broader knowledge system.

In order to overcome the flaws of the modal research practice, method-relevant beliefs must be strengthened. There are three ways in order to do this:

  1. Stronger emphasis on direct replication
    A direct replication leads to greater confidence in the results. They are necessary to ensure that an effect is real.
  2. Verify integrity of methodological procedures
    Method-relevant beliefs are more difficult to reject if the integrity of methodological procedures are verified and this leads to a less ambiguous interpretation of results. This includes routinely checking the internal consistency of the scores of any measurement instrument that is used. This includes the use of objective markers of instruction comprehension.
  3. Use stronger forms of NHST
    The null hypothesis should be a theoretically derived point value of the focal variable, instead of a hypothesis of no difference.

Image

Access: 
Public

Image

Join WorldSupporter!
This content is used in:

Scientific & Statistical Reasoning – Summary interim exam 3 (UNIVERSITY OF AMSTERDAM)

Scientific & Statistical Reasoning – Article summary (UNIVERSITY OF AMSTERDAM)

Search a summary

Image

 

 

Contributions: posts

Help other WorldSupporters with additions, improvements and tips

Add new contribution

CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Image CAPTCHA
Enter the characters shown in the image.

Image

Spotlight: topics

Check the related and most recent topics and summaries:
Institutions, jobs and organizations:
Activities abroad, study fields and working areas:
This content is also used in .....

Image

Check how to use summaries on WorldSupporter.org

Online access to all summaries, study notes en practice exams

How and why use WorldSupporter.org for your summaries and study assistance?

  • For free use of many of the summaries and study aids provided or collected by your fellow students.
  • For free use of many of the lecture and study group notes, exam questions and practice questions.
  • For use of all exclusive summaries and study assistance for those who are member with JoHo WorldSupporter with online access
  • For compiling your own materials and contributions with relevant study help
  • For sharing and finding relevant and interesting summaries, documents, notes, blogs, tips, videos, discussions, activities, recipes, side jobs and more.

Using and finding summaries, notes and practice exams on JoHo WorldSupporter

There are several ways to navigate the large amount of summaries, study notes en practice exams on JoHo WorldSupporter.

  1. Use the summaries home pages for your study or field of study
  2. Use the check and search pages for summaries and study aids by field of study, subject or faculty
  3. Use and follow your (study) organization
    • by using your own student organization as a starting point, and continuing to follow it, easily discover which study materials are relevant to you
    • this option is only available through partner organizations
  4. Check or follow authors or other WorldSupporters
  5. Use the menu above each page to go to the main theme pages for summaries
    • Theme pages can be found for international studies as well as Dutch studies

Do you want to share your summaries with JoHo WorldSupporter and its visitors?

Quicklinks to fields of study for summaries and study assistance

Main summaries home pages:

Main study fields:

Main study fields NL:

Follow the author: JesperN
Work for WorldSupporter

Image

JoHo can really use your help!  Check out the various student jobs here that match your studies, improve your competencies, strengthen your CV and contribute to a more tolerant world

Working for JoHo as a student in Leyden

Parttime werken voor JoHo

Statistics
2381