If you're conducting research, particularly in the social sciences, you may have come across the term preregistration. Preregistering your research is a great way to improve the transparency, credibility and reliability of your findings.
In this article, we'll explain what preregistration is, why it's useful, how to get started and what registered reports are.
What is a preregistration?
Preregistration involves writing a detailed plan of how you intend to carry out your research and uploading it to a preregistration archive (such as the Open Science Framework (OSF)) before you begin collecting data.
Your plan should include as much detail as possible about how you intend to conduct and analyse your study. For example:
Research hypotheses: What are you predicting or hoping to investigate?
Study design: How will your study be structured?
Participant criteria: What are your inclusion and exclusion criteria?
Sample size: How many participants do you intend to recruit, and how have you decided on this number?
Study materials: What materials, questionnaires or equipment will you use?
Dependent variables: What outcomes will you measure, and how will you calculate them?
Procedure: What will participants be asked to do?
Randomisation: How will participants be assigned to different conditions, if applicable?
Data preparation: How will you clean and prepare your dataset for analysis?
Outliers: How will you identify and handle outliers?
Analysis plan: What statistical tests or other analytical methods will you use?
Data management: How will you store, manage and protect your research data?
This might seem like a lot to consider! However, you don't need to have every detail of your research project finalised before preregistering.
Research doesn't always go exactly to plan, and that's okay. You can make changes to your original plan as your study develops, provided you clearly explain and document any deviations.
For example, you might initially plan to use parametric statistical tests but discover after collecting your data that your data are not normally distributed. In this situation, you might decide to use non-parametric tests instead. The important thing is to be transparent about the change and explain why you made it.
How do I preregister my research?
One popular platform for preregistering research is the Open Science Framework (OSF).
Once you've written your research plan, you can follow these general steps:
Create an OSF project: Set up a project for your upcoming study.
Invite collaborators: Add any colleagues or researchers who are working with you.
Upload your research plan: Add your protocol and any relevant supporting materials to your project.
Create your preregistration: Once you're happy with your plan, create a preregistration. This produces a timestamped, frozen version of your project, providing a record of what you intended to do before collecting data.
Choose your visibility settings: You can make your preregistration publicly available straight away or choose to embargo it for a period of up to four years.
An embargo can be useful if you're concerned about making your research ideas publicly available before you're ready. Your registration is preserved, but access is restricted until the embargo ends.
For more guidance, visit the OSF website.
Why should I preregister my research?
Preregistration offers several benefits for researchers and the wider scientific community.
1. Strengthens the credibility of your findings
Preregistration helps distinguish between hypotheses you made before collecting data (predictions) and explanations developed after seeing your results (postdictions).
When your research findings support a hypothesis that you specified in advance, readers can have greater confidence that it wasn't developed simply to fit the results.
2. Helps prevent questionable research practices
By documenting your planned sample size, exclusion criteria and analysis methods in advance, preregistration makes it harder to selectively change your approach to achieve statistically significant results (sometimes referred to as p-hacking).
It also helps readers understand which analyses were planned and which were conducted later.
3. Helps address publication bias
Publication bias occurs when studies with statistically significant or positive findings are more likely to be published than studies with non-significant findings.
Preregistration, particularly through approaches such as registered reports, can help shift the focus towards the quality of the research question and methodology rather than whether the results are statistically significant.
4. Improves your research design
Writing a detailed research plan before collecting data gives you an opportunity to think carefully about your methodology. It can help you identify potential weaknesses, clarify your hypotheses and address problems before they arise.
5. Makes writing up your research easier
Having your methodology and analysis plan documented in advance can make it easier to write your research paper once data collection and analysis are complete.
6. Demonstrates transparency and openness
Perhaps most importantly, preregistration demonstrates your commitment to openness, honesty and transparency. These are important principles of good scientific research.
Can I preregister exploratory research?
Absolutely!
Preregistration isn't just for research with specific hypotheses or predicted outcomes. It's also valuable for exploratory research.
Even if you don't know exactly what you might find, preregistration allows you to document your research questions, methods and planned approach.
It also helps you distinguish between analyses you planned in advance and new questions or patterns that emerge during your research.
This transparency helps others understand how your findings were reached and gives them greater confidence in your work.
What are registered reports?
Registered reports (sometimes called reviewed preregistrations) are another approach to preregistration.
With a traditional preregistration, you document your research plan before collecting data. With a registered report, your research question and proposed methodology are also reviewed by a journal's peer reviewers before data collection begins.
Here's how the process generally works:
Submit your research proposal: You submit your research question, hypotheses (if applicable) and proposed methodology to a participating journal.
Receive peer review: Reviewers assess your research design and provide feedback before you begin collecting data.
Receive in-principle acceptance: If your proposal meets the journal's requirements, the journal agrees in principle to publish your research, provided you follow the approved methodology and meet the agreed conditions.
Conduct your research: You carry out your study in line with the approved plan, documenting and justifying any necessary changes.
Submit your completed research: You submit your findings for final review and publication.
One of the biggest advantages of registered reports is that you receive expert feedback on your methodology before investing time and resources in data collection.
They also help reduce publication bias because the journal's initial decision to accept your research is based on the quality of the research question and methodology, rather than whether your findings are statistically significant.
Feedback might mean making changes to your original plan, but identifying potential problems early can save you a lot of time and effort later.
Where can I find out more?
If you'd like to learn more about preregistration and registered reports, the following resources are a great place to start:
Preregistration is an important part of the movement towards more transparent and reproducible research, sometimes described in psychology as Psychology's Renaissance.
Whether you're conducting confirmatory or exploratory research, preregistration is a valuable way to demonstrate your commitment to producing credible, transparent and trustworthy scientific findings.
Still have questions? You can find more answers to questions about preregistration here.
