Skip to content
ALL Metrics
-
Views
15
Downloads
Get PDF
Get XML
Cite
Export
Track
Study Protocol

Experiences of novice student team members in evidence synthesis: Study protocol for a study within a review.

[version 1; peer review: 1 approved with reservations]
PUBLISHED 02 Jul 2025
Author details Author details
OPEN PEER REVIEW
REVIEWER STATUS

Abstract

Background

Evidence synthesis plays a vital role in healthcare research, informing clinical practice and policy. Increasingly, students are involved in reviews, yet their experiences, including the challenges and facilitators for participation, remain underexplored. This study aims to examine the barriers and opportunities encountered by novice student team members in evidence synthesis.

Methods

This study is embedded within the Study Within A Review (SWAR) framework and will use a mixed-methods approach. Students in health-related disciplines engaged in or having just completed their first evidence synthesis will be recruited through academic networks and word of mouth. Data will be collected primarily via focus groups, in addition to a short, embedded survey. Thematic analysis will be employed to analyse qualitative data, while descriptive statistics will be used for survey responses.

Results

The study aims to describe experiences of students involved in evidence synthesis, identifying barriers and facilitators related to their participation. Findings will inform recommendations for improving evidence synthesis training, mentorship, and student engagement strategies.

Conclusion

Understanding student experiences in evidence synthesis may inform the development of targeted training and support mechanisms. The findings will provide valuable insights for academic institutions and research teams seeking to optimise student involvement in evidence synthesis.

Keywords

Evidence synthesis, systematic review, novice researchers, student experiences

Background

Evidence synthesis is a critical research methodology in healthcare, providing a structured and transparent approach to consolidating findings across studies and identifying key knowledge gaps1,2. Furthermore, evidence synthesis plays a central role in informing policy and practice recommendations. This is especially important in light of the association between the implementation of evidence-based decision making and positive health outcomes3. Evidence synthesis is a popular methodological approach, with rapid increases in the publication of systematic reviews in the past decade4. Although clear guidelines for the reporting and conduct of evidence syntheses exist5,6, quality is inconsistent7.

One key factor influencing the quality and efficiency of evidence synthesis is the composition and expertise of the review team. Increasingly, novice researchers and students are included in evidence synthesis teams, either as part of research training or formal coursework. The involvement of students in research brings with it numerous benefits. Student participation in evidence synthesis fosters skill development in systematic searching, critical appraisal, and synthesis methodologies, all of which are foundational in developing research competence. Moreover, the involvement of students in research projects enables the development of knowledge, which is often integrated into clinical practice8. However, novices may face unique barriers and facilitators during the evidence synthesis process, with more research needed to investigate what these are and how successful student participation in evidence syntheses can be nurtured.

Addressing this gap is particularly relevant in the healthcare domain, where students engaged in evidence synthesis may later apply these skills in clinical practice, policymaking, or academic research. Given that health and social care students represent an important subset of end-users of evidence synthesis, evaluating their experiences with a view to improvement may enhance research literacy and encourage more healthcare professionals to contribute to systematic reviews. Moreover, many clinicians return to education, completing postgraduate programmes as a form of professional development. It has been suggested that establishing and fostering partnerships with policy makers and managers may facilitate the implementation of systematic review findings9. Similarly, encouraging the participation of currently practicing clinicians in the conduct of reviews may enhance the relevance and impact of the output itself.

Although numerous publicly available training resources exist to support students in conducting evidence syntheses, there has been limited research on their actual experiences, challenges, and perceived facilitators during the review process. Existing literature has primarily focused on early career researchers10. Yet, there is a distinct gap in understanding how students navigate the evidence synthesis process. Unlike early career researchers, students may have less access to structured mentorship, formal research networks, and methodological expertise11, which can impact their ability to engage meaningfully in evidence synthesis projects. Identifying factors that could either facilitate or impede student participation in these projects may help create a more supportive environment for their involvement and enhance the quality of outputs. Furthermore, examining students' experiences can provide insights into their learning journeys, the knowledge they acquire, and whether their learning is applied to practice.

Aims and objectives

This study is embedded within the Study Within A Review (SWAR) framework, an approach designed to evaluate methodological processes within evidence synthesis12. SWARs aim to generate evidence on how systematic reviews are conducted, structured, and reported, thereby informing best practices. By embedding this study within a SWAR framework, the research aims to understand student experiences and training approaches. This SWAR aims to address the following objectives:

  • Explore the experiences of novice student team members who have worked on/are working on evidence synthesis projects.

  • Identify key barriers and facilitators influencing the ability of student researchers to contribute effectively to evidence synthesis projects.

Methods

Design

This SWAR will be conducted in the Faculty of Education and Health Sciences, which spans many health-related disciplines and offers both undergraduate and postgraduate study opportunities. This SWAR will adopt a mixed method, embedded design13. A qualitative dominant approach will be taken, with quantitative data collection aiming to complement qualitative findings. For the qualitative element, focus groups will explore the experiences and opinions of students in relation to evidence synthesis. A constructivist approach will be taken, acknowledging the creation of meaning through interaction14. The quantitative element will consist of a short accompanying survey detailing demographic information and three Likert Scale questions pertaining to satisfaction with the evidence synthesis experience. Qualitative and quantitative elements will be collected concurrently. The topic guide and survey are available in Section 6, Extended Data. Given the primarily qualitative approach, the Consolidated Criteria for Reporting Qualitative Studies (COREQ) Checklist will be adhered to for qualitative elements15. The Good Reporting of A Mixed Methods Study (GRAMMs) will also be used to ensure transparent reporting16. In lieu of mixed method protocol guidelines, this protocol has been reported in accordance with established guidelines for qualitative protocol reporting17.

Research team roles and experience

This research team comprises five researchers. SD and AG will be involved in facilitating the focus groups. SD (BSc, PhD) is a Chartered Physiotherapist and an Assistant Professor within the School of Allied Health. She has experience in completing and supervising several evidence synthesis projects and has completed an Evidence Synthesis Ireland Fellowship. AG (BSc) is a student within the Department of Psychology, undertaking his MSc in psychology of global mobility, inclusion and diversity in society. AG has no previous experience completing evidence synthesis projects. RG (BSc, PhD), EA (BSc, PhD) and AW (BSc, PhD) are academic staff within the Faculty of Education and Health Sciences. Each of these authors has previously conducted and supervised numerous evidence synthesis projects.

Reflexivity

The backgrounds, beliefs, and experiences of the researchers collecting, analysing, and interpreting the qualitative data will be acknowledged. Researchers will examine their biases through the use of reflective diaries and critical discussion of interpretations during the analysis process. This aims to strengthen the trustworthiness of the study, however, the inherent subjectivity of researchers in the creation of themes and codes is recognised.

Participants and recruitment

A convenience sample of students who have just completed or are in the process of completing their first evidence synthesis within a health-related discipline will be recruited via virtual learning platform announcement and word of mouth.

Procedure

Students wishing to participate in the study will be asked to participate in a single online focus group and survey, led by members of the research team (SD or AG). Each focus group will consist of up to 6 students, in line with previous recommendations18. It is envisaged that 10–15 participants will be recruited across 3 focus groups.

Focus groups will be used to explore the experiences of students who have contributed to an evidence synthesis, using an interview guide agreed a priori through discussion among the research team and consideration of previous literature. The focus group will explore topics such as satisfaction with evidence synthesis experiences, barriers and facilitators to completion, and applicability to clinical practice. Each focus group will be audio recorded and will be allocated approximately 1 hour. One interviewer (SD/AG) will be present at each focus group and will make field notes. Where possible, groups will not be moderated by research team members who have previously worked in a supervisory capacity with focus group members. Students will also be asked to complete a short custom survey (5–10 minutes in duration) (Qualtrics), detailing their clinical position (if any), evidence synthesis experience, and perceptions of the experience.

Data analysis

Focus groups will be transcribed verbatim by the investigators and verified against audio recordings for accuracy. Data will be analysed in line with Braun and Clarke’s reflexive thematic analysis19,20. Two researchers (SD and AG) will independently familiarise themselves with the data by reading transcripts and listening to audio recordings. These researchers will independently code interviews using NVivo (Version 15), with subsequent comparison and discussion of codes, as well as the creation of themes emerging from the codes. Quantitative survey data will be used to complement qualitative elements and will be analysed using descriptive statistics in SPSS (IBM). Qualitative and quantitative data will be analysed independently and then integrated at the inferential stage13.

Ethical considerations

Ethical approval for this study has been obtained from the Faculty of Education and Health Sciences Research Ethics Committee at the University of Limerick on 27/11/2024 (Approval Number: 2024_11_23_EHS). The information sheet explaining the study will be sent to interested participants to review. On the day of data collection, written informed consent will be collected via the Qualtrics platform. All participants will be notified of their right to withdraw at any time, up until data anonymisation. Minimal risks are anticipated for participants in this study.

Dissemination

The findings of this study will be disseminated via journal publication and locally via a “Knowledge Exchange Event”.

Study status

At the time of protocol submission, recruitment has commenced, with data collection on-going.

Conclusions

This SWAR aims to address a critical gap in the literature by exploring the experiences of novice student contributors to evidence synthesis projects, with a particular focus on the barriers and facilitators encountered throughout the process. As evidence synthesis plays an increasingly vital role in healthcare research and decision-making, it is essential to understand how students, both as current learners and future professionals, engage with this methodology.

Findings from this SWAR will have implications for academic institutions and research teams seeking to involve students in evidence synthesis projects. The identification of key facilitators and barriers may be used to inform the development of tailored training resources, mentorship strategies, and support mechanisms to enhance student engagement and skill development. Furthermore, by increasing stakeholder literacy in evidence synthesis, this research may contribute to broader efforts to integrate evidence-based practice into healthcare education and clinical settings.

Comments on this article Comments (0)

Version 1
VERSION 1 PUBLISHED 02 Jul 2025
Comment
Author details Author details
Competing interests
Grant information
Copyright
Download
 
Export To
metrics
VIEWS
85
 
downloads
15
Citations
CITE
how to cite this article
Dillon S, Gall A, Ahern E et al. Experiences of novice student team members in evidence synthesis: Study protocol for a study within a review. [version 1; peer review: 1 approved with reservations]. HRB Open Res 2025, 8:74 (https://doi.org/10.12688/hrbopenres.14154.1)
NOTE: If applicable, it is important to ensure the information in square brackets after the title is included in all citations of this article.
track
receive updates on this article
Track an article to receive email alerts on any updates to this article.

Open Peer Review

Current Reviewer Status: ?
Key to Reviewer Statuses VIEW
ApprovedThe paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approvedFundamental flaws in the paper seriously undermine the findings and conclusions
Version 1
VERSION 1
PUBLISHED 02 Jul 2025
Views
8
Cite
Reviewer Report 16 Sep 2025
Maura Dowling, University of Galway, Galway, County Galway, Ireland 
Approved with Reservations
VIEWS 8
Thank you for the opportunity to review the protocol of a study within a review (SWAR) examining the barriers and opportunities encountered by students undertaking evidence synthesis.

The proposed reporting guidelines are appropriate, complemented by focus group ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Dowling M. Reviewer Report For: Experiences of novice student team members in evidence synthesis: Study protocol for a study within a review. [version 1; peer review: 1 approved with reservations]. HRB Open Res 2025, 8:74 (https://doi.org/10.21956/hrbopenres.15566.r49640)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.

Comments on this article Comments (0)

Version 1
VERSION 1 PUBLISHED 02 Jul 2025
Comment
Alongside their report, reviewers assign a status to the article:
Approved - the paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations - A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approved - fundamental flaws in the paper seriously undermine the findings and conclusions

Are you a HRB-funded researcher?

Submission to HRB Open Research is open to all HRB grantholders or people working on a HRB-funded/co-funded grant on or since 1 January 2017. Sign up for information about developments, publishing and publications from HRB Open Research.

You must provide your first name
You must provide your last name
You must provide a valid email address
You must provide an institution.

Thank you!

We'll keep you updated on any major new updates to HRB Open Research

Sign In
If you've forgotten your password, please enter your email address below and we'll send you instructions on how to reset your password.

The email address should be the one you originally registered with F1000.

Email address not valid, please try again

You registered with F1000 via Google, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Google account password, please click here.

You registered with F1000 via Facebook, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Facebook account password, please click here.

Code not correct, please try again
Email us for further assistance.
Server error, please try again.