Keywords
Implementation Science, inclusive education, disability, speech, language and communication needs
Implementation Science, inclusive education, disability, speech, language and communication needs
We have further aligned the text to reflect that phase 1 of our study has already been conducted in preparation for publication of the protocol. We have reduced the number of ACRONYMs and ensured consistency of the use of these throughout the study. We have added a sentence from methods into the introduction re the constructs we are planning to investigate.
See the authors' detailed response to the review by Trina D Spencer
See the authors' detailed response to the review by Michael Donnelly
According to school census data, children and young people with speech, language and communication needs (SLCN) represent a sizeable proportion of the school-aged population (Lindsay & Strand, 2016; Norbury et al., 2016a), and are a vulnerable group in terms of poor social and emotional, and educational outcomes (Conti-Ramsden & Durkin, 2012; Conti-Ramsden et al., 2018). Children and young people with SLCN can struggle to understand and/or to use grammar, to learn new vocabulary and linguistic concepts and/or to use language for higher order tasks such as making inferences and/or predictions and problem-solving (Norbury et al., 2016a) as well as co-occurring difficulties with written language (Alloway et al., 2017; Archibald et al., 2013). As teaching and learning in the classroom is essentially language-based, children with SLCN can be particularly disadvantaged in accessing the curriculum (Dockrell & Lindsay, 1998; Dockrell et al., 2017). For some children with SLCN, these barriers to learning can have a negative impact into adulthood, with reported difficulties gaining skilled employment, mental health (Botting et al., 2016) and living independently (Botting et al., 2016). Prior to school entry, speech and language difficulties are considered a ‘health’ need and are managed by speech and language therapists, employed by health services.
Once of school age, the majority children and young people with SLCN in Ireland, as in many other high-income countries, attend ordinary (mainstream) schools (Cosgrove et al., 2014; Gallagher et al., 2020). (Black-Hawkins et al., 2016; Day & Prunty, 2015; Nilholm, 2020). Where a child’s SLCN act as a barrier to their learning and participation in the classroom, they are referred to as ‘special educational needs’ (SEN). In the Irish context, a special educational need is defined as ‘… a restriction in the capacity of the person to participate in and benefit from education on account of an enduring physical, sensory, mental health or learning disability, or any other condition which results in a person learning differently from a person without that condition’ (EPSEN Act 2004, p 6). The educational landscape for children and young people with SEN in Ireland has witnessed radical and rapid transformation since the early 1990s, in line with many countries internationally (Department of Education and Skills, 2015), with a shift in focus towards creating more socially-responsive inclusive school environments (Rose et al., 2015). Essential to this policy goal is the effective integration of ‘health’ interventions in schools (IASLT, 2017; Rix et al., 2013a).
For schools to address the needs of children and young people with SLCN, three distinct tiers of intervention exist; interventions delivered at a universal level (support for all); interventions delivered at a targeted level (support for some); and interventions delivered at a specialist level (support for few) (Rix et al., 2013b). Speech and language therapists provide interventions at all three levels. This tiered approach to the delivery of support in school is underpinned by public health principles (Ehren & Nelson, 2005; Greenwood et al., 2017) including the need for: early and accurate identification of needs, more equitable access to appropriate support (Law et al., 2013) and more efficient and cost-effective allocation of specialist resources (Ebbels et al., 2019; Lindsay et al., 2012).
Considerable emphasis is placed on the provision of effective universal interventions in the classroom for children and young people with special educational needs in policy in Ireland (Department of Education and Skills, 2017; National Council for Special Education, 2019). Universal interventions are defined as techniques or strategies that can be integrated into the teaching and learning of the classroom for the benefit of all students including the child with SEN (Edyburn, 2010). In the field of speech and language therapy, intervention research has focused primarily on establishing the efficacy of therapy techniques for school-aged children with SLCN to be delivered at targeted and/or specialist levels (Ebbels et al., 2017; Walker et al., 2020) with less of a focus on the development of interventions at a universal level (Dobinson & Dockrell, 2021; Dockrell & Howell 2015; Ebbels et al., 2017; Law et al., 2012).
Universal level interventions to support SLCN which have been piloted in the classroom setting have paid limited, if any, attention to the contextual factors which may facilitate or hinder their implementation (Douglas & Burshnic, 2019; Roberts et al., 2020). Despite the fact that multiple and complex barriers to the uptake of evidence-based research into routine teaching practice have been reported for some time in the education literature (Cook & Odom, 2013; Domitrovich et al., 2008; Fixsen et al., 2013), there is little to guide researchers when developing and/or implementing universal interventions for SLCN in the ordinary classroom.
According to Eccles & Mittman (2006), implementation science can facilitate the study of methods to support the systematic uptake of evidence into routine practice and by doing so can improve the quality and effectiveness of healthcare across contexts. Evaluation of the implementation of interventions is only one focus of implementation science. Certain characteristics related to the intervention itself have also been shown to influence uptake of research into practice. Considering factors such as practitioners views of the trialability, adaptability and complexity of an intervention at the pilot stage when designing new interventions can ensure interventions are acceptable and sustainable (Bauer & Kirchner, 2020). Therefore implementation science has a role in guiding the design of new interventions in addition to facilitating uptake of interventions where efficacy has already been established.
According to the findings of a recent systematic review of the implementation science literature (Nilsen & Bernhardsson, 2019), a large number of conceptual frameworks have been developed and tested within the field of implementation science research in the context of healthcare settings over the last twenty years. A conceptual framework can be defined as “a structure, overview, outline, system or plan consisting of various descriptive categories, e.g. concepts, constructs or variables, and the relations between them that are presumed to account for a phenomenon” (Nilsen, 2015, p2). The use of conceptual frameworks in implementation research to guide data collection and analysis is important for several reasons. The use of such frameworks can mitigate against conceptual confusion across studies, and can help create a consistent vocabulary for domains and constructs (Nilsen, 2015). Facilitating the synthesis of findings across studies is essential to building the evidence base for what, how, and when implementation strategies work in the context of schools. (Bauer & Kirchner, 2020; Geng et al., 2017).
Although implementation science has been employed for some time in clinical, health and community settings, its application within the educational domain is still relatively new and there are many areas for further research within this discipline (Lyon et al., 2018; Moir, 2018). An increasing number of studies have focussed on the implementation of school wide initiatives in the education literature particularly with regards to emotional behavioural needs (Durlak, 2016; Durlak & Wells, 1997; Oberle et al., 2016). In the field of speech and language therapy, researchers have outlined the potential benefits of implementation science in addressing research to practice gaps (Campbell & Douglas, 2017; Douglas & Burshnic, 2019; Olswang & Prelock, 2015). However, there are no conceptual frameworks that we know of which have been developed specifically for use in research with regards to the development and/or implementation of universal interventions for children and young people with SLCN in the classroom (Olswang & Prelock, 2015). Without such research tools, we are limited in our capacity to build up a body of knowledge to facilitate the successful uptake of research into practice in this context.
In this study we will scope the literature in order to document the use of implementation science frameworks in the development and/or implementation of universal interventions for children identified as having SEN in the ordinary classroom in general schools. As per Nilsen’s schema of implementation science theories, models, and frameworks (2015), we are interested in the use of determinant frameworks i.e. those conceptual frameworks used to understand and/or explain what influences implementation outcomes. To guide the analysis we will use the domains of the Consolidated Framework for Implementation Research (CFIR) (Damschroder et al. (2009). The CFIR is a meta-theoretical framework developed to create a consistent vocabulary for domains and constructs in implementation science research. The CFIR has been used widely in implementation science studies across a range of health service research contexts previously, providing a set of constructs upon which theories hypothesising specific mechanisms of change and interactions can be developed and tested empirically. As we are scoping the use of determinant frameworks, the constructs we will report on are descriptive categories or factors believed or found to influence implementation outcomes (Nilsen, 2015). Based on the study findings, we will propose a draft model of implementation science constructs which can act as a starting point for researchers to address implementation considerations when developing and/or implementing universal interventions for SLCN in school. This set of constructs will allow us to begin to build an evidence-base in implementation science in this context. Building an evidence base with regards to the determinants of successful implementation in the classroom for children and young people with SLCN gives us the potential to develop more acceptable and sustainable universal interventions, and ultimately to improve the participation and achievement of children and young people with these needs in school.
The objectives of the review are to:
1. To document the use of implementation science frameworks in the development and/or implementation of universal interventions in the ordinary classroom for children and young people identified as having SEN in the published peer-reviewed literature
2. To describe the implementation science frameworks and constructs used including psychometric properties as well as the theoretical underpinnings of the frameworks where stated
3. To propose constructs that may be applicable to the development and/or the implementation of universal interventions for children and young people with SLCN
The study aims to address the following research questions:
1. What implementation science frameworks have been used in the development and/or implementation of universal interventions in ordinary classrooms for children and young people with special education needs?
2. What specific constructs have been identified in the research literature as important when researching the development and/or implementation of universal interventions in this context?
3. What constructs might be applied to research aimed at developing and/or implementing universal interventions for SLCN needs in this context?
A scoping review will be undertaken. Like systematic reviews, scoping reviews use a systematic approach to searching, screening, and reporting of the literature but differ in that the method is used to: examine the extent, range, and nature of a particular research activity, to summarize/map research findings, and/or to identify concepts which may be transferable to other research contexts. A scoping review is therefore the most suited method to address the research questions of the study.
This review is planned to be carried out in distinct phases as described by Levac et al. (2010). Phase one, the development of the research question, has already been completed in order to meet the requirements of the publication of the protocol. Decisions that guided the development of the research questions are described below. The remaining phases to be completed include: (1) identifying potentially relevant studies, (2) screening and selecting papers, (3) charting and extracting data from included papers, (4) collating, summarising and reporting the results and (5) consulting with stakeholders. As suggested, more extensive content analysis may be required, depending on the nature of the papers included in the review (Levac et al., 2010).
In developing our research questions we were guided by the need to have a well-defined research question which includes a clearly-defined phenomenon of interest, a well-defined population and a description of the context when conducting a scoping review given the potentially large body of papers which may be analysed (Colquhoun et al., 2014). We identified the phenomenon of interest as the use of implementation science frameworks. We defined implementation science research as “the scientific study of methods to promote the systematic uptake of research findings and other evidence-based practices into routine practice” (Eccles & Mittman, 2006, p1). We defined a framework as per Nilsen’s definition i.e. “a structure, overview, outline, system or plan consisting of various descriptive categories, e.g. concepts, constructs or variables, and the relations between them that are presumed to account for a phenomenon” (Nilsen, 2015, p2). As we are scoping the use of determinant frameworks, the constructs we will report on are descriptive categories or factors believed or found to influence implementation outcomes (Nilsen, 2015).
In relation to the population of interest, we broadened the scope of the review beyond children and young people with SLCN to include children and young people with a range of SEN. We did so for two reasons. Firstly, we know that the field of implementation science is relatively under-developed in the field of speech and language therapy and therefore unlikely to yield many papers. Secondly, provided the studies are focused on implementation of universal interventions in the context of the ordinary classroom, we hold that these studies can bring transferable contextual insights to implementation of interventions related to SLCN. We also avoid using narrow inclusion and exclusion criteria based on a particular diagnostic category when specifying our populations of interest. Therefore, studies will include children and young people with any of the following: (i) communication and interaction needs, (ii) cognition and learning needs, (iii) social, emotional and mental health difficulties needs, and (iv) sensory and/or physical needs. We will include intervention studies which aim to improve any of the areas of need stated above provided they are universal level and related to the general classroom.
As most children and young people with SEN are educated in general schools the context of interest in the study was the ordinary classroom. Given the differences in education systems internationally, we are aware that it will be important to pay careful attention to selecting search terms and to extracting as much detail as possible about the setting in which the studies were conducted in order to contextualise our findings.
Search strategy and terms. A preliminary search string was developed based on an adapted Phenomenon - Situation (P-S) framework (Jakubec & Astle, 2017). See Table 1 for details. Once the search string is finalised and the searches are conducted, the search results will be reported using the PRISMA extension for Scoping Reviews (PRISMA-ScR) tool (Tricco et al., 2018), the most up-to-date guidance on conducting scoping reviews. Search terms will be adapted to the basic search particulars (eg., wildcards (*) and truncations, capacity for complex searches) of each electronic database. Electronic searches will be supplemented with snowballing techniques such as by seeking recommended articles from well-cited implementation science researchers across health and education. Any articles retrieved via manual searches will be incorporated into the PRISMA-ScR flowchart. A manual search of reference lists will be undertaken as well as a manual search of Implementation Science research group websites known to the research group. Any papers retrieved manually will be added to the papers from the electronic searches on Rayyan for Title and Abstract screening (see study screening and selection section).
Following preliminary assessment of electronic databases for their relevance and coverage of the topic literature, five electronic databases have been identified to be included in the search:
ERIC (Education Resources Information Center) is a database of indexed and full-text education literature and resources.
Embase is a medical database produced by Elsevier which includes journals related to healthcare policy and management.
Allied and Complementary Medicine Database (AMED) is a database designed for therapists amongst other healthcare practitioners and includes articles on allied therapies and related subjects.
PubMed is a database which supports the search and retrieval of biomedical and life sciences literature.
PsycARTICLE is a database of social and behavioral sciences published literature.
To ensure compatibility with the standards expected of a scoping review for peer-reviewed publication, explicit inclusion/exclusion criteria will be applied.
The following studies will be included:
Empirical studies published in peer-reviewed journals
Primary implementation science research with qualitative, mixed methods and/or quantitative design
Related to universal interventions in schools
Related to interventions aimed at improving (i) communication and interaction needs, (ii) cognition and learning needs, (iii) social, emotional and mental health difficulties, and/or (iv) sensory and/or physical needs
Related to the ordinary classroom setting
Papers published/available in English
The following literature will be excluded:
Policy briefs, books, book chapters, editorials, commentaries and published or unpublished reports from governments and other agencies
Related to pre-school/kindergarten years (< 5 years) or third level education (<18 years+)
No explicit implementation science conceptual framework constructs are referenced in the collection and/or analysis of the data
Related to special education settings/ special classrooms1
Not related to children and young people identified as having difficulties in one of the following: (i) communication and interaction, (ii) cognition and learning, (iii) social, emotional and mental health difficulties, and (iv) sensory and/or physical needs.
Once the electronic and manual searches are conducted, citation abstracts for all items will be exported into EndNote (x9). Rayyan (2016) -a web and mobile app for systematic reviews will be used to independently screen the papers. After removing duplicates, the remaining items will be screened for inclusion, initially on the basis of title and abstract. Where inclusion or exclusion cannot be determined on the basis of title and abstract, the paper will be included for full-text screening.
Two researchers (ALG and CAM) will screen an initial sample of randomly selected papers independently for inclusion. As suggested by (Levac et al., 2010), inclusion/exclusion criteria may be refined at this point if necessary. Any differences in screening decision-making will be discussed. If needed, independent screening will be continued until decisions are consistent. Full-text screening will then be undertaken between the researchers for all papers where it was not possible to determine inclusion or exclusions on the basis of title and abstract. Following the full-text screening, studies recommended for exclusion will be reviewed by an additional researcher (JF) to ensure consistency in the application of exclusion criteria. A final list of all included papers will be agreed amongst the research team.
Two researchers, (ALG and CAM) will simultaneously extract data into Excel (2019) for five randomly selected papers in order to assure consistency in data extraction (ALG and CAM). Following this check for quality assurance, which will be repeated until agreement is reached, we will divide the remaining included studies for data extraction. Data to be extracted will include:
Background information related to the study (author(s), date, study objectives, research question, intervention details, country).
Population(s)/ Special Educational Need of interest.
Name and description of implementation science framework.
Description/definitions and psychometric properties of the constructs used in the study.
Theoretical underpinnings of the research and/or framework if referenced.
Any constructs identified as important to inform implementation research when developing universal interventions in ordinary classrooms.
As discussed by Levac et al. (2010), this process may need to be iterative meaning that new categories may need to be developed based on the findings of the extraction phase.
As the purpose of this scoping review is to describe and synthesise the current research, papers will not be excluded based on quality criteria. However, part of the extraction process will include an assessment of the methodological and reporting quality of the studies using the ‘Mixed Methods Appraisal Tool’ (MMAT) (Pace et al., 2012; Pluye et al., 2009) and the ‘Standards for Reporting Implementation Studies (StaRI) Statement’ (Pinnock et al., 2017). This appraisal step has been included as an aim of the study is to make recommendations for future research. Quality appraisal details will be extracted when presenting the details of the included papers as will any reported psychometric properties related to specific IS constructs. These properties may relate to reliability (internal consistency and test-retest); validity (construct and criterion); broad application (validated in different settings and cultures); and sensitivity to change (responsiveness) (Rabin et al., 2012).
The analysis will be conducted by ALG and CAM in consultation with the review team. Descriptive statistics, if relevant, will be used to summarise the general characteristics of included studies. As we are mapping the current literature, we will not exclude on the basis of quality score. However, we will contextualise the findings in relation to these scores, discussing the findings of the analysis and when making any recommendations for research. When making recommendations regarding the use of specific IS constructs, we will contextualise these also in relation to the psychometric properties described above. Where there is insufficient evidence regarding the psychometric properties of any constructs this will also be made explicit in the analysis, discussion and in recommendations for future research. Where papers fail the preliminary methodological questions on the MMAT, findings from these studies will not be included in the recommendations for research.
We will then conduct a qualitative content analysis to map the extracted implementation science constructs. Our analysis will be carried out deductively, guided by five implementation science domains developed by Damschroder et al. (2009). These domains have been widely used in implementation science research across a range of health service research contexts previously. The domains relate to intervention characteristics, inner setting, outer setting, and implementation process. These domains will be operationalised as per definitions set out by Damschroder et al. (2009); intervention characteristics will include any constructs related to the features of the intervention that are stated to have influenced implementation, inner setting will include organisational factors which have been reported to influence implementation, outer setting will include elements related to the broader context or environment that are stated to have influenced implementation such as policy, characteristics of individuals involved in the implementation which impacted the success of the implementation and the implementation process includes any identified strategies or tactics reported to have influenced implementation.
A summary of study aims and findings will be shared with a sample of researchers in the field of implementation science as well as practitioners who support speech and language needs in school (teachers, educational psychologists and speech and language therapists). Researchers in the field of implementation science will be identified via known research networks and by reviewing relevant journals. Practitioners will be identified via professional networks. Feedback from these stakeholders will be used to shape the final interpretation and presentation of the study findings. Findings of the scoping review will be disseminated by publication and at relevant conferences internationally.
Children and young people with speech, language and communication needs (SLCN) represent a sizeable proportion of the school-aged population (Lindsay & Strand, 2016; Norbury et al., 2016b). Such needs can have a negative impact on an individual’s educational outcomes and potentially longer term in terms of employability and difficulties with mental health (Conti-Ramsden & Durkin, 2012; Conti-Ramsden et al., 2018).
Interventions for children and young people with SLCN in school are delivered using a phased approach; at a universal level, then a targeted level and a specialist level depending on the child’s response to intervention. Intervention research in SLCN has focused mainly on establishing the efficacy of interventions aimed at a targeted or specialist level, with insufficient consideration given to the development and/or implementation of interventions to support SLCN, delivered at a universal level, in the ordinary classroom. Understanding the factors which can facilitate and/or act as a barrier to the implementation of universal interventions is essential if we are to improve outcomes for this population.
We will conduct a scoping review of the implementations science literature to map and synthesise the use of implementation science frameworks in developing and/or implementing universal interventions in school. The review aims to document implementation science research related to any category of special education needs provided that the context under investigation is the ordinary classroom. By synthesising the use of existing implementation science frameworks in relation to interventions in the ordinary classroom for children and young people with special education needs more broadly, we aim to propose a draft model of implementation science constructs which can act as a starting point for researchers to begin address implementation considerations when developing and implementing universal interventions for children and young people with SLCN. By doing so we have the potential to support the successful uptake of interventions for this population in school where efficacy has already been established, as well as to guide acceptable and sustainable intervention development in this context going forward.
This scoping review protocol is the first to focus on implementation considerations in the development of universal interventions for SLCN in the ordinary classroom. We will use the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews tool, and the most current guidance on conducting scoping reviews, in order to ensure a systematic approach to searching, screening and reporting. This study will search journals from across the fields of education and health in order to maximise the comprehensiveness of the review. This scoping review may miss studies published outside of journals (e.g. theses, book chapters, unpublished reports and other grey literature).
No data are associated with this article.
It is with a deep sense of sadness that we share the death of Professor James Law, OBE one of the co-authors of our paper.
James was a renowned researcher in the field of speech, language and communication disorders, specialising in the use of large population cohorts in this subject. He recently led the Cost Action European research network to improve children's oral language abilities, as well as assisting the profession in considering ways to use telemedicine to deliver paediatric speech and language therapy services in response to the COVID-19 pandemic. James worked tirelessly to bring evidence-based approaches to children's services across the UK, Europe, Australia, and beyond. Countless SLTs benefited from his time, knowledge, and passion. James will be known by all in the speech and language therapy community for his research interventions.
Ar dheis Dé go raibh a anam.
Competing Interests: No competing interests were disclosed.
Reviewer Expertise: Multi-tiered oral language interventions; implementation research; evidence-based practice.
Competing Interests: No competing interests were disclosed.
Reviewer Expertise: Public health and health care research
Competing Interests: No competing interests were disclosed.
Reviewer Expertise: Multi-tiered oral language interventions; implementation research; evidence-based practice.
Is the rationale for, and objectives of, the study clearly described?
Partly
Is the study design appropriate for the research question?
Partly
Are sufficient details of the methods provided to allow replication by others?
Partly
Are the datasets clearly presented in a useable and accessible format?
Not applicable
Competing Interests: No competing interests were disclosed.
Reviewer Expertise: Multi-tiered oral language interventions; implementation research; evidence-based practice.
Is the rationale for, and objectives of, the study clearly described?
Yes
Is the study design appropriate for the research question?
Yes
Are sufficient details of the methods provided to allow replication by others?
Yes
Are the datasets clearly presented in a useable and accessible format?
Yes
Competing Interests: No competing interests were disclosed.
Reviewer Expertise: Public health and health care research
Alongside their report, reviewers assign a status to the article:
Invited Reviewers | ||
---|---|---|
1 | 2 | |
Version 3 (revision) 31 Jan 22 |
read | |
Version 2 (revision) 15 Nov 21 |
read | read |
Version 1 29 Apr 21 |
read | read |
Provide sufficient details of any financial or non-financial competing interests to enable users to assess whether your comments might lead a reasonable person to question your impartiality. Consider the following examples, but note that this is not an exhaustive list:
Sign up for content alerts and receive a weekly or monthly email with all newly published articles
Register with HRB Open Research
Already registered? Sign in
Submission to HRB Open Research is open to all HRB grantholders or people working on a HRB-funded/co-funded grant on or since 1 January 2017. Sign up for information about developments, publishing and publications from HRB Open Research.
We'll keep you updated on any major new updates to HRB Open Research
The email address should be the one you originally registered with F1000.
You registered with F1000 via Google, so we cannot reset your password.
To sign in, please click here.
If you still need help with your Google account password, please click here.
You registered with F1000 via Facebook, so we cannot reset your password.
To sign in, please click here.
If you still need help with your Facebook account password, please click here.
If your email address is registered with us, we will email you instructions to reset your password.
If you think you should have received this email but it has not arrived, please check your spam filters and/or contact for further assistance.
Comments on this article Comments (0)