Keywords
intervention fidelity, implementation science, behaviour change, low back pain, imaging, primary care
intervention fidelity, implementation science, behaviour change, low back pain, imaging, primary care
Intervention fidelity refers both to the degree to which the intervention was delivered as intended and to the methodological strategies used to monitor and enhance the reliability and validity of behavioural interventions1,2. Intervention fidelity can impact both the internal and external validity of trials evaluating the effectiveness of behavioural interventions, and knowledge of the level of intervention fidelity in the intervention can result in greater confidence in the results of these trials1. If the intervention was found to be effective but fidelity was low, the effect may be due to unknown factors that were omitted from, or added to, the intervention. If the intervention was found to be ineffective and fidelity was also low, it would be unknown whether the intervention itself was ineffective or whether it was ineffective due to poor delivery of a potentially effective intervention. Without knowledge of intervention fidelity, there is a risk of applying ineffective interventions in clinical settings or prematurely discarding effective interventions; these are costly for both patients and the healthcare system3,4. Despite the importance of intervention fidelity addressed in both the Consolidated Standards of Reporting Trials statement5 and the Template for Intervention Description and Replication checklist and guide6, intervention fidelity is still often overlooked in trials of behaviour change interventions7.
The National Institutes of Health Behavior Change Consortium (NIH BCC), in 2005, developed a framework for intervention fidelity which includes five areas: design, training, delivery, receipt, and enactment1. Fidelity of study design refers to the study adequately testing its hypothesis in relation to an underlying theoretical framework (e.g., using a protocol review group and pilot testing the intervention). Fidelity of training refers to adequate training and the fidelity with which this training is delivered to the providers who will be implementing the intervention. Fidelity of delivery refers to the delivery of the intervention by providers as intended by the intervention developers. Fidelity of receipt refers to the ability of patients to understand and perform the treatment-related skills during the intervention. Fidelity of enactment refers to the ability of the patient to perform the treatment-related skills in relevant real-life settings. The framework, which was updated in 2011, provides strategies to enhance and assess intervention fidelity in each of these areas2,3.
Non-specific low back pain (LBP) is a common condition8, a leading cause of disability globally9, and associated with large economic and social burdens10. As most cases of LBP have no pathoanatomical cause of pain, diagnostic imaging has limited utility11. Despite clinical practice guidelines recommending against the use of routine imaging for the assessment and management of LBP12,13, lumbar radiography for non-specific LBP remains common in clinical practice14,15.
A cluster randomised controlled trial will be used to evaluate the effectiveness of a theory-informed intervention to reduce non-indicated imaging for LBP. This intervention will be adapted from a similar intervention that used the Behaviour Change Wheel and the Theoretical Domains Framework16 and targeted both general practitioners (GPs) and patients. In the previous intervention, preliminary testing was conducted with international LBP experts to determine consistency with clinical guidelines, and with GPs and health consumers to determine barriers and enablers to its implementation in clinical practice, resulting in the development of a clinical resource. The clinical resource is an LBP management and education booklet designed to: 1) provide GPs with a clinical decision support tool; 2) remind GPs of appropriate clinical indicators for imaging for LBP; 3) facilitate communication between GPs and patients through providing reassurance and education; 4) provide patients with an individualised management plan; and 5) provide patients with educational resources to take home. In the cluster randomised controlled trial, GPs and chiropractors in Newfoundland and Labrador, Canada, will undergo a training session and be responsible for the delivery of the clinical resource to patients.
It is unknown whether previous studies aiming to reduce unnecessary imaging for LBP have adequately addressed intervention fidelity. As such, the aim of this study will be to provide an understanding of the perceived barriers and enablers to ensuring intervention fidelity (fidelity of training and delivery) of a proposed theory-informed intervention to reduce imaging for LBP by GPs and chiropractors.
Our study has two objectives:
1. To explore perceived barriers and enablers to ensuring fidelity of training of GPs and chiropractors to deliver a proposed intervention aimed at reducing imaging for low back pain.
2. To explore perceived barriers and enablers to ensuring fidelity of delivery of a proposed intervention aimed at reducing imaging for low back pain by GPs and chiropractors.
This will be an exploratory, qualitative interview study describing the perceptions of GPs and chiropractors on the training and delivery of a proposed intervention aimed at reducing imaging for LBP. We will use the Atkins et al. (2017)17 guide for applying the Theoretical Domains Framework (TDF) to assess barriers and enablers to behaviour change. The TDF was initially developed to identify factors that influence healthcare providers’ behaviours related to the implementation of evidence-based recommendations17,18. It was revised and validated to include 14 domains covering 84 theoretical constructs17,19. The final study will be reported according to the Consolidated criteria for reporting qualitative research (COREQ)20.
Fee-for-service GPs and chiropractors who hold a license, are registered in the province of Newfoundland and Labrador (NL), are currently in practice (involved in direct patient care), and regularly manage patients with LBP will be eligible for this study. Both these healthcare providers routinely manage patients with LBP and have the ability to order imaging, particularly radiographs.
Purposive snowball sampling will be used to identify study participants. This form of sampling was chosen to ensure wide representation of participants across NL from a geographical and clinical practice perspective. Participants will be recruited through professional and research networks and associations across NL. At the end of each interview, participants will be asked to identify an additional two people who may be interested in participating in the study. With all recruitment strategies, emphasis will be placed on seeking GPs and chiropractors from both urban and rural regions of NL. Emphasis will also be placed on seeking participants who may have differing views or practice patterns to ensure a wide range of perspectives and to avoid premature saturation.
We will use the principles for deciding saturation in theory-based interviews proposed by Francis et al. (2010)21 to determine our sample size. A minimum of 10 interviews will be conducted and analysed to determine if we have reached thematic saturation (the point where no new themes are identified) and geographic diversity. A stopping criterion of three will be used, meaning that if new themes are identified in the last three interviews, an additional three interviews will be conducted. This iterative process will be repeated either to saturation or to a maximum of 20 interviews. If researchers identify major differences between the two professions during this process, analysis and thematic saturation will be assessed separately by profession, otherwise the participants will be analysed as a single group.
Interview procedure. Semi-structured interviews with open-ended questions will be conducted by two members of the research team. Additional members of the research team may be present to take field notes. Interviews will be conducted over phone or a videoconferencing platform, Cisco Webex (Cisco Systems, Milpitas, United States). The interviews are expected to take approximately 60 minutes. At the start of the interview, participants will be asked demographic questions on the following: profession (GP or chiropractor); practice location (urban or rural); and years in practice. Then, the researcher will provide a brief presentation on intervention fidelity (what it is and why it is important), the aim of the interview, and the goal of the intervention that the participants will be delivering as part of the future trial. Participants will be provided with examples of proposed strategies to enhance and/or assess intervention fidelity for the proposed intervention. All interviews will be audio-recorded and transcribed verbatim.
Interview guide. The interview guide (see extended data22) will be adapted from a previous study by Toomey et al. (2016)23, which aimed to develop an intervention fidelity protocol for an intervention to promote self-management for people with chronic LBP or osteoarthritis. More specific questions about perceived barriers and enablers will be included in our interview guide. Additionally, questions in our interview guide will be guided by a checklist developed by the NIH BCC to assess the various components of intervention fidelity3. We chose to prioritise questions directly related to the intervention fidelity checklist rather than using an interview guide based on the TDF to ensure the various components of intervention fidelity were addressed. The interview guide will include questions related to (i) participants’ attitudes towards the proposed intervention material, (ii) participants’ thoughts on how to enhance and/or assess fidelity of provider training by the research team based on the examples they were shown, and (iii) participants’ thoughts on how to enhance and/or assess fidelity of the proposed intervention delivery by the providers to the patients based on the examples they were shown. Content experts in qualitative research, intervention fidelity, and LBP will be consulted to establish face validity of the interview guide. The interview guide will be pilot tested with two of the participants and refined if necessary.
Coding will begin after 3–5 interviews have been completed and transcribed using NVivo (V12, QSR International, Melbourne, Australia). Two reviewers will read transcripts until they are familiar with the data prior to beginning coding. The TDF will be used as a coding framework to code and analyse the data.
Data will be analysed using a three-step process: (1) domain coding; (2) generating specific belief statements; and (3) identifying relevant domains. Two reviewers will independently code participant responses into the relevant theoretical domain(s). We will use the 14 domains from the revised version of the TDF as well as an additional “other” domain to capture any responses that do not fit into one of the TDF domains. The reviewers will meet after coding the first two transcripts to compare results and Fleiss’ kappa (κ) will be calculated for all domains to assess how reliably the reviewers coded the same response to the same domains. Any domains with κ < 0.8 will be coded to consensus. The remaining interviews will be coded independently by the same two reviewers and once all interviews have been completed, κ will again be calculated, with any domains with κ < 0.8 reviewed and coded to consensus. Then, one reviewer will generate a statement representing the key message of each response (specific belief). The list of specific beliefs will be reviewed by another reviewer for completeness and accuracy. Lastly, the two reviewers will use discussion to identify which domains likely represent the perceived barriers and enablers to ensuring fidelity of training or delivery. The domains most likely representing perceived barriers and enablers to ensuring fidelity of training or delivery will be identified through consideration of: the frequency of the belief statements; the presence of conflicting beliefs; and the perceived strength of the impact a belief may have on the target behaviours17.
Responses will be coded into the “other” domain if they do not reflect barriers or enablers related to the behaviour of interest (i.e., enhancing and/or assessing fidelity of training or delivery). These responses may relate to clinicians’ general perceptions of the intervention material or perceived acceptability of this intervention by patients. Responses in the “other” domain will be analysed inductively to establish categories and themes.
This study has received ethics approval from the Newfoundland and Labrador Health Research Ethics Board (HREB #2020.299). Clinicians interested in participating in the study will be provided with a project information letter prior to the interview. At the start of each interview, participants will be asked if they have read the information letter, if they have any questions, and whether or not they consent to participating in this study. Members of the research team will be available to answer any questions. Verbal consent, if obtained, will be documented. Completion of the interview will imply that the participant consented to the entire interview and consent was not withdrawn during this period.
Non-indicated imaging for LBP is a form of low-value care and the routine use of imaging is not recommended in clinical practice24. Interventions that are aimed at targeting this behaviour are needed to improve patient outcomes and reduce overutilisation of healthcare resources. By developing an understanding of barriers and enablers to intervention fidelity prior to the start of a trial, intervention developers will have the opportunity to further refine the intervention and make the trial more feasible and pragmatic. Specifically, exploring barriers and enablers to fidelity of training and delivery will allow for the development of strategies to enhance and assess fidelity of training and delivery during the trial, thereby improving the confidence we may have in the results of the trial. This study will be an important step in developing a fidelity protocol for the upcoming cluster randomised controlled trial of the theory-informed intervention aimed at reducing non-indicated imaging for LBP in NL. Our results may help to ensure that the proposed intervention will be delivered with good fidelity and that fidelity can be appropriately assessed.
Open Science Framework: Exploring perceived barriers and enablers to fidelity of training and delivery of an intervention to reduce imaging for low back pain: a qualitative interview study protocol (extended files). https://doi.org/10.17605/OSF.IO/2R45Z22.
Data are available under the terms of the Creative Commons Attribution 4.0 International license (CC-BY 4.0).
Is the rationale for, and objectives of, the study clearly described?
Partly
Is the study design appropriate for the research question?
Yes
Are sufficient details of the methods provided to allow replication by others?
Partly
Are the datasets clearly presented in a useable and accessible format?
Not applicable
Competing Interests: No competing interests were disclosed.
Reviewer Expertise: Chiropractic practitioner, educator, and clinician scientist with experience in explanatory and pragmatic clinical trials, research and publications in the area of clinical decision making and experience training clinicians participating in clinical trials.
Is the rationale for, and objectives of, the study clearly described?
Yes
Is the study design appropriate for the research question?
Yes
Are sufficient details of the methods provided to allow replication by others?
Yes
Are the datasets clearly presented in a useable and accessible format?
Not applicable
Competing Interests: I was the lead author of the development of the intervention that is planned to be tested in the eventual RCT (ref 16)
Reviewer Expertise: Intervention development and feasibility testing, particularly in the area of reducing imaging for low back pain.
Alongside their report, reviewers assign a status to the article:
Invited Reviewers | ||
---|---|---|
1 | 2 | |
Version 1 10 May 21 |
read | read |
Provide sufficient details of any financial or non-financial competing interests to enable users to assess whether your comments might lead a reasonable person to question your impartiality. Consider the following examples, but note that this is not an exhaustive list:
Sign up for content alerts and receive a weekly or monthly email with all newly published articles
Register with HRB Open Research
Already registered? Sign in
Submission to HRB Open Research is open to all HRB grantholders or people working on a HRB-funded/co-funded grant on or since 1 January 2017. Sign up for information about developments, publishing and publications from HRB Open Research.
We'll keep you updated on any major new updates to HRB Open Research
The email address should be the one you originally registered with F1000.
You registered with F1000 via Google, so we cannot reset your password.
To sign in, please click here.
If you still need help with your Google account password, please click here.
You registered with F1000 via Facebook, so we cannot reset your password.
To sign in, please click here.
If you still need help with your Facebook account password, please click here.
If your email address is registered with us, we will email you instructions to reset your password.
If you think you should have received this email but it has not arrived, please check your spam filters and/or contact for further assistance.
Comments on this article Comments (0)