Keywords
patient safety, safety culture, hospital setting, healthcare worker, management
patient safety, safety culture, hospital setting, healthcare worker, management
A short summary of our updates is: an enhanced review of the deployment of safety culture as a concept, and the differing perspectives therein; an incorporation of the new research question recommended; a clarification on the specific focus and limitation of the research; clarification on the treatment of varying measurement instruments in the review; and an adjustment to the reference in the Lancet, as observed by both reviewers.
See the authors' detailed response to the review by Jane K. O'Hara
See the authors' detailed response to the review by Laura Adamson
In 2000, the seminal report by the Institute of Medicine, To Err is Human, estimated over 90,000 patient deaths from medical error related to both system failure and poor organisational culture1. Since that time the incidence of patient safety events have remained high globally, due in part to the increasing complexity of healthcare and multi-morbidities2,3. To Err is Human recommended the concept of a patient safety culture to support the health workforce to provide safer care1,4. A major focus is on the reduction and mitigation of patient safety events, building a culture of reporting and learning from events, and supporting those affected by harm. Patients are considered first victims of patient safety events, while members of the workforce may experience a second victim impact, including physical and psychological distress5,6. How organisations respond to and learn from safety events affecting patients, families and staff is a marker of their patient safety culture and impacts the future safety and wellbeing of all concerned.
A safety culture is about shared organisational beliefs, values, norms and procedures for patient safety7,8. Safety climate, on the other hand, relates to a group or team perception of safety culture in organisations9. Rather than a specific process or technology, interventions to promote a culture of safety are designed to improve organisational conditions, enhancing leadership and teamwork among health care providers to support safe patient care10–12. Safety culture interventions which target staff behaviour include executive walk-rounds or interdisciplinary rounds; multicomponent unit-based interventions; team training or communication initiatives11; frameworks for assessing, reporting and improving patient safety concerns; and standalone courses13,14. Patient safety educational interventions have also targeted the patient safety skills, attitudes and knowledge of healthcare workers to support safe patient care15, with safety culture likely moderating their impact16. While there are over 80 definitions of the terms “safety culture”, “patient safety culture” and “safety climate” across the literature17, core distinctions are set out in Table 1.
Patient safety culture | One aspect of an organization’s culture. It can be personified by shared values, beliefs, norms, and procedures related to patient safety among members of an organization, unit, or team. It influences clinician and staff behaviours, attitudes, and cognitions through cues about the relative priority of patient safety compared to other goals such as throughput or efficiency11. |
Safety culture | The product of individual and group values, attitudes, perceptions, competencies, and patterns of behaviour that determine the commitment to, and the style and proficiency of, an organisation’s health and safety management4. |
Safety climate | Group or team perceptions of safety culture in organisations. These are measurable aspects of safety culture, in contrast to domains of culture such as behaviour and values9. |
The theoretical construct of “safety culture” is contested in the literature18. One perspective posits that safety culture exists as an empirical measurable entity, as a product of values, beliefs, attitudes and behaviours, to be manipulated by intervening in the healthcare system4. A contrasting perspective views the concept of safety culture more usefully deployed as a conceptual lens to inform analysis of the healthcare system18. In the latter, safety behaviours are a reflection of a generic organisational culture, emerging over time through other multiple internal and external system dynamics19. The dearth of robust, definitive explanations for changes in safety culture in the literature, particularly those that demonstrate little connection between safety culture interventions and reduced adverse events, is seen as supporting the conceptual approach19.
The empirical assessment of safety culture is also diverse, with multiple tools based on unique constructs of safety culture17. Furthermore, there is increased recognition of the need for triangulated data sources to assess the safety of healthcare organisations. Data on safety culture alone is not always considered sufficient to explain changes in safety behaviours and culture19,20. Additional data sources such as routine hospital data on adverse events, and multiple types of data such as quantitative and qualitative are needed to better inform analysis19. Recently, Churrucca et al. constructed common over-arching themes to synthesise domains of safety culture across different assessment tools17. These common themes enable comparison between various data collection instruments17.
Reflecting the above debates, evidence on the effectiveness of interventions to improve safety culture is weak, but suggests they contribute to clinical care processes and to improved clinician and staff perceptions of safety culture11. A safety culture can support staff to deliver effective and timely care to patients, increase staff competencies to collectively learn from patient safety events when they occur21, and can strengthen organisational support to healthcare teams to recover from patient safety events22–26. Despite a focus on patient safety within measures of safety culture, there is inconsistent evidence for the link between interventions seeking to enhance a safety culture and patient outcomes such as hospital readmission rates, length of stay, pressure ulcers and falls, or ventilator associated pneumonia15,27–31. The knowledge base on safety culture and patient outcomes is mixed, and a safety culture can moderate the effects of patient safety interventions on patients.
Measures of safety culture focus on staff attitudes and behaviours related to the prioritisation of patient safety4,32,33. In hospitals, evaluations of safety culture typically measure workforce related domains such as teamwork, communication, or information exchange, safety culture outcomes such as reporting rates, and patient outcomes such as falls, length of stay, or readmission rates11,27. A minority of measures include domains related to staff outcomes such as staff safety behaviours, staff injury rates, or well-being following a patient safety event34. Interventions to enhance safety culture are generally targeted at enhancing the norms and behaviours of hospital staff, but without an associated focus or exploration of the staff outcomes associated with safety culture. Evidence suggests that a safety culture can alleviate stress and burnout for staff35–37, support recovery and learning from events, and safeguard against repeat events38–41 by supporting staff to safely speak out about what is not working34,42. There is a now a need for a review of the impact of safety culture interventions on staff, to generate a common understanding of what staff outcomes are associated with interventions to improve safety culture and what staff outcomes should be measured. This research seeks to isolate staff outcomes, thereby examining the impact of safety culture interventions on staff where staff effects are claimed to take place.
Safety culture measurement tools focus on generating data to improve the safety of care provided to patients, and they do so by measuring staff perceptions of safety culture43, including staff attitudes, behaviours, and norms17. Depending on the instruments selected, staff outcomes and experiences may be captured through the deployment of safety culture measurement tools alone or in combination with other data sources. Prior research suggests a bi-directional relationship between safety culture and staff experience. The strongest evidence suggests that a safety culture influences certain staff outcomes such as staff behaviour to improve safety, event reporting, staff turnover, and injury rates among staff34,44. This literature reviews seeks to isolate staff outcomes as the point of interest including, but not limited to, burnout, stress, well-being, turnover or absenteeism36,45. In doing this, the review recognises studies that claim to manipulate safety culture.
Hospital staff experiences of and outcomes from interventions to improve safety culture are rarely examined in their own right. There is a knowledge gap on how safety culture affects staff in hospital settings. This systematic review seeks to address the knowledge gap and generate a conceptual understanding of associated staff outcomes based on the available published evidence, evaluating the state of evidence connecting safety culture to staff outcomes. Understanding these issues is important: as Shaw et al. have stated, ‘there is no patient safety without health worker safety’46.
A systematic review of the literature will examine the state of evidence connecting interventions to improve safety culture to hospital staff outcomes. The research questions are:
1) How is safety culture defined in studies with interventions that aim to enhance it?
2) What effects do interventions to improve safety culture have on hospital staff?
3) What intervention features, safety culture domains or other factors explain these effects?
4) What staff outcomes and experiences are identified?
This study is a mixed methods systematic review47,48 of published literature guided by the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines49.
Searches will be conducted using the electronic databases of MEDLINE, EMBASE, CINAHL, Health Business Elite, and Scopus. The search strategy will include the following terms: patient safety culture, hospital workforce and management, hospital setting, and high-, middle- and low-income countries. The primary search will begin in PUBMED with major keywords listed on the Medline Medical Subject Headings (MeSH) terms, such as “patient safety,” “safety climate,” and “hospital workforce”. Search terms will be used in conjunction with Boolean Operators “AND” and “OR.” Supplementary Files will provide details of the full search strategy. Reference lists of all articles included for full-text screening will also be searched. A sample of the search run through Medline is provided in Table 2.
Articles that report research involving both clinical and non-clinical members of the hospital workforce, and hospital management, will be included. Articles will be included if they are (a) quantitative, qualitative or mixed methods studies that evaluate an intervention in a hospital setting with an explicit aim to improve safety culture; (b) contain empirical data for analysis; (c) are available in any language; (d) are published in peer-reviewed scholarly journals; and (e) are published since 2000 (from the publication date of To Err is Human).
Articles will be excluded if they (a) describe interventions that do not have an explicit aim to improve safety culture, (b) do not measure the effect of the intervention on safety culture, and/or (c) have a primary purpose other than hospital staff or patient safety culture. From a theoretical perspective, the research approach may limit the review to studies that view safety culture as amenable to change within a healthcare system, and exclude conceptual studies. The approach adopted is an explicit focus limited to studies that seek to measure change in safety culture as a totality and not sub-elements of safety-culture only. Limitations of the study design, such as bias toward quantitative studies and interventions which target safety culture will be acknowledged in the findings. Inclusion and exclusion criteria are illustrated in Table 3.
Search results will be entered to Endnote where duplicates will be removed. Titles and abstracts of remaining articles will be screened for inclusion by two reviewers in Covidence, a systematic review data management program. Disagreement will be resolved by discussion with a third reviewer. Those selected for full-text review will be assessed according to the inclusion and criteria for addition to the final sample, again by two reviewers and discussion with a third to resolve disagreements.
Data will be extracted from each article and organized into a matrix. The articles will be examined to determine if and how well they measure effect on or capture outcome experience of health care workers and management following safety culture interventions. Data will be organised according to author, year, sample size, sample characteristics, place of publication, study setting, study design, intervention structure, intervention content, intervention duration, outcomes measured, measurement instrument, and principal findings. Data from included articles will be assessed independently by two authors, and disagreements will be resolved by discussion until a consensus is reached. The mixed-methods appraisal tool (MMAT) will be used as a quality assessment tool, with two authors discussing and cross-checking quality scores49–51. The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials52 and non-randomised studies of interventions53 will be employed to verify bias.
Synthesis will follow the Joanna Briggs Institute methodological guidance for mixed methods reviews, which recommends a convergent approach to synthesis and integration48 following the work of Hong et al.,50 and Sandelowski51. A convergent integrated approach, with simultaneous synthesis, is suitable as the review question can be answered by both quantitative and qualitative research designs, involves data transformation and allows reviewers to combine quantitative and qualitative data48. To answer the research questions ‘how is safety culture defined in studies with interventions that aim to enhance it.?’; ‘what effects do interventions to improve safety culture have on staff?’; ‘what intervention features, safety culture domains or other factors explain these effects?’, and ‘what staff outcomes and experiences are identified?’ a thematic analysis of staff outcomes will be simultaneously combined with data on measures and effects available in the evidence.
Is the rationale for, and objectives of, the study clearly described?
Yes
Is the study design appropriate for the research question?
Yes
Are sufficient details of the methods provided to allow replication by others?
Yes
Are the datasets clearly presented in a useable and accessible format?
Not applicable
Competing Interests: No competing interests were disclosed.
Reviewer Expertise: Outcome assessment, Clinical epidemiology, Quality and safety, Population health
Competing Interests: No competing interests were disclosed.
Reviewer Expertise: Incident learning systems and safety culture in Radiation Oncology.
Is the rationale for, and objectives of, the study clearly described?
Yes
Is the study design appropriate for the research question?
Yes
Are sufficient details of the methods provided to allow replication by others?
Yes
Are the datasets clearly presented in a useable and accessible format?
Not applicable
Competing Interests: No competing interests were disclosed.
Reviewer Expertise: Incident learning systems and safety culture in Radiation Oncology.
Is the rationale for, and objectives of, the study clearly described?
Partly
Is the study design appropriate for the research question?
Partly
Are sufficient details of the methods provided to allow replication by others?
Yes
Are the datasets clearly presented in a useable and accessible format?
Yes
Competing Interests: No competing interests were disclosed.
Alongside their report, reviewers assign a status to the article:
Invited Reviewers | |||
---|---|---|---|
1 | 2 | 3 | |
Version 2 (revision) 18 Nov 22 |
read | read | |
Version 1 01 Jul 22 |
read | read |
Provide sufficient details of any financial or non-financial competing interests to enable users to assess whether your comments might lead a reasonable person to question your impartiality. Consider the following examples, but note that this is not an exhaustive list:
Sign up for content alerts and receive a weekly or monthly email with all newly published articles
Register with HRB Open Research
Already registered? Sign in
Submission to HRB Open Research is open to all HRB grantholders or people working on a HRB-funded/co-funded grant on or since 1 January 2017. Sign up for information about developments, publishing and publications from HRB Open Research.
We'll keep you updated on any major new updates to HRB Open Research
The email address should be the one you originally registered with F1000.
You registered with F1000 via Google, so we cannot reset your password.
To sign in, please click here.
If you still need help with your Google account password, please click here.
You registered with F1000 via Facebook, so we cannot reset your password.
To sign in, please click here.
If you still need help with your Facebook account password, please click here.
If your email address is registered with us, we will email you instructions to reset your password.
If you think you should have received this email but it has not arrived, please check your spam filters and/or contact for further assistance.
Comments on this article Comments (0)