Keywords
Disability; regulation; compliance; residential care.
Non-compliance with care regulations is common but underlying causes are poorly understood.
We used inspection data to calculate the frequency of non-compliance in residential disability services (RDS) in Ireland and characterised the non-compliance using thematic analysis.
The median level of non-compliance across all centres was 27% (interquartile range 13% to 46%). Of the 1263 centres inspected 13 (1%) were compliant and 100 (8%) were non-compliant with all regulations inspected. Eight themes were identified in a sub-sample of non-compliant inspections. The theme ‘insufficient resources’ appeared most frequently, second was ‘governance and management failings’. The theme ‘poor documentation quality’ had the broadest explanatory reach, linked to non-compliance in 72% of regulations.
Non-compliance with regulations is common in Irish RDS. Themes describing non-compliance provide insight to service providers and regulators to develop quality improvement initiatives. Interventions focusing on resources, documentation quality and governance are most likely to stimulate broad-based improvement across all regulations.
Disability; regulation; compliance; residential care.
The statutory regulation of health and social care services is commonly used to assure quality, increase accountability and identify opportunities for improvement. Regulation can be defined as: “sustained and focused control exercised by a public agency over activities that are valued by a community”1. Governments typically empower an independent authority to regulate and inspect service providers. There are also models of mandatory accreditation that are largely equivalent to regulation2,3. In the health and social care field a wide range of regulations related to structures (e.g. the physical environment) and processes (e.g. infection control procedures) are assessed in different jurisdictions.
Regulatory compliance is the degree to which an organisation adheres to the prescriptions of the regulator: “behavior fitting expectations communicated to regulatees regarding how the former [regulatees] should or should not behave in a given situation”4. Non-compliance provokes some form of response from the regulator and can lead to an escalating set of sanctions including, in rare circumstances, the withdrawal of licenses to operate5.
Non-compliance with health and social care regulations is common as evidenced in a range of contexts: 22% of adult social care services in England received ratings of ‘requires improvement’ or ‘inadequate’ with respect to regulations pertaining to governance6; non-compliance with certain personal and clinical care standards in Australian residential care settings was as high as 44% between April and June of 20227; nursing home inspectors in the USA make an average of between six and seven findings of non-compliance (deficiencies) per standard inspection8. An improved understanding of the reasons for non-compliance may assist service providers and regulators in identifying opportunities to improve compliance. It would be particularly useful to know which causes have the broadest reach across regulations as addressing such root causes could have a large impact on overall compliance and quality of care.
While inspection reports are routinely published, we have found no research (by means of a preliminary systematic search) that uses this potentially rich source of information to identify the most common reasons for non-compliance9,10.
Residential disability services provide care to a vulnerable population. Mortality rates for people with disabilities living in residential care facilities are lower than those for the general population11,12. There is a high prevalence of abuse of people with intellectual disabilities when compared with the general population13. Communication difficulties can often represent a barrier between people with disabilities and health and social care professionals, making it difficult to identify healthcare needs and preferences14. From a service provider perspective, social care is challenged in many jurisdictions by a funding crisis that has concomitant impacts on quality15–17. It is therefore particularly important to improve compliance in the residential disability sector given the unique vulnerabilities of the population coupled with the challenges that exist in service provision.
This study answer three questions. First, what is the frequency of non-compliance with health and social care regulations at residential centres for people with disabilities in Ireland? Second, what are the causes of non-compliance as stated in inspection reports? Third, which causes of non-compliance have the broadest impact across regulations?
This was a descriptive, qualitative study using document analysis. The document analysis was conducted in accordance with the seven phase process outlined by Moilanen. First, determining the purpose, data and study design; second, determining the selection strategy; third, selecting or developing an extraction matrix; fourth, pilot testing; fifth, collecting and analysing data; sixth, credibility of the study; seventh, research ethics18. Thematic analysis was conducted as a part of the fifth step.
We identified inspection reports for providers of residential care for people with disabilities [hereafter referred to as ‘centres’] published by the health and social care regulator in Ireland [hereafter referred to as ‘the regulator’] as potentially suitable for addressing the research questions. Inspections of centres in Ireland are typically carried out by one inspector over one to two days. Inspectors do not assess all regulations during an inspection. In advance of an inspection inspectors will choose what to assess from a total of 32 regulations. During the course of an inspection, inspectors will speak with residents and staff as well as carers or relatives of residents should they make themselves available. They will also observe care, assess the physical environment and review documentation19.
There were 1329 inspections carried out by the regulator in 2022, 70% of which were unannounced20. The frequency of a centre’s inspections can be higher where poor levels of compliance are identified. In 2022, 145 centres were inspected twice and 23 were inspected 3 or more times20. The regulator publishes most inspection reports within four months of the inspection (some are withheld in the interests of protecting people’s identity, see section on ethical approval) after a process of quality assurance and allowing centre a right of reply to the findings19.
All centres in Ireland that were inspected by the regulator between 1st January 2019 and 31st October 2022 inclusive, were included. There were 1401 centres operating in Ireland as of 31st December 2021 (the most recently-published data by the regulator for the sample period), these included the following service types: adults (n=1270; 90.7%), children (n=94; 6.7%), mixed i.e., all age groups (n=37; 2.6%)21.
Access to compliance data was approved by the regulator via a letter from the Chief Inspector of Social Services. In addition, PD was legally authorised to access this data as a current employee of the regulator and their status as an authorised person. PD obtained the data by accessing the regulator’s IT system (PRISM), selecting the necessary variables through an ‘advanced find’ search and exporting the resulting data to an Excel spreadsheet22.
These data included the inspection reference number (alphanumeric), inspector’s name (character), centre name (character), centre identification number (alphanumeric), inspection type (categorical: risk inspections [conducted due to significant concerns about quality and safety of a service]/thematic inspections [focused solely on infection control practices]/new applicant inspections [assessments of centres prior to admitting residents]/regular inspections [wide-ranging assessments that were carried out twice per three year period for each centre]) and service type (categorical: adults/children/mixed).
Compliance judgments for each regulation that was assessed by the inspector on the day(s) of inspection were included. There were three possible judgments: compliant, substantially compliant, and not compliant. The regulatory judgments are described by the regulator as follows: “Compliant means the provider and or the person in charge is in full compliance with the relevant regulation. Substantially compliant means that the provider or person in charge has generally met the requirements of the regulation but some action is required to be fully compliant. A judgment of not compliant means the provider or person in charge has failed to comply with a regulation and that considerable action is required to reach compliance”19.
We used published and unpublished inspection reports as a data source. Inspection reports were authored by inspectors and contained descriptions of their findings on the day of inspection. Reports follow a template with three main sections: section 1, what residents told inspectors and what inspectors observed; section 2, capacity and capability (the governance arrangements and resources available to a centre to carry on the service); section 3, quality and safety. Section 1 contains descriptions of interactions with residents and inspector observations on how care was provided. There are no regulatory judgments in this section. In section 2, the inspector(s) write a narrative describing the centre’s capacity and capability for providing the service, referencing issues such as governance arrangements, training, complaints and the management of incidents. At the end of section 2 the reports contain a list each of the regulations assessed in the capacity and capability category as well as the regulatory judgment (compliant/substantially compliant/not compliant) for each, along with text as supporting evidence for the judgment. In section 3, the inspector(s) describe in narrative form their findings with respect to quality and safety (e.g. quality of life, activities, fire safety, safeguarding) and the report lists each of the regulations assessed in the quality and safety category, along with the regulatory judgment and the supporting evidence for each. During the period covered by this study there were 32 regulations that could feature in inspection reports23 (Supplementary file 1 contains a full list of regulations). The 32 regulations contain multiple sub regulations, as demonstrated for regulation 10 (communication) below:
“Communication
10. (1) The registered provider shall ensure that each resident is assisted and supported at all times to communicate in accordance with the residents’ needs and wishes.
(2) The person in charge shall ensure that staff are aware of any particular or individual communication supports required by each resident as outlined in his or her personal plan.
(3) The registered provider shall ensure that—
(a) each resident has access to a telephone and appropriate media, such as television, radio, newspapers and internet;
(b) where required, residents are facilitated to access assistive technology and aids and appliances to promote their full capabilities; and
(c) where required residents are supported to use assistive technology and aids and appliances.”23
Some regulations are worded in a manner that seeks to provide support to people relative to their specific needs whereas others are more prescriptive in terms of the facilities that should be provided to people (e.g. a telephone).
All inspection reports described the evidence identified by the inspector to support each compliance judgment. The evidence supporting judgments of ‘not compliant’ and ‘substantially compliant’ were the data of interest for this study. While ‘substantially compliant’ could be read as a positive finding, we opted to include data pertaining to these judgments because, as per the description above, they referred to some element of the regulation not being satisfactorily met.
The time period for the sample (1st January 2019 to 31st October 2022) was chosen because the regulator changed the way regulations were assessed during the course of 2018. Any inspections conducted prior to this used different compliance judgments. The end date for the sample was the last full month available prior to commencing data extraction.
There are four inspection types: monitoring inspections which are conducted routinely regardless of the level of risk in a service; risk inspections which are carried out on foot of concerns around the quality and safety of a service; new applicant inspections that take place prior to a service commencing operations; and thematic inspections which focus on a specific aspect of care. We selected monitoring inspections for our analysis (n=1917). We did this because of the nature of the other inspection types. Risk inspections could have biased the sample as they are conducted due to specific quality concerns. Thematic inspections only covered infection control during the study period. New applicant inspections only assess the likelihood of future compliance.
To ensure a centre was represented only once in the sample we retained the most recent inspection reports for each centre. This sample contained inspection reports for 1263 centres, one report per centre.
A thematic analysis was conducted of causes of non-compliance on a sub-sample of 35 inspection reports. The sub-sample was identified by first excluding all reports with 100% ‘compliant’ judgments (n=777) as they contained no relevant data i.e., information on non-compliances. We then randomly sampled the remaining 1140 inspection reports. Each included inspection was allocated a random number in MS Excel22 through the random number generator function which produced the seed for the sample. Inspections were then sorted in ascending order by the seed. We selected the first 25 inspections on the list and this constituted the first tranche of reports in the sub-sample. To ensure an inspector was only represented once in the sub-sample we retained their numerically first inspection and deleted any subsequent ones. We then replaced a deleted inspection with the next inspection on the list by an inspector that did not appear in the initial 25.
Data were imported into R Studio (Version 2023.03.0, RStudio PBC)24. We calculated the frequency each regulation was assessed and the non-compliance percentage for each regulation ((total number of judgments of ‘not compliant’ and ‘substantially compliant’/total number of judgments) * 100) in the sample (n=1263).
We calculated the mean non-compliance percentage for all centres by first calculating the non-compliance percentage for each individual centre. This was done by summing the number of judgments of ‘not compliant’ and ‘substantially compliant’ in each inspection and dividing the result by the total number of regulations assessed in the inspection: ((number of judgments of ‘not compliant’ and ‘substantially compliant’/total number of judgments) * 100). We used this to calculate the mean non-compliance percentage for all centres.
We calculated the number of centres that were fully compliant (i.e. were found to be in compliance with all regulations that were assessed on an inspection) and centres that were fully non-compliant (i.e. no regulations assessed during the inspection were found to be compliant).
Descriptive statistics (n (%) or median (IQR) as appropriate) for centre type; publication status; bed number; year of inspection; overall non-compliance percentage; number of fully compliant and fully non-compliant centres for all inspection reports in the sample and sub-sample were calculated.
We adopted a thematic analysis approach to identify reasons for non-compliance using the first tranche of 25 inspection reports in the sub-sample. Two researchers (PD and LMK) piloted a data extraction process for three inspection reports. The focus of data extraction was on phrases or sentences that supported compliance judgements made by the inspector. We included the number of the regulation that was associated with the extracted text. Subsequent to the pilot we amended the data extraction form to specify which section in the report the extracted data came from.
Two researchers (PD and LMK) independently coded an initial five reports. Coding was performed inductively where each researcher assigned codes to the text using NVivo25. There were occasions in reports where a non-compliance was referenced in more than one section. Similarly, there were instances where several issues that contributed to a single instance of non-compliance were listed e.g. multiple rooms in a premises that required cleaning. In such cases, to avoid counting multiple instances of the same reasons for non-compliance and increasing the frequency count for that code, we only coded one piece of text relevant to a reason for non-compliance per report. However, the same piece of text was placed in multiple codes where appropriate. For example, the following text “one resident had no plan in place to guide how they should be supported with their mental health diagnosis” could be placed in a code related to ‘documentation’ as well as ‘guidance for staff’.
Upon completion of coding the initial five reports, codebooks were generated through NVivo25 where PD and LMK then met to compare and agree coding and interpretation of the data, and devise any additional codes for inclusion. Disagreements were resolved through consensus or through discussion with the third author (JB). The codebook was subsequently revised and PD coded the remaining data independently.
PD reviewed the codes to group them into sub-themes and parent themes that characterised the reasons for non-compliance. Once completed, PD reviewed all sub-themes and parent themes to identify similarities and determine whether any could be combined or collapsed. We proceeded to add five inspection reports to the sub-sample until saturation was reached i.e. no new themes were identified.
We then determined the frequency effect size (FES) and intensity effect size (IES) for each parent theme and sub-theme by adapting an approach to meta-summary as described by Sandelowski (2007)26. The FES represents how prevalent each theme and sub-theme was in the sample of inspection reports and the IES represents the quantity of data coded to a theme and sub-theme as a proportion of all coded data. The FES was calculated by dividing the number of reports that included a theme by the total number of reports in the sample. The IES was calculated by dividing the total number of texts (‘texts’ refers to words or phrases which were coded during thematic analysis) included in a theme and sub-theme by the total number of texts. We reported our thematic analysis findings under each parent theme in order of highest FES.
We mapped the parent themes back to the regulations by identifying which regulation was being referred to in each individual piece of text, calculating the frequency and percent contribution of themes to each regulation and tabulating these data as a heat map.
Inspection reports contained no personally identifiable information (PII) relating to residents as this is the policy of the regulator27. As such, there was no PII contained in these data apart from the name of the person in charge of the centre which is publicly available. All data pertaining to this research were stored on a secure online platform. Files used for the analysis were only accessible by the first author and shared with the other authors as necessary.
The lead author, PD, is a full-time employee of the Health Information and Quality Authority (HIQA) which is the regulator for health and social care in Ireland. PD is engaged in a PhD that is funded by HIQA and this study comprises part of the PhD research. PD is a male with over 10 years of experience working in a regulatory capacity. There is a potential for the experience of working in a regulatory capacity to influence the means by which documents were analysed in this study and in the interpretation of data. To guard against this, document analysis involved the input of the other authors and the potential for bias or assumptions to be introduced into the interpretation of data was openly discussed among the authors at all stages of the research.
The Social Research Ethics Committee of University College Cork, Ireland, granted ethical approval for this research (Log: 2023-011) on 16/3/2023. Ethical approval was sought in order to access the inspection reports that were not published by the regulator. Non-publication of inspection reports is typically done to protect the identity and privacy of people living in a centre. For example, where a centre has only one resident, making that inspection report (which may contain sensitive information such as their healthcare or safeguarding needs) publicly available would compromise that person’s privacy and dignity. Unpublished reports accounted for 150 (11.9%) of the total sample. There were no human participants so there was no need to obtain consent from any individual for participation.
1263 inspections were included in our study that took place between 1st January 2019 and 31st October 2022 inclusive. These included 19,173 individual assessments of regulations. All of the possible 32 regulations were featured (Figure 1). There were inspection reports for 1,147 (91.8%) adult centres, 87 (6.9%) children’s centres and 29 (2.3%) mixed centres. Unpublished reports accounted for 150 (11.9%) of the total sample. The median (IQR) bed number in centres was 5.0 (4.0, 8.0). There were 256 (20.3%) inspections in 2019, 79 (6.3%) in 2020, 403 (31.9%) in 2021 and 525 (41.6%) in 2022. The median centre-level non-compliance was 27% (13%, 46%). Thirteen centres (1%) in the overall sample had an inspection where all regulations assessed were judged compliant; 100 centres (8.1%) failed to comply with any regulations. The characteristics of the sub-sample were broadly similar to the overall sample (Table 1).
* The number at the end of each bar represents the number of occasions the regulation was assessed.
Characteristic | Total, n = 12631 | Sub-sample, n = 351 |
---|---|---|
Service type | ||
Adults | 1147 (90.8%) | 32 (91.4%) |
Children | 87 (6.9%) | 2 (5.7%) |
Mixed | 29 (2.3%) | 1 (2.9%) |
Publication status | ||
Report not published | 150 (11.9%) | 3 (8.6%) |
Report published | 1113 (88.1%) | 32 (91.4%) |
Beds | 5.0 (4.0, 8.0) | 6.0 (4.0, 8.0) |
Year of inspection | ||
2019 | 256 (20.3%) | 9 (25.7%) |
2020 | 79 (6.3%) | 1 (2.9%) |
2021 | 403 (31.9%) | 10 (28.6%) |
2022 | 525 (41.6%) | 15 (42.9%) |
Non-compliance percentage | 27 (13, 46) | 32 (14, 50) |
Fully compliant centres | 13 (1.0%) | n/a |
Fully non-compliant centres | 100 (8.1%) | n/a |
“Governance and management” was the most frequently assessed regulation (n=1256, 99.4%), followed by "staffing” (n=1192, 96.5%) and “training and staff development” (n=1133, 91.8%). The regulation with the highest percentage of non-compliance (not compliant + substantially compliant judgments) was “fire precautions” (53.4%), followed by “written policies and procedures” (52.1%) and "premises” (52.1%). “Insurance”, was found fully compliant in all inspections where it was assessed (n=250).
Eight parent themes describing reasons for non-compliance were identified. In order of FES these were: insufficient resources, governance and management failings, poor documentation quality, non-person-centred care, weak processes, inadequate safety, staffing-related concerns and poor care management (Table 2).
Theme/sub-theme | FES* (n=35) | IES** (n=385) | ||
---|---|---|---|---|
n | % | n | % | |
Insufficient resources | 27 | 77.1 | 65 | 16.9 |
Quality of physical premises | 22 | 62.9 | 49 | 12.7 |
Other resources | 10 | 28.6 | 16 | 4.2 |
Governance and management failings | 23 | 65.7 | 57 | 14.8 |
General governance issues | 16 | 45.7 | 21 | 5.5 |
Reporting failures | 10 | 28.6 | 14 | 3.6 |
Quality improvement issues | 8 | 22.9 | 8 | 2.1 |
Inadequate management supervision | 7 | 20.0 | 11 | 2.9 |
Incompatibility of residents | 3 | 8.6 | 3 | 0.8 |
Poor documentation quality | 23 | 65.7 | 77 | 20.0 |
Failure to review/update a plan or document | 16 | 45.7 | 21 | 5.5 |
Planning documents or information not available, not comprehensive or poor quality | 16 | 45.7 | 32 | 8.3 |
Record keeping failures | 14 | 40.0 | 19 | 4.9 |
Contract of care issues | 4 | 11.4 | 5 | 1.3 |
Non-person-centred care | 21 | 60.0 | 66 | 17.1 |
Non person-centred care | 16 | 45.7 | 31 | 8.1 |
Unmet resident need | 12 | 34.3 | 21 | 5.5 |
Information unavailable for residents | 7 | 20.0 | 7 | 1.8 |
Lack of privacy | 6 | 17.1 | 7 | 1.8 |
Weak processes | 20 | 57.1 | 40 | 10.4 |
Risk management problems | 14 | 40.0 | 20 | 5.2 |
Cleaning required improvement | 9 | 25.7 | 10 | 2.6 |
Infection control practices | 8 | 22.9 | 10 | 2.6 |
Inadequate safety | 17 | 48.6 | 40 | 10.4 |
Fire safety concerns | 15 | 42.9 | 31 | 8.1 |
Safeguarding concerns | 6 | 17.1 | 9 | 2.3 |
Staffing-related concerns | 16 | 45.7 | 27 | 7.0 |
Staff training unavailable or not provided | 14 | 40.0 | 23 | 6.0 |
Uninformed staff | 4 | 11.4 | 4 | 1.0 |
Poor care management | 9 | 25.7 | 13 | 3.4 |
Care not provided as per plan | 6 | 17.1 | 8 | 2.1 |
Behaviour management issues | 3 | 8.6 | 5 | 1.3 |
This parent theme refers to the physical and human resources available to the centre to provide a service. For clarity, the reference to resources in the title does not necessarily relate to financial resources. There were 27 inspection reports containing instances of this parent theme.
Quality of physical premises. Twenty-two inspection reports contained references to the quality of the physical premises where care was provided. The codes included in this sub-theme outlined problems related to inter alia the suitability of the premises for meeting the needs of residents; refurbishment requirements; worn surfaces and fabrics; accessibility difficulties and general maintenance or repairs. The code that most frequently appeared in this sub-theme was ‘fixtures, fittings or surfaces in need of repair’, for example: “damaged seals on a floor and other bathroom fittings and a damaged mirror”; “large furnishings required repair or replacement”; “internal window sills in one house were water damaged”. ‘Painting or decorating required’ was the second most frequent code: “chipped and worn paintwork was noted around both buildings”; “A number of rooms, including residents’ bedrooms required painting”.
Other resources. This sub-theme contained instances of where an inspection report described issues related to an identified lack of physical and human resources within the premises. Resources sometimes referred to relatively minor items such as clinical waste bins but also included inadequate staff levels to meet the assessed needs of residents, for example: “staff had told the inspector that recent staffing levels negatively impacted on their ability to support residents in activities both in the centre and in their local community, especially at the weekends”; “the provider had not consistently allocated sufficient staff to the centre to support residents' assessed needs”.
This parent theme refers to instances where the practices and structures relating to governance contributed to non-compliance; this theme was identified in 23 inspection reports.
General governance issues. This sub-theme contained instances of where services had failed with regard to routine governance matters. For example, codes included ‘no training needs analysis’, ‘no observational audits of hand hygiene’ and ‘failure to adhere to statement of purpose’. There were other examples where inspection reports described concerns with governance due to inaction or a failure to implement commitments that were previously made to the regulator: “improvements identified as required in relation to the premises at the time of the last inspection, had not yet been undertaken”; “A protective measure, stated by the registered provider to be in place, related to staff supervision. This protective measure was not in place on the day of inspection and only related to days that the person in charge was present in the house”. The code that appeared most frequently in this sub-theme related to a service’s failure to act on the findings of their own audits, for example: “The person in charge had identified that there remained an ongoing issue with the heating of the centre and temperature of water, as the controls were not contained within the building. There was no time bound plan to address this, and some areas of the centre were uncomfortably warm during the inspection”.
Reporting failures. Centre staff are responsible for reporting various incidents to relevant authorities. Ten inspection reports described failings in this responsibility. Primarily, these related to a failure to notify the regulator of certain prescribed incidents within the required timeframe e.g. “The use of some restrictive practices, including chemical and physical restraints, had not been notified to the Chief Inspector”; “13 notifications in relation to safeguarding were submitted retrospectively following inspection”. There were a smaller number of incidents relating to failures on behalf of staff to report certain incidents to management: “incidents were reported by staff when they encountered the person in charge rather than when the alleged event happened”; “staff had failed to record or report these behaviours as they felt it was unnecessary”.
Quality improvement issues. Eight inspection reports contained findings related to how quality improvement in services was not managed effectively. For example, in some cases audits were conducted that did not result in actions for quality improvement: “While the registered provider had in place a recent annual review of the quality and safety of the service provided to residents, there was no improvement plan identified in relation to notifiable incidents”. Inspectors also occasionally found fault with the quality of audit practice: “the inspector found that audits did not comprehensively reflect the known risks in the centre. Furthermore, there was no comprehensive plan in place to address these risks. It was not established therefore that these audits were being used as a tool to drive service improvement”.
Inadequate management supervision. There were examples in seven inspection reports of failures related to management supervision of the service and of staff. On occasion it was found that staff were not in receipt of supervision, support or development: “Records reflected that each staff member had been met once in the last twelve months and not every two months as per the providers [sic] policy”; “effective arrangements were not in place to support, develop and performance manage all members of the staff team”. There were some also instances of senior management not having sufficient time to carry out their duties: “The clinical nurse manager worked full-time hours in the centre, however approximately two-thirds of their shifts were spent as one of the two nurses directly supporting the residents throughout the day, with a limited portion of hours protected for attending to management duties”.
Incompatibility of residents. Three reports contained references to interpersonal difficulties between residents which were impacting on the wellbeing of all who lived in the centre. We determined this to be a governance and management issue as the service providers were aware of the difficulties but had not acted promptly: “The provider had failed to address the compatibility of residents in the centre. The inspector met five residents and two spoke of their worry, concern, avoiding contact with the resident experiencing unstable mental health and the limitations this had on their living environment”.
Instances of documents being insufficiently detailed, poor record-keeping or not properly reviewed were reflected in this parent theme. This parent theme was identified in 23 inspection reports.
Failure to review/update a plan or document. Sixteen reports contained examples of where plans or documents were available but had not been reviewed or updated in an appropriate manner. This included occasions where it was mandatory to review a document: “not all of the policies and procedures required to be maintained, as identified in Schedule 5 of the regulations, had been reviewed within the last three years as is required”; or where it would be deemed necessary to support residents’ care and support needs: “associated risk assessments and safety plans required reviewing to ensure that they included measures that were in line with the behaviour support plan”.
Planning documents or information not available, not comprehensive or poor quality. This sub-theme captured instances where inspectors found fault with various documents and information that were important for guiding care and support within a service. Some examples of the types of documentation that were found to be of poor quality or not comprehensive included assessments of need, personal plans, behaviour support plans and medication plans. Inspectors also found documentation and information to have been unavailable: “there was no procedure or guidance available to lone working staff around the supervision and care of residents”; or due to not being of the required quality: “While dietary care plans were on file, these had not been completed in consultation with multidisciplinary professionals such as dietitians or by staff with specific training or knowledge in the relevant areas”.
Record-keeping failures. There were 14 instances where inspection reports outlined failures in the maintenance of records. Among the codes included in this sub-theme were poor record upkeep; poor recording of fire safety precautions taken; poor record-keeping relating to restrictive practice use. In some cases, it was found that important information was not being recorded: “while the residents reported peer-on-peer related issues, they were not being recorded”; “the inspector found that a number of specific behavioural incidents were not being satisfactory logged or recorded”.
Contract of care issues. Four inspection reports detailed issues related to residents’ contracts of care. Some contracts were not signed by the resident or their representative, were generic in nature, or did not detail all charges for services. For example: “the agreements did not include details of the fees to be charged”.
This parent theme included instances where the care provided to people living in centres did not adequately take account of their individual needs and preferences; non-person-centred care was identified in 21 inspection reports.
General non-person-centred care. This sub-theme encompassed a wide range of practices that were considered to reflect care that did not meet the needs of individuals using services. Some of the codes related to failures by services to support residents in living a fulfilling life (e.g. poor access to activities; unresponsive to resident needs/preferences; lack of progress on personal goals) whilst others were related to the nature of the premises (e.g. premises required age-appropriate facilities for children; garden not accessible to wheelchair users; lack of suitable storage for residents). Some inspection reports relayed concerns as expressed by residents. For example, one report contained a reference to a resident telling an inspector that they had no remote control for their television, another described a resident expressing a wish to move to accommodation with fewer service users.
Unmet resident need. Twelve inspection reports noted that residents had needs that were either partially or fully unmet by the service, in part linked to insufficient staffing levels: “On other occasions it was noted that residents were asked to leave the vicinity during an incident where a resident was engaging in behaviours of concern. As there was only one staff member present, there was limited support for all residents during this time”; “Staff spoken with told inspector [sic] that the current staffing levels had affected residents' ability to access the community and attend activities”. There were some codes which appeared in this sub-theme as well as in non-person-centred care above because it clearly reflected an unmet need in addition to a failure to provide care in a person-centred manner. For example, the following text was placed in the ‘unmet responsive to resident preferences’ code in both sub-themes: “a review of daily notes indicated that some residents have limited opportunities to engage in activities that were in line with their interests, capacities and needs”.
Information unavailable for residents. Seven inspection reports contained findings where information on fees and services were not provided in contracts of care as required. In addition to contracts, there were failings found in terms of how information was presented (“some of the information displayed was too high on the wall for the children to see”) and with information not being made available (“the resident did not have access to information about their payments or financial affairs”). There was text in this sub-theme that also appeared in the contracts of care sub-theme above. For example, the failure to include details on additional charges was regarded as a shortcoming in the content of the contract and also a lack of information available to the resident.
Lack of privacy. This sub-theme reflected two distinct aspects of resident privacy. The first related to being facilitated to have a private space such as one’s own bedroom: “One area for improvement noted on the walkabout of the centre was the practice and use of viewing panels on residents bedroom doors…The inspector was not assured that these checks were required in response to the assessed needs of residents”; “the inspector saw that one resident had recently expressed a wish to have their own bedroom. There was no comprehensive, time-bound plan in place to support this resident to have their own room and to uphold their right to privacy”. Secondly, there were failures in terms of keeping personal information private: “Inspectors observed personal information regarding residents were being stored in communal areas”; “residents [sic] files were left in the kitchen area on an open shelved unit and one residents feeding support plan was taped to the kitchen table”.
This parent theme refers to instances where processes in a centre (e.g. cleaning routines or ongoing risk management) contributed to non-compliances. There were 20 inspection reports that contained instances of weak processes.
Risk management problems. Fourteen inspection reports detailed examples of where services had failed to identify risks (e.g. “a number of risks had not been identified within the designated centre's risk register, including the risk of injury to residents due to sloping roofs in residents’ bedrooms”); failed to carry out risk assessments for identified risks (e.g. “not all identified risks to residents had corresponding risk assessments”); and had not reviewed risk assessments appropriately (e.g. “risk assessments and safety plans required reviewing to ensure that they included measures that were in line with the behaviour support plan”). Some inspection reports also described occasions where the risk assessment processes required improvement, for example, in the context of risk rating: “some risk assessments required review as the ratings were not reflective of the risks posed by hazards in this centre”.
Cleaning required improvement. Nine reports noted that cleaning processes were inadequate. One of these reports described mould in areas. Others identified stains on carpets and toilets. Areas of general uncleanliness were also found: “shared shower spaces which were not clean and thick dust or cobwebs in some corners and ceilings around the house”.
Infection control practices. The processes supporting infection control were found to be insufficient in eight reports. The most frequent issue related to worn or damaged surfaces that could not be adequately cleaned and thereby presented an infection control risk. In addition, there were examples of where services had operated outside of national guidance for managing COVID-19 (e.g. “the inspector saw that the provider's written guidance and procedures for managing cases of COVID-19 had not been updated in line with the most recent public health guidance”; “staff practices regarding wearing of PPE [Personal Protective Equipment] at the start of the inspection did not reflect the most up-to-date guidance”.
This parent theme contained examples of where safety precautions were insufficient to ensure the wellbeing of people living in centres. Inadequate safety was noted in 17 reports.
Fire safety concerns. Fifteen reports contained instances where fire safety contributed to non-compliances. There were seven reports in which issues with fire doors (doors with a technical specification to withstand fire for a certain number of minutes) were identified. Fire doors were sometimes not in places they should have been (e.g. “considerable areas of the centre did not have fire doors fitted”), or they were being held open inappropriately (e.g. “it was observed that a resident's bin was placed in front of their bedroom door, which may prevent the door from closing in the event of a fire”). Other findings related to fire safety included: personal emergency evacuation plans (personalised plans for managing the evacuation of individuals) were not sufficiently comprehensive or not available in accordance with the service’s fire plan; fire equipment in need of repair/review; inadequate fire containment measures; and fire drills not being comprehensive.
Safeguarding concerns. Safeguarding is the practice of protecting a person from harm or neglect whilst also promoting their individual wellbeing28. Six inspection reports contained examples of where safeguarding investigations were not carried out: “an allegation of abuse raised in May 2020 had not been resolved. While the provider had put steps in place to begin the investigation it had not commenced at the time of this inspection”; safeguarding plans not put in place: “safeguarding plans had not been updated or put in place following incidents”; residents leaving a centre unsupervised: “three incidents had occurred in recent months which resulted in the resident leaving the centre without staff support”; and residents not being protected against the behaviours of concern of other residents: “residents were not safeguarded against the effects of behaviours of concern in the centre”.
This parent theme referred to instances where staff did not have the capacity to carry out their duties, due to being uninformed on people’s needs or not having access to training; there were 16 such instances in inspection reports.
Staff training unavailable or not provided. Fourteen inspection reports noted issues with mandatory training (e.g. fire safety) and with service-specific training (e.g. management of dysphagia). For example, “there were some gaps in staff being in receipt of training in mandatory areas and also in relation to training to support residents in relation to specific assessed needs”. In some instances, the inspector noted reasons for the lack of training of staff such as the unavailability of in-person training programmes due to COVID-19 restrictions and the inaccessibility of online training due to a cyber-attack on the computer systems of the Irish national health service.
Uninformed staff. Inspectors drew attention to staff not having the required knowledge or guidance to carry out their duties or meet the needs of residents in four reports. For example, “staff were unaware of specific sensory and tactile responses to be employed in the event that a resident was upset and required a behavioural support intervention. These therapeutic interventions were clearly documented in the resident’s behaviour support plan but the inspector did not see evidence that staff could identify and alleviate the cause of a resident’s behaviour”. One report noted excessive use of relief/agency staff which impacted on continuity of care and created extra work for regular staff.
This parent theme contained examples of where the care of persons living in a service was not managed in accordance with their identified needs and preferences. There were nine reports that contained such instances.
Care not provided as per plan. The types of plans referred to in this sub-theme included ‘personal plans’ which provide an overall assessment of a person’s needs and how these are to be met, as well as plans to address specific care needs such as behaviour support plans or a percutaneous endoscopic gastronomy (PEG) feed plan. Six inspection reports described occasions where the care provided was not in accordance with such plans. For example, “one resident had a protocol in place for the use of a psychotropic medication as needed (PRN). The protocol in place advised staff to monitor the resident for the presentation of three of six identified behaviours before administering this PRN. Progress notes suggested that at times, the resident only presented with one or two of these behaviours when staff had adminstered [sic] the PRN”.
Behaviour management issues. The management of residents’ behavioural support needs was found to be an issue in three inspection reports. In some instances these issues were impacting on the wellbeing of other residents: “the behaviours of a small number of residents were sometimes difficult for staff to manage in a group living environment and this had the potential to have a negative impact on other residents”.
Of the 32 regulations, 25 were featured in the sub-sample i.e. were found to be ‘not compliant’ or ‘substantially compliant’ in at least one inspection report (Figure 2). The theme of ‘poor documentation quality’ was linked to 18 of the 25 regulations, followed by ‘governance and management failings’ (n=15 regulations) and ‘non-person-centred care’ (n=12 regulations). The theme that was linked to the least number of regulations was ‘weak processes’ (n=4 regulations).
One regulation (positive behavioural support) was linked to all eight themes indicating that it was the area with the greatest variety of potential causes of non-compliance. Seven themes were identified as causes of non-compliance for the ‘risk management procedures’ regulation and six themes were linked to the ‘governance and management’ and ‘protection’ regulations. There were six regulations that appeared only once in the data and, by default, where only one theme appeared (communication; persons in charge; directory of residents; information for residents; medicines and pharmaceutical services; Notification of periods when the person in charge is absent).
Our findings show that non-compliance with social care regulations in residential disability services in Ireland is widespread. Only 1% of centres in our sample managed to be fully compliant. At the other end of the spectrum, over 8% of centres failed to comply with all of the regulations assessed during inspection. The median non-compliance percentage of centres nationally was 27%. This suggests that compliance with regulations in this sector is challenging and that only a very small number of centres were able to satisfactorily meeting all of the regulatory requirements.
It is difficult to compare our findings with similar care settings in other countries. For example, the Care Quality Commission (CQC) in England publish annual, national-level data on compliance levels but do not include data specific to residential disability services29. Moreover, the compliance descriptors differ to those used in Ireland (inadequate, requires improvement, good, outstanding). For reference, the CQC rated 83% of adult social care services as good or outstanding29. We could not identify any other publicly-available data on compliance levels in services similar to residential disability services in other countries.
Three regulations were found non-compliant more than half the time they were assessed: fire precautions; written policies and procedures; and premises. One potential explanation for the high level of non-compliance with these regulations may be found in their content and complexity. For example, the premises regulation contains seven subsections which specify requirements with a wide range of matters related to the physical infrastructure of centres such as design, outdoor areas, equipment and accessibility. Similarly, the fire precautions regulation has five subsections which cover firefighting equipment, staff training, fire drills and evacuation. This is in contrast with regulations such as insurance which has two subsections that require centres to have insurance against injury to residents and loss or damage to property — matters which are relatively simple to arrange. This regulation was found to be fully compliant in our sample.
A systematic review focusing on standards in healthcare settings identified several barriers in terms of implementation which may prove instructive due to their similarity with regulations30. Two themes are consistent with our findings: services have a lack of training, support tools and consistent monitoring processes; services have poor access to resources and funding. One outcome of insufficient funding identified in the review was the poor maintenance of infrastructure and equipment30; this outcome also featured prominently in our findings although our study was not designed to investigate whether this was a consequence of poor funding.
In exploring the causes of non-compliance, the theme that appeared most frequently was ‘insufficient resources’. A focus on remedying these matters — many of which appear to be financial or staffing matters — could contribute to significant improvements in compliance levels. Many reports drew attention to relatively minor maintenance or refurbishment works such as painting, the presence of mould, furniture repair or flooring problems. However, the inspection reports did not provide any additional explanation as to why these failings occurred. One might expect issues that were clearly visible and obvious to be identified and remedied on an ongoing basis by centre management. Indeed, there is a subsection in the governance and management regulation that requires centre providers to make unannounced visits to their centres every six months and prepare a report on the quality and safety of the service. One might conclude that the failure to address basic repair and maintenance issues is symptomatic of a lack of financial or staff resources to address such issues; or, a failure of governance and oversight.
However, not all resource-related issues can be remedied easily in residential care. It is difficult for service providers in Ireland to independently increase their available resources as the vast majority of residential disability centres are state-funded20. In 2019 the regulator in Ireland called attention to poor quality premises as a key challenge for service providers nationally and stated that state funding for new infrastructure would be required31. This underlines the need for a national strategy in Ireland focused on improving the quality of physical infrastructure in centres as well as identifying future reforms necessary to achieve a highly-person-centred approach to care for what will be a vulnerable, ageing population32.
The theme of ‘Governance and management failures’ featured prominently in the sub-sample of inspection reports. Material in this theme made reference to management in centres not acting on known issues, not supervising staff appropriately or not reporting matters as required. The regulation for governance and management was also frequently found not compliant, the fourth highest of the 32 regulations. It would seem logical to suggest that a centre that is not well managed will not only fail to meet governance and management regulations but also fail multiple other regulations. Therefore, improvements in governance and management — potentially through personnel with more management expertise or stronger accountability practices — may lead to concomitant compliance improvements across a broad range of regulations.
There are examples in the literature that can inform quality improvement approaches for governance. A systematic review of interventions to strengthen professional governance in nursing in a broad range of healthcare settings identified two broad approaches: enhancing structural empowerment and reinforcing leadership and teamwork33. The former included interventions such as the creation of nursing councils or expanding staff involvement in budgeting decisions. Interventions in the latter category included mentoring programmes and succession planning frameworks. Eight of the 12 studies included in the review reported positive results in terms of improvements to governance, albeit with some caution regarding the methodological quality of the included studies33.
Policy options to improve leadership in managers of Australian nursing homes was the subject of a systematic review published in 201034. The authors identified a range of options such as inter alia higher middle-manager qualification requirements; development of a leadership and management qualities framework; establishment of a minimum dataset for data on managers containing information on diversity, qualifications, remuneration and turnover34.
‘Poor documentation quality’ was the theme with the third highest FES in our study. Some of the sub-themes (i.e. ‘failure to review/update a plan or document’, ‘planning documents or information not available, not comprehensive or poor quality’) suggest that non-compliances were commonly found with care plan documentation. The accuracy and coherence of care plan documentation was also found to be poor in a study conducted in long-term care settings in the Netherlands35. The authors suggested that investments in resources such as more time for staff to attend to documentation and more structured (electronic) care plans had the potential to improve documentation quality35. Further, a systematic review evaluating the introduction of electronic nursing documentation found evidence that they can reduce documentation errors36. These studies illustrate possible means by which service providers can undertake quality improvement initiatives aimed at reducing non-compliances related to documentation.
When the themes were mapped back to the regulations we observed a difference across regulations with respect to how many themes contribute to findings of non-compliance. Of the 25 regulations in the sub-sample, ‘poor documentation quality’ was a factor in 18 (72%); ‘governance and management failings’ was a factor in 15 (60%). This suggests that improvements in both these themes could lead to broad-based improvement across all regulations. Conversely, there were some themes that appeared as factors in a relatively small number of regulations e.g. ‘weak processes’ (n=4) and ‘inadequate safety’ (n=5). To take inadequate safety as an example, this may mean that improvements in this regard would only impact a narrower range of regulations that are related to safety e.g. fire precautions or safeguarding.
Similar inferences can be drawn with respect to individual regulations. For example, there were 16 instances of non-compliance with the residents’ rights regulation but it was linked to only two themes, with one (non-person-centred care) accounting for 81.3% of its total. There were others such as positive behavioural support that featured all themes and where there was a broad spread in terms of each theme’s percent contribution (ranging from 2.8% for ‘inadequate safety’ to 33.3% for ‘poor documentation quality’). This suggests that there are some regulations that are quite narrow in terms of ways they can be found non-compliant and others which are more wide-ranging. The amount of content in each regulation, and its complexity, may also play a role in this regard.
There may be additional factors contributing to non-compliance that were not observable by our study. For example, how does the relationship between the regulatee and inspector influence the outcome of an inspection? Some recent research in the field of regulation has sought to investigate the interaction between inspector and regulatee to examine how this impacts on levels of compliance37,38. The wider context within which social care is structured and resourced may also have a bearing on levels of compliance with regulations. Many countries are in the midst of a crisis in social care, characterised by inadequate funding levels, staff shortages and demographic challenges15–17,39,40.
This is the first study to characterise non-compliance in a health or social care setting using thematic analysis. This type of analysis is sparse in the literature on regulatory compliance in health and social care services41. We used a structured approach to document analysis as described in Moilanen et al. (2022)18. We also adapted a method to measuring frequency and intensity effect sizes in our analysis, more commonly used in meta summaries26, which makes it somewhat novel. This allowed for a description of themes and regulations that highlighted their relative importance in terms of understanding non-compliance.
There were a number of limitations to our study. Some regulations did not appear in the sub-sample for the thematic analysis and several others were featured only once. It is possible that some additional themes may have emerged from assessing non-compliances related to these regulations. Nevertheless, the regulations that did feature in the sample are reflective of those most frequently-assessed and we are satisfied that the parent themes and sub-themes identified are representative of the broader problems found in centres.
Our findings rely on evidence described in inspection reports which, by their nature, constitute first order constructs. For example, an inspection report may include the following observation as evidence of non-compliance: “There was evidence of mould and condensation in the bedroom window of one resident”. Here, the mould was the cause of the inspector’s concern and the reason for the judgment of non-compliance. However, there may be several contributory factors at play here, ones that are not explicitly stated in the report. These may include poor cleaning practices, inadequate ventilation, or old/outdated premises. In turn, such contributory factors might have root causes such as poor staff culture or a lack of financial resources. Therefore, while we identify themes that represent reasons for non-compliance, these themes may themselves have deeper root causes which this study was not designed to identify. Nonetheless, we consider the findings of our study useful as they identify high-level failures that can be leveraged in further research to identify potential root causes.
A further potential limitation is observed in the somewhat circular nature of the relationship between themes and regulations. For example, the theme with the highest frequency in the governance and management regulation was ‘governance and management failings’. This is perhaps to be expected because the inspection reports, as described in the limitation above, do not provide any details which might identify deeper root causes for non-compliances. Nevertheless, we hold the view that mapping the themes to the regulations was a useful exercise as it demonstrated how some regulations can be failed in a multiplicity of ways and how certain themes of non-compliance, are found in the majority of regulations.
Non-compliance with social care regulations by centres in Ireland is commonplace. Interventions focusing on resources, governance and documentation quality represent areas for targeted improvements which may lead to higher overall levels of compliance. We describe non-compliance at the level of individual regulations where three (fire precautions, premises and written policies and procedures) were found non-compliant in more than half of the occasions they were assessed. The content and complexity of some regulations compared to others may go some way to explaining the observed differences in levels of non-compliance across regulations. Eight themes were identified in the text describing non-compliance in inspection reports. Some of the themes (e.g. ‘insufficient resources’) appeared frequently in inspection reports and were also featured more widely when mapped back to individual regulations. There may be deeper underlying causes that explain how these themes manifest. The themes describing non-compliance may provide insights to service providers and regulators in the development of quality improvement initiatives. Further quantitative studies on resource availability or qualitative research exploring non-compliance with individuals tasked with compliance in residential disability services (e.g. service managers or inspectors) may help elucidate these underlying causes.
The data used for this study are not publicly available due to privacy and ethical restrictions. The restrictions are necessary to protect the identity of individual people and centres. For example, it may be possible for someone to identify the type of care and support someone receives in a centre that accommodates just one person. The data are available on request from the corresponding author (pdunbar@hiqa.ie) and can be shared by way of a data sharing agreement that will require agreement of the Health Information and Quality Authority as the data controller. The Health Information and Quality Authority will facilitate sharing of the data if it can be established that they will be used for legitimate research purposes and that they will be managed and processed in line with all relevant data protection legislation.
Repository: List of 32 regulations. 10.6084/m9.figshare.2809981742.
Data file 1. (A complete list of the regulations pertaining to residential disability services in Ireland)
Repository: Standards for Reporting Qualitative Research (SRQR) checklist. 10.6084/m9.figshare.2809977843.
Data file 1. (Standards for Reporting Qualitative Research (SRQR) checklist)
Data are available under the terms of the Creative Commons Zero "No rights reserved" data waiver (CC0 1.0 Public domain dedication).
Is the work clearly and accurately presented and does it cite the current literature?
Yes
Is the study design appropriate and is the work technically sound?
Yes
Are sufficient details of methods and analysis provided to allow replication by others?
Yes
If applicable, is the statistical analysis and its interpretation appropriate?
Yes
Are all the source data underlying the results available to ensure full reproducibility?
Yes
Are the conclusions drawn adequately supported by the results?
Yes
References
1. A Reader on Regulation. 1998. Publisher Full TextCompeting Interests: No competing interests were disclosed.
Reviewer Expertise: Regulation; quality and safeguarding; governance
Alongside their report, reviewers assign a status to the article:
Invited Reviewers | |
---|---|
1 | |
Version 1 03 Feb 25 |
read |
Provide sufficient details of any financial or non-financial competing interests to enable users to assess whether your comments might lead a reasonable person to question your impartiality. Consider the following examples, but note that this is not an exhaustive list:
Sign up for content alerts and receive a weekly or monthly email with all newly published articles
Register with HRB Open Research
Already registered? Sign in
Submission to HRB Open Research is open to all HRB grantholders or people working on a HRB-funded/co-funded grant on or since 1 January 2017. Sign up for information about developments, publishing and publications from HRB Open Research.
We'll keep you updated on any major new updates to HRB Open Research
The email address should be the one you originally registered with F1000.
You registered with F1000 via Google, so we cannot reset your password.
To sign in, please click here.
If you still need help with your Google account password, please click here.
You registered with F1000 via Facebook, so we cannot reset your password.
To sign in, please click here.
If you still need help with your Facebook account password, please click here.
If your email address is registered with us, we will email you instructions to reset your password.
If you think you should have received this email but it has not arrived, please check your spam filters and/or contact for further assistance.
Comments on this article Comments (0)