Skip to content
ALL Metrics
-
Views
20
Downloads
Get PDF
Get XML
Cite
Export
Track
Study Protocol

A protocol for a mixed-methods analysis of the usability and acceptability of a digital cognitive-behavioural therapy for insomnia (dCBT-I) intervention (SleepioTM) in participants with cognitive impairment.

[version 1; peer review: 1 approved]
PUBLISHED 18 Jun 2025
Author details Author details
OPEN PEER REVIEW
REVIEWER STATUS

Abstract

Background

Sleep disturbance is common among those with cognitive impairment, potentially contributing to negative outcomes. Furthermore, growing evidence suggests that sleep disturbance is associated with the onset and progression of cognitive decline. There is therefore increasing interest in treating sleep disturbance in people with cognitive impairment.

Non-pharmacological treatments for sleep disturbance are unhindered by many of the adverse effects associated with pharmacological treatments, yet evidence supporting their use in clinical practice is often lacking. Cognitive behavioural therapy for insomnia (CBT-I) is the first-line treatment for insomnia and has demonstrated effectiveness in people with cognitive impairment in a small number of trials. Digital CBT-I (dCBT-I) overcomes many of the obstacles associated with accessing CBT-I (such as limited availability of therapists and transportation) whilst presenting others (such as internet access and digital literacy).

Aim

To undertake a mixed-methods analysis of the usability and acceptability of a dCBT-I intervention (Sleepio) among people with cognitive impairment.

Methods

Participants will be community-dwelling adults aged ≥50 years with cognitive decline and probable insomnia. Study partners (being caregivers, family or friends of participants) will be recruited, if available, to examine how their involvement influences usability and acceptability.

Participants will be given access to Sleepio, a fully automated and personalised dCBT-I programme delivered over the course of six weekly sessions. Usability and acceptability will be assessed by a bespoke questionnaire incorporating the System Usability Scale and the Usability Metric for User Experience - Lite (UMUX-Lite). Semi-structured interviews will explore participants’ experience of using the intervention.

Conclusion

By examining barriers and facilitators to the usability and acceptability of Sleepio among people with cognitive impairment, this study will provide insight into the potential efficacy of the intervention in this population whilst informing the design of a future definitive clinical trial.

Keywords

Sleep, Cognitive Impairment, Dementia, Digital Cognitive Behavioural Therapy for Insomnia, Qualitative, Usability, Acceptability.

Introduction

Sleep is essential to maintain good physical and mental health13 and plays a central role in many physiological functions4. Nevertheless, insomnia is common with approximately one-third of all adults experiencing insomnia symptoms5, increasing to 75% in those aged over 65 years6. Sleep patterns change as we age7. Normal ageing is associated with reductions in total sleep time, sleep efficiency and slow wave sleep8. Sleep disturbance is even more common among older adults with cognitive impairment9. Compared to healthy aged-matched controls, people with mild cognitive impairment (MCI) experience reduced total sleep time, sleep efficiency and duration of REM, whilst sleep onset latency, wakefulness after sleep onset, and duration of stage one sleep are increased10,11.

Indeed, there is a well-established association between sleep disturbance and cognitive impairment12, with evidence suggesting that the relationship may be causal and bi-directional13. A meta-analysis of observational studies estimated that 15% of Alzheimer’s Disease may be attributable to sleep disturbance14. Despite the recent Dementia Prevention, Intervention and Care: 2024 report of the Lancet Commission concluding that further research is needed to clarify the effect of sleep disturbance on cognitive decline15, therefore, interest is growing in sleep disturbance as a potential modifiable risk factor for cognitive impairment16. The European Academy of Neurology Brain Health Strategy, for example, has included sleep as a determinant of brain health17.

Furthermore, sleep disturbance tends to worsen as cognitive impairment advances18,19, leading to deteriorating cognitive outcomes20 and quality of life21, as well as strained relationships with caregivers who experience considerable physical and emotional distress and burnout as a consequence22,23. The increased caregiver burden caused by sleep disturbance in people with dementia has been shown to lead to sub-optimal care24 and early institutionalisation25,26. Sleep is therefore an important treatment target throughout the natural history of dementia, to potentially slow the progression of early-stage disease and to reduce the burden of symptoms in more advanced cases.

Pharmacological treatments for sleep disturbance are associated with a range of adverse effects, including sedation and increased risk of falls, headaches and dizziness27. This has led to the American Geriatric Society Beers Criteria recommending against the use of pharmacological agents to treat sleep in older people28. Additionally, there is evidence to suggest that pharmacological treatments to improve sleep can worsen cognitive function in older people13. There is therefore increasing focus on exploring non-pharmacological approaches to treating sleep disturbance among older people with cognitive impairment29.

Cognitive behavioural therapy for insomnia (CBT-I) is the first-line treatment recommended for insomnia and is supported by a large evidence base3033. A recent meta-analysis of controlled clinical trials of sleep treatments for people with cognitive impairment included two trials of CBT-I and both demonstrated significant improvements in sleep34. One of the trials, involving 28 participants from independent living facilities, achieved significant improvement in both subjective and objective measures of sleep using the Insomnia Severity Index (ISI) and wrist actigraphy respectively35. The other trial, involving 35 participants recruited from outpatient clinics, found no improvement in objective sleep measures, with significant improvements only in subjective sleep quality36. Participants in the latter trial did not have significant sleep disturbance at baseline, however, and it is perhaps for this reason that meta-analysis of the two trials did not find any significant effect on sleep. Given the promising results in the trial that included participants with sleep disturbances at baseline, there is a need to further investigate the potential application of CBT-I to treat sleep disturbances among people with cognitive impairment.

Unfortunately, however, CBT-I is often difficult to access for many due to the shortage of trained therapists37. Digital CBT-I (dCBT-I) provides a possible solution to overcome the barriers associated with accessing the traditional therapist-delivered model of CBT-I. Indeed, evidence demonstrates the effectiveness of dCBT-I38,39, which has also recently been shown to be feasible and effective in older people40. A small mixed-methods study involving 12 participants has demonstrated preliminary acceptability of dCBT-I (SHUTi OASIS) among older people with MCI41. More recently, a small open-label randomised controlled feasibility trial demonstrated preliminary efficacy of dCBT-I (Sleepio) in improving the ISI of people with MCI42. This latter trial was conducted remotely, indicating that the participants likely had relatively mild deficits and were adept at using digital technology. A recent qualitative study, conducted among patients who were recovering from stroke, identified some difficulties accessing and operating the Sleepio programme43. Nevertheless, nine out of a total of eleven participants successfully completed the programme, although three did require the assistance of their respective caregivers to do so.

It has been suggested that more qualitative research is required to explore barriers and facilitators to the uptake and acceptability of alternative modes of delivery of CBT-I, such as dCBT-I44. By its exploratory and inductive nature45, qualitative research can provide more nuanced and subtle insights into the participants’ perspective of how interventions are delivered in practice46, thus helping to guide the design of future interventions and clinical trials.

Aim

Given the importance of treating co-morbid sleep disturbance at all stages of cognitive decline, we propose to undertake a mixed-methods analysis of the usability and acceptability of dCBT-I (Sleepio) among people with varying degrees of cognitive decline, ranging from subjective cognitive decline (SCD) through to MCI and mild-moderate dementia. We will also endeavour to assess whether usability and acceptability can be improved by the availability of a study partner to assist with operation of the dCBT-I (Sleepio) programme. This will help to determine which people with cognitive impairment may be able to use and benefit from dCBT-I (Sleepio) to treat co-morbid sleep disturbance.

Methods

Intervention

Sleepio is a fully-automated and personalised dCBT-I intervention designed to treat insomnia using a combination of cognitive, behavioural, sleep hygiene and relaxation techniques. It is delivered through a web-based platform, supporting iOS or Android mobile applications. Underlying algorithms organise the delivery of information, support, and advice in a manner tailored to each individual patient based on their responses to an initial sleep study questionnaire and subsequent daily sleep diary entries throughout the duration of the programme. The programme consists of six sessions, each between five and twenty minutes in duration. Sleepio can be completed within a six-week period. However, the average time taken to complete the programme is 9–10 weeks. No time restriction is placed on the user to complete the sessions, and all previously viewed sessions remain available to the user to re-watch throughout the duration of the programme. Participants are offered daily notifications to prompt adherence to the programme.

Participants

Potential participants will be community-dwelling adults aged fifty years and older with probable insomnia attending outpatient memory clinics affiliated with the Mercy University Hospital in Cork, Ireland. Only participants with probable insomnia will be included because, although previous studies have suggested the effectiveness of Sleepio in sub-clinical insomnia47, other studies have demonstrated that participants’ motivation to adhere to the Sleepio programme was proportional to the severity of their sleep disturbance43. Study partners, if available, will also be recruited for dyadic participation and may include caregivers, family members or friends attending memory clinic with the participants. A previous qualitative study of the usability of Sleepio amongst patients following stroke found that some had to rely on help from partners to operate the programme and suggested that more people may be able to use dCBT-I if given support from a partner or caregiver43. It is anticipated that study partners may play an important role in facilitating successful adherence of participants to the Sleepio programme, particularly among participants with more advanced cognitive impairment48. While ideal and likely to enrich the study, the availability of a study partner will not be an inclusion/exclusion criterion. We will nevertheless endeavour to include them when available. Other inclusion/exclusion criteria are as follows:

Inclusion criteria:

  • 1. Aged ≥50 years.

  • 2. Sleep Condition Indicator (SCI)49 Score ≤16/32. The SCI is an 8 item scale validated to assess insomnia based on DSM-5 criteria. Scores range from 0–32, with scores ≤16 indicating probable insomnia.

  • 3. Established SCD, MCI or mild-moderate dementia, diagnosed by a consultant physician specialised in cognitive disorders prior to enrolment in the study. Dementia will be defined using DSM-5 classification and staged according to the Reisberg FAST scale50 into early/mild/moderate stage. MCI will be defined using Petersen’s criteria51. Participants must score between 0 – 2 on the Clinical Dementia Rating (CDR) scale52, a commonly used clinician-rating scale of global symptom severity in dementia.

  • 4. Sufficient physical/sensory (visual/hearing) capacity to use the intervention, as judged by the clinician/investigator.

  • 5. English-speaker (intervention only available in English).

  • 6. Community-dwellers (non-institutionalised).

  • 7. Ability to provide informed written consent.

Exclusion criteria:

  • 1. Known history of an International Classification of Diseases (ICD) defined sleep disorder other than insomnia disorder.

  • 2. Receipt of a sleep-related cognitive behavioural therapy intervention within the past six months.

  • 3. CDR >2

  • 4. Severe depression (defined as depression requiring hospitalization in the past 12-months or visit to psychiatry outpatient clinic in the past three months).

  • 5. Unstable depression/anxiety disorders or panic attacks (unstable will be defined as changes in antidepressant medications within the last three months - i.e. no start, stop or change in dose).

  • 6. Other relevant major neuropsychiatric disorders, including schizophrenia, psychosis, mania, bipolar affective disorder, epilepsy or seizure disorder.

  • 7. Ongoing substance or alcohol abuse.

  • 8. Long-term physical or sensory impairment, pain or other medical condition which, in the opinion of the principal investigator, could impair participation for reasons other than cognitive impairment.

  • 9. Planned surgery or hospitalisation during the study that could interfere with participation.

  • 10. Medical conditions rendering the patient too unwell to continue to participate in the study in the opinion of the principal investigator.

  • 11. A change in the following medication within the three months prior to enrolment:

    • a. Benzodiazepine and non-benzodiazepine hypnotic or anxiolytics agents

    • b. Cholinesterase inhibitors or Memantine

    • c. Antidepressants

    • d. Antipsychotics

    • e. Amphetamine derivatives

    • f. Decongestants

    • g. Narcotic analgesics

    • h. β-Blockers

    • i. Pulmonary medications (Theophylline and Albuterol)

    • j. Melatonin

Recruitment

All patients attending memory clinics affiliated with the Mercy University Hospital in Cork, Ireland will be screened for eligibility. Consecutive patients who meet eligibility criteria will be invited to participate in the study. It is hoped to recruit 20–30 participants over a four month period. Where possible, study partners including friends or family members of participants, will be recruited to support participants throughout the study.

Consent process

Fully informed written consent will be obtained from each participant prior to enrolment. The capacity of all participants to provide valid informed consent to participate in the study will be determined by a consultant physician in geriatric medicine. Fully informed written consent to participation will also be obtained from study partners (caregivers, friends, and or family members) if available and willing to participate. Participants and their study partners (if applicable) will be provided with a Participant Information Leaflet detailing the purpose of the study and what participation in the study would entail for them. Copies of the Participant Information Leaflet and Consent Forms that will be used in the study are available in the extended data.

Enrolment

Once recruited, participants will be provided with access to the study intervention (Sleepio). Given the digital nature of the intervention, each participant’s digital literacy will be assessed using the Mobile Device Proficiency Questionnaire53. Every participant will be provided with a training/orientation session to teach them how to use the Sleepio programme. Additionally, each participant will be provided with clear written instructions on how to access and use the Sleepio programme. If a study partner is available, and both the participant and the study partner consent to their participation in the study, the partner will be also included in the training session.

Data collection

Data collection will be carried out in accordance with the European Union’s General Data Protection Regulation and local data protection policies. The following data will be recorded in respect of every participant at baseline:

  • Demographic data, including: age, sex, marital status, level of education, and employment status.

  • Charlson Co-morbidity Index54

  • Cognitive diagnosis and stage of cognitive impairment

  • Medications

Following completion of the Sleepio programme, usability and acceptability will be assessed initially by a bespoke questionnaire incorporating the System Usability Scale55, adapted for cognitive impairment56, and the Usability Metric for User Experience - Lite (UMUX -Lite)57. The System Usability Scale is a validated and commonly employed 10 item Likert-type scale that provides a global assessment of how user-friendly a system or product is perceived to be. The UMUX-Lite is a more condensed two item Likert-type scale that also measures user-satisfaction with a system or product. Finally, participants and their study partners (where applicable) will be interviewed to further assess the usability and acceptability of the programme. The interview will be audio-recorded and conducted in a semi-structured manner using the topic guide included in the supplementary material. Participants and their study partners will be asked to expound on any difficulties they had in complying with the programme and whether they found the programme beneficial. In order to reduce the possibility of social desirability and positivity bias, the participants and their study partners (where applicable) will be informed that the interviewer is not affiliated with Sleepio and that the objective of the study is to obtain an accurate understanding of their experience using the programme in order to guide future research.

Data analysis

In respect of the bespoke questionnaire on usability and acceptability, categorical variables will be described in frequencies and percentages, while mean scores will be reported for the incorporated Systems Usability Scale and UMUX-Lite.

The audio-recorded semi-structured interviews will be transcribed verbatim. Transcripts of the interviews will be anonymised and the audio-recordings will be destroyed immediately following transcription. Transcripts will be read and re-read to ensure data immersion. Thematic analysis will be undertaken using open coding to identify patterns and themes in a six-stage process involving: familiarisation, generating initial codes, developing themes, reviewing themes, defining and naming themes, and reporting findings46. This process of analysis will be undertaken manually at first and then repeated using a qualitative data management software system to ensure thorough analysis. Emerging patterns and themes will be discussed periodically amongst all the researchers involved in this study (except ALH – see competing interests statement below) to facilitate collaborative reflexive analysis as consensus is reached58. The Standards for Reporting Qualitative Research will be adhered to when reporting the findings of the study59.

Discussion

This mixed-methods study will explore the usability and acceptability of a dCBT-I (Sleepio) intervention in people with cognitive impairment. CBT-I is the first-line treatment for insomnia3033. However, the effectiveness of cognitive behavioural therapy may be limited in people with cognitive impairment by their diminished ability to comprehend, learn, remember and apply the skills taught by the therapy programme48. This may be more marked for dCBT-I. By including participants with cognitive impairment ranging from SCD to mild-moderate dementia, this study will help identify the categories of people from amongst this cohort who are most likely to benefit from dCBT-I. By examining the barriers and facilitators that influence usability and acceptability of the Sleepio programme amongst people with cognitive impairment, this study will investigate how the delivery of dCBT-I may be adapted to enhance usability and acceptability amongst this population. In particular, the effect of digital literacy and the availability of study partners to support adherence to the programme will be analysed. Improved understanding of the influence of these factors will assist in the development of guidance on the use and application of dCBT-I in clinical practice for this cohort and older adults in general, who often rate their own comfort and familiarity with technology as poor or average60. By providing insights into the factors that influence usability, acceptability and potential efficacy of dCBT-I amongst people with cognitive impairment, this study will also help inform the design of a future definitive randomised controlled trial that will assess the effectiveness of dCBT-I to treat probable insomnia amongst this population.

Conclusion

This mixed-methods analysis of the usability and acceptability of a dCBT-I (Sleepio) intervention in people with cognitive impairment will help inform the design of a future randomised controlled trial that will assess the effectiveness of the intervention in this population.

Ethics & consent statement

This mixed-methods qualitative study will be conducted in accordance with the Declaration of Helsinki. Ethical approval for this study was granted by the Clinical Research Ethics Committee of the Cork Teaching Hospitals (CREC) on the 5th December 2023, under CREC reference number: ECM 4 (gg) 05/12/2023. Results of the study will be published in a peer-reviewed journal and presented at relevant academic conferences. Fully informed written consent will be obtained from each participant prior to enrolment.

Comments on this article Comments (0)

Version 1
VERSION 1 PUBLISHED 18 Jun 2025
Comment
Author details Author details
Competing interests
Grant information
Copyright
Download
 
Export To
metrics
VIEWS
107
 
downloads
20
Citations
CITE
how to cite this article
Crowley P, Flanagan E, Henry AL and O'Caoimh R. A protocol for a mixed-methods analysis of the usability and acceptability of a digital cognitive-behavioural therapy for insomnia (dCBT-I) intervention (SleepioTM) in participants with cognitive impairment. [version 1; peer review: 1 approved]. HRB Open Res 2025, 8:68 (https://doi.org/10.12688/hrbopenres.14177.1)
NOTE: If applicable, it is important to ensure the information in square brackets after the title is included in all citations of this article.
track
receive updates on this article
Track an article to receive email alerts on any updates to this article.

Open Peer Review

Current Reviewer Status: ?
Key to Reviewer Statuses VIEW
ApprovedThe paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approvedFundamental flaws in the paper seriously undermine the findings and conclusions
Version 1
VERSION 1
PUBLISHED 18 Jun 2025
Views
2
Cite
Reviewer Report 18 Aug 2025
Alexandra Hinterberger, Salzburg University, Salzburg, Austria 
Approved
VIEWS 2
The authors propose a mixed-methods protocol to investigate the usability and acceptability of a dCBT-I program (Sleepio) in participants with cognitive impairment. 20-30 adults aged 50+ with MCI and likely insomnia will use Sleepio over (a minimum of) six weeks. ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Hinterberger A. Reviewer Report For: A protocol for a mixed-methods analysis of the usability and acceptability of a digital cognitive-behavioural therapy for insomnia (dCBT-I) intervention (SleepioTM) in participants with cognitive impairment. [version 1; peer review: 1 approved]. HRB Open Res 2025, 8:68 (https://doi.org/10.21956/hrbopenres.15590.r48112)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.

Comments on this article Comments (0)

Version 1
VERSION 1 PUBLISHED 18 Jun 2025
Comment
Alongside their report, reviewers assign a status to the article:
Approved - the paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations - A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approved - fundamental flaws in the paper seriously undermine the findings and conclusions

Are you a HRB-funded researcher?

Submission to HRB Open Research is open to all HRB grantholders or people working on a HRB-funded/co-funded grant on or since 1 January 2017. Sign up for information about developments, publishing and publications from HRB Open Research.

You must provide your first name
You must provide your last name
You must provide a valid email address
You must provide an institution.

Thank you!

We'll keep you updated on any major new updates to HRB Open Research

Sign In
If you've forgotten your password, please enter your email address below and we'll send you instructions on how to reset your password.

The email address should be the one you originally registered with F1000.

Email address not valid, please try again

You registered with F1000 via Google, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Google account password, please click here.

You registered with F1000 via Facebook, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Facebook account password, please click here.

Code not correct, please try again
Email us for further assistance.
Server error, please try again.