Skip to content
ALL Metrics
-
Views
82
Downloads
Get PDF
Get XML
Cite
Export
Track
Study Protocol

The diagnostic and predictive accuracy of the PRISMA-7 screening tool for frailty in older adults: A systematic review protocol

[version 1; peer review: 2 approved]
PUBLISHED 22 May 2020
Author details Author details
OPEN PEER REVIEW
REVIEWER STATUS

Abstract

Background: Older adults are at risk of adverse outcomes due to frailty. A number of frailty screening instruments have been developed to identify older adults at increased risk of frailty. This systematic review and meta-analysis will look to examine the diagnostic accuracy of the Program of Research to Integrate the Services for the Maintenance of Autonomy 7 (PRISMA-7).
Methods and analysis: A systematic literature search will be conducted from 2008-February 2020 in PubMed, EMBASE, CINAHL, EBSCO and the Cochrane Library to identify validation studies of the PRISMA-7 tool.  A pre-specified PRISMA-7 score of ≥3 (maximum score 7 points) will be used to identify frailty in older adults. Prospective or retrospective cohort studies, cross-sectional studies and the control arm of randomised controlled trials will be included that attempt to validate the diagnostic accuracy of the PRISMA-7 screening tool in older adults across all healthcare settings when compared to a reference standard. The predictive accuracy of the PRISMA-7 tool will also be explored. Study quality will be assessed by the QUADAS-2 tool. A bivariate random effects model will be used to generate pooled estimates of sensitivity and specificity. Statistical heterogeneity will be explored using validated methods.
Ethics and dissemination: Formal ethical approval is not required as primary data will not be collected. The results will be disseminated through a peer-reviewed publication, conference presentation and the popular press.
Protocol registration: Awaiting registration with the International Prospective Register for Systematic Reviews (PROSPERO).

Keywords

PRISMA-7, Frailty, older adults, diagnostic accuracy, predictive accuracy, sensitivity and specificity, review

Introduction

Global demographic trends suggest that the number of adults aged 65 years or older will more than double by 20501, resulting in an increased burden on healthcare systems and a disproportionate increase in the burden on emergency departments (EDs). Older people are frequent users of the healthcare system2, and they are more likely to experience adverse health outcomes including functional decline, unplanned ED presentation and hospitalisation following emergency care3. Chronological age alone cannot reliably predict health service utilisation, similarly level of disability or multi-morbidity cannot exclusively explain healthcare service utilisation2,4. Increased utilisation of healthcare services is in part due to increased frailty5.

The concept of frailty has evolved over the years. In 2001, Fried and Walston described a frailty phenotype with five related components to form a cycle of frailty: motor weakness, slowness, exhaustion, low activity and weight loss6. At the same time, the deficit accumulation model was also proposed, which included the number of diseases, conditions, and co-morbidities across many domains to determine frailty status7. Frailty has recently been defined by a consensus group as a medical syndrome with “multiple causes and contributors which is characterised by diminished strength, endurance, and reduced physiologic function that increases an individual’s vulnerability for developing increased dependency and/or death”8. In a systematic review of 21 community-based studies of older adults, the prevalence of frailty was reported to range from 4% to 59.1%9. Frailty is over-represented among acute hospital admissions, with 24–40% of older adults presenting with moderate to severe frailty10. The wide range of prevalence rates possibly reflect variation across the studies in terms of definitions of frailty and methodological approaches.

Regardless of the definition used, the presence of frailty has been shown to predict mortality11,12, increased risk of falls13, depressive symptoms14, disability15, dementia16, delirium17, decrease in ability to carry out activities of daily living (ADLs)18, reduced quality of life and functional impairment19, use of healthcare services2, and institutionalisation20. Recent evidence proposes that while frailty may be age related, it is not age dependant. Hanlon et al. (2018) report that frailty and pre-frailty are associated with female sex, obesity and underweight, smoking, socioeconomic deprivation, and multimorbidity21.

In recent years, a number of frailty screening tools have been developed and have demonstrated an increased risk of adverse outcomes in frail older adults22. These frailty screening tools broadly focus on physical markers of decline or on the accumulation of deficits in physical, cognitive, mental health and functional domains23. One such screening tool is the PRISMA-7 (Program of Research to Integrate the Services for the Maintenance of Autonomy 7). The PRISMA-7 was derived in Canada in 2007 and comprises a brief, 7-item yes/no questionnaire where a cut off score of ≥3 is used to identify frail older adults. The questions cover age, general health, activities and social supports, with each answer receiving a score of one or zero24. The PRISMA-7 is recommended by the British Geriatric Society (2014)25 as a quick and simple frailty screening tool. It is also recommended for use by the Asia-Pacific Clinical Practice Guidelines for the Management of Frailty (2017)26, and by the National Institute for Health and Care Excellence (NICE) guidelines (2016)27. Since its derivation, a number of studies have attempted to examine its diagnostic accuracy identifying frailty in older adults and its predictive accuracy in determining risk of adverse outcomes among those classified as frail28,29. This systematic review aims to synthesise the totality of evidence regarding the diagnostic and predictive accuracy of the PRISMA-7 at identifying frailty in older adults and subsequent risk of adverse outcomes.

Methods and analysis

Study design

A systematic review will be conducted to identify studies that have attempted to validate the PRISMA-7 screening tool in older adults, across healthcare settings. The systematic review will conform to the principles outlined in the Cochrane Handbook for Systematic Reviews of Diagnostic Test Accuracy30 and the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Protocols (PRISMA) standardised reporting guidelines will be referenced31. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses Protocols (PRISMA-P) guidelines were used in completing this review protocol32; see Reporting guidelines33.

Eligibility criteria

Studies will be selected using the population, experimental test, reference standard and study designs (PEOS) criteria. The population of interest include older adult’s ≥65 years (mean/median age ≥65 years) across healthcare settings where the PRISMA-7 screening tool was administered and compared to a reference standard. While there is no ‘gold standard’ for the definition of frailty, for the purposes of this review we will use five different reference standards including the Comprehensive Geriatric Assessment (CGA), clinical judgement by an expert panel, Fried Physical Frailty Phenotype, the Functional Autonomy Measurement System and the Frailty Index. The CGA is a multidisciplinary evaluation of multiple domains, including medical, mental and functional problems of older persons34. Clinical judgement by an expert panel (including geriatricians, geriatric nurses and general practitioners) using validated screening tools to inform decision-making, including but not limited to tools including the Mini Mental State Exam (MMSE)35, InterRAI-Community Health Assessment (InterRAI-CHA)36, Identification of Seniors at Risk (ISAR)37. The Functional Autonomy Measurement System (SMAF)38 is a 29-item scale developed upon the concepts of health and disability as described by the World Health Organisation’s (WHO)39. Fried et al. developed the Fried Physical Frailty Phenotype, which assesses frailty through five physical components; unintentional weight loss, self-reported exhaustion, weakness (grip strength), slow walking speed and low physical activity6. The frailty index (FI) is a cumulative model of quantifying frailty, the model counts “deficits in health”, on the premise that the more deficits an individual has the greater probability of frailty. When a minimum of 30 variables are included, the FI is strongly associated with risk of death, institutionalisation and worsening health status40.

Prospective or retrospective cohort studies or cross-sectional studies will be included where the PRISMA-7 is used to screen older adults and compared to one or more of these reference standards to explore the diagnostic accuracy of the tool. In terms of establishing the predictive accuracy of the PRISMA-7, the reference standard will comprise adverse short and long-term outcomes experienced post-administration of the PRISMA-7. Adverse outcomes will include functional decline, unplanned ED presentation, unscheduled hospital admission, admission to long-term care or mortality.

Exclusion criteria

Studies will be excluded if their populations mean or median age is <65 and where data cannot be extracted separately on those ≥65 years. Grey literature will not be included.

Information sources/search strategy

The search will include studies published from 2008 (year that the PRISMA-7 was derived) to the present and will be limited to the title, abstract, and index terms used to describe the article. A PubMed search strategy can be seen in Table 1.

Table 1. PubMed search strategy, modified accordingly for use in other databases.

SearchSearch stringEntries
#1((PRISMA Seven[Title/Abstract] OR PRISMA-7[Title/Abstract] OR PRISMA 7[Title/Abstract] OR (Program of Research
on Integration of Services for the Maintenance of Autonomy Seven)[Title/Abstract] OR (Program of Research on
Integration of Services for the Maintenance of Autonomy 7)[Title/Abstract])) AND ((older adult)[Title/Abstract] OR
elderly[Title/Abstract] OR geriatric [Title/Abstract] OR aging[Title/Abstract] OR aged[Title/Abstract] OR senior
[Title/Abstract] OR (older person)[Title/Abstract] OR (older people)[Title/Abstract] OR (aged 65[Title/Abstract] OR
aged 65+)[Title/Abstract] OR (aged over sixty five)[Title/Abstract] OR retired[Title/Abstract])
141

The following electronic databases will be searched:

• PubMed

• EMBASE

• CINAHL

• EBSCO and Cochrane Library

Studies in all languages will be included and translated. This search will be supplemented by hand searching references of retrieved papers and searching Google Scholar. All searches will be imported into Endnote reference management system and duplicates will be removed.

Study selection and data extraction

Titles and abstracts will be independently screened for relevance based upon the above inclusion criteria by two reviewers (OH, AON). Studies deemed eligible for inclusion will be read fully and their suitability for inclusion will be independently determined by RG. Any disagreements will be managed by discussion. Data will be extracted from the included studies by two independent reviewers (AON, OH) using standardised forms that will include, study type and setting, patient demographics (age, gender) and clinical characteristics including relevant inclusion and exclusion criteria, person who administered the PRISMA-7. Any disagreements in data extraction will be resolved by discussion. If the disagreement persists, a third author (RG) will independently extract the data. If a study presents missing, unclear or incompletely reported data, we will attempt to contact the study authors to obtain the data. The extent of missing data will be documented in the extraction form.

Risk of bias in individual studies

Methodological quality of the selected studies will be evaluated independently by two reviewers (OH and RG) using the QUADAS-2 tool41, a validated tool for the quality assessment of diagnostic and prognostic accuracy studies. Disagreements will be resolved by a third reviewer (KR).

Data synthesis and analysis

Statistical analysis will be completed using Stata version 12 (StataCorp, TX, USA) by RG. A series of 2 × 2 tables (PRISMA-7 ≥3) will be constructed and data will be populated on the number of true positives, false positives, true negatives and false negatives from each study. Authors of included studies will be contacted to provide additional data on study outcomes where necessary. Pooled estimates of sensitivity and specificity with 95% confidence intervals (95% CIs) will be calculated to determine the diagnostic and predictive accuracy of the PRISMA-7 using a bivariate random effects model. We have employed this methodology in previous studies4244. In the context of diagnostic accuracy, sensitivity refers to the proportion of older adults who are correctly classified as frail (PRISMA-7 ≥3) when compared to the reference standard whereas specificity refers to those who are correctly classified as non-frail (PRISMA-7 <3). In terms of predictive accuracy, sensitivity refers to the proportion of frail older adults (PRISMA-7 ≥3) who experience an adverse outcome whereas specificity refers to those who are non-frail (PRISMA-7 <3) and do not experience a subsequent adverse outcome.

Individual and summary estimates of sensitivity and specificity will be graphed on a receiver-operating characteristic (ROC) graph. Statistical heterogeneity will be examined using the variance of logit-transformed sensitivity and specificity, with smaller values indicating less heterogeneity between studies. Bayes’ theorem will be applied to estimate the post-test probability of an adverse outcome45. The c statistic, or area under the curve, with 95% CI will be used to represent model discrimination. Values between 0.7 and 0.9 indicate moderate accuracy and values greater than 0.9 demonstrate high accuracy46. We will conduct sensitivity analyses to examine the impact of methodological quality, reference standard used and setting of care on the diagnostic and predictive value of the PRISMA-7 where possible. Funnel plots will be generated to examine publication bias.

Discussion

Frailty is a dynamic condition that contributes to functional decline in older adults47. Early identification of frailty can improve care for older adults and reduce the risk of exacerbation of pre-frail states48. The British Geriatric Society recommends that all encounters between health and social care staff and older people include an assessment of frailty49. Better identification of frailty or pre-frail individuals will allow for more specific and tailored interventions to be provided to these individuals. The European Innovation Partnership on Active and Healthy Ageing (EIP on AHA) action plan A3, states that successful prevention of frailty and functional decline requires more knowledge about the risk factors and the stratification of patients50. The EIP on AHA recommend the use of short risk-prediction instruments, to identify individuals at risk of frailty50. These instruments should be simple, valid, accurate and reliable23. The PRISMA-724 is a brief instrument used to identify frailty in older adults. Its use is recommended in International guidelines26,27. This systematic review will provide important information about the quantity and quality of studies validating the PRISMA-7. It will summarise the evidence regarding the diagnostic and predictive value of the PRISMA-7 at identifying adverse outcomes in frail older adults across a variety of settings.

Dissemination

The systematic review will be published in a peer-reviewed journal and presented at appropriate conferences (e.g. Irish Gerontology Society Annual meeting, Health Research Board).

Data availability

Underlying data

No underlying data are associated with this article.

Reporting guidelines

Figshare: PRISMA-P checklist for ‘The diagnostic and predictive accuracy of the PRISMA-7 screening tool for frailty in older adults: A systematic review protocol’. https://doi.org/10.6084/m9.figshare.1222912533.

The completed PRISMA-P checklist is available under the terms of the Creative Commons Zero “No rights reserved” data waiver (CC0 1.0 Public domain dedication).

Comments on this article Comments (0)

Version 1
VERSION 1 PUBLISHED 22 May 2020
Comment
Author details Author details
Competing interests
Grant information
Copyright
Download
 
Export To
metrics
VIEWS
797
 
downloads
82
Citations
CITE
how to cite this article
Higginbotham O, O'Neill A, Barry L et al. The diagnostic and predictive accuracy of the PRISMA-7 screening tool for frailty in older adults: A systematic review protocol [version 1; peer review: 2 approved]. HRB Open Res 2020, 3:26 (https://doi.org/10.12688/hrbopenres.13042.1)
NOTE: If applicable, it is important to ensure the information in square brackets after the title is included in all citations of this article.
track
receive updates on this article
Track an article to receive email alerts on any updates to this article.

Open Peer Review

Current Reviewer Status: ?
Key to Reviewer Statuses VIEW
ApprovedThe paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approvedFundamental flaws in the paper seriously undermine the findings and conclusions
Version 1
VERSION 1
PUBLISHED 22 May 2020
Views
11
Cite
Reviewer Report 11 Jun 2021
Aisling O’Halloran, The Irish Longitudinal Study on Ageing, Medical Gerontology, School of Medicine, Trinity College Dublin, Dublin, Ireland 
Approved
VIEWS 11
In this manuscript the authors present a study protocol to conduct a systematic literature review and meta-analysis to validate the diagnostic and predictive accuracy of a screening tool, the Program of Research to Integrate the Services for the Maintenance of ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
O’Halloran A. Reviewer Report For: The diagnostic and predictive accuracy of the PRISMA-7 screening tool for frailty in older adults: A systematic review protocol [version 1; peer review: 2 approved]. HRB Open Res 2020, 3:26 (https://doi.org/10.21956/hrbopenres.14138.r29498)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
Views
25
Cite
Reviewer Report 23 Jun 2020
Michelle Canavan, HRB-Clinical Research Facility, National University of Ireland Galway, Galway, Ireland 
Maria Costello, HRB-Clinical Research Facility, National University of Ireland, Galway, Ireland 
Approved
VIEWS 25
This is a study protocol for a systematic review and meta-analysis which will explore the diagnostic and predictive accuracy of the PRISMA-7 tool for identifying frail older adults. This protocol is awaiting registration with the International Prospective Register for Systematic ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Canavan M and Costello M. Reviewer Report For: The diagnostic and predictive accuracy of the PRISMA-7 screening tool for frailty in older adults: A systematic review protocol [version 1; peer review: 2 approved]. HRB Open Res 2020, 3:26 (https://doi.org/10.21956/hrbopenres.14138.r27440)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.

Comments on this article Comments (0)

Version 1
VERSION 1 PUBLISHED 22 May 2020
Comment
Alongside their report, reviewers assign a status to the article:
Approved - the paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations - A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approved - fundamental flaws in the paper seriously undermine the findings and conclusions

Are you a HRB-funded researcher?

Submission to HRB Open Research is open to all HRB grantholders or people working on a HRB-funded/co-funded grant on or since 1 January 2017. Sign up for information about developments, publishing and publications from HRB Open Research.

You must provide your first name
You must provide your last name
You must provide a valid email address
You must provide an institution.

Thank you!

We'll keep you updated on any major new updates to HRB Open Research

Sign In
If you've forgotten your password, please enter your email address below and we'll send you instructions on how to reset your password.

The email address should be the one you originally registered with F1000.

Email address not valid, please try again

You registered with F1000 via Google, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Google account password, please click here.

You registered with F1000 via Facebook, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Facebook account password, please click here.

Code not correct, please try again
Email us for further assistance.
Server error, please try again.