Keywords
Interactive dashboards, potentially inappropriate prescribing, audit and feedback, preventable drug related morbidity, polypharmacy
Advances in therapeutics and healthcare have led to a growing population of individuals living with multimorbidity and polypharmacy making prescribing more challenging. Most prescribing occurs in primary care and General Practitioners (GPs) have expressed interest in comparative feedback on their prescribing performance. Clinical decision support systems (CDSS) and audit and feedback interventions have shown some impact, but changes are often short-lived. Interactive dashboards, a novel approach integrating CDSS and audit and feedback elements, offer longitudinal updated data outside clinical encounters. This systematic review aims to explore the effectiveness of interactive dashboards on prescribing-related outcomes in primary care and examine the characteristics of these dashboards.
This protocol was prospectively registered on PROSPERO (CRD42023481475) and reported in line with PRISMA-P guidelines. Searches of PubMed, EMBASE, Medline, PsychINFO, CINAHL, Scopus, the Cochrane Library, and grey literature, including trial registries were performed to identify interventional studies (randomised and non-randomised) that assess the effectiveness of interactive dashboards on prescribing related outcomes. The search will be supplemented by searching references of retrieved articles with the use of an automated citation chaser. Identified records will be screened independently by two reviewers and data from eligible studies extracted using a purposely developed data extraction tool. We will narratively summarise the intervention types and those associated with improvements in prescribing outcomes. A quantitative synthesis will be carried out if a sufficient number of homogenous studies are identified. Methodological quality will be assessed by two reviewers using the Cochrane Effective Practice and Organisation of Care risk assessment tool.
This systematic review will explore the effect of interactive dashboards on prescribing related outcome measures in primary care and describe the characteristics of interactive dashboards. This research may inform future intervention development and shape policymaking particularly in the context of ongoing and planned developments in e-prescribing infrastructure.
Interactive dashboards, potentially inappropriate prescribing, audit and feedback, preventable drug related morbidity, polypharmacy
In response to reviewer feedback, some revisions have been made to the manuscript. The introduction section has been updated to strengthen the rationale for this systematic review, additional references have been added. Key terms such as implicit and explicit medication appropriateness tools and effectiveness have been elaborated on. Clarity on the population of interest has also been provided, with minor changes made to table 1 to reflect this. In the study selection section, the fact that full text articles will be screened independently has been clarified. The analysis section has been updated to clarify under which criteria a meta-analysis will be performed. Information around sensitivity analyses has been added.
See the authors' detailed response to the review by Rainer Tan and Nina Emery
See the authors' detailed response to the review by Heike Vornhagen
See the authors' detailed response to the review by Denis O'Mahony
See the authors' detailed response to the review by Augustino Mwogosi
Reducing medication-related harm has been identified within the World Health Organisation’s (WHO) third global patient safety challenge in 2017, ‘Medication without Harm’1. In the United States alone it is estimated that adverse drug reactions represent the third leading cause of death2. While English data shows 1.5% of hospital admissions are as a result of an Adverse Drug Reaction (ADR)3. In Ireland ADRs are the third most common type of reported adverse event in the health care system4. Most prescribing occurs in primary care5 and qualitative data from general practitioners (GPs) indicates prescribing has become more challenging, particularly for patients with multimorbidity and polypharmacy6. Irish GPs in a nationwide cluster randomised controlled trial (RCT) evaluating a deprescribing intervention, viewed participation as an opportunity to review their prescribing practices and were interested in getting performance feedback7. There is evidence that audit and feedback is effective in improving professional behaviour and that ongoing or repeated feedback is more effective8–10.
Primary care prescribers receive feedback on their prescribing through various means, such as clinical decision support systems (CDSS) and audit and feedback. CDSS are real-time, electronic tools that provide prescribers with knowledge and person-specific information at the point of care, which supplement decision-making processes11. CDSS are embedded in clinical software and typically appear as “alerts” for the prescriber. However problems such as interrupting work flow and too many alerts can cause “alert fatigue” resulting in the user ignoring recommendations12. Evidence suggests CDSS probably have a small effect on practitioner performance but the effect on patient reported and clinical outcomes is less clear13,14. Audit and feedback involves retrospectively reviewing clinical performance or practices, enabling peer comparison and social norm feedback and it has been identified as an effective strategy for improving prescribing15,16. However, audit and feedback data typically provide a snapshot at one time point and therefore improvements may be temporary17. Interactive dashboards combine elements of both CDSS and audit and feedback; the data is longitudinal and updated on an ongoing basis but is outside the clinical encounter. The prescriber can visualise their data graphically and the data can be manipulated and interacted with through various interactive elements, identifying both time trends and comparisons with peers18.
Medicines optimisation interventions that target a heterogonous population often use prescribing-related outcome measures, as clinical outcome’s such as ADRs or unplanned hospital admissions may take time to manifest or reach measurable levels19. Various tools have been developed to assess the quality of prescribing and broadly speaking these can be categorised into two groups: explicit tools and implicit tools. A systematic review published in 2014 identified 46 different explicit and implicit tools that have been developed to assess medication appropriateness. Explicit tools are focused on drugs, measuring how they fit pre-defined criteria whereas implicit tools are based on clinical guidelines and clinical evaluation criteria20. Examples of explicit measures of medication appropriateness include the United States (US) Beers criteria21 and the European Screening Tool for Older People’s potentially inappropriate Prescriptions (STOPP) criteria22. Multiple observational studies have demonstrated an association between potentially inappropriate prescribing, measured using these indicators, and clinical outcomes such as increased emergency admissions, ADRs and reduced health related quality of life23–25. In addition, specific research groups have identified high-risk and low-value prescribing criteria and evaluated the effectiveness of interventions utilising these criteria26–28. For example the Data-driven Quality Improvement in Primary Care (DQIP) intervention included an informatics tool that provided weekly updates of selected high risk prescribing indicators to clinicians, and facilitated medication review by graphically displaying relevant drug history data29. The pharmacist-led information technology intervention (PINCER) was effective at reducing hazardous prescribing, however the effect may have been temporary as the original intervention provided a snapshot of data from the electronic health record26. More recently an interactive dashboard utilizing the PINCER criteria has been developed whereby the user can track their performance across different criteria compared to other practices and over time30, and this intervention resulted in a reduction of potentially hazardous prescribing by 27.9% (95% CI 20.3% to 36.8%, p < 0.001)31.
In line with national and international campaigns to reduce medication-related harm and recent developments in e-prescribing infrastructure, this systematic review aims to explore the effectiveness of interactive dashboards in improving prescribing-related outcomes in primary care. These outcomes include potentially inappropriate prescribing (PIP) and drug utilisation rates (e.g., reducing prescribing volumes where lower rates are preferable or optimising prescribing patterns in line with guidelines). Additionally, it aims to describe the characteristics of these interventions to inform future intervention development and e-prescribing infrastructure.
This systematic review was prospectively registered on PROSPERO (CRD42023481475), it will be conducted in line with guidance set out in the Cochrane Handbook for Systematic Reviews of Interventions32, and reported in adherence to PRISMA-P reporting guidelines33. At the time of writing, the search strategy has been finalised, title and abstract screening has been completed, and full text review is currently in process.
An information specialist in the host institution’s library with extensive experience in supporting systematic reviews was involved in developing search strategies. A systematic literature search was conducted and included the following databases; PubMed, EMBASE, MEDLINE (OVID), PsycINFO (EBSCOhost), CINAHL (EBSCOhost), Scopus and the Cochrane Library (OVID).
A search of grey literature was conducted by running keyword searches in OpenGrey, CADTH Grey Matters and web-based clinical trial registries. The search was supplemented by searching references of retrieved articles with the use of an automated citation chaser34. No restrictions were placed on language or year of publication. Search terms included “interactive dashboard” and the medical subject heading (MeSH) “clinical audit”, “medical audit”, “benchmarking” and “feedback” and keywords to capture concepts related to providing prescribers with feedback, such as “electronic health record” and “alerts”. See supplementary file 1 for electronic search reports, including the full search terms.
Identified records were uploaded to Covidence systematic review software and de-duplicated. Reviewers were blinded to minimise potential bias and ensure impartial evaluation of the included studies. Two reviewers independently read the titles/abstracts of identified records and eliminated studies not meeting inclusion criteria. The full text of the remaining studies will be reviewed again independently by two reviewers who will assess their suitability for inclusion. Disagreement will be resolved through discussion with the wider study group. Eligibility criteria are described in Table 1. All outcome measures detailed in Table 1 will be considered, we do anticipate however, based on scoping searches, that explicit criteria and utilisation patterns will feature more prominently. All interventional designs will be included including randomised controlled trials (RCTs) (e.g. cluster RCTs, step wedged RCTs and individually randomised RCTs) and non-randomised interventional studies (e.g. interrupted time series design and controlled before and after studies)35.
Two review authors will independently extract data using a purposely developed data extraction tool in Covidence, developed with use of the Template for Intervention Description and Replication (TIDieR) checklist36. Extracted data will include study details (e.g. setting, design), population (e.g. GPs), intervention details, comparison group, outcome measures and results. Table 2 outlines example data that may be extracted to describe the intervention using the TIDieR checklist. We will attempt to contact the lead authors of primary studies to locate missing data. Discrepancies will be resolved through discussion and consensus between two reviewers with consultation with a third reviewer if necessary.
Methodological quality assessment. Methodological Quality Assessment will be performed by two reviewers using the Cochrane Effective Practice and Organisation of Care (EPOC) risk of bias tool35. Discrepancies will be resolved through discussion and consensus between two reviewers with consultation with a third reviewer if necessary.
Analysis. We will narratively summarise the intervention types and those associated with improvements in prescribing outcomes. Additionally, we will narratively describe the prescribing related outcomes used by included studies. A quantitative synthesis (i.e. meta-analysis) will be considered if a sufficient number of homogenous studies are identified which examine the same outcome. We defined homogeneity based on several key factors, (i) study design (ii) outcome definition (iii) level of measurement.
If a meta-analysis is conducted, a random-effects model will likely be appropriate given the review question. We will not combine results from different study designs and interventions in an overall meta-analysis. Results will be presented in separate subgroups in the same forest plot (with no summary effect estimate) Heterogeneity will be assessed through a visual assessment and a logic-based assessment of study differences. We will conduct a standard Q-test statistic for heterogeneity and evaluate the heterogeneity via the I² statistic, which can be interpreted as the proportion of variability in the meta-analysis due to between study heterogeneity. Funnel plots will explore publication bias if more than ten studies are identified. These plots will help assess the relationship between effect size and study precision. As we believe that heterogeneity exists regardless of whether we happen to detect it using a statistical test, we will focus less on significance tests and instead further investigate the sources and impact of the heterogeneity (e.g Risk of Bias) through sensitivity analysis. In the event of substantial clinical or methodological heterogeneity, we will not report study results as pooled effect estimates and will synthesise study findings using the approach suggested in the Synthesis Without Meta-analysis (SWIM) guidance37.”
All missing outcome data for included studies will be recorded on the data extraction form and reported in the risk of bias table. If there is insufficient information on the primary outcomes (due to inability to contact authors, unavailable data), these studies will be reported separately. Reasons for exclusion will be described and included in a supplementary table. As this systematic review is assessing an intervention targeted at primary care prescribers, included studies may have aggregate level patient data, thus it may not be possible to conduct population level subgroup analysis.
With a growing population of individuals living with multimorbidity and polypharmacy, prescribing has become more challenging with a greater propensity for adverse outcomes6,19. Preventable drug related morbidity (PDRM) has significant economic and social consequences at both the individual patient-level and for the wider healthcare system38, it is thus vital to develop interventions to support safe and effective prescribing.
Interactive dashboards have become increasingly prevalent in healthcare settings, offering a versatile tool for visualising clinical data across various levels ranging from organisational, physician to patient-focused applications. They have the potential to enhance patient care and safety by providing contemporaneous feedback on potentially suboptimal treatment or care when integrated into clinical record systems39.
Interactive dashboards have demonstrated varied effects on prescribing-related outcomes, such as antibiotic prescribing rates and appropriate statin use40,41. Current evidence suggests they are most effective when combined with additional strategies which include education and/or behavioural components41. Given the limited number of eligible studies identified in previous reviews, the present systematic review will not restrict its focus to specific medication classes.
This research will be conducted in line with Cochrane guidance. To increase transparency and reduce the risk of selective reporting this systematic review has been prospectively registered on PROSPERO, and will involve a search of the grey literature and trial registries to reduce the risk of publication bias. Title and abstract screening, full-text review, and methodological quality assessment will be performed by two reviewers working independently and blinded to each other's assessments, thereby minimising the potential for bias and errors. Excluding studies in progress but not yet published may lead to publication bias.
This research may identify gaps in the current literature and inform future intervention development with respect to how prescribing data may be fed back to prescribers. The findings from this review may inform policies aimed at enhancing or expanding the infrastructure necessary for effective e-prescribing, particularly those focused on optimising prescribing behaviours. In addition, this review will provide prescribers with a synthesised understanding of how interactive dashboards have been used, highlighting their potential benefits and limitations. This may lead to more informed decisions in regards adopting or optimising use of such tools in clinical practice, with the ultimate aim of improving patient safety and reducing medication related harm.
This project contains the following extended data:
figshare: Supplementary file 1: Electronic search reports https://doi.org/10.6084/m9.figshare.25859506.v142
fighare: Supplementary file 2: PRISMA-P 2015 checklist https://doi.org/10.6084/m9.figshare.25887193.v143
Data are available under the terms of the Creative Commons Attribution 4.0 International license (CC-BY 4.0) (https://creativecommons.org/licenses/by/4.0/)
Killian Walsh, Information Specialist, RCSI library; Mobeena Naz, Medical Student, RCSI.
Competing Interests: No competing interests were disclosed.
Reviewer Expertise: Digital Health, antibiotic stewardship
Competing Interests: No competing interests were disclosed.
Reviewer Expertise: Dashboards, Data Visualisation, UX Design
Competing Interests: No competing interests were disclosed.
Reviewer Expertise: The core areas of research include Health Informatics and Decision-Support Systems, which focus on optimising the implementation and use of Electronic Health Record (EHR) systems to improve clinical decision-making in primary healthcare. Research also explores the integration of generative AI in EHR systems, particularly in low-resource settings.
Is the rationale for, and objectives of, the study clearly described?
Partly
Is the study design appropriate for the research question?
Partly
Are sufficient details of the methods provided to allow replication by others?
Yes
Are the datasets clearly presented in a useable and accessible format?
Yes
Competing Interests: No competing interests were disclosed.
Reviewer Expertise: Digital Health, antibiotic stewardship
Is the rationale for, and objectives of, the study clearly described?
Partly
Is the study design appropriate for the research question?
Yes
Are sufficient details of the methods provided to allow replication by others?
Yes
Are the datasets clearly presented in a useable and accessible format?
Not applicable
Competing Interests: No competing interests were disclosed.
Reviewer Expertise: Dashboards, Data Visualisation, UX Design
Is the rationale for, and objectives of, the study clearly described?
Yes
Is the study design appropriate for the research question?
Yes
Are sufficient details of the methods provided to allow replication by others?
Yes
Are the datasets clearly presented in a useable and accessible format?
Not applicable
Competing Interests: No competing interests were disclosed.
Reviewer Expertise: Polypharmacy in older people; clinical pharmacology
Is the rationale for, and objectives of, the study clearly described?
Partly
Is the study design appropriate for the research question?
Yes
Are sufficient details of the methods provided to allow replication by others?
Yes
Are the datasets clearly presented in a useable and accessible format?
Partly
Competing Interests: No competing interests were disclosed.
Reviewer Expertise: The core areas of research include Health Informatics and Decision-Support Systems, which focus on optimising the implementation and use of Electronic Health Record (EHR) systems to improve clinical decision-making in primary healthcare. Research also explores the integration of generative AI in EHR systems, particularly in low-resource settings.
Alongside their report, reviewers assign a status to the article:
Invited Reviewers | ||||
---|---|---|---|---|
1 | 2 | 3 | 4 | |
Version 2 (revision) 19 Feb 25 |
read | read | read | |
Version 1 03 Jul 24 |
read | read | read | read |
Provide sufficient details of any financial or non-financial competing interests to enable users to assess whether your comments might lead a reasonable person to question your impartiality. Consider the following examples, but note that this is not an exhaustive list:
Sign up for content alerts and receive a weekly or monthly email with all newly published articles
Register with HRB Open Research
Already registered? Sign in
Submission to HRB Open Research is open to all HRB grantholders or people working on a HRB-funded/co-funded grant on or since 1 January 2017. Sign up for information about developments, publishing and publications from HRB Open Research.
We'll keep you updated on any major new updates to HRB Open Research
The email address should be the one you originally registered with F1000.
You registered with F1000 via Google, so we cannot reset your password.
To sign in, please click here.
If you still need help with your Google account password, please click here.
You registered with F1000 via Facebook, so we cannot reset your password.
To sign in, please click here.
If you still need help with your Facebook account password, please click here.
If your email address is registered with us, we will email you instructions to reset your password.
If you think you should have received this email but it has not arrived, please check your spam filters and/or contact for further assistance.
Comments on this article Comments (0)