Skip to content
ALL Metrics
-
Views
28
Downloads
Get PDF
Get XML
Cite
Export
Track
Study Protocol

Artificial intelligence to improve antimicrobial prescribing: A protocol for a systematic review

[version 1; peer review: 2 approved with reservations]
PUBLISHED 29 Jul 2022
Author details Author details
OPEN PEER REVIEW
REVIEWER STATUS

Abstract

Introduction: The inappropriate use of antimicrobials is a threat to their effectiveness and often results in antimicrobial resistance (AMR) and difficult to treat infections. Different methods have been implemented to control AMR, and in recent years, artificial intelligence (AI) has been used to improve antimicrobial prescribing. However, there is insufficient information about the contribution of AI in improving antimicrobial prescribing. This systematic review aims to determine whether the use of AI can improve antimicrobial prescribing for human patients.
Methods: Observational studies that examine the potential or actual use of AI in improving antimicrobial prescribing cited in IEEE Xplore, ScienceDirect, Scopus, Web of Science, OVID, EMBASE and ACM will be included in this systematic review. There will be no restriction on language, nor the setting (i.e.: primary care or hospital) nor the time when the studies included were conducted. The primary outcome of this systematic review is the relative reduction in prescribed antimicrobials, while the secondary outcome is the relative reduction in patients’ consultations, whether for infection recurrence or worsening of symptoms. Data will be meta-analyzed with a Random Effects Model. The I2 statistic for heterogeneity will be calculated and the Newcastle Ottawa Scale Tool will be used to assess risk of bias.
Dissemination: The results will be disseminated through a peer-reviewed publication and scientific sessions.
PROSPERO Registration: This protocol has been registered in PROSPERO online database (CRD42022329049; 14 May 2022).

Keywords

Artificial Intelligence (AI), Machine Learning, Prediction, Data Analytics, Antimicrobial Prescription, Antibiotic Prescription, Anti-bacterial Prescription, Human Patients

Introduction

The inappropriate and excessive use of antimicrobials reduce their efficacy in the treatment of bacterial infections1. Around 50% of antimicrobial use is not appropriate27, leading to a higher number of resistant pathogens8. The rise of antimicrobial resistance (AMR) has a noticeable impact on the morbidity, the mortality and health care cost9,10. If it is not tackled, 300 million people are estimated to die by 2050; AMR also impacts global GDP which is estimated to be reduced by 2% –3.5%, with a loss of between 60 to 100 trillion USD of economic output worldwide by 205011. In recent years, artificial intelligence (AI) has been adopted to support improved antimicrobial use and control AMR12,13. Examples of AI applications for this purpose include: prediction of AMR, diagnosis of antimicrobial resistant infections, prediction of the rational use of antimicrobials, identifying new antimicrobial peptides (AMPs), and exploring antimicrobial combinations. The AI methods used for these applications include: decision trees, support vector machines and artificial neural networks14. No reviews were identified on the use of AI methods to improve antimicrobial prescribing, and thus, the objective of this systematic review protocol is to determine whether the use of AI can improve antimicrobial prescribing in human patients.

Research question

Can the use of AI improve antimicrobial prescribing in human patients?

Methods

This protocol is developed in line with “The Preferred Reporting Items for Systematic Reviews and Meta-Analyses Protocols (PRISMA-P)” guidelines15 and is registered in PROSPERO database (CRD42022329049) on 14 May 2022. The planned time to carry out this review is from April 2022 till October 2022.

Study design

The selected studies will be observational in nature, including cohort studies; and any study that examines the potential or actual use of AI, or machine learning, or data analytics to improve the antimicrobial prescriptions or use in human patients will be included in this review.

Eligibility criteria

Types of participants: Participants will be human patients, and there will be no restrictions on age, gender, weight, or morbidities.

Settings: There will be no restriction on the setting of the studies.

Time: There will be no restriction on the time of publication of the studies included.

Language: There will be no restriction on the language of the articles included.

Data sources and search strategy

Data sources: A search strategy will be developed and applied to the following databases: ScienceDirect, Scopus, OVID, EMBASE, and Web of Science. Since part of the studies will have been carried out through a computer science lens, ACM Digital library, and IEEE Xplore databases will also be searched to collect as many relevant publications as possible.

Search strategy: The Search for keywords will be used across three different concepts: 1. Artificial Intelligence, 2. Prescriptions, 3. Population, and it will be customized to every database searched depending on its special filters. The detailed search strategy can be found in Extended data16.

Study records

Data extraction and management: Citations resulting from searching the different databases will be imported into EndNote, merged, and checked for duplicates. After removing duplicates, studies will be imported into an excel sheet, and the screening for titles and abstracts, for inclusion or exclusion, will be conducted.

Study selection: Two reviewers will independently screen the titles and abstracts to define eligible studies using the inclusion and exclusion criteria. When it is unclear whether a study is to be included or not, it will be included for the full text screening stage. If any reviews are identified among the studies, a manual search of their included studies will be conducted to ensure that all relevant studies are included. Conflicts between reviewers will be resolved through discussion till a consensus is reached, else a third reviewer will resolve the conflict. If there is missing information in a study, the author will be contacted for clarification. A PRISMA flow diagram will be used to keep track of the studies selection process.

Study outcome measures

Primary outcome: The relative reduction in antimicrobial prescriptions.

Secondary outcome: The relative reduction in re-consultation of patients, whether for infection recurrence or worsening condition (i.e.: symptoms).

Assessment of risk of bias

For the internal validity of this review, Newcastle Ottawa Scale17 tool will be used to assess the risk of bias for the included studies. The domains of this tool are selection (“representativeness of the exposed cohort”, “selection of the non-exposed cohort”, “ascertainment of exposure”, and “demonstration that outcome of interest was not present at start of study”), comparability (“comparability of cohorts on the basis of the design or analysis”), and outcome (“assessment of outcome”, “was follow-up long enough for outcomes to occur”, “adequacy of follow up of cohorts”). The results of the risk of bias assessment will be used to inform the synthesis, the interpretation of the results as well as the discussion of findings for this review.

Data synthesis

As most studies in this review will be observational, which may lead to heterogeneity of the data, a Random Effects Model will be used to obtain odds ratios with a 95% confidence interval. The I2 statistic will be calculated to studying the heterogeneity of the studies included. If any missing data is suspected in one or more studies during the review, the authors of the study will be contacted to clarify, and thus minimize the risk of bias during the meta-analysis. If sufficient data is available, this review will conduct subgroup analysis for population age groups.

Study status

This study is currently in the “abstract-title” screening phase.

Discussion

This systematic review will add value by providing combined evidence of the use of AI to improve antimicrobial prescribing. It will explore advantages of using AI, with its effectiveness, efficiency, and optimized use of resources to improve antimicrobial prescribing and use. The “no-restriction” on language, time and setting will lead to inclusion of more studies, which will contribute to the generalizability and applicability of the findings, which in turn increases the external validity of the study. The observational nature of the studies included may lead to the presence of heterogeneity, which may affect the meta-analysis of the study. Some of the issues of using AI are associated with the amount of data used in a study; if the data is limited or partially unavailable, this may influence the quality of the study. As studies of poor quality may represent some difficulty in interpreting the findings, the inclusion of additional databases for searching will increase the number of relevant studies and reduce the impact of poor-quality studies. Finally, the findings of this review may be useful to design interventions to reduce antimicrobial prescribing and target both the public and antimicrobial prescribers. The results will be disseminated through a peer-reviewed publication, national and international scientific sessions.

Strengths and limitations of this study

This study will explore the advantages of AI in reducing antimicrobial prescribing, and the “no-restriction” on language, time and setting of the studies will lead to inclusion of more studies, and thus higher applicability of findings. On the other hand, the expected heterogeneity due to the observational nature of the studies may hinder meta-analysis, and the studies, with poor quality, will represent some difficulty in the interpretation of findings.

Data availability

Underlying data

No data are associated with this article.

Extended data

Figshare: Search Strategy - Artificial Intelligence to Improve Antimicrobial Prescribing- A Protocol for a Systematic Review. https://doi.org/10.6084/m9.figshare.20195723.v116

This project contains the following extended data:

  • - Search Strategy - Artificial Intelligence to Improve Antimicrobial Prescribing- A Protocol for a Systematic Review.docx

Data are available under the terms of the Creative Commons Attribution 4.0 International license (CC-BY 4.0).

Reporting guidelines

Figshare: PRISMA-P Checklist for “Artificial intelligence to improve antimicrobial prescribing: A protocol for a systematic review”. https://doi.org/10.6084/m9.figshare.2019557318

Data are available under the terms of the Creative Commons Attribution 4.0 International license (CC-BY 4.0).

Ethical approval

No ethical approval is required as no primary, personal or confidential data are collected in this study and all studies included are published.

Comments on this article Comments (0)

Version 1
VERSION 1 PUBLISHED 29 Jul 2022
Comment
Author details Author details
Competing interests
Grant information
Copyright
Download
 
Export To
metrics
VIEWS
555
 
downloads
28
Citations
CITE
how to cite this article
Amin D, Garzón-Orjuela N, Garcia Pereira A et al. Artificial intelligence to improve antimicrobial prescribing: A protocol for a systematic review [version 1; peer review: 2 approved with reservations]. HRB Open Res 2022, 5:54 (https://doi.org/10.12688/hrbopenres.13582.1)
NOTE: If applicable, it is important to ensure the information in square brackets after the title is included in all citations of this article.
track
receive updates on this article
Track an article to receive email alerts on any updates to this article.

Open Peer Review

Current Reviewer Status: ?
Key to Reviewer Statuses VIEW
ApprovedThe paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approvedFundamental flaws in the paper seriously undermine the findings and conclusions
Version 1
VERSION 1
PUBLISHED 29 Jul 2022
Views
27
Cite
Reviewer Report 13 Jan 2023
Barbara Clyne, Department of General Practice, RCSI University of Medicine and Health Sciences, Dublin, Ireland 
Approved with Reservations
VIEWS 27
This review addresses an important topic and is well written, however, more detail on the proposal would be beneficial to the reader. 

Abstract:
  • End of first sentence doesn’t seem to be in the
... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Clyne B. Reviewer Report For: Artificial intelligence to improve antimicrobial prescribing: A protocol for a systematic review [version 1; peer review: 2 approved with reservations]. HRB Open Res 2022, 5:54 (https://doi.org/10.21956/hrbopenres.14836.r33240)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
Views
40
Cite
Reviewer Report 13 Jan 2023
Carla Pires, Escola de Ciências e Tecnologias da Saúde, Universidade Lusófona’s Research Center for Biosciences and Health Technologies, Lisbon, Portugal 
Approved with Reservations
VIEWS 40
This protocol was registered in PROSPERO online database (CRD42022329049; 14 May 2022).

In general, the study protocol is well defined.

Some suggestions/recommendations:

Study objective: “to determine whether the use of AI ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Pires C. Reviewer Report For: Artificial intelligence to improve antimicrobial prescribing: A protocol for a systematic review [version 1; peer review: 2 approved with reservations]. HRB Open Res 2022, 5:54 (https://doi.org/10.21956/hrbopenres.14836.r33241)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.

Comments on this article Comments (0)

Version 1
VERSION 1 PUBLISHED 29 Jul 2022
Comment
Alongside their report, reviewers assign a status to the article:
Approved - the paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations - A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approved - fundamental flaws in the paper seriously undermine the findings and conclusions

Are you a HRB-funded researcher?

Submission to HRB Open Research is open to all HRB grantholders or people working on a HRB-funded/co-funded grant on or since 1 January 2017. Sign up for information about developments, publishing and publications from HRB Open Research.

You must provide your first name
You must provide your last name
You must provide a valid email address
You must provide an institution.

Thank you!

We'll keep you updated on any major new updates to HRB Open Research

Sign In
If you've forgotten your password, please enter your email address below and we'll send you instructions on how to reset your password.

The email address should be the one you originally registered with F1000.

Email address not valid, please try again

You registered with F1000 via Google, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Google account password, please click here.

You registered with F1000 via Facebook, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Facebook account password, please click here.

Code not correct, please try again
Email us for further assistance.
Server error, please try again.