Scolaris Content Display Scolaris Content Display

Figure 1 Study flow diagram.
Figuras y tablas -
Figure 1

Figure 1 Study flow diagram.

Risk of bias graph: review authors' judgements about each risk of bias item presented as percentages across all included studies.Blank sections in this graph are due to use of different ROB criteria for CBA, NRT and RCT versus ITS studies
Figuras y tablas -
Figure 2

Risk of bias graph: review authors' judgements about each risk of bias item presented as percentages across all included studies.

Blank sections in this graph are due to use of different ROB criteria for CBA, NRT and RCT versus ITS studies

Forest plot of comparison: 1 Prescribing: RCTs of all interventions to reduce unnecessary prescribing, outcome: 1.1 Dichotomous outcomes, increase in desired practice.
Figuras y tablas -
Figure 3

Forest plot of comparison: 1 Prescribing: RCTs of all interventions to reduce unnecessary prescribing, outcome: 1.1 Dichotomous outcomes, increase in desired practice.

Forest plot of comparison: 1 Effectiveness: Prescribing outcomes from RCTs of interventions to reduce unnecessary antibiotic use, outcome: 1.4 Continuous outcomes, duration of all antibiotic treatment (days).
Figuras y tablas -
Figure 4

Forest plot of comparison: 1 Effectiveness: Prescribing outcomes from RCTs of interventions to reduce unnecessary antibiotic use, outcome: 1.4 Continuous outcomes, duration of all antibiotic treatment (days).

Forest plot of comparison: 2 Adverse effects: Clinical outcomes from RCTs of interventions to reduce unnecessary antibiotic use, outcome: 2.1 Mortality, all RCTs.
Figuras y tablas -
Figure 5

Forest plot of comparison: 2 Adverse effects: Clinical outcomes from RCTs of interventions to reduce unnecessary antibiotic use, outcome: 2.1 Mortality, all RCTs.

Forest plot of comparison: 2 Adverse effects: Clinical outcomes from RCTs of interventions to reduce unnecessary antibiotic use, outcome: 2.4 Length of stay, all RCTs.
Figuras y tablas -
Figure 6

Forest plot of comparison: 2 Adverse effects: Clinical outcomes from RCTs of interventions to reduce unnecessary antibiotic use, outcome: 2.4 Length of stay, all RCTs.

Meta‐regression by effect modifier for 29 RCTs. A positive value for Beta indicates enhanced intervention effect. One RCT had both enabling and restrictive components in the intervention (Strom 2010).
Figuras y tablas -
Figure 7

Meta‐regression by effect modifier for 29 RCTs. A positive value for Beta indicates enhanced intervention effect. One RCT had both enabling and restrictive components in the intervention (Strom 2010).

Forest plot of comparison 5: RCTs of enablement with and without feedback, outcome: 5.1 Enablement plus feedback.
Figuras y tablas -
Figure 8

Forest plot of comparison 5: RCTs of enablement with and without feedback, outcome: 5.1 Enablement plus feedback.

Forest plot of comparison 5: RCTs of enablement with and without feedback, outcome: 5.2 Enablement without feedback.
Figuras y tablas -
Figure 9

Forest plot of comparison 5: RCTs of enablement with and without feedback, outcome: 5.2 Enablement without feedback.

Meta‐regression by effect modifiers of intervention for 91 ITS studies. Outcome is effect on prescribing six months' postintervention. There are 16 studies with both enabling and restricting intervention components ().
Figuras y tablas -
Figure 10

Meta‐regression by effect modifiers of intervention for 91 ITS studies. Outcome is effect on prescribing six months' postintervention. There are 16 studies with both enabling and restricting intervention components (Figure 11).

Meta‐regression of prescribing outcome by effect modifiers for 29 ITS studies of interventions that included restriction.
Figuras y tablas -
Figure 11

Meta‐regression of prescribing outcome by effect modifiers for 29 ITS studies of interventions that included restriction.

Meta‐regression by effect modifier for 43 ITS studies of interventions that included enablement but not restriction. Outcome is effect on prescribing six months' postintervention. Note that four studies with feedback were not included in this analysis because they also included restriction.
Figuras y tablas -
Figure 12

Meta‐regression by effect modifier for 43 ITS studies of interventions that included enablement but not restriction. Outcome is effect on prescribing six months' postintervention. Note that four studies with feedback were not included in this analysis because they also included restriction.

Meta‐regression by effect modifiers for 34 microbial outcomes 12 months' postintervention from 26 ITS studies. The bars show the results for unadjusted versus adjusted analyses, the comparison for unplanned interventions is with planned interventions in both the unadjusted and adjusted analysis.CDI: Clostridium difficile infection
 GPC: infection with antibiotic‐resistant gram‐positive cocci
 GNB: infection with antibiotic‐resistant gram‐negative bacteriaOther infection control: 'Yes' means there were changes to infection control processes during the study period.
Figuras y tablas -
Figure 13

Meta‐regression by effect modifiers for 34 microbial outcomes 12 months' postintervention from 26 ITS studies. The bars show the results for unadjusted versus adjusted analyses, the comparison for unplanned interventions is with planned interventions in both the unadjusted and adjusted analysis.

CDI: Clostridium difficile infection
GPC: infection with antibiotic‐resistant gram‐positive cocci
GNB: infection with antibiotic‐resistant gram‐negative bacteria

Other infection control: 'Yes' means there were changes to infection control processes during the study period.

Meta‐regression by effect modifiers for 20 microbial outcomes 12 months' postintervention from 14 ITS studies of planned interventions that provided details about other infection control changes or interventions.CDI: Clostridium difficile infection
 GPC: infection with antibiotic‐resistant gram‐positive cocci
 GNB: infection with antibiotic‐resistant gram‐negative bacteriaOther infection control: 'Yes' means there were changes to infection control processes during the study period.
Figuras y tablas -
Figure 14

Meta‐regression by effect modifiers for 20 microbial outcomes 12 months' postintervention from 14 ITS studies of planned interventions that provided details about other infection control changes or interventions.

CDI: Clostridium difficile infection
GPC: infection with antibiotic‐resistant gram‐positive cocci
GNB: infection with antibiotic‐resistant gram‐negative bacteria

Other infection control: 'Yes' means there were changes to infection control processes during the study period.

Comparison 1 Effectiveness: Prescribing outcomes from RCTs of interventions to reduce unnecessary antibiotic use, Outcome 1 Dichotomous outcomes, increase in desired practice.
Figuras y tablas -
Analysis 1.1

Comparison 1 Effectiveness: Prescribing outcomes from RCTs of interventions to reduce unnecessary antibiotic use, Outcome 1 Dichotomous outcomes, increase in desired practice.

Comparison 1 Effectiveness: Prescribing outcomes from RCTs of interventions to reduce unnecessary antibiotic use, Outcome 2 Dichotomous outcomes, all RCTs with results of cluster RCTs adjusted by inflation factor.
Figuras y tablas -
Analysis 1.2

Comparison 1 Effectiveness: Prescribing outcomes from RCTs of interventions to reduce unnecessary antibiotic use, Outcome 2 Dichotomous outcomes, all RCTs with results of cluster RCTs adjusted by inflation factor.

Comparison 1 Effectiveness: Prescribing outcomes from RCTs of interventions to reduce unnecessary antibiotic use, Outcome 3 Dichotomous outcomes, low or medium 'Risk of bias' studies only.
Figuras y tablas -
Analysis 1.3

Comparison 1 Effectiveness: Prescribing outcomes from RCTs of interventions to reduce unnecessary antibiotic use, Outcome 3 Dichotomous outcomes, low or medium 'Risk of bias' studies only.

Comparison 1 Effectiveness: Prescribing outcomes from RCTs of interventions to reduce unnecessary antibiotic use, Outcome 4 Continuous outcomes, duration of all antibiotic treatment (days).
Figuras y tablas -
Analysis 1.4

Comparison 1 Effectiveness: Prescribing outcomes from RCTs of interventions to reduce unnecessary antibiotic use, Outcome 4 Continuous outcomes, duration of all antibiotic treatment (days).

Comparison 1 Effectiveness: Prescribing outcomes from RCTs of interventions to reduce unnecessary antibiotic use, Outcome 5 Continuous outcomes, duration of all antibiotic treatment with results of cluster RCTs adjusted by inflation factor.
Figuras y tablas -
Analysis 1.5

Comparison 1 Effectiveness: Prescribing outcomes from RCTs of interventions to reduce unnecessary antibiotic use, Outcome 5 Continuous outcomes, duration of all antibiotic treatment with results of cluster RCTs adjusted by inflation factor.

Comparison 1 Effectiveness: Prescribing outcomes from RCTs of interventions to reduce unnecessary antibiotic use, Outcome 6 Continuous outcomes, low or medium 'Risk of bias' studies only.
Figuras y tablas -
Analysis 1.6

Comparison 1 Effectiveness: Prescribing outcomes from RCTs of interventions to reduce unnecessary antibiotic use, Outcome 6 Continuous outcomes, low or medium 'Risk of bias' studies only.

Comparison 1 Effectiveness: Prescribing outcomes from RCTs of interventions to reduce unnecessary antibiotic use, Outcome 7 Continuous outcome, consumption of targeted antibiotic only, standardised mean reduction (original outcome cost, days or DDD).
Figuras y tablas -
Analysis 1.7

Comparison 1 Effectiveness: Prescribing outcomes from RCTs of interventions to reduce unnecessary antibiotic use, Outcome 7 Continuous outcome, consumption of targeted antibiotic only, standardised mean reduction (original outcome cost, days or DDD).

Comparison 2 Adverse effects: Clinical outcomes from RCTs of interventions to reduce unnecessary antibiotic use, Outcome 1 Mortality, all RCTs.
Figuras y tablas -
Analysis 2.1

Comparison 2 Adverse effects: Clinical outcomes from RCTs of interventions to reduce unnecessary antibiotic use, Outcome 1 Mortality, all RCTs.

Comparison 2 Adverse effects: Clinical outcomes from RCTs of interventions to reduce unnecessary antibiotic use, Outcome 2 Mortality, all RCTs with results of cluster RCTs adjusted by inflation factor.
Figuras y tablas -
Analysis 2.2

Comparison 2 Adverse effects: Clinical outcomes from RCTs of interventions to reduce unnecessary antibiotic use, Outcome 2 Mortality, all RCTs with results of cluster RCTs adjusted by inflation factor.

Comparison 2 Adverse effects: Clinical outcomes from RCTs of interventions to reduce unnecessary antibiotic use, Outcome 3 Mortality, low or medium 'Risk of bias' RCTs.
Figuras y tablas -
Analysis 2.3

Comparison 2 Adverse effects: Clinical outcomes from RCTs of interventions to reduce unnecessary antibiotic use, Outcome 3 Mortality, low or medium 'Risk of bias' RCTs.

Comparison 2 Adverse effects: Clinical outcomes from RCTs of interventions to reduce unnecessary antibiotic use, Outcome 4 Length of stay, all RCTs.
Figuras y tablas -
Analysis 2.4

Comparison 2 Adverse effects: Clinical outcomes from RCTs of interventions to reduce unnecessary antibiotic use, Outcome 4 Length of stay, all RCTs.

Comparison 2 Adverse effects: Clinical outcomes from RCTs of interventions to reduce unnecessary antibiotic use, Outcome 5 Length of stay, all RCTs with results of cluster RCTs adjusted by inflation factor.
Figuras y tablas -
Analysis 2.5

Comparison 2 Adverse effects: Clinical outcomes from RCTs of interventions to reduce unnecessary antibiotic use, Outcome 5 Length of stay, all RCTs with results of cluster RCTs adjusted by inflation factor.

Comparison 2 Adverse effects: Clinical outcomes from RCTs of interventions to reduce unnecessary antibiotic use, Outcome 6 Length of stay, low or medium 'Risk of bias' RCTs only.
Figuras y tablas -
Analysis 2.6

Comparison 2 Adverse effects: Clinical outcomes from RCTs of interventions to reduce unnecessary antibiotic use, Outcome 6 Length of stay, low or medium 'Risk of bias' RCTs only.

Comparison 3 Adverse effects: Clinical outcomes of interventions targeting antibiotic choice, Outcome 1 Mortality for trial patients.
Figuras y tablas -
Analysis 3.1

Comparison 3 Adverse effects: Clinical outcomes of interventions targeting antibiotic choice, Outcome 1 Mortality for trial patients.

Comparison 3 Adverse effects: Clinical outcomes of interventions targeting antibiotic choice, Outcome 2 Length of stay for trial patients.
Figuras y tablas -
Analysis 3.2

Comparison 3 Adverse effects: Clinical outcomes of interventions targeting antibiotic choice, Outcome 2 Length of stay for trial patients.

Comparison 4 Adverse effects: Clinical outcomes of interventions targeting antibiotic exposure, Outcome 1 Mortality for trial patients.
Figuras y tablas -
Analysis 4.1

Comparison 4 Adverse effects: Clinical outcomes of interventions targeting antibiotic exposure, Outcome 1 Mortality for trial patients.

Comparison 4 Adverse effects: Clinical outcomes of interventions targeting antibiotic exposure, Outcome 2 Length of stay for trial patients.
Figuras y tablas -
Analysis 4.2

Comparison 4 Adverse effects: Clinical outcomes of interventions targeting antibiotic exposure, Outcome 2 Length of stay for trial patients.

Comparison 5 Modifiers of intended effect: Comparison of enabling interventions with and without feedback, Outcome 1 Enablement with feedback.
Figuras y tablas -
Analysis 5.1

Comparison 5 Modifiers of intended effect: Comparison of enabling interventions with and without feedback, Outcome 1 Enablement with feedback.

Comparison 5 Modifiers of intended effect: Comparison of enabling interventions with and without feedback, Outcome 2 Enablement without feedback.
Figuras y tablas -
Analysis 5.2

Comparison 5 Modifiers of intended effect: Comparison of enabling interventions with and without feedback, Outcome 2 Enablement without feedback.

Summary of findings for the main comparison. Effects of interventions to improve use of antibiotics on prescribing, clinical outcomes, adverse events, and effect modifiers (heterogeneity)

Patient or population: adults or children undergoing inpatient antibiotic prophylaxis or treatment

Settings: mainly high‐income countries (North America or Western Europe)

Intervention: any intervention targeting healthcare professionals that aimed to improve antibiotic prescribing to hospital inpatients

Comparison: usual care (varied across studies)

Effectiveness: prescribing outcomes from RCTs

Outcomes

Absolute effect*

No of participants

(No of studies)

Certainty of the evidence (GRADE)

Comments

Without intervention

With intervention

Proportion of participants who were treated according to antibiotic prescribing guidelines

Follow‐up to end of study

43 per 100

58 per 100

23,394 participants

(29 RCTs)

⊕⊕⊕⊕
High

We have graded the certainty of evidence as high because heterogeneity was explained by prespecified effect modifiers (see below). The intervention effect varied between the studies, but the direction of effect was consistent. Restricting the analysis to studies at low risk of bias gave a similar result (RD 11%, 95% CI 10% to 12%).

Difference: 15 more participants per 100 (95% CI 15 to 23) received appropriate treatment following intervention.

Duration of all antibiotic treatment

11.0 days

9.1 days

3318 participants

(14 RCTs)

⊕⊕⊕⊕
High

Difference: 1.95 fewer days per participant (95% CI 2.22 to 1.67)

Mortality

Follow‐up to end of study

11 per 100

11 per 100

15,827 participants

28 (RCTs)

⊕⊕⊕⊝1
Moderate

Mortality and length of stay were measured to determine the impact of reduced antibiotic use on clinical outcomes. The results were similar for studies that targeted antibiotic choice or exposure.

Only 1 of the interventions in the RCTs with mortality or length‐of‐stay outcomes had a restrictive component (Singh 2000). This evidence is therefore at high risk of indirectness because 7 studies in the next section of the table (see below) raise concerns about the safety of restrictive interventions. Moreover, the ITS studies showed that restrictive components were included in 42 (34%) of 123 hospital interventions.

Difference: 0 more deaths per 100 participants (95% CI 1 to 0 fewer)

Mean length of hospital stay per participant

12.9 days

11.8 days

3834 participants

15 (RCTs)

⊕⊕⊕⊝1
Moderate

Difference: 1.1 fewer days per participant (95% CI 1.5 to 0.7 fewer)

Delay in treatment

Restrictive interventions increased the risk of delay in all 3 studies. The risk to patients resulted in termination of the RCT by the Trial Monitoring Committee.

1 RCT, 2 cohort

⊕⊕⊝⊝2
Low

The evidence from these 7 studies of unintended consequences raises concerns about the directness of the evidence of safety from the 29 RCTs in the previous section of the table (see above).

Negative professional culture

Loss of trust in infection specialists because of failure to record approvals for restricted drugs or provide warning about stopping treatment

Misleading or inaccurate information from prescribers in order to meet criteria for restricted drugs. In 1 hospital, misdiagnosis of hospital‐acquired infection was large enough to trigger an outbreak investigation.

1 case control, 2 cohort, 1 qualitative

⊕⊕⊖⊖3
Low

Effect modifiers (heterogeneity) for immediate effect of intervention on prescribing outcomes:
impact of behaviour change functions (enablementor restriction) and additional impact of feedback, RCTs and ITS studies. A positive value for Beta means the modifier is associated with increased effect

Effect modifier

Adjusted effect in meta‐regression
Beta
(95% CI)

Number of studies

Certainty of the evidence (GRADE)

Comments

Enablement

15.12

(8.45 to 21.8)

29 RCTs

⊕⊕⊕⊕
High

The effect of enablement and restriction is similar in the RCTs and ITS studies. Of the 29 RCTs, only 8 (31%) of interventions were hospital‐wide, the majority being in single units. In contrast, 64 (70%) of the interventions in ITS studies were hospital‐wide.

12.86

(4.11 to 21.6)

91 ITS

Restriction

34.91

(13.52 to 56.29)

29 RCTs

⊕⊕⊕⊕
High

24.69

(13.74 to 35.64)

91 ITS

Addition of feedback to enablement

10.88

(7.16 to 19.32)

23 RCTs

⊕⊕⊕⊝2
Moderate

Feedback was included in 4 (17%) of 23 RCTs and 20 (47%) of 43 ITS studies with interventions that included enablement. There were not enough interventions with goal setting and action planning to analyse as effect modifiers.

15.63

(0.56 to 30.70)

43 ITS

Addition of enablement to restriction

38.36

(18.94 to 57.78)

29 ITS

⊕⊕⊖⊖3
Low

Enablement was included in 13 (45%) of 29 ITS studies with restrictive interventions.

*The risk WITHOUT the intervention is based on the median control group risk across studies. The corresponding risk WITH the intervention (and the 95% confidence interval for the difference) is based on the overall relative effect (and its 95% confidence interval).
CI: confidence interval; ITS: interrupted time series; RCT: randomised controlled trial; RD: risk difference

GRADE Working Group grades of evidence
High certainty: Further research is very unlikely to change our confidence in the estimate of effect.
Moderate certainty: Further research is likely to have an important impact on our confidence in the estimate of effect and may change the estimate.
Low certainty: Further research is very likely to have an important impact on our confidence in the estimate of effect and is likely to change the estimate.
Very low certainty: We are very uncertain about the estimate.

Details of five GRADE criteria for all outcomes from RCTs are in Appendix 2.

1We downgraded the evidence to moderate because of indirectness.
2We downgraded the evidence because most studies are non‐randomised studies.
3We graded the evidence as low because it is all from non‐randomised studies.
4We graded the evidence as very low because it is all from non‐randomised studies and there was too much heterogeneity for reliable evidence synthesis.

Figuras y tablas -
Summary of findings for the main comparison. Effects of interventions to improve use of antibiotics on prescribing, clinical outcomes, adverse events, and effect modifiers (heterogeneity)
Table 1. Definition of behaviour change techniques and intervention functions

Intervention Function

Definition

Intervention components

Education

Increasing knowledge or understanding

Educational meetings;

Dissemination of educational materials;

Educational outreach

Persuasion

Using communication to induce positive or negative feelings or to stimulate action

Educational outreach by academic detailing or review and recommend change

Restriction

Using rules to reduce the opportunity to engage in the target behaviour (or increase the target behaviour by reducing the opportunity to engage in competing behaviours)

Restrictive

Environmental restructuring

Changing the physical context

Reminders (physical) such as posters, pocket‐size or credit card‐size summaries or on laboratory test reports;

Structural (e.g. new laboratory tests or rapid reporting of results)

Enablement

Increasing means/reducing barriers to increase capability or opportunity

Audit and feedback;

Decision support through computerised systems or through circumstantial reminders that were triggered by actions or events related to the targeted behaviour;

Educational outreach by review and recommend change

Figuras y tablas -
Table 1. Definition of behaviour change techniques and intervention functions
Table 2. Unintended consequences of ITS studies: mortality*

Study

Prescribing target

Restriction

Design of analysis

Effect estimate

95% CI

Lee 2014

Choice of drug

No

Cohort

Incidence rate ratio 1.1

0.9 to 1.5

Popovski 2015

Choice of drug

No

Cohort

Increase by 1.4%

‐1.2% to 4.1%

Wang 2014

Choice of drug

Yes

ITS, segmented regression

Change in slope ‐0.0172

No data

Yoon 2014

Choice of drug

Yes

Cohort

+0.43 per 1000 OBD

No data

*Mortality was measured in all patients in the hospital rather than just those patients who were the targets of the interventions.

CI: confidence interval
ITS: interrupted time series
OBD: occupied bed day

Figuras y tablas -
Table 2. Unintended consequences of ITS studies: mortality*
Table 3. Unintended consequences of ITS studies: length of stay*

Study

Prescribing target

Restrictive

Design of analysis

Effect estimate

95% CI

Mittal 2014

Exposure, % treated

No

Cohort

‐0.5 days

No data

Skaer 1993

Choice of drug

No

Cohort

‐0.1 days

‐0.49 to +0.29

*Length of stay was measured in all patients in the hospital rather than just those patients who were the targets of the interventions.

CI: confidence interval
ITS: interrupted time series

Figuras y tablas -
Table 3. Unintended consequences of ITS studies: length of stay*
Table 4. Unintended consequences of ITS studies: other

Study

Prescribing target

Design of analysis

Effect measure

Effect estimate

95% CI

Bell 2014

Antibiotic choice

ITS, segmented regression

Risk of postoperative acute kidney injury

Increase 98%

93.8% to 94.2%

Van Kasteren 2005

Exposure, duration

Cohort

Surgical‐site infection

Decrease 0.8%

‐2.2% to 0.6%

Volpe 2012

Time to first antibiotic dose

Cohort

Left without being seen rate

Decrease 0.4%

No data

CI: confidence interval
ITS: interrupted time series

Figuras y tablas -
Table 4. Unintended consequences of ITS studies: other
Table 5. Unintended consequences studies (case control, cohort, or qualitative)

Study

Design

Patients

Intended target

Unintended consequence

Effect estimate

95% CI

Interventions with a restrictive component

Baysari 2013

Qualitative

36 physicians

Reduce unnecessary use of restricted antibiotics

Inaccurate feedback

Not quantified; qualitative study

Calfee 2003

Case control

Not clear

Increase in physician‐based diagnosis of nosocomial infection

No denominator data

Connor 2007

Cohort

120

Failure to warn prescribers about discontinuation

Duvoisin 2014

Cohort

222

Reduce unnecessary laboratory tests

Delay in TFAD (HR > 1 shows delay less likely in intervention period)

Multivariate HR 1.56

1.17 to 2.07

LaRosa 2007

Cross‐sectional

15,440

Reduce unnecessary use of restricted antibiotics

Orders for restricted antibiotics (% all orders) from 10 to 11 pm vs all other hours

Cohort

360

% appropriate orders 10 to 11 pm vs 9 to 10 pm

‐23.7%

‐31.8% to ‐15.5%

Linkin 2007

Cohort

200

Risk of inaccurate information in orders judged inappropriate vs appropriate

OR 2.2

1.0 to 4.4

Winters 2010

Cohort

3251

Risk of 1‐hour delay in TFAD

OR 1.5

1.2 to 1.8

Risk of 2‐hour delay in TFAD

OR 1.8

1.4 to 2.2

Interventions with no restrictive component

Friedberg 2009

Cohort

13,042

Reduce time to first antibiotic dose for patients with community‐acquired pneumonia

% CAP diagnoses

1% increase

No denominator data

Kanwar 2007

Cohort

518

% correct CAP diagnoses

‐7.9% decrease

‐15.4% to ‐0.4%

Welker 2008

Cohort

548

% correct CAP diagnoses

‐16.0% decrease

‐7.6% to ‐24.4%

CAP: community‐acquired pneumonia
CI: confidence interval
HR: hazard ratio
OR: odds ratio
TFAD: time to the first antibiotic dose

Figuras y tablas -
Table 5. Unintended consequences studies (case control, cohort, or qualitative)
Table 6. Summary of intervention components for 29 RCTs (Analysis 1.1; Figures 3 and 7) and 91 ITS studies (Figure 10)

Intervention function and components

RCT

ITS

Enablement

24

studies

59

studies

Number of enabling or restrictive intervention components

27

76

Studies with > 1 Enabling intervention component

2

8%*

19

32%*

Audit and feedback

4

17%

24

41%

Computerised decision support

1

4%

3

5%

Circumstantial reminders

16

67%

18

31%

Review and recommend change

6

25%

31

53%

Restriction

2

studies

29

studies

Number of Restrictive intervention components

3

41

Studies with > 1 Restrictive intervention component

1

50%

10

34%

Expert approval

1

50%

18

62%

Compulsory order form

1

50%

7

24%

Removal

0

10

34%

Review and make change

1

50%

6

21%

No Enablement or Restriction

4

studies

18

studies

Number of intervention components

6

25

Studies with > 1 intervention component

2

50%

6

33%

Educational materials or meetings

3

75%

16

89%

Educational outreach (academic detailing)

1

25%

6

33%

Physical reminders

1

25%

2

11%

Structural intervention

1

25%

1

6%

*The denominator for all percentages is the number of studies for each intervention function. One RCT, Strom 2010, and 16 ITS studies (Figure 11) included both enabling and restrictive intervention components.

ITS: interrupted time series
RCT: randomised controlled trial

Figuras y tablas -
Table 6. Summary of intervention components for 29 RCTs (Analysis 1.1; Figures 3 and 7) and 91 ITS studies (Figure 10)
Table 7. Data from 5 studies about the effect of removal of interventions. The intended effect of all interventions was reduction in unnecessary antibiotic use

Study

Intervention function

Intervention effect (95% CI)

Time intervention was in place

Effect of removal (95% CI)

Kallen 2009

Restriction

‐87.5%

‐115.4 to ‐59.7

6 months

398.9%

238.2 to 559.5

Kim 2008

Restriction

‐23.1%

‐53.7 to +7.4

9 months

6.0%

‐23.4 to 35.4

Standiford 2012

Enablement

‐28.6%

‐46.5 to ‐10.6

7 years

31.0%

6.8 to 55.3

Himmelberg 1991

Restriction

No data

“long‐standing”

301.2%

230.9 to 371.5

Skrlin 2011

Restriction

2 years

255.8%

194.7 to 316.9

CI: confidence interval

Figuras y tablas -
Table 7. Data from 5 studies about the effect of removal of interventions. The intended effect of all interventions was reduction in unnecessary antibiotic use
Table 8. Randomised controlled trials with microbial outcomes

Study

Design

Microbial outcome

Reason not in meta‐analysis

Annane 2013

RCT

Colonisation with MRSA (nasal swab) and GNRB (rectal swabs)

Not comparable with any other RCT

Bouza 2007

RCT

Number of cases of Clostridium difficile

Not in prescribing meta‐analysis

Lesprit 2013

RCT

Secondary infection and/or colonisation with multidrug‐resistant bacteria in the 6 months following randomisation

Not in prescribing meta‐analysis. It is impossible to assess the impact of the intervention on colonisation or infection with bacteria resistant to specific antibiotics.

Palmay 2014

RCT

CDI and infection with antibiotic resistant organisms cases/1000 OBD

Not in prescribing meta‐analysis

Singh 2000

RCT

Number of participants with "antimicrobial resistance and/or superinfections" from randomisation until discharge from hospital

It is impossible to assess the impact of the intervention on colonisation or infection with bacteria resistant to specific antibiotics.

CDI: Clostridium difficile infection
GNRB: gram‐negative resistant bacteria
MRSA: methicillin‐resistant Staphylococcus aureus
OBD: occupied bed day
RCT: randomised controlled trial

Figuras y tablas -
Table 8. Randomised controlled trials with microbial outcomes
Table 9. Microbial outcomes from 26 ITS studies from the prescribing meta‐analysis that include reliable data about prescribing outcomes at 6 months and microbial outcomes at 12 months postintervention

Prescribing target

Microbial outcome

N

Study ID

Cephalosporins

GNRB

8

Grohs 2014; Kim 2008; Knudsen 2014; Lee 2007; McNulty 1997; Meyer 2009; Petrikkos 2007; Tangdén 2011

MRSA

1

May 2000

Carbapenems

GNRB

1

Goldstein 2009

Fluoroquinolones

GNRB

3

Cook 2011b; Lafaurie 2012; Willemsen 2010

MRSA

1

Lafaurie 2012

High‐risk antibiotics

CDI

6

Aldeyab 2012; Chan 2011; Dancer 2013; Fowler 2007; Talpaert 2011; Valiquette 2007

GNRB

4

Buising 2008a; Chan 2011; Dancer 2013; Liebowitz 2008

MRSA

6

Aldeyab 2014; Ananda‐Rajah 2010; Chan 2011; Dancer 2013; Fowler 2007; Liebowitz 2008

Total antibiotic use

CDI

2

Cook 2011a; Jump 2012

MRSA

1

Cook 2011a

Vancomycin

VRE

1

Lautenbach 2003

Total microbial

34*

*Some studies had more than one microbial outcome, so the total is 34 microbial outcomes from 26 studies.

CDI: Clostridium difficile infection
GNRB: gram‐negative resistant bacteria
ITS: interrupted time series
MRSA: methicillin‐resistant Staphylococcus aureus
VRE: vancomycin‐resistant enterococci

Figuras y tablas -
Table 9. Microbial outcomes from 26 ITS studies from the prescribing meta‐analysis that include reliable data about prescribing outcomes at 6 months and microbial outcomes at 12 months postintervention
Comparison 1. Effectiveness: Prescribing outcomes from RCTs of interventions to reduce unnecessary antibiotic use

Outcome or subgroup title

No. of studies

No. of participants

Statistical method

Effect size

1 Dichotomous outcomes, increase in desired practice Show forest plot

29

23394

Risk Difference (M‐H, Fixed, 95% CI)

0.15 [0.14, 0.16]

2 Dichotomous outcomes, all RCTs with results of cluster RCTs adjusted by inflation factor Show forest plot

29

5802

Risk Difference (M‐H, Fixed, 95% CI)

0.17 [0.15, 0.19]

3 Dichotomous outcomes, low or medium 'Risk of bias' studies only Show forest plot

15

13086

Risk Difference (M‐H, Fixed, 95% CI)

0.11 [0.10, 0.12]

4 Continuous outcomes, duration of all antibiotic treatment (days) Show forest plot

14

3318

Mean Difference (IV, Fixed, 95% CI)

‐1.95 [‐2.22, ‐1.67]

5 Continuous outcomes, duration of all antibiotic treatment with results of cluster RCTs adjusted by inflation factor Show forest plot

14

3318

Mean Difference (IV, Fixed, 95% CI)

‐1.95 [‐2.23, ‐1.67]

6 Continuous outcomes, low or medium 'Risk of bias' studies only Show forest plot

3

755

Mean Difference (IV, Fixed, 95% CI)

‐3.06 [‐3.76, ‐2.37]

7 Continuous outcome, consumption of targeted antibiotic only, standardised mean reduction (original outcome cost, days or DDD) Show forest plot

4

1053

Std. Mean Difference (IV, Fixed, 95% CI)

‐0.25 [‐0.37, ‐0.13]

Figuras y tablas -
Comparison 1. Effectiveness: Prescribing outcomes from RCTs of interventions to reduce unnecessary antibiotic use
Comparison 2. Adverse effects: Clinical outcomes from RCTs of interventions to reduce unnecessary antibiotic use

Outcome or subgroup title

No. of studies

No. of participants

Statistical method

Effect size

1 Mortality, all RCTs Show forest plot

28

15827

Risk Difference (M‐H, Fixed, 95% CI)

‐0.00 [‐0.01, 0.00]

2 Mortality, all RCTs with results of cluster RCTs adjusted by inflation factor Show forest plot

28

8332

Risk Difference (M‐H, Fixed, 95% CI)

‐0.01 [‐0.02, 0.01]

3 Mortality, low or medium 'Risk of bias' RCTs Show forest plot

8

6249

Risk Difference (M‐H, Fixed, 95% CI)

‐0.00 [‐0.02, 0.01]

4 Length of stay, all RCTs Show forest plot

15

3834

Mean Difference (IV, Fixed, 95% CI)

‐1.12 [‐1.54, ‐0.70]

5 Length of stay, all RCTs with results of cluster RCTs adjusted by inflation factor Show forest plot

15

3834

Mean Difference (IV, Fixed, 95% CI)

‐1.22 [‐1.68, ‐0.76]

6 Length of stay, low or medium 'Risk of bias' RCTs only Show forest plot

6

1731

Mean Difference (IV, Fixed, 95% CI)

‐0.85 [‐1.38, ‐0.32]

Figuras y tablas -
Comparison 2. Adverse effects: Clinical outcomes from RCTs of interventions to reduce unnecessary antibiotic use
Comparison 3. Adverse effects: Clinical outcomes of interventions targeting antibiotic choice

Outcome or subgroup title

No. of studies

No. of participants

Statistical method

Effect size

1 Mortality for trial patients Show forest plot

11

7658

Risk Difference (M‐H, Fixed, 95% CI)

‐0.00 [‐0.02, 0.01]

2 Length of stay for trial patients Show forest plot

7

2276

Mean Difference (IV, Fixed, 95% CI)

‐1.50 [‐2.16, ‐0.83]

Figuras y tablas -
Comparison 3. Adverse effects: Clinical outcomes of interventions targeting antibiotic choice
Comparison 4. Adverse effects: Clinical outcomes of interventions targeting antibiotic exposure

Outcome or subgroup title

No. of studies

No. of participants

Statistical method

Effect size

1 Mortality for trial patients Show forest plot

18

9173

Risk Difference (M‐H, Fixed, 95% CI)

‐0.00 [‐0.01, 0.01]

2 Length of stay for trial patients Show forest plot

8

1558

Mean Difference (IV, Fixed, 95% CI)

‐0.87 [‐1.42, ‐0.33]

Figuras y tablas -
Comparison 4. Adverse effects: Clinical outcomes of interventions targeting antibiotic exposure
Comparison 5. Modifiers of intended effect: Comparison of enabling interventions with and without feedback

Outcome or subgroup title

No. of studies

No. of participants

Statistical method

Effect size

1 Enablement with feedback Show forest plot

4

3747

Risk Difference (M‐H, Fixed, 95% CI)

0.19 [0.16, 0.22]

2 Enablement without feedback Show forest plot

7

1827

Risk Difference (M‐H, Fixed, 95% CI)

0.13 [0.09, 0.17]

Figuras y tablas -
Comparison 5. Modifiers of intended effect: Comparison of enabling interventions with and without feedback