Scolaris Content Display Scolaris Content Display

Cochrane Database of Systematic Reviews Protocol - Intervention

Aural toilet (ear cleaning) for chronic suppurative otitis media

This is not the most recent version

Collapse all Expand all

Abstract

This is a protocol for a Cochrane Review (Intervention). The objectives are as follows:

To assess the effects of aural toilet procedures for people with chronic suppurative otitis media.

Background

This is one of a suite of Cochrane Reviews evaluating the comparative effectiveness of non‐surgical interventions for CSOM using topical antibiotics, topical antibiotics with corticosteroids, systemic antibiotics, topical antiseptics and aural toileting (ear cleaning) methods (Table 1).

Open in table viewer
Table 1. Table of Cochrane Reviews

Topical antibiotics with steroids

Topical antibiotics

Systemic antibiotics

Topical antiseptics

Aural toileting (ear cleaning)

Topical antibiotics with steroids

Review CSOM‐4

Topical antibiotics

Review CSOM‐4

Review CSOM‐1

Systemic antibiotics

Review CSOM‐4

Review CSOM‐3

Review CSOM‐2

Topical antiseptics

Review CSOM‐4

Review CSOM‐6

Review CSOM‐6

Review CSOM‐5

Aural toileting

Review CSOM‐4

Not reviewed

Not reviewed

Not reviewed

Review CSOM‐7

Placebo (or no intervention)

Review CSOM‐4

Review CSOM‐1

Review CSOM‐2

Review CSOM‐5

Review CSOM‐7

CSOM‐1: Topical antibiotics for chronic suppurative otitis media (Brennan‐Jones 2018a).

CSOM‐2: Systemic antibiotics for chronic suppurative otitis media (Chong 2018a).

CSOM‐3: Topical versus systemic antibiotics for chronic suppurative otitis media (Chong 2018b).

CSOM‐4: Topical antibiotics with steroids for chronic suppurative otitis media (Brennan‐Jones 2018b).

CSOM‐5: Topical antiseptics for chronic suppurative otitis media (Head 2018a).

CSOM‐6: Antibiotics versus topical antiseptics for chronic suppurative otitis media (Head 2018b).

CSOM‐7: Aural toilet (ear cleaning) for chronic suppurative otitis media (Bhutta 2018).

This review will compare the effectiveness of aural toileting (ear cleaning) against other methods of aural toileting or placebo/no treatment for CSOM.

Description of the condition

Chronic suppurative otitis media (CSOM), which is also often referred to as chronic otitis media (COM), is a chronic inflammation and infection of the middle ear and mastoid cavity, characterised by ear discharge (otorrhoea) through a perforated tympanic membrane.

The predominant symptoms of CSOM are ear discharge and hearing loss. Ear discharge can be persistent or intermittent, and many sufferers find it socially embarrassing (Orji 2013). Some patients also experience discomfort or earache. Most patients with CSOM experience temporary or permanent hearing loss with average hearing levels typically between 10 and 40 decibels (Jensen 2013). The hearing loss can be disabling, and it can have an impact on speech and language skills, employment prospects, and on children’s psychosocial and cognitive development, including academic performance (Elemraid 2010; Olatoke 2008; WHO 2004). Consequently, quality of life can be affected. CSOM can also progress to serious complications in rare cases (and more often when cholesteatoma is present): both extracranial complications (such as mastoid abscess, postauricular fistula and facial palsy) and intracranial complications (such as otitic meningitis, lateral sinus thrombosis and cerebellar abscess) have been reported (Dubey 2007; Yorgancılar 2013).

CSOM is estimated to have a global incidence of 31 million episodes per year, or 4.8 new episodes per 1000 people (all ages), with 22% of cases affecting children under five years of age (Monasta 2012; Schilder 2016). The prevalence of CSOM varies widely between countries, but it disproportionately affects people at socio‐economic disadvantage. It is rare in high‐income countries, but common in many low‐ and middle‐income countries (Mahadevan 2012; Monasta 2012; Schilder 2016; WHO 2004).

Definition of disease

There is no universally accepted definition of CSOM. Some define CSOM in patients with a duration of otorrhoea of more than two weeks but others may consider this an insufficient duration, preferring a minimum duration of six weeks or more than three months (Verhoeff 2006). Some include diseases of the tympanic membrane within the definition of CSOM, such as tympanic perforation without a history of recent ear discharge, or the disease cholesteatoma (a growth of the squamous epithelium of the tympanic membrane).

In accordance with a consensus statement, here we will use CSOM only to refer to tympanic membrane perforation, with intermittent or continuous ear discharge (Gates 2002). We will use a duration of otorrhoea of two weeks as an inclusion criterion, in accordance with the definition used by the World Health Organization, but we will use subgroup analyses to explore whether this is a factor that affects observed treatment effectiveness (WHO 2004).

Many people affected by CSOM do not have good access to modern primary healthcare, let alone specialised ear and hearing care, and in such settings health workers may be unable to view the tympanic membrane to definitively diagnose CSOM. It can also be difficult to view the tympanic membrane when the ear discharge is profuse. Therefore we will also include, as a subset for analysis, studies where participants have had chronic ear discharge for at least two weeks, but where the diagnosis is unknown.

At‐risk populations

Some populations are considered to be at high risk of CSOM. There is a high prevalence of disease among Indigenous people such as the Aboriginal and Torres Strait Islander Australian, Native American and Inuit populations. This is likely due to an interplay of factors, including socio‐economic deprivation and possibly differences resulting from population genetics (Bhutta 2016). Those with primary or secondary immunodeficiency are also susceptible to CSOM. Children with craniofacial malformation (including cleft palate) or chromosomal mutations such as Down syndrome are prone to chronic non‐suppurative otitis media ('glue ear'), and by extrapolation may also be at greater risk of suppurative otitis media. The reasons for this association with craniofacial malformation are not well understood, but may include altered function of the Eustachian tube, coexistent immunodeficiency, or both. These populations may be less responsive to treatment and more likely to develop CSOM, recurrence or complications.

Children who have a grommet (ventilation tube) in the tympanic membrane to treat glue ear or recurrent acute otitis media may be more prone to develop CSOM; however, their pathway to CSOM may differ and therefore they may respond differently to treatment. Children with grommets who have chronic ear discharge meeting the CSOM criteria are therefore considered to be a separate high‐risk subgroup (van der Veen 2006).

Treatment

Treatments for CSOM may include topical antibiotics (administered into the ear) with or without steroids, systemic antibiotics (given either by mouth or by injection), topical antiseptics and ear cleaning (aural toileting), all of which can be used on their own or in various combinations. Whereas primary healthcare workers or patients themselves can deliver some treatments (for example, some aural toileting and antiseptic washouts), in most countries antibiotic therapy requires prescription by a doctor. Surgical interventions are an option in cases where complications arise or in patients who have not responded to pharmacological treatment; however, there is a range of practice in terms of the type of surgical intervention that should be considered and the timing of the intervention. In addition, access to or availability of surgical interventions is setting‐dependent. This series of Cochrane Reviews will therefore focus on non‐surgical interventions. In addition, most clinicians consider cholesteatoma to be a variant of CSOM, but acknowledge that it will not respond to non‐surgical treatment (or will only respond temporarily) (Bhutta 2011). Therefore, people with cholesteatoma will not be included in these reviews.

Description of the intervention

Aural toileting is an umbrella term used to describe the process of manually cleaning the ear. Techniques used may include dry mopping ('wicking', with cotton wool or tissue paper), suction clearance (typically under a microscope) or irrigation (using manual or automated syringing). Dry mopping may be effective in removing mucopurulent discharge, but less effective in removing epithelial debris or thick pus compared to irrigation or microsuction. Aural toileting can be used alone or in addition to other treatments for CSOM, such as antibiotics or topical antiseptics.

The technique and frequency of toileting may have an impact on its effectiveness. It is possible that dry mopping in the community is more effective because it can be delivered frequently, or it may be that less frequent suctioning by a specialist using a microscope is more effective because debris and pus are comprehensively removed. For these reasons, we will consider the different aural toileting methods as separate subgroups and pooling will only occur if there is no evidence of a difference in effect.

How the intervention might work

In aural toileting the ear canal is manually cleaned to remove the pathogenic bacteria and inflammatory mediators that contribute to inflammation, to allow the tympanic membrane to be visualised for diagnosis, and to facilitate the delivery of topical interventions such as antibiotics or antiseptics to the target area to improve their effectiveness.

There have been reports of pain, bleeding and dizziness and/or vertigo with aural toileting (Addams‐Williams 2010; Gray 1988). With suction techniques there is also the potential for noise‐induced hearing loss, although no lasting effects have been observed (Addams‐Williams 2010).

Why it is important to do this review

Aural toileting is often used prior to other interventions such as topical antiseptics or antibiotics, but it is not known what role aural toileting alone plays in disease resolution or whether there are important differences in the effectiveness of different techniques. In addition, the use of aural toileting may influence clinical decisions regarding which other treatments to use (for example, systemic or topical treatment). Therefore the effectiveness of aural toilet as an adjunctive treatment is also an important question. Aural toileting is a potentially low‐cost treatment that is accessible in most settings; it is even possible to perform some forms of aural toileting, such as dry mopping, without medical support. The effectiveness of such interventions thus has implications for how and where treatment for CSOM is provided.

Objectives

To assess the effects of aural toilet procedures for people with chronic suppurative otitis media.

Methods

Criteria for considering studies for this review

Types of studies

We will include studies with the following design characteristics:

  • Randomised controlled trials (including cluster‐randomised trials where the unit of randomisation is the setting or operator) and quasi‐randomised trials.

  • Patients were followed up for at least one week.

We will exclude studies with the following design characteristics:

  • Cross‐over trials, because CSOM is not expected to be a stable chronic condition. Unless data from the first phase are available, we will exclude such studies.'

Types of participants

We will include studies with patients (adults and children) who had:

  • chronic ear discharge of unknown cause; or

  • chronic suppurative otitis media.

We will define patients with chronic ear discharge as patients with at least two weeks of ear discharge, where the cause of the discharge was unknown.

We will define patients with chronic suppurative otitis media (CSOM) as patients with:

  • chronic or persistent ear discharge for at least two weeks; and

  • a perforated tympanic membrane.

We will not exclude any populations based on age, risk factors (cleft palate, Down syndrome), ethnicity (e.g. Australian Aboriginal or Torres Strait Islanders) or the presence of ventilation tubes (grommets). Where available, we will record these factors in the patient characteristics section during data extraction from the studies. If any of the included studies mostly recruited these patients (80% or more), we will analyse them in a subgroup analysis (see Subgroup analysis and investigation of heterogeneity).

We will exclude studies where the majority (more than 50%) of participants:

  • had an alternative diagnosis to CSOM (e.g. otitis externa);

  • had underlying cholesteatoma;

  • had ear surgery within the last six weeks.

We will not include studies designed to evaluate interventions in the immediate peri‐surgical period, which are focused on assessing the impact of the intervention on the surgical procedure or outcomes.

Types of interventions

Intervention

All aural toileting methods, frequencies and durations, including but not limited to the following:

  • Dry mopping ('wicking'): with cotton bud; Jobson‐Horne or other ear probe wrapped in cotton wool; or tissue spears (rolled up tissue papers).

  • Irrigation of the external auditory canal using a syringe or similar device. Different solutions (antiseptics versus normal water/saline) and types of irrigation instrument (e.g. manual syringe versus automated Propulse) have been described. Irrigation may be followed by dry mopping or vice versa.

  • Microsuction of the external auditory canal to remove discharge.

Comparisons

The following are the comparators:

  • Placebo, no treatment

  • Another method or aural toileting.

There are three potential scenarios for analysis:

  • Aural toileting as a stand‐alone treatment: studies where all participants received no additional treatment or another form of aural toileting (e.g. a study comparing microsuction plus daily dry mopping versus daily dry mopping).

  • Aural toileting as an add‐on to antiseptics: this will include studies where all participants also used a daily antiseptic, with or without another form of aural toileting procedure.

  • Aural toileting as an add‐on to topical/systemic antibiotics: studies where all participants received topical or systemic antibiotics, with or without another form of aural toileting or antiseptics.

Many comparison pairs are possible in this review. The main comparisons of interest that we will summarise and present in the 'Summary of findings' table will be:

  • aural toileting as a main (single) therapy versus placebo or no intervention;

  • aural toileting versus placebo or no intervention, where both arms also received topical antibiotics and/or systemic antibiotics as an add‐on therapy; and

  • aural toileting versus placebo or no intervention, where both arms also received topical antiseptics as an add‐on therapy.

Types of outcome measures

We will analyse the following outcomes in the review, but we will not use them as a basis for including or excluding studies.

We will extract and report data from the longest available follow‐up for all outcomes.

Primary outcomes

  • Resolution of ear discharge or 'dry ear' (whether otoscopically confirmed or not), measured at:

    • between one week and up to two weeks;

    • two weeks to up to four weeks; and

    • after four weeks.

  • Health‐related quality of life using a validated instrument for CSOM (e.g. Chronic Otitis Media Outcome Test (COMOT)‐12 (Phillips 2014a; Phillips 2014b; van Dinther 2015), Chronic Otitis Media Outcome Test (COMOT)‐15 (Baumann 2011), Chronic Ear Survey (CES) (Nadol 2000).

  • Ear pain (otalgia) or discomfort or local irritation.

Secondary outcomes

  • Hearing, measured as the pure‐tone average of air conduction thresholds across four frequencies tested (500 Hz, 1000 Hz, 2000 Hz and 4000 Hz) of the affected ear. If this is not available, we will report the pure‐tone average of the thresholds measured.

  • Serious complications, including intracranial complications (such as otitic meningitis, lateral sinus thrombosis and cerebellar abscess) and extracranial complications (such as mastoid abscess, postauricular fistula and facial palsy), and death.

  • Adverse events: dizziness/vertigo/balance problems.

  • Adverse events: ear bleeding.

Search methods for identification of studies

The Cochrane ENT Information Specialist will conduct systematic searches for randomised controlled trials and controlled clinical trials. There will be no language, publication year or publication status restrictions. We may contact original authors for clarification and further data if trial reports are unclear and we will arrange translations of papers where necessary.

Electronic searches

Published, unpublished and ongoing studies will be identified by searching the following databases from their inception:

  • the Cochrane Register of Studies ENT Trials Register (search via CRS Web to date);

  • the Cochrane Central Register of Controlled Trials (CENTRAL) (search via CRS Web to date);

  • Ovid MEDLINE(R) Epub Ahead of Print, In‐Process & Other Non‐Indexed Citations, Ovid MEDLINE(R) Daily and Ovid MEDLINE(R) (1946 to present);

  • Ovid EMBASE (1974 to date);

  • EBSCO CINAHL (1982 to date);

  • LILACS (search to date);

  • KoreaMed (search to date);

  • IndMed (search to date);

  • PakMediNet (search to date);

  • African Index Medicus (search to date);

  • Web of Knowledge, Web of Science (1945 to date);

  • ClinicalTrials.gov, www.clinicaltrials.gov (search via the Cochrane Register of Studies to date);

  • World Health Organization (WHO) International Clinical Trials Registry Platform (ICTRP) (search to date);

  • ISRCTN, www.isrctn.com (search to date).

The subject strategies for databases are detailed in Appendix 1. The strategy has been designed to identify all relevant studies for a suite of reviews on various interventions for chronic otitis media (Bhutta 2018; Brennan‐Jones 2018a; Brennan‐Jones 2018b; Chong 2018a; Chong 2018b; Head 2018a; Head 2018b), with additional top‐up searches for this review. Where appropriate, these will be combined with subject strategy adaptations of the highly sensitive search strategy designed by Cochrane for identifying randomised controlled trials and controlled clinical trials (as described in the Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0, Box 6.4.b. (Handbook 2011)).

Searching other resources

We will scan the reference lists of identified publications for additional trials and contact trial authors if necessary. In addition, the Information Specialist will search Ovid MEDLINE to retrieve existing systematic reviews relevant to this systematic review, so that we can scan their reference lists for additional trials. The Information Specialist will also run non‐systematic searches of Google Scholar to retrieve grey literature and other sources of potential trials.

Data collection and analysis

Selection of studies

At least two review authors (KH/LYC) will independently screen all titles and abstracts of the references obtained from the database searches to identify potentially relevant studies. At least two review authors (KH/LYC) will evaluate the full text of each potentially relevant study to determine whether it meets the inclusion and exclusion criteria for this review.

We will resolve any differences by discussion and consensus, with the involvement of a third author for clinical and methodological input where necessary.

Data extraction and management

At least two review authors (KH/LYC/CBJ/MB) will independently extract data from each study using a standardised data collection form (see Appendix 2). Whenever a study has more than one publication, we will retrieve all publications to ensure complete extraction of data. Where there are discrepancies in the data extracted by different review authors, we will check these against the original reports and resolve differences by discussion and consensus, with the involvement of a third author or a methodologist where appropriate. We will contact the original study authors for clarification or for missing data whenever possible. If differences are found between publications of a study, we will contact the original authors for clarification. We will use data from the main paper(s) if no further information is found.

We will include key characteristics of the included studies, such as study design, setting (including location), year of study, sample size, age and sex of participants, and how outcomes were defined or collected in the studies. In addition, we will also collect baseline information on prognostic factors or effect modifiers (see Appendix 2). For this review, this will include the following information whenever available:

  • duration of ear discharge at entry to the study;

  • diagnosis of ear discharge (where known);

  • number people who may be at higher risk of CSOM, including those with cleft palate or Down syndrome;

  • ethnicity of participants including the number who are from Indigenous populations;

  • number who have previously had ventilation tubes (grommets) inserted (and, where known, the number who have tubes still in place);

  • number who have had previous ear surgery;

  • number who have had previous treatments for CSOM (non‐responders, recurrent versus new cases).

We will record concurrent treatments alongside the details of the interventions used. See the 'Data extraction form' in Appendix 2 for more details.

For the outcomes of interest to the review, we will extract the findings of the studies on an available case analysis basis, i.e. we will include data from all patients available at the time points based on the treatment randomised whenever possible, irrespective of compliance or whether patients had received the treatment as planned.

In addition to extracting pre‐specified information about study characteristics and aspects of methodology relevant to risk of bias, we will extract the following summary statistics for each trial and each outcome:

  • For continuous data: the mean values, standard deviations and number of patients for each treatment group. Where endpoint data are not available, we will extract the values for change from baseline. We will analyse data from disease‐specific quality of life scales such as COMOT‐12, COMOT‐15 and CES as continuous data.

  • For binary data: the number of participants experiencing an event and the number of patients assessed at the time point.

  • For ordinal scale data: if the data appear to be approximately normally distributed or if the analysis that the investigators performed suggests parametric tests were appropriate, then we will treat the outcome measures as continuous data. Alternatively, if data are available, we plan to convert into binary data.

  • Time‐to‐event outcomes: we are not expecting any outcomes to be measured as time‐to‐event data. However, if outcomes such as resolution of ear discharge are measured in this way, we will report the hazard ratios.

For resolution of ear discharge, we will extract the longest available data within the time frame of interest, defined as from one week up to (and including) two weeks (7 days to 14 days), from two weeks up to (and including) four weeks (15 to 28 days), and after four weeks (28 days or one month).

For other outcomes, we will report the results from the longest available follow‐up period.

Extracting data for pain/discomfort and adverse effects

For these outcomes, there will be variations in how studies have reported the outcomes. For example, some studies will report both 'pain' and 'discomfort' separately whereas others will not. Prior to the commencement of data extraction, we will agree and specify a data extraction algorithm for how data should be extracted.

We will extract data for serious complications as a composite outcome. If a study reports more than one complication and we cannot distinguish whether these occurred in one or more patients, we will extract the data with the highest incidence. This prevents double counting.

Extracting data from figures

Where values for primary or secondary outcomes are shown as figures within the paper, we will contact the study authors to try to obtain the raw values. When the raw values are not provided, we will extract information from the graphs using an online data extraction tool, using the best quality version of the relevant figures available.

Assessment of risk of bias in included studies

At least two review authors (KH/LYC/CBJ/MB) will independently assess the risk of bias of each included study. We will follow the guidance in the Cochrane Handbook for Systematic Reviews of Interventions (Handbook 2011), using the Cochrane 'Risk of bias' tool. With this tool we will assess the risk of bias as 'low', 'high' or 'unclear' for each of the following six domains:

  • sequence generation;

  • allocation concealment;

  • blinding of participants, personnel and outcome assessment;

  • incomplete outcome data;

  • selective reporting;

  • other sources of bias.

Measures of treatment effect

We will summarise the effects of dichotomous outcomes (e.g. proportion of patients with complete resolution of ear discharge) as risk ratios (RR) with confidence intervals (CIs). For the key outcomes that we will present in the 'Summary of findings' table, we will also express the results as absolute numbers based on the pooled results and compared to the assumed risk. We also plan to calculate the number needed to treat to benefit (NNTB) using the pooled results. The assumed baseline risk will typically be either (a) the median of the risks of the control groups in the included studies, this being used to represent a 'medium‐risk population' or, alternatively, (b) the average risk of the control groups in the included studies, which is used as the 'study population' (Handbook 2011). If a large number of studies are available, and where appropriate, we also plan to present additional data based on the assumed baseline risk in (c) a low‐risk population and (d) a high‐risk population.

For continuous outcomes, we will express treatment effects as a mean difference (MD) with standard deviation (SD). If different scales are used to measure the same outcome we will use the standardised mean difference (SMD) and we will provide a clinical interpretation of the SMD values.

Unit of analysis issues

Cross‐over studies

This review will not use data from phase II of cross‐over studies.

The ear as the unit of randomisation: within‐patient randomisation in patients with bilateral ear disease

For data from studies where 'within‐patient' randomisation was used (i.e. studies where both ears (right versus left) were randomised) the analyses will adjust for the paired nature of the data (Elbourne 2002; Stedman 2011), as outlined in section 16.4 of the Cochrane Handbook for Systematic Reviews of Interventions (Handbook 2011).

The ear as the unit of randomisation: non‐paired randomisation in patients with bilateral ear disease

Some patients with bilateral disease may receive the same treatment in both ears, whereas others will receive a different treatment in each ear. We will not exclude these studies but we will only report the data if specific pairwise adjustments have been completed or if sufficient data can be obtained to be able to make adjustments.

The patient as the unit of randomisation

Some studies randomise by patient and those with bilateral CSOM will receive the same intervention for both ears. In some studies the results may be reported as a separate outcome for each ear (the total number of ears is used as the denominator in the analysis). The correlation of response between the left ear and right ear when given the same treatment is expected to be very high, and if both ears are counted in the analysis this is effectively a form of double counting, which may be especially problematic in smaller studies if the number of people with bilateral CSOM is unequal. We will not exclude these studies, but we will only report the results if the paper presents the data in such a way that we can include the data from each participant only once (one data point per participant) or if we have enough information to reliably estimate the effective sample size or inflated standard errors as presented in chapter 16.3 of the Cochrane Handbook for Systematic Reviews of Interventions (Handbook 2011). If this is not possible we will contact the authors for more information. If there is no response from the authors, then we will not include data from these studies in the analysis.

If we find cluster‐randomised trials by setting or operator, we will analyse these according to the methods in section 16.3 of the Cochrane Handbook for Systematic Reviews of Interventions (Handbook 2011).

Dealing with missing data

We will contact study authors via email whenever the outcome of interest is not reported, if the methods of the study suggest that the outcome had been measured. We will do the same if not all data required for meta‐analysis are reported, unless the missing data are standard deviations. If standard deviation data are not available, we will approximate these using the standard estimation methods from P values, standard errors or 95% CIs if these are reported, as detailed in the Cochrane Handbook for Systematic Reviews of Interventions (Handbook 2011). Where it is impossible to estimate these, we will contact the study authors.

Apart from imputations for missing standard deviations, we will not conduct any other imputations. We will extract and analyse data for all outcomes using the available case analysis method.

Assessment of heterogeneity

We will assess clinical heterogeneity (which may be present even in the absence of statistical heterogeneity) by examining the included studies for potential differences in the types of participants recruited, interventions or controls used, and the outcomes measured. We will not pool studies where the clinical heterogeneity makes it unreasonable to do so.

We will assess statistical heterogeneity by visually inspecting the forest plots and by considering the Chi² test (with a significance level set at P value < 0.10) and the I² statistic, which calculates the percentage of variability that is due to heterogeneity rather than chance, with I² values over 50% suggesting substantial heterogeneity (Handbook 2011).

Assessment of reporting biases

We will assess reporting bias as within‐study outcome reporting bias and between‐study publication bias.

Outcome reporting bias (within‐study reporting bias)

We will assess within‐study reporting bias by comparing the outcomes reported in the published report against the study protocol, whenever this can be obtained. If the protocol is not available, we will compare the outcomes reported to those listed in the methods section. If results are mentioned but not reported adequately in a way that allows analysis (e.g. the report only mentions whether the results were statistically significant or not), bias in a meta‐analysis is likely to occur. We will try to find further information from the study authors. If no further information can be obtained, we will note this as being a high risk of bias. Where there is insufficient information to judge the risk of bias, we will note this as an unclear risk of bias (Handbook 2011).

Publication bias (between‐study reporting bias)

We plan to create funnel plots if sufficient studies (more than 10) are available for an outcome. If we observe asymmetry of the funnel plot, we plan to conduct more formal investigation using the methods proposed by Egger 1997.

Data synthesis

We will conduct all meta‐analyses using Review Manager 5.3 (RevMan 2014). For dichotomous data, we plan to analyse treatment differences as a risk ratio (RR) calculated using the Mantel‐Haenszel methods. We plan to analyse time‐to‐event data using the generic inverse variance method.

For continuous outcomes, if all the data are from the same scale, we plan to pool mean values obtained at follow‐up with change outcomes and report this as a MD. However, if the SMD has to be used as an effect measure, we will not pool change and endpoint data.

When statistical heterogeneity is low, random‐effects versus fixed‐effect methods yield trivial differences in treatment effects. However, when statistical heterogeneity is high, the random‐effects method provides a more conservative estimate of the difference.

Subgroup analysis and investigation of heterogeneity

We will subgroup studies where most participants (80% or more) meet the criteria stated below in order to determine whether the effect of the intervention is different compared to other patients. Due to the risks of reporting and publication bias with unplanned subgroup analyses of trials, we will only analyse subgroups reported in studies if these were prespecified and stratified at randomisation.

We plan to conduct subgroup analyses regardless of whether statistical heterogeneity is observed for studies that included patients identified as high risk (i.e. thought to be less responsive to treatment and more likely to develop CSOM, recurrence or complications) and patients with ventilation tubes (grommets). 'High risk' patients include Indigenous populations (e.g. Australian Aboriginal and Torres Strait Islanders, Native Americans and Inuit populations of Alaska, Canada and Greenland), people with craniofacial malformation (e.g. cleft palate), Down syndrome and people with known immunodeficiency.

We plan to present the main analyses of this review in the form of forest plots based on this main subgroup analysis.

  • For the high‐risk group, this applies to the outcomes resolution of ear discharge (dry ear), quality of life, pain/discomfort, development of complications and hearing loss.

For patients with ventilation tubes, this applies to the outcome resolution of ear discharge (dry ear) for the time point of four weeks or more because this group is perceived to be at lower risk of treatment failure and recurrence than other patient groups. If statistical heterogeneity is observed, we will also conduct subgroup analysis for the effect modifiers below. If there are statistically significant subgroup effects, we will present these subgroup analysis results as forest plots.

For this review, effect modifiers include:

  • Diagnosis of CSOM: it is likely that some studies will include patients with chronic ear discharge but who have not had a diagnosis of CSOM. Therefore, we will subgroup studies where most patients (80% or more) meet the criteria for CSOM diagnosis in order to determine whether the effect of the intervention is different compared to patients where the precise diagnosis is unknown and inclusion into the study is based purely on chronic ear discharge symptoms.

  • Duration of ear discharge: there is uncertainty about whether the duration of ear discharge prior to treatment has an impact on the effectiveness of treatment and whether more established disease (i.e. discharge for more than six weeks) is more refractory to treatment compared with discharge of a shorter duration (i.e. less than six weeks).

  • Patient age: patients who are younger than two years old versus patients up to six years old versus adults. Patients under two years are widely considered to be more difficult to treat.

We will present the results as subgroups regardless of the presence of statistical heterogeneity based on the main types of aural toileting methods as follows:

  • dry mopping;

  • irrigation;

  • microsuction.

This is because the different methods of aural toileting are expected to have different treatment effects and possible adverse effects due to their intensity (e.g. microsuction is thought to be a more intense method than dry mopping).

Sensitivity analysis

We plan to carry out sensitivity analyses to determine whether the findings are robust to the decisions made in the course of identifying, screening and analysing the trials. We plan to conduct sensitivity analysis for the following factors, whenever possible:

  • Impact of model chosen: fixed‐effect versus random‐effects model.

  • Risk of bias of included studies: excluding studies with high risk of bias (we will define these as studies that have a high risk of allocation concealment bias and a high risk of attrition bias (overall loss to follow‐up of 20%, differential follow‐up observed)).

  • Where there is statistical heterogeneity, studies that only recruited patients who had previously not responded to one of the treatments under investigation in the RCT. Studies that specifically recruited patients who did not respond to a treatment could potentially have reduced the relative effectiveness of an agent.

If any of these investigations finds a difference in the size of the effect or heterogeneity, we will mention this in the 'Effects of interventions' section and/or present the findings in a table.

GRADE and 'Summary of findings' table

Using the GRADE approach, at least two review authors (KH/LYC) will independently rate the overall quality of evidence using the GDT tool (http://www.guidelinedevelopment.org/) for the main comparison pairs listed in the Types of interventions section. The quality of evidence reflects the extent to which we are confident that an estimate of effect is correct and we will apply this in the interpretation of results. There are four possible ratings: 'high', 'moderate', 'low' and 'very low' (Handbook 2011). A rating of 'high' quality evidence implies that we are confident in our estimate of effect and that further research is very unlikely to change our confidence in the estimate of effect. A rating of 'very low' quality implies that any estimate of effect obtained is very uncertain.

The GRADE approach rates evidence from RCTs that do not have serious limitations as high quality. However, several factors can lead to the downgrading of the evidence to moderate, low or very low. The degree of downgrading is determined by the seriousness of these factors:

  • study limitations (risk of bias);

  • inconsistency;

  • indirectness of evidence;

  • imprecision;

  • publication bias.

The 'Summary of findings' tables will present the following outcomes:

  • resolution of ear discharge or 'dry ear':

    • at between one week and up to two weeks;

    • after four weeks;

  • health‐related quality of life;

  • ear pain (otalgia) or discomfort or local irritation;

  • hearing;

  • serious complications;

  • adverse events: dizziness/vertigo/balance problems.

Table 1. Table of Cochrane Reviews

Topical antibiotics with steroids

Topical antibiotics

Systemic antibiotics

Topical antiseptics

Aural toileting (ear cleaning)

Topical antibiotics with steroids

Review CSOM‐4

Topical antibiotics

Review CSOM‐4

Review CSOM‐1

Systemic antibiotics

Review CSOM‐4

Review CSOM‐3

Review CSOM‐2

Topical antiseptics

Review CSOM‐4

Review CSOM‐6

Review CSOM‐6

Review CSOM‐5

Aural toileting

Review CSOM‐4

Not reviewed

Not reviewed

Not reviewed

Review CSOM‐7

Placebo (or no intervention)

Review CSOM‐4

Review CSOM‐1

Review CSOM‐2

Review CSOM‐5

Review CSOM‐7

CSOM‐1: Topical antibiotics for chronic suppurative otitis media (Brennan‐Jones 2018a).

CSOM‐2: Systemic antibiotics for chronic suppurative otitis media (Chong 2018a).

CSOM‐3: Topical versus systemic antibiotics for chronic suppurative otitis media (Chong 2018b).

CSOM‐4: Topical antibiotics with steroids for chronic suppurative otitis media (Brennan‐Jones 2018b).

CSOM‐5: Topical antiseptics for chronic suppurative otitis media (Head 2018a).

CSOM‐6: Antibiotics versus topical antiseptics for chronic suppurative otitis media (Head 2018b).

CSOM‐7: Aural toilet (ear cleaning) for chronic suppurative otitis media (Bhutta 2018).

Figures and Tables -
Table 1. Table of Cochrane Reviews