Le SIDA en Afrique subsaharienne (serveur d'exploration)

Attention, ce site est en cours de développement !
Attention, site généré par des moyens informatiques à partir de corpus bruts.
Les informations ne sont donc pas validées.

Implementation strategies for health systems in low-income countries: an overview of systematic reviews

Identifieur interne : 002E13 ( Pmc/Corpus ); précédent : 002E12; suivant : 002E14

Implementation strategies for health systems in low-income countries: an overview of systematic reviews

Auteurs : Tomas Pantoja ; Newton Opiyo ; Simon Lewin ; Elizabeth Paulsen ; Agustín Ciapponi ; Charles S. Wiysonge ; Cristian A. Herrera ; Gabriel Rada ; Blanca Pe Aloza ; Lilian Dudley ; Marie-Pierre Gagnon ; Sebastian Garcia Marti ; Andrew D. Oxman

Source :

RBID : PMC:5621088

Abstract

Background

A key function of health systems is implementing interventions to improve health, but coverage of essential health interventions remains low in low-income countries. Implementing interventions can be challenging, particularly if it entails complex changes in clinical routines; in collaborative patterns among different healthcare providers and disciplines; in the behaviour of providers, patients or other stakeholders; or in the organisation of care. Decision-makers may use a range of strategies to implement health interventions, and these choices should be based on evidence of the strategies' effectiveness.

Objectives

To provide an overview of the available evidence from up-to-date systematic reviews about the effects of implementation strategies for health systems in low-income countries. Secondary objectives include identifying needs and priorities for future evaluations and systematic reviews on alternative implementation strategies and informing refinements of the framework for implementation strategies presented in the overview.

Methods

We searched Health Systems Evidence in November 2010 and PDQ-Evidence up to December 2016 for systematic reviews. We did not apply any date, language or publication status limitations in the searches. We included well-conducted systematic reviews of studies that assessed the effects of implementation strategies on professional practice and patient outcomes and that were published after April 2005. We excluded reviews with limitations important enough to compromise the reliability of the review findings. Two overview authors independently screened reviews, extracted data and assessed the certainty of evidence using GRADE. We prepared SUPPORT Summaries for eligible reviews, including key messages, 'Summary of findings' tables (using GRADE to assess the certainty of the evidence) and assessments of the relevance of findings to low-income countries.

Main results

We identified 7272 systematic reviews and included 39 of them in this overview. An additional four reviews provided supplementary information. Of the 39 reviews, 32 had only minor limitations and 7 had important methodological limitations. Most studies in the reviews were from high-income countries. There were no studies from low-income countries in eight reviews.

Implementation strategies addressed in the reviews were grouped into four categories – strategies targeting:

1. healthcare organisations (e.g. strategies to change organisational culture; 1 review);

2. healthcare workers by type of intervention (e.g. printed educational materials; 14 reviews);

3. healthcare workers to address a specific problem (e.g. unnecessary antibiotic prescription; 9 reviews);

4. healthcare recipients (e.g. medication adherence; 15 reviews).

Overall, we found the following interventions to have desirable effects on at least one outcome with moderate- or high-certainty evidence and no moderate- or high-certainty evidence of undesirable effects.

1.Strategies targeted at healthcare workers: educational meetings, nutrition training of health workers, educational outreach, practice facilitation, local opinion leaders, audit and feedback, and tailored interventions.

2.Strategies targeted at healthcare workers for specific types of problems: training healthcare workers to be more patient-centred in clinical consultations, use of birth kits, strategies such as clinician education and patient education to reduce antibiotic prescribing in ambulatory care settings, and in-service neonatal emergency care training.

3. Strategies targeted at healthcare recipients: mass media interventions to increase uptake of HIV testing; intensive self-management and adherence, intensive disease management programmes to improve health literacy; behavioural interventions and mobile phone text messages for adherence to antiretroviral therapy; a one time incentive to start or continue tuberculosis prophylaxis; default reminders for patients being treated for active tuberculosis; use of sectioned polythene bags for adherence to malaria medication; community-based health education, and reminders and recall strategies to increase vaccination uptake; interventions to increase uptake of cervical screening (invitations, education, counselling, access to health promotion nurse and intensive recruitment); health insurance information and application support.

Authors' conclusions

Reliable systematic reviews have evaluated a wide range of strategies for implementing evidence-based interventions in low-income countries. Most of the available evidence is focused on strategies targeted at healthcare workers and healthcare recipients and relates to process-based outcomes. Evidence of the effects of strategies targeting healthcare organisations is scarce.

Implementation strategies for health systems in low-income countries

What is the aim of this overview?

The aim of this Cochrane Overview is to provide a broad summary of what is known about the effects of strategies for implementing interventions to improve health in low-income countries.

This overview is based on 39 relevant systematic reviews. Each of these reviews searched for studies that evaluated the different types of implementation strategies within the scope of the question addressed by the review. The reviews included a total of 1332 studies.

This overview is one of a series of four Cochrane Overviews that evaluate different health system arrangements.

What was studied in the overview?

A key function of health systems is implementing interventions to improve health. Coverage of essential health interventions remains low in low-income countries. Decision-makers may use a range of strategies to implement health interventions, and these choices should be based on evidence of the strategies' effectiveness.

What are the main results of the overview?

The following implementation strategies had desirable effects on at least one outcome with moderate- or high-certainty evidence and no moderate- or high-certainty evidence of undesirable effects.

Strategies targeted at healthcare workers

- Educational meetings.

- Nutrition training of health workers.

- Educational outreach (vs. no intervention).

- Practice facilitation.

- Local opinion leaders.

- Audit and feedback.

- Tailored interventions (vs. no intervention).

Strategies targeted at healthcare workers for specific types of problems

- Training healthcare workers to be more patient-centred in clinical consultations.

- Use of birth kits.

- Clinician education and patient education to reduce antibiotic prescribing in ambulatory care settings.

- In-service neonatal emergency care training.

Strategies targeted at healthcare recipients

- Mass media interventions to increase immediate uptake of HIV testing (leaflets and gain-framed videos).

- Intensive self-management and adherence, intensive disease management to improve health literacy.

- Behavioural interventions and mobile phone text messages for adherence to antiretroviral therapy.

- A one-time incentive to start or continue tuberculosis prophylaxis.

- Default reminders for patients being treated for active tuberculosis.

- Use of sectioned polythene bags for adherence to malaria medication.

- Community-based health education, and reminders and recall strategies for vaccination uptake.

- Providing free insecticide-treated bednets.

- Interventions to improve uptake of cervical screening (invitations, education, counselling, access to health promotion nurse, and intensive recruitment).

- Health insurance information and application support.

The following implementation strategies had low- or very low-certainty evidence (or no studies available) for all the outcomes that were considered.

Strategies targeted at healthcare organisations

- Strategies to improve organisational culture.

Strategies targeted at healthcare workers

- Printed educational materials.

- Internet-based learning.

- Interprofessional education.

- Teaching critical appraisal.

- Educational outreach (vs. another intervention).

- Pharmacist-provided services.

- Safety checklists for use by medical care teams in acute hospital settings.

- Tailored interventions (vs. non-tailored interventions, and interventions targeted at organisational and individual barriers vs. interventions targeted at individual barriers only).

- Interventions to encourage the use of systematic reviews in clinical decision-making.

Strategies targeted at healthcare workers for specific types of problems

- Interventions to improve handwashing.

- Interventions to reduce unnecessary caesarean section rates.

- Training of traditional birth attendants.

- Skilled birth attendance.

- Training of traditional healers about STD and HIV medicine.

Strategies targeted at healthcare recipients

- Providing information/education for promoting HIV testing (multimedia).

- Providing written medicine information.

- Single interventions to improve health literacy.

- Interventions to improve medication adherence.

- Adherence – TB (immediate versus deferred incentives; cash vs. non-cash incentive; different levels of cash incentives; incentives vs. other interventions).

- Adherence – malarial medication (blister packed tablets and capsules compared to tablets and capsules in paper envelopes; tablets in sectioned polythene bags compared to bottled syrup).

- Training of healthcare workers, home visits, and monetary incentives to improve immunisation coverage.

- Risk factor assessment to improve the uptake of cervical cancer screening.

How up to date is this overview?

The overview authors searched for systematic reviews that had been published up to 17 December 2016.


Url:
DOI: 10.1002/14651858.CD011086.pub2
PubMed: 28895659
PubMed Central: 5621088

Links to Exploration step

PMC:5621088

Le document en format XML

<record>
<TEI>
<teiHeader>
<fileDesc>
<titleStmt>
<title xml:lang="en">Implementation strategies for health systems in low-income countries: an overview of systematic reviews</title>
<author>
<name sortKey="Pantoja, Tomas" sort="Pantoja, Tomas" uniqKey="Pantoja T" first="Tomas" last="Pantoja">Tomas Pantoja</name>
<affiliation>
<nlm:aff id="au1">
<institution>Department of Family Medicine, Faculty of Medicine, Pontificia Universidad Católica de Chile</institution>
<addr-line>Santiago, Chile</addr-line>
</nlm:aff>
</affiliation>
<affiliation>
<nlm:aff id="au2">
<institution>Evidence Based Health Care Program, Pontificia Universidad Católica de Chile</institution>
<addr-line>Santiago, Chile</addr-line>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Opiyo, Newton" sort="Opiyo, Newton" uniqKey="Opiyo N" first="Newton" last="Opiyo">Newton Opiyo</name>
<affiliation>
<nlm:aff id="au3">
<institution>Cochrane Editorial Unit, Cochrane</institution>
<addr-line>London, UK</addr-line>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Lewin, Simon" sort="Lewin, Simon" uniqKey="Lewin S" first="Simon" last="Lewin">Simon Lewin</name>
<affiliation>
<nlm:aff id="au4">
<institution>Norwegian Institute of Public Health</institution>
<addr-line>Oslo, Norway</addr-line>
</nlm:aff>
</affiliation>
<affiliation>
<nlm:aff id="au5">
<institution>Health Systems Research Unit, South African Medical Research Council</institution>
<addr-line>Tygerberg, South Africa</addr-line>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Paulsen, Elizabeth" sort="Paulsen, Elizabeth" uniqKey="Paulsen E" first="Elizabeth" last="Paulsen">Elizabeth Paulsen</name>
<affiliation>
<nlm:aff id="au4">
<institution>Norwegian Institute of Public Health</institution>
<addr-line>Oslo, Norway</addr-line>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Ciapponi, Agustin" sort="Ciapponi, Agustin" uniqKey="Ciapponi A" first="Agustín" last="Ciapponi">Agustín Ciapponi</name>
<affiliation>
<nlm:aff id="au6">
<institution>Argentine Cochrane Centre, Institute for Clinical Effectiveness and Health Policy (IECS-CONICET)</institution>
<addr-line>Buenos Aires, Argentina</addr-line>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Wiysonge, Charles S" sort="Wiysonge, Charles S" uniqKey="Wiysonge C" first="Charles S" last="Wiysonge">Charles S. Wiysonge</name>
<affiliation>
<nlm:aff id="au7">
<institution>Cochrane South Africa, South African Medical Research Council</institution>
<addr-line>Cape Town, South Africa</addr-line>
</nlm:aff>
</affiliation>
<affiliation>
<nlm:aff id="au8">
<institution>Centre for Evidence-based Health Care, Faculty of Medicine and Health Sciences, Stellenbosch University</institution>
<addr-line>Cape Town, South Africa</addr-line>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Herrera, Cristian A" sort="Herrera, Cristian A" uniqKey="Herrera C" first="Cristian A" last="Herrera">Cristian A. Herrera</name>
<affiliation>
<nlm:aff id="au2">
<institution>Evidence Based Health Care Program, Pontificia Universidad Católica de Chile</institution>
<addr-line>Santiago, Chile</addr-line>
</nlm:aff>
</affiliation>
<affiliation>
<nlm:aff id="au9">
<institution>Department of Public Health, School of Medicine, Pontificia Universidad Católica de Chile</institution>
<addr-line>Santiago, Chile</addr-line>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Rada, Gabriel" sort="Rada, Gabriel" uniqKey="Rada G" first="Gabriel" last="Rada">Gabriel Rada</name>
<affiliation>
<nlm:aff id="au2">
<institution>Evidence Based Health Care Program, Pontificia Universidad Católica de Chile</institution>
<addr-line>Santiago, Chile</addr-line>
</nlm:aff>
</affiliation>
<affiliation>
<nlm:aff id="au10">
<institution>Department of Internal Medicine and Evidence-Based Healthcare Program, Faculty of Medicine, Pontificia Universidad Católica de Chile</institution>
<addr-line>Santiago, Chile</addr-line>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Pe Aloza, Blanca" sort="Pe Aloza, Blanca" uniqKey="Pe Aloza B" first="Blanca" last="Pe Aloza">Blanca Pe Aloza</name>
<affiliation>
<nlm:aff id="au1">
<institution>Department of Family Medicine, Faculty of Medicine, Pontificia Universidad Católica de Chile</institution>
<addr-line>Santiago, Chile</addr-line>
</nlm:aff>
</affiliation>
<affiliation>
<nlm:aff id="au2">
<institution>Evidence Based Health Care Program, Pontificia Universidad Católica de Chile</institution>
<addr-line>Santiago, Chile</addr-line>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Dudley, Lilian" sort="Dudley, Lilian" uniqKey="Dudley L" first="Lilian" last="Dudley">Lilian Dudley</name>
<affiliation>
<nlm:aff id="au11">
<institution>Division of Community Health, Faculty of Medicine and Health Sciences, Stellenbosch University</institution>
<addr-line>Cape Town, South Africa</addr-line>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Gagnon, Marie Pierre" sort="Gagnon, Marie Pierre" uniqKey="Gagnon M" first="Marie-Pierre" last="Gagnon">Marie-Pierre Gagnon</name>
<affiliation>
<nlm:aff id="au12">
<institution>Population Health and Optimal Health Practices Research Unit, CHU de Québec - Université Laval Research Centre</institution>
<addr-line>Québec City, Canada</addr-line>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Garcia Marti, Sebastian" sort="Garcia Marti, Sebastian" uniqKey="Garcia Marti S" first="Sebastian" last="Garcia Marti">Sebastian Garcia Marti</name>
<affiliation>
<nlm:aff id="au13">
<institution>Institute for Clinical Effectiveness and Health Policy</institution>
<addr-line>Buenos Aires, Argentina</addr-line>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Oxman, Andrew D" sort="Oxman, Andrew D" uniqKey="Oxman A" first="Andrew D" last="Oxman">Andrew D. Oxman</name>
<affiliation>
<nlm:aff id="au4">
<institution>Norwegian Institute of Public Health</institution>
<addr-line>Oslo, Norway</addr-line>
</nlm:aff>
</affiliation>
</author>
</titleStmt>
<publicationStmt>
<idno type="wicri:source">PMC</idno>
<idno type="pmid">28895659</idno>
<idno type="pmc">5621088</idno>
<idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC5621088</idno>
<idno type="RBID">PMC:5621088</idno>
<idno type="doi">10.1002/14651858.CD011086.pub2</idno>
<date when="2017">2017</date>
<idno type="wicri:Area/Pmc/Corpus">002E13</idno>
<idno type="wicri:explorRef" wicri:stream="Pmc" wicri:step="Corpus" wicri:corpus="PMC">002E13</idno>
</publicationStmt>
<sourceDesc>
<biblStruct>
<analytic>
<title xml:lang="en" level="a" type="main">Implementation strategies for health systems in low-income countries: an overview of systematic reviews</title>
<author>
<name sortKey="Pantoja, Tomas" sort="Pantoja, Tomas" uniqKey="Pantoja T" first="Tomas" last="Pantoja">Tomas Pantoja</name>
<affiliation>
<nlm:aff id="au1">
<institution>Department of Family Medicine, Faculty of Medicine, Pontificia Universidad Católica de Chile</institution>
<addr-line>Santiago, Chile</addr-line>
</nlm:aff>
</affiliation>
<affiliation>
<nlm:aff id="au2">
<institution>Evidence Based Health Care Program, Pontificia Universidad Católica de Chile</institution>
<addr-line>Santiago, Chile</addr-line>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Opiyo, Newton" sort="Opiyo, Newton" uniqKey="Opiyo N" first="Newton" last="Opiyo">Newton Opiyo</name>
<affiliation>
<nlm:aff id="au3">
<institution>Cochrane Editorial Unit, Cochrane</institution>
<addr-line>London, UK</addr-line>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Lewin, Simon" sort="Lewin, Simon" uniqKey="Lewin S" first="Simon" last="Lewin">Simon Lewin</name>
<affiliation>
<nlm:aff id="au4">
<institution>Norwegian Institute of Public Health</institution>
<addr-line>Oslo, Norway</addr-line>
</nlm:aff>
</affiliation>
<affiliation>
<nlm:aff id="au5">
<institution>Health Systems Research Unit, South African Medical Research Council</institution>
<addr-line>Tygerberg, South Africa</addr-line>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Paulsen, Elizabeth" sort="Paulsen, Elizabeth" uniqKey="Paulsen E" first="Elizabeth" last="Paulsen">Elizabeth Paulsen</name>
<affiliation>
<nlm:aff id="au4">
<institution>Norwegian Institute of Public Health</institution>
<addr-line>Oslo, Norway</addr-line>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Ciapponi, Agustin" sort="Ciapponi, Agustin" uniqKey="Ciapponi A" first="Agustín" last="Ciapponi">Agustín Ciapponi</name>
<affiliation>
<nlm:aff id="au6">
<institution>Argentine Cochrane Centre, Institute for Clinical Effectiveness and Health Policy (IECS-CONICET)</institution>
<addr-line>Buenos Aires, Argentina</addr-line>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Wiysonge, Charles S" sort="Wiysonge, Charles S" uniqKey="Wiysonge C" first="Charles S" last="Wiysonge">Charles S. Wiysonge</name>
<affiliation>
<nlm:aff id="au7">
<institution>Cochrane South Africa, South African Medical Research Council</institution>
<addr-line>Cape Town, South Africa</addr-line>
</nlm:aff>
</affiliation>
<affiliation>
<nlm:aff id="au8">
<institution>Centre for Evidence-based Health Care, Faculty of Medicine and Health Sciences, Stellenbosch University</institution>
<addr-line>Cape Town, South Africa</addr-line>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Herrera, Cristian A" sort="Herrera, Cristian A" uniqKey="Herrera C" first="Cristian A" last="Herrera">Cristian A. Herrera</name>
<affiliation>
<nlm:aff id="au2">
<institution>Evidence Based Health Care Program, Pontificia Universidad Católica de Chile</institution>
<addr-line>Santiago, Chile</addr-line>
</nlm:aff>
</affiliation>
<affiliation>
<nlm:aff id="au9">
<institution>Department of Public Health, School of Medicine, Pontificia Universidad Católica de Chile</institution>
<addr-line>Santiago, Chile</addr-line>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Rada, Gabriel" sort="Rada, Gabriel" uniqKey="Rada G" first="Gabriel" last="Rada">Gabriel Rada</name>
<affiliation>
<nlm:aff id="au2">
<institution>Evidence Based Health Care Program, Pontificia Universidad Católica de Chile</institution>
<addr-line>Santiago, Chile</addr-line>
</nlm:aff>
</affiliation>
<affiliation>
<nlm:aff id="au10">
<institution>Department of Internal Medicine and Evidence-Based Healthcare Program, Faculty of Medicine, Pontificia Universidad Católica de Chile</institution>
<addr-line>Santiago, Chile</addr-line>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Pe Aloza, Blanca" sort="Pe Aloza, Blanca" uniqKey="Pe Aloza B" first="Blanca" last="Pe Aloza">Blanca Pe Aloza</name>
<affiliation>
<nlm:aff id="au1">
<institution>Department of Family Medicine, Faculty of Medicine, Pontificia Universidad Católica de Chile</institution>
<addr-line>Santiago, Chile</addr-line>
</nlm:aff>
</affiliation>
<affiliation>
<nlm:aff id="au2">
<institution>Evidence Based Health Care Program, Pontificia Universidad Católica de Chile</institution>
<addr-line>Santiago, Chile</addr-line>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Dudley, Lilian" sort="Dudley, Lilian" uniqKey="Dudley L" first="Lilian" last="Dudley">Lilian Dudley</name>
<affiliation>
<nlm:aff id="au11">
<institution>Division of Community Health, Faculty of Medicine and Health Sciences, Stellenbosch University</institution>
<addr-line>Cape Town, South Africa</addr-line>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Gagnon, Marie Pierre" sort="Gagnon, Marie Pierre" uniqKey="Gagnon M" first="Marie-Pierre" last="Gagnon">Marie-Pierre Gagnon</name>
<affiliation>
<nlm:aff id="au12">
<institution>Population Health and Optimal Health Practices Research Unit, CHU de Québec - Université Laval Research Centre</institution>
<addr-line>Québec City, Canada</addr-line>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Garcia Marti, Sebastian" sort="Garcia Marti, Sebastian" uniqKey="Garcia Marti S" first="Sebastian" last="Garcia Marti">Sebastian Garcia Marti</name>
<affiliation>
<nlm:aff id="au13">
<institution>Institute for Clinical Effectiveness and Health Policy</institution>
<addr-line>Buenos Aires, Argentina</addr-line>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Oxman, Andrew D" sort="Oxman, Andrew D" uniqKey="Oxman A" first="Andrew D" last="Oxman">Andrew D. Oxman</name>
<affiliation>
<nlm:aff id="au4">
<institution>Norwegian Institute of Public Health</institution>
<addr-line>Oslo, Norway</addr-line>
</nlm:aff>
</affiliation>
</author>
</analytic>
<series>
<title level="j">The Cochrane Database of Systematic Reviews</title>
<idno type="eISSN">1469-493X</idno>
<imprint>
<date when="2017">2017</date>
</imprint>
</series>
</biblStruct>
</sourceDesc>
</fileDesc>
<profileDesc>
<textClass></textClass>
</profileDesc>
</teiHeader>
<front>
<div type="abstract" xml:lang="en">
<sec>
<title>Background</title>
<p>A key function of health systems is implementing interventions to improve health, but coverage of essential health interventions remains low in low-income countries. Implementing interventions can be challenging, particularly if it entails complex changes in clinical routines; in collaborative patterns among different healthcare providers and disciplines; in the behaviour of providers, patients or other stakeholders; or in the organisation of care. Decision-makers may use a range of strategies to implement health interventions, and these choices should be based on evidence of the strategies' effectiveness.</p>
</sec>
<sec>
<title>Objectives</title>
<p>To provide an overview of the available evidence from up-to-date systematic reviews about the effects of implementation strategies for health systems in low-income countries. Secondary objectives include identifying needs and priorities for future evaluations and systematic reviews on alternative implementation strategies and informing refinements of the framework for implementation strategies presented in the overview.</p>
</sec>
<sec>
<title>Methods</title>
<p>We searched Health Systems Evidence in November 2010 and PDQ-Evidence up to December 2016 for systematic reviews. We did not apply any date, language or publication status limitations in the searches. We included well-conducted systematic reviews of studies that assessed the effects of implementation strategies on professional practice and patient outcomes and that were published after April 2005. We excluded reviews with limitations important enough to compromise the reliability of the review findings. Two overview authors independently screened reviews, extracted data and assessed the certainty of evidence using GRADE. We prepared SUPPORT Summaries for eligible reviews, including key messages, 'Summary of findings' tables (using GRADE to assess the certainty of the evidence) and assessments of the relevance of findings to low-income countries.</p>
</sec>
<sec>
<title>Main results</title>
<p>We identified 7272 systematic reviews and included 39 of them in this overview. An additional four reviews provided supplementary information. Of the 39 reviews, 32 had only minor limitations and 7 had important methodological limitations. Most studies in the reviews were from high-income countries. There were no studies from low-income countries in eight reviews.</p>
<p>Implementation strategies addressed in the reviews were grouped into four categories – strategies targeting:</p>
<p>1. healthcare organisations (e.g. strategies to change organisational culture; 1 review);</p>
<p>2. healthcare workers by type of intervention (e.g. printed educational materials; 14 reviews);</p>
<p>3. healthcare workers to address a specific problem (e.g. unnecessary antibiotic prescription; 9 reviews);</p>
<p>4. healthcare recipients (e.g. medication adherence; 15 reviews).</p>
<p>Overall, we found the following interventions to have desirable effects on at least one outcome with moderate- or high-certainty evidence and no moderate- or high-certainty evidence of undesirable effects.</p>
<p>1.
<bold>Strategies targeted at healthcare workers</bold>
: educational meetings, nutrition training of health workers, educational outreach, practice facilitation, local opinion leaders, audit and feedback, and tailored interventions.</p>
<p>2.
<bold>Strategies targeted at healthcare workers for specific types of problems</bold>
: training healthcare workers to be more patient-centred in clinical consultations, use of birth kits, strategies such as clinician education and patient education to reduce antibiotic prescribing in ambulatory care settings, and in-service neonatal emergency care training.</p>
<p>3.
<bold>Strategies targeted at healthcare recipients</bold>
: mass media interventions to increase uptake of HIV testing; intensive self-management and adherence, intensive disease management programmes to improve health literacy; behavioural interventions and mobile phone text messages for adherence to antiretroviral therapy; a one time incentive to start or continue tuberculosis prophylaxis; default reminders for patients being treated for active tuberculosis; use of sectioned polythene bags for adherence to malaria medication; community-based health education, and reminders and recall strategies to increase vaccination uptake; interventions to increase uptake of cervical screening (invitations, education, counselling, access to health promotion nurse and intensive recruitment); health insurance information and application support.</p>
</sec>
<sec>
<title>Authors' conclusions</title>
<p>Reliable systematic reviews have evaluated a wide range of strategies for implementing evidence-based interventions in low-income countries. Most of the available evidence is focused on strategies targeted at healthcare workers and healthcare recipients and relates to process-based outcomes. Evidence of the effects of strategies targeting healthcare organisations is scarce.</p>
</sec>
<sec>
<title>Implementation strategies for health systems in low-income countries</title>
<p>
<bold>What is the aim of this overview?</bold>
</p>
<p>The aim of this Cochrane Overview is to provide a broad summary of what is known about the effects of strategies for implementing interventions to improve health in low-income countries.</p>
<p>This overview is based on 39 relevant systematic reviews. Each of these reviews searched for studies that evaluated the different types of implementation strategies within the scope of the question addressed by the review. The reviews included a total of 1332 studies.</p>
<p>This overview is one of a series of four Cochrane Overviews that evaluate different health system arrangements.</p>
<p>
<bold>What was studied in the overview?</bold>
</p>
<p>A key function of health systems is implementing interventions to improve health. Coverage of essential health interventions remains low in low-income countries. Decision-makers may use a range of strategies to implement health interventions, and these choices should be based on evidence of the strategies' effectiveness.</p>
<p>
<bold>What are the main results of the overview?</bold>
</p>
<p>The following implementation strategies had desirable effects on at least one outcome with moderate- or high-certainty evidence and no moderate- or high-certainty evidence of undesirable effects.</p>
<p>
<bold>Strategies targeted at healthcare workers</bold>
</p>
<p>- Educational meetings.</p>
<p>- Nutrition training of health workers.</p>
<p>- Educational outreach (vs. no intervention).</p>
<p>- Practice facilitation.</p>
<p>- Local opinion leaders.</p>
<p>- Audit and feedback.</p>
<p>- Tailored interventions (vs. no intervention).</p>
<p>
<bold>Strategies targeted at healthcare workers for specific types of problems</bold>
</p>
<p>- Training healthcare workers to be more patient-centred in clinical consultations.</p>
<p>- Use of birth kits.</p>
<p>- Clinician education and patient education to reduce antibiotic prescribing in ambulatory care settings.</p>
<p>- In-service neonatal emergency care training.</p>
<p>
<bold>Strategies targeted at healthcare recipients</bold>
</p>
<p>- Mass media interventions to increase immediate uptake of HIV testing (leaflets and gain-framed videos).</p>
<p>- Intensive self-management and adherence, intensive disease management to improve health literacy.</p>
<p>- Behavioural interventions and mobile phone text messages for adherence to antiretroviral therapy.</p>
<p>- A one-time incentive to start or continue tuberculosis prophylaxis.</p>
<p>- Default reminders for patients being treated for active tuberculosis.</p>
<p>- Use of sectioned polythene bags for adherence to malaria medication.</p>
<p>- Community-based health education, and reminders and recall strategies for vaccination uptake.</p>
<p>- Providing free insecticide-treated bednets.</p>
<p>- Interventions to improve uptake of cervical screening (invitations, education, counselling, access to health promotion nurse, and intensive recruitment).</p>
<p>- Health insurance information and application support.</p>
<p>The following implementation strategies had low- or very low-certainty evidence (or no studies available) for all the outcomes that were considered.</p>
<p>
<bold>Strategies targeted at healthcare organisations</bold>
</p>
<p>- Strategies to improve organisational culture.</p>
<p>
<bold>Strategies targeted at healthcare workers</bold>
</p>
<p>- Printed educational materials.</p>
<p>- Internet-based learning.</p>
<p>- Interprofessional education.</p>
<p>- Teaching critical appraisal.</p>
<p>- Educational outreach (vs. another intervention).</p>
<p>- Pharmacist-provided services.</p>
<p>- Safety checklists for use by medical care teams in acute hospital settings.</p>
<p>- Tailored interventions (vs. non-tailored interventions, and interventions targeted at organisational and individual barriers vs. interventions targeted at individual barriers only).</p>
<p>- Interventions to encourage the use of systematic reviews in clinical decision-making.</p>
<p>
<bold>Strategies targeted at healthcare workers for specific types of problems</bold>
</p>
<p>- Interventions to improve handwashing.</p>
<p>- Interventions to reduce unnecessary caesarean section rates.</p>
<p>- Training of traditional birth attendants.</p>
<p>- Skilled birth attendance.</p>
<p>- Training of traditional healers about STD and HIV medicine.</p>
<p>
<bold>Strategies targeted at healthcare recipients</bold>
</p>
<p>- Providing information/education for promoting HIV testing (multimedia).</p>
<p>- Providing written medicine information.</p>
<p>- Single interventions to improve health literacy.</p>
<p>- Interventions to improve medication adherence.</p>
<p>- Adherence – TB (immediate versus deferred incentives; cash vs. non-cash incentive; different levels of cash incentives; incentives vs. other interventions).</p>
<p>- Adherence – malarial medication (blister packed tablets and capsules compared to tablets and capsules in paper envelopes; tablets in sectioned polythene bags compared to bottled syrup).</p>
<p>- Training of healthcare workers, home visits, and monetary incentives to improve immunisation coverage.</p>
<p>- Risk factor assessment to improve the uptake of cervical cancer screening.</p>
<p>
<bold>How up to date is this overview?</bold>
</p>
<p>The overview authors searched for systematic reviews that had been published up to 17 December 2016.</p>
</sec>
</div>
</front>
<back>
<div1 type="bibliography">
<listBibl>
<biblStruct>
<analytic>
<author>
<name sortKey="Augustincic Polec, L" uniqKey="Augustincic Polec L">L Augustincic Polec</name>
</author>
<author>
<name sortKey="O Neill, J" uniqKey="O Neill J">J O'Neill</name>
</author>
<author>
<name sortKey="Welch, V" uniqKey="Welch V">V Welch</name>
</author>
<author>
<name sortKey="Ueffing, E" uniqKey="Ueffing E">E Ueffing</name>
</author>
<author>
<name sortKey="Tanjong Ghogomu, E" uniqKey="Tanjong Ghogomu E">E Tanjong Ghogomu</name>
</author>
<author>
<name sortKey="Pardo Pardo, J" uniqKey="Pardo Pardo J">J Pardo Pardo</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Baker, R" uniqKey="Baker R">R Baker</name>
</author>
<author>
<name sortKey="Camosso Stefinovic, J" uniqKey="Camosso Stefinovic J">J Camosso-Stefinovic</name>
</author>
<author>
<name sortKey="Gillies, C" uniqKey="Gillies C">C Gillies</name>
</author>
<author>
<name sortKey="Shaw, Ej" uniqKey="Shaw E">EJ Shaw</name>
</author>
<author>
<name sortKey="Cheater, F" uniqKey="Cheater F">F Cheater</name>
</author>
<author>
<name sortKey="Flottorp, S" uniqKey="Flottorp S">S Flottorp</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Baskerville, Nb" uniqKey="Baskerville N">NB Baskerville</name>
</author>
<author>
<name sortKey="Liddy, C" uniqKey="Liddy C">C Liddy</name>
</author>
<author>
<name sortKey="Hogg, W" uniqKey="Hogg W">W Hogg</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Berkman, Nd" uniqKey="Berkman N">ND Berkman</name>
</author>
<author>
<name sortKey="Sheridan, Sl" uniqKey="Sheridan S">SL Sheridan</name>
</author>
<author>
<name sortKey="Donahue, Ke" uniqKey="Donahue K">KE Donahue</name>
</author>
<author>
<name sortKey="Halpern, Dj" uniqKey="Halpern D">DJ Halpern</name>
</author>
<author>
<name sortKey="Viera, A" uniqKey="Viera A">A Viera</name>
</author>
<author>
<name sortKey="Crotty, K" uniqKey="Crotty K">K Crotty</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Cook, Da" uniqKey="Cook D">DA Cook</name>
</author>
<author>
<name sortKey="Levinson, Aj" uniqKey="Levinson A">AJ Levinson</name>
</author>
<author>
<name sortKey="Garside, S" uniqKey="Garside S">S Garside</name>
</author>
<author>
<name sortKey="Dupras, Dm" uniqKey="Dupras D">DM Dupras</name>
</author>
<author>
<name sortKey="Erwin, Pj" uniqKey="Erwin P">PJ Erwin</name>
</author>
<author>
<name sortKey="Montori, Vm" uniqKey="Montori V">VM Montori</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Jorgenson, S" uniqKey="Jorgenson S">S Jorgenson</name>
</author>
<author>
<name sortKey="Sadigh, G" uniqKey="Sadigh G">G Sadigh</name>
</author>
<author>
<name sortKey="Sikorskii, A" uniqKey="Sikorskii A">A Sikorskii</name>
</author>
<author>
<name sortKey="Lewin, S" uniqKey="Lewin S">S Lewin</name>
</author>
<author>
<name sortKey="Smith, Rc" uniqKey="Smith R">RC Smith</name>
</author>
<author>
<name sortKey="Coffey, J" uniqKey="Coffey J">J Coffey</name>
</author>
<author>
<name sortKey="Olomu, A" uniqKey="Olomu A">A Olomu</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Everett, T" uniqKey="Everett T">T Everett</name>
</author>
<author>
<name sortKey="Bryant, A" uniqKey="Bryant A">A Bryant</name>
</author>
<author>
<name sortKey="Griffin, Mf" uniqKey="Griffin M">MF Griffin</name>
</author>
<author>
<name sortKey="Martin Hirsch, Ppl" uniqKey="Martin Hirsch P">PPL Martin-Hirsch</name>
</author>
<author>
<name sortKey="Forbes, Ca" uniqKey="Forbes C">CA Forbes</name>
</author>
<author>
<name sortKey="Jepson, Rg" uniqKey="Jepson R">RG Jepson</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Flodgren, G" uniqKey="Flodgren G">G Flodgren</name>
</author>
<author>
<name sortKey="Parmelli, E" uniqKey="Parmelli E">E Parmelli</name>
</author>
<author>
<name sortKey="Doumit, G" uniqKey="Doumit G">G Doumit</name>
</author>
<author>
<name sortKey="Gattellari, M" uniqKey="Gattellari M">M Gattellari</name>
</author>
<author>
<name sortKey="O Brien, Ma" uniqKey="O Brien M">MA O'Brien</name>
</author>
<author>
<name sortKey="Grimshaw, J" uniqKey="Grimshaw J">J Grimshaw</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Forsetlund, L" uniqKey="Forsetlund L">L Forsetlund</name>
</author>
<author>
<name sortKey="Bj Rndal, A" uniqKey="Bj Rndal A">A Bjørndal</name>
</author>
<author>
<name sortKey="Rashidian, A" uniqKey="Rashidian A">A Rashidian</name>
</author>
<author>
<name sortKey="Jamtvedt, G" uniqKey="Jamtvedt G">G Jamtvedt</name>
</author>
<author>
<name sortKey="O Brien, Ma" uniqKey="O Brien M">MA O'Brien</name>
</author>
<author>
<name sortKey="Wolf, F" uniqKey="Wolf F">F Wolf</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Giguere, A" uniqKey="Giguere A">A Giguère</name>
</author>
<author>
<name sortKey="Legare, F" uniqKey="Legare F">F Légaré</name>
</author>
<author>
<name sortKey="Grimshaw, J" uniqKey="Grimshaw J">J Grimshaw</name>
</author>
<author>
<name sortKey="Turcotte, S" uniqKey="Turcotte S">S Turcotte</name>
</author>
<author>
<name sortKey="Fiander, M" uniqKey="Fiander M">M Fiander</name>
</author>
<author>
<name sortKey="Grudniewicz, A" uniqKey="Grudniewicz A">A Grudniewicz</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Gould, Dj" uniqKey="Gould D">DJ Gould</name>
</author>
<author>
<name sortKey="Moralejo, D" uniqKey="Moralejo D">D Moralejo</name>
</author>
<author>
<name sortKey="Drey, N" uniqKey="Drey N">N Drey</name>
</author>
<author>
<name sortKey="Chudleigh, Jh" uniqKey="Chudleigh J">JH Chudleigh</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Haynes, Rb" uniqKey="Haynes R">RB Haynes</name>
</author>
<author>
<name sortKey="Ackloo, E" uniqKey="Ackloo E">E Ackloo</name>
</author>
<author>
<name sortKey="Sahota, N" uniqKey="Sahota N">N Sahota</name>
</author>
<author>
<name sortKey="Mcdonald, Hp" uniqKey="Mcdonald H">HP McDonald</name>
</author>
<author>
<name sortKey="Yao, X" uniqKey="Yao X">X Yao</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Horsley, T" uniqKey="Horsley T">T Horsley</name>
</author>
<author>
<name sortKey="Hyde, C" uniqKey="Hyde C">C Hyde</name>
</author>
<author>
<name sortKey="Santesso, N" uniqKey="Santesso N">N Santesso</name>
</author>
<author>
<name sortKey="Parkes, J" uniqKey="Parkes J">J Parkes</name>
</author>
<author>
<name sortKey="Milne, R" uniqKey="Milne R">R Milne</name>
</author>
<author>
<name sortKey="Stewart, R" uniqKey="Stewart R">R Stewart</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Hundley, Va" uniqKey="Hundley V">VA Hundley</name>
</author>
<author>
<name sortKey="Avan, Bi" uniqKey="Avan B">BI Avan</name>
</author>
<author>
<name sortKey="Braunholtz, D" uniqKey="Braunholtz D">D Braunholtz</name>
</author>
<author>
<name sortKey="Graham, Wj" uniqKey="Graham W">WJ Graham</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Ivers, N" uniqKey="Ivers N">N Ivers</name>
</author>
<author>
<name sortKey="Jamtvedt, G" uniqKey="Jamtvedt G">G Jamtvedt</name>
</author>
<author>
<name sortKey="Flottorp, S" uniqKey="Flottorp S">S Flottorp</name>
</author>
<author>
<name sortKey="Young, Jm" uniqKey="Young J">JM Young</name>
</author>
<author>
<name sortKey="Odgaard Jensen, J" uniqKey="Odgaard Jensen J">J Odgaard-Jensen</name>
</author>
<author>
<name sortKey="French, Sd" uniqKey="French S">SD French</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Jacobson Vann, Jc" uniqKey="Jacobson Vann J">JC Jacobson Vann</name>
</author>
<author>
<name sortKey="Szilagyi, P" uniqKey="Szilagyi P">P Szilagyi</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Jia, L" uniqKey="Jia L">L Jia</name>
</author>
<author>
<name sortKey="Yuan, B" uniqKey="Yuan B">B Yuan</name>
</author>
<author>
<name sortKey="Lu, Y" uniqKey="Lu Y">Y Lu</name>
</author>
<author>
<name sortKey="Garner, P" uniqKey="Garner P">P Garner</name>
</author>
<author>
<name sortKey="Meng, Q" uniqKey="Meng Q">Q Meng</name>
</author>
<author>
<name sortKey="Huang, F" uniqKey="Huang F">F Huang</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Khunpradit, S" uniqKey="Khunpradit S">S Khunpradit</name>
</author>
<author>
<name sortKey="Tavender, E" uniqKey="Tavender E">E Tavender</name>
</author>
<author>
<name sortKey="Lumbiganon, P" uniqKey="Lumbiganon P">P Lumbiganon</name>
</author>
<author>
<name sortKey="Laopaiboon, M" uniqKey="Laopaiboon M">M Laopaiboon</name>
</author>
<author>
<name sortKey="Wasiak, J" uniqKey="Wasiak J">J Wasiak</name>
</author>
<author>
<name sortKey="Gruen, Rl" uniqKey="Gruen R">RL Gruen</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Ko, Hc" uniqKey="Ko H">HC Ko</name>
</author>
<author>
<name sortKey="Turner, Tj" uniqKey="Turner T">TJ Turner</name>
</author>
<author>
<name sortKey="Finnigan, Ma" uniqKey="Finnigan M">MA Finnigan</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Liu, Q" uniqKey="Liu Q">Q Liu</name>
</author>
<author>
<name sortKey="Abba, K" uniqKey="Abba K">K Abba</name>
</author>
<author>
<name sortKey="Alejandria, Mm" uniqKey="Alejandria M">MM Alejandria</name>
</author>
<author>
<name sortKey="Sinclair, D" uniqKey="Sinclair D">D Sinclair</name>
</author>
<author>
<name sortKey="Balanag, Vm" uniqKey="Balanag V">VM Balanag</name>
</author>
<author>
<name sortKey="Lansang, Mad" uniqKey="Lansang M">MAD Lansang</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Lutge, Ee" uniqKey="Lutge E">EE Lutge</name>
</author>
<author>
<name sortKey="Wiysonge, Cs" uniqKey="Wiysonge C">CS Wiysonge</name>
</author>
<author>
<name sortKey="Knight, Se" uniqKey="Knight S">SE Knight</name>
</author>
<author>
<name sortKey="Sinclair, D" uniqKey="Sinclair D">D Sinclair</name>
</author>
<author>
<name sortKey="Volmink, J" uniqKey="Volmink J">J Volmink</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Mbuagbaw, L" uniqKey="Mbuagbaw L">L Mbuagbaw</name>
</author>
<author>
<name sortKey="Van Derkop, Ml" uniqKey="Van Derkop M">ML van derKop</name>
</author>
<author>
<name sortKey="Lester, Rt" uniqKey="Lester R">RT Lester</name>
</author>
<author>
<name sortKey="Thirumurthy, H" uniqKey="Thirumurthy H">H Thirumurthy</name>
</author>
<author>
<name sortKey="Pop Eleches, C" uniqKey="Pop Eleches C">C Pop-Eleches</name>
</author>
<author>
<name sortKey="Ye, C" uniqKey="Ye C">C Ye</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Nicolson, Dj" uniqKey="Nicolson D">DJ Nicolson</name>
</author>
<author>
<name sortKey="Knapp, P" uniqKey="Knapp P">P Knapp</name>
</author>
<author>
<name sortKey="Raynor, Dk" uniqKey="Raynor D">DK Raynor</name>
</author>
<author>
<name sortKey="Spoor, P" uniqKey="Spoor P">P Spoor</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="O Brien, Ma" uniqKey="O Brien M">MA O'Brien</name>
</author>
<author>
<name sortKey="Rogers, S" uniqKey="Rogers S">S Rogers</name>
</author>
<author>
<name sortKey="Jamtvedt, G" uniqKey="Jamtvedt G">G Jamtvedt</name>
</author>
<author>
<name sortKey="Oxman, Ad" uniqKey="Oxman A">AD Oxman</name>
</author>
<author>
<name sortKey="Odgaard Jensen, J" uniqKey="Odgaard Jensen J">J Odgaard-Jensen</name>
</author>
<author>
<name sortKey="Kristoffersen, Dt" uniqKey="Kristoffersen D">DT Kristoffersen</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Opiyo, N" uniqKey="Opiyo N">N Opiyo</name>
</author>
<author>
<name sortKey="English, M" uniqKey="English M">M English</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Orton, Lc" uniqKey="Orton L">LC Orton</name>
</author>
<author>
<name sortKey="Barnish, G" uniqKey="Barnish G">G Barnish</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Oyo Ita, A" uniqKey="Oyo Ita A">A Oyo-Ita</name>
</author>
<author>
<name sortKey="Wiysonge, C" uniqKey="Wiysonge C">C Wiysonge</name>
</author>
<author>
<name sortKey="Oringanje, C" uniqKey="Oringanje C">C Oringanje</name>
</author>
<author>
<name sortKey="Nwachukwu, Ce" uniqKey="Nwachukwu C">CE Nwachukwu</name>
</author>
<author>
<name sortKey="Oduwole, O" uniqKey="Oduwole O">O Oduwole</name>
</author>
<author>
<name sortKey="Meremikwu, Mm" uniqKey="Meremikwu M">MM Meremikwu</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Pande, S" uniqKey="Pande S">S Pande</name>
</author>
<author>
<name sortKey="Hiller, Je" uniqKey="Hiller J">JE Hiller</name>
</author>
<author>
<name sortKey="Nkansah, N" uniqKey="Nkansah N">N Nkansah</name>
</author>
<author>
<name sortKey="Bero, L" uniqKey="Bero L">L Bero</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Parmelli, E" uniqKey="Parmelli E">E Parmelli</name>
</author>
<author>
<name sortKey="Flodgren, G" uniqKey="Flodgren G">G Flodgren</name>
</author>
<author>
<name sortKey="Schaafsma, Me" uniqKey="Schaafsma M">ME Schaafsma</name>
</author>
<author>
<name sortKey="Baillie, N" uniqKey="Baillie N">N Baillie</name>
</author>
<author>
<name sortKey="Beyer, Fr" uniqKey="Beyer F">FR Beyer</name>
</author>
<author>
<name sortKey="Eccles, Mp" uniqKey="Eccles M">MP Eccles</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Perrier, L" uniqKey="Perrier L">L Perrier</name>
</author>
<author>
<name sortKey="Mrklas, K" uniqKey="Mrklas K">K Mrklas</name>
</author>
<author>
<name sortKey="Shepperd, S" uniqKey="Shepperd S">S Shepperd</name>
</author>
<author>
<name sortKey="Dobbins, M" uniqKey="Dobbins M">M Dobbins</name>
</author>
<author>
<name sortKey="Mckibbon, Ka" uniqKey="Mckibbon K">KA McKibbon</name>
</author>
<author>
<name sortKey="Straus, Se" uniqKey="Straus S">SE Straus</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Ranji, Sr" uniqKey="Ranji S">SR Ranji</name>
</author>
<author>
<name sortKey="Steinman, M" uniqKey="Steinman M">M Steinman</name>
</author>
<author>
<name sortKey="Shojania, K" uniqKey="Shojania K">K Shojania</name>
</author>
<author>
<name sortKey="Gonzalez, R" uniqKey="Gonzalez R">R Gonzalez</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Reeves, S" uniqKey="Reeves S">S Reeves</name>
</author>
<author>
<name sortKey="Perrier, L" uniqKey="Perrier L">L Perrier</name>
</author>
<author>
<name sortKey="Goldman, J" uniqKey="Goldman J">J Goldman</name>
</author>
<author>
<name sortKey="Freeth, D" uniqKey="Freeth D">D Freeth</name>
</author>
<author>
<name sortKey="Zwarenstein, M" uniqKey="Zwarenstein M">M Zwarenstein</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Sibley, Lm" uniqKey="Sibley L">LM Sibley</name>
</author>
<author>
<name sortKey="Sipe, Ta" uniqKey="Sipe T">TA Sipe</name>
</author>
<author>
<name sortKey="Barry, D" uniqKey="Barry D">D Barry</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Simoni, Jm" uniqKey="Simoni J">JM Simoni</name>
</author>
<author>
<name sortKey="Pearson, Cr" uniqKey="Pearson C">CR Pearson</name>
</author>
<author>
<name sortKey="Pantalone, Dw" uniqKey="Pantalone D">DW Pantalone</name>
</author>
<author>
<name sortKey="Marks, G" uniqKey="Marks G">G Marks</name>
</author>
<author>
<name sortKey="Crepaz, N" uniqKey="Crepaz N">N Crepaz</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Simoni, Jm" uniqKey="Simoni J">JM Simoni</name>
</author>
<author>
<name sortKey="Amico, Kr" uniqKey="Amico K">KR Amico</name>
</author>
<author>
<name sortKey="Smith, L" uniqKey="Smith L">L Smith</name>
</author>
<author>
<name sortKey="Nelson, K" uniqKey="Nelson K">K Nelson</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Sorsdahl, K" uniqKey="Sorsdahl K">K Sorsdahl</name>
</author>
<author>
<name sortKey="Ipser, Jc" uniqKey="Ipser J">JC Ipser</name>
</author>
<author>
<name sortKey="Stein, Dj" uniqKey="Stein D">DJ Stein</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Sunguya, Bf" uniqKey="Sunguya B">BF Sunguya</name>
</author>
<author>
<name sortKey="Poudel, Kc" uniqKey="Poudel K">KC Poudel</name>
</author>
<author>
<name sortKey="Mlunde, Lb" uniqKey="Mlunde L">LB Mlunde</name>
</author>
<author>
<name sortKey="Shakya, P" uniqKey="Shakya P">P Shakya</name>
</author>
<author>
<name sortKey="Urassa, Dp" uniqKey="Urassa D">DP Urassa</name>
</author>
<author>
<name sortKey="Jimba, M" uniqKey="Jimba M">M Jimba</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Vidanapathirana, J" uniqKey="Vidanapathirana J">J Vidanapathirana</name>
</author>
<author>
<name sortKey="Abramson, Mj" uniqKey="Abramson M">MJ Abramson</name>
</author>
<author>
<name sortKey="Forbes, A" uniqKey="Forbes A">A Forbes</name>
</author>
<author>
<name sortKey="Fairley, C" uniqKey="Fairley C">C Fairley</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Yakoob, My" uniqKey="Yakoob M">MY Yakoob</name>
</author>
<author>
<name sortKey="Ali, Ma" uniqKey="Ali M">MA Ali</name>
</author>
<author>
<name sortKey="Ali, Mu" uniqKey="Ali M">MU Ali</name>
</author>
<author>
<name sortKey="Imdad, A" uniqKey="Imdad A">A Imdad</name>
</author>
<author>
<name sortKey="Lawn, Je" uniqKey="Lawn J">JE Lawn</name>
</author>
<author>
<name sortKey="Van Denbroek, N" uniqKey="Van Denbroek N">N Van DenBroek</name>
</author>
<author>
<name sortKey="Bhutta, Za" uniqKey="Bhutta Z">ZA Bhutta</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Arditi, C" uniqKey="Arditi C">C Arditi</name>
</author>
<author>
<name sortKey="Rege Walther, M" uniqKey="Rege Walther M">M Rège-Walther</name>
</author>
<author>
<name sortKey="Wyatt, Jc" uniqKey="Wyatt J">JC Wyatt</name>
</author>
<author>
<name sortKey="Durieux, P" uniqKey="Durieux P">P Durieux</name>
</author>
<author>
<name sortKey="Burnand, B" uniqKey="Burnand B">B Burnand</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Beilby, Jj" uniqKey="Beilby J">JJ Beilby</name>
</author>
<author>
<name sortKey="Silagy, Ca" uniqKey="Silagy C">CA Silagy</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Bordley, Wc" uniqKey="Bordley W">WC Bordley</name>
</author>
<author>
<name sortKey="Chelminski, A" uniqKey="Chelminski A">A Chelminski</name>
</author>
<author>
<name sortKey="Margolis, Pa" uniqKey="Margolis P">PA Margolis</name>
</author>
<author>
<name sortKey="Kraus, R" uniqKey="Kraus R">R Kraus</name>
</author>
<author>
<name sortKey="Szilagyi, Pg" uniqKey="Szilagyi P">PG Szilagyi</name>
</author>
<author>
<name sortKey="Vann, Jj" uniqKey="Vann J">JJ Vann</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Chaillet, N" uniqKey="Chaillet N">N Chaillet</name>
</author>
<author>
<name sortKey="Dube, E" uniqKey="Dube E">E Dubé</name>
</author>
<author>
<name sortKey="Dugas, M" uniqKey="Dugas M">M Dugas</name>
</author>
<author>
<name sortKey="Audibert, F" uniqKey="Audibert F">F Audibert</name>
</author>
<author>
<name sortKey="Tourigny, C" uniqKey="Tourigny C">C Tourigny</name>
</author>
<author>
<name sortKey="Fraser, Wd" uniqKey="Fraser W">WD Fraser</name>
</author>
<author>
<name sortKey="Dumont, A" uniqKey="Dumont A">A Dumont</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Fudickar, A" uniqKey="Fudickar A">A Fudickar</name>
</author>
<author>
<name sortKey="Horle, K" uniqKey="Horle K">K Hörle</name>
</author>
<author>
<name sortKey="Wiltfang, J" uniqKey="Wiltfang J">J Wiltfang</name>
</author>
<author>
<name sortKey="Bein, B" uniqKey="Bein B">B Bein</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Grilli, R" uniqKey="Grilli R">R Grilli</name>
</author>
<author>
<name sortKey="Ramsay, C" uniqKey="Ramsay C">C Ramsay</name>
</author>
<author>
<name sortKey="Minozzi, S" uniqKey="Minozzi S">S Minozzi</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Grimshaw, Jm" uniqKey="Grimshaw J">JM Grimshaw</name>
</author>
<author>
<name sortKey="Thomas, Re" uniqKey="Thomas R">RE Thomas</name>
</author>
<author>
<name sortKey="Maclennan, G" uniqKey="Maclennan G">G MacLennan</name>
</author>
<author>
<name sortKey="Fraser, C" uniqKey="Fraser C">C Fraser</name>
</author>
<author>
<name sortKey="Ramsay, Cr" uniqKey="Ramsay C">CR Ramsay</name>
</author>
<author>
<name sortKey="Vale, L" uniqKey="Vale L">L Vale</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Horvath, T" uniqKey="Horvath T">T Horvath</name>
</author>
<author>
<name sortKey="Azman, H" uniqKey="Azman H">H Azman</name>
</author>
<author>
<name sortKey="Kennedy, Ge" uniqKey="Kennedy G">GE Kennedy</name>
</author>
<author>
<name sortKey="Rutherford, Gw" uniqKey="Rutherford G">GW Rutherford</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Hulscher, Me" uniqKey="Hulscher M">ME Hulscher</name>
</author>
<author>
<name sortKey="Wensing, M" uniqKey="Wensing M">M Wensing</name>
</author>
<author>
<name sortKey="Van Derweijden, T" uniqKey="Van Derweijden T">T van DerWeijden</name>
</author>
<author>
<name sortKey="Grol, R" uniqKey="Grol R">R Grol</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Ioannidis, Jp" uniqKey="Ioannidis J">JP Ioannidis</name>
</author>
<author>
<name sortKey="Lau, J" uniqKey="Lau J">J Lau</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Jayaraman, S" uniqKey="Jayaraman S">S Jayaraman</name>
</author>
<author>
<name sortKey="Sethi, D" uniqKey="Sethi D">D Sethi</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Jayaraman, S" uniqKey="Jayaraman S">S Jayaraman</name>
</author>
<author>
<name sortKey="Sethi, D" uniqKey="Sethi D">D Sethi</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Kendrick, D" uniqKey="Kendrick D">D Kendrick</name>
</author>
<author>
<name sortKey="Hewitt, M" uniqKey="Hewitt M">M Hewitt</name>
</author>
<author>
<name sortKey="Dewey, M" uniqKey="Dewey M">M Dewey</name>
</author>
<author>
<name sortKey="Elkan, R" uniqKey="Elkan R">R Elkan</name>
</author>
<author>
<name sortKey="Blair, M" uniqKey="Blair M">M Blair</name>
</author>
<author>
<name sortKey="Robinson, J" uniqKey="Robinson J">J Robinson</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Lam Antoniades, M" uniqKey="Lam Antoniades M">M Lam-Antoniades</name>
</author>
<author>
<name sortKey="Ratnapalan, S" uniqKey="Ratnapalan S">S Ratnapalan</name>
</author>
<author>
<name sortKey="Tait, G" uniqKey="Tait G">G Tait</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Lee, Acc" uniqKey="Lee A">ACC Lee</name>
</author>
<author>
<name sortKey="Lawn, Je" uniqKey="Lawn J">JE Lawn</name>
</author>
<author>
<name sortKey="Cousens, S" uniqKey="Cousens S">S Cousens</name>
</author>
<author>
<name sortKey="Kumar, V" uniqKey="Kumar V">V Kumar</name>
</author>
<author>
<name sortKey="Osrin, D" uniqKey="Osrin D">D Osrin</name>
</author>
<author>
<name sortKey="Bhutta, Za" uniqKey="Bhutta Z">ZA Bhutta</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Legare, F" uniqKey="Legare F">F Legare</name>
</author>
<author>
<name sortKey="Ratte, S" uniqKey="Ratte S">S Ratte</name>
</author>
<author>
<name sortKey="Stacey, D" uniqKey="Stacey D">D Stacey</name>
</author>
<author>
<name sortKey="Kryworuchko, J" uniqKey="Kryworuchko J">J Kryworuchko</name>
</author>
<author>
<name sortKey="Gravel, K" uniqKey="Gravel K">K Gravel</name>
</author>
<author>
<name sortKey="Graham, Id" uniqKey="Graham I">ID Graham</name>
</author>
<author>
<name sortKey="Turcotte, S" uniqKey="Turcotte S">S Turcotte</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Minkman, M" uniqKey="Minkman M">M Minkman</name>
</author>
<author>
<name sortKey="Ahaus, K" uniqKey="Ahaus K">K Ahaus</name>
</author>
<author>
<name sortKey="Huijsman, R" uniqKey="Huijsman R">R Huijsman</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Naikoba, S" uniqKey="Naikoba S">S Naikoba</name>
</author>
<author>
<name sortKey="Hayward, A" uniqKey="Hayward A">A Hayward</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Nglazi, Md" uniqKey="Nglazi M">MD Nglazi</name>
</author>
<author>
<name sortKey="Bekker, Lg" uniqKey="Bekker L">LG Bekker</name>
</author>
<author>
<name sortKey="Wood, R" uniqKey="Wood R">R Wood</name>
</author>
<author>
<name sortKey="Hussey, Gd" uniqKey="Hussey G">GD Hussey</name>
</author>
<author>
<name sortKey="Wiysonge, Cs" uniqKey="Wiysonge C">CS Wiysonge</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Pattinson, Rc" uniqKey="Pattinson R">RC Pattinson</name>
</author>
<author>
<name sortKey="Say, L" uniqKey="Say L">L Say</name>
</author>
<author>
<name sortKey="Makin, Jd" uniqKey="Makin J">JD Makin</name>
</author>
<author>
<name sortKey="Bastos, Mh" uniqKey="Bastos M">MH Bastos</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Pearce, J" uniqKey="Pearce J">J Pearce</name>
</author>
<author>
<name sortKey="Mann, Mk" uniqKey="Mann M">MK Mann</name>
</author>
<author>
<name sortKey="Jones, C" uniqKey="Jones C">C Jones</name>
</author>
<author>
<name sortKey="Vanbuschbach, S" uniqKey="Vanbuschbach S">S vanBuschbach</name>
</author>
<author>
<name sortKey="Olff, M" uniqKey="Olff M">M Olff</name>
</author>
<author>
<name sortKey="Bisson, Ji" uniqKey="Bisson J">JI Bisson</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Rowe, Re" uniqKey="Rowe R">RE Rowe</name>
</author>
<author>
<name sortKey="Garcia, J" uniqKey="Garcia J">J Garcia</name>
</author>
<author>
<name sortKey="Macfarlane, Aj" uniqKey="Macfarlane A">AJ Macfarlane</name>
</author>
<author>
<name sortKey="Davidson, Ll" uniqKey="Davidson L">LL Davidson</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Rueda, S" uniqKey="Rueda S">S Rueda</name>
</author>
<author>
<name sortKey="Park Wyllie, Ly" uniqKey="Park Wyllie L">LY Park-Wyllie</name>
</author>
<author>
<name sortKey="Bayoumi, Am" uniqKey="Bayoumi A">AM Bayoumi</name>
</author>
<author>
<name sortKey="Tynan, Am" uniqKey="Tynan A">AM Tynan</name>
</author>
<author>
<name sortKey="Antoniou, Ta" uniqKey="Antoniou T">TA Antoniou</name>
</author>
<author>
<name sortKey="Rourke, Sb" uniqKey="Rourke S">SB Rourke</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Safdar, N" uniqKey="Safdar N">N Safdar</name>
</author>
<author>
<name sortKey="Abad, C" uniqKey="Abad C">C Abad</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Shea, B" uniqKey="Shea B">B Shea</name>
</author>
<author>
<name sortKey="Andersson, N" uniqKey="Andersson N">N Andersson</name>
</author>
<author>
<name sortKey="Henry, D" uniqKey="Henry D">D Henry</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Shojania, Kg" uniqKey="Shojania K">KG Shojania</name>
</author>
<author>
<name sortKey="Jennings, A" uniqKey="Jennings A">A Jennings</name>
</author>
<author>
<name sortKey="Mayhew, A" uniqKey="Mayhew A">A Mayhew</name>
</author>
<author>
<name sortKey="Ramsay, Cr" uniqKey="Ramsay C">CR Ramsay</name>
</author>
<author>
<name sortKey="Ecclesmp" uniqKey="Ecclesmp">EcclesMp</name>
</author>
<author>
<name sortKey="Grimshaw, J" uniqKey="Grimshaw J">J Grimshaw</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Smith, La" uniqKey="Smith L">LA Smith</name>
</author>
<author>
<name sortKey="Jones, C" uniqKey="Jones C">C Jones</name>
</author>
<author>
<name sortKey="Meek, S" uniqKey="Meek S">S Meek</name>
</author>
<author>
<name sortKey="Webster, J" uniqKey="Webster J">J Webster</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Smits, Pb" uniqKey="Smits P">PB Smits</name>
</author>
<author>
<name sortKey="Verbeek, Jh" uniqKey="Verbeek J">JH Verbeek</name>
</author>
<author>
<name sortKey="Debuisonje, Cd" uniqKey="Debuisonje C">CD deBuisonjé</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Sowden, Aj" uniqKey="Sowden A">AJ Sowden</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Turner, T" uniqKey="Turner T">T Turner</name>
</author>
<author>
<name sortKey="Harris, C" uniqKey="Harris C">C Harris</name>
</author>
<author>
<name sortKey="Molyneux, E" uniqKey="Molyneux E">E Molyneux</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Wafula, Fn" uniqKey="Wafula F">FN Wafula</name>
</author>
<author>
<name sortKey="Goodman, Ca" uniqKey="Goodman C">CA Goodman</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Zedler, Bk" uniqKey="Zedler B">BK Zedler</name>
</author>
<author>
<name sortKey="Kakad, P" uniqKey="Kakad P">P Kakad</name>
</author>
<author>
<name sortKey="Colilla, S" uniqKey="Colilla S">S Colilla</name>
</author>
<author>
<name sortKey="Murrelle, L" uniqKey="Murrelle L">L Murrelle</name>
</author>
<author>
<name sortKey="Shah, Nr" uniqKey="Shah N">NR Shah</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Abraham, C" uniqKey="Abraham C">C Abraham</name>
</author>
<author>
<name sortKey="Michie, S" uniqKey="Michie S">S Michie</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Althabe, F" uniqKey="Althabe F">F Althabe</name>
</author>
<author>
<name sortKey="Bergel, E" uniqKey="Bergel E">E Bergel</name>
</author>
<author>
<name sortKey="Cafferata, Ml" uniqKey="Cafferata M">ML Cafferata</name>
</author>
<author>
<name sortKey="Gibbons, L" uniqKey="Gibbons L">L Gibbons</name>
</author>
<author>
<name sortKey="Ciapponi, A" uniqKey="Ciapponi A">A Ciapponi</name>
</author>
<author>
<name sortKey="Aleman, A" uniqKey="Aleman A">A Alemán</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Arnold, Sr" uniqKey="Arnold S">SR Arnold</name>
</author>
<author>
<name sortKey="Straus, Se" uniqKey="Straus S">SE Straus</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Baldwin, K" uniqKey="Baldwin K">K Baldwin</name>
</author>
<author>
<name sortKey="Namdari, S" uniqKey="Namdari S">S Namdari</name>
</author>
<author>
<name sortKey="Donegan, D" uniqKey="Donegan D">D Donegan</name>
</author>
<author>
<name sortKey="Kamath, Af" uniqKey="Kamath A">AF Kamath</name>
</author>
<author>
<name sortKey="Mehta, S" uniqKey="Mehta S">S Mehta</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Bero, La" uniqKey="Bero L">LA Bero</name>
</author>
<author>
<name sortKey="Grilli, R" uniqKey="Grilli R">R Grilli</name>
</author>
<author>
<name sortKey="Grimshaw, Jm" uniqKey="Grimshaw J">JM Grimshaw</name>
</author>
<author>
<name sortKey="Harvey, E" uniqKey="Harvey E">E Harvey</name>
</author>
<author>
<name sortKey="Oxman, Ad" uniqKey="Oxman A">AD Oxman</name>
</author>
<author>
<name sortKey="Thomson, Ma" uniqKey="Thomson M">MA Thomson</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Bloom, Bs" uniqKey="Bloom B">BS Bloom</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Boaz, A" uniqKey="Boaz A">A Boaz</name>
</author>
<author>
<name sortKey="Baeza, J" uniqKey="Baeza J">J Baeza</name>
</author>
<author>
<name sortKey="Fraser, A" uniqKey="Fraser A">A Fraser</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Brennan, S" uniqKey="Brennan S">S Brennan</name>
</author>
<author>
<name sortKey="Mckenzie, J" uniqKey="Mckenzie J">J McKenzie</name>
</author>
<author>
<name sortKey="Whitty, P" uniqKey="Whitty P">P Whitty</name>
</author>
<author>
<name sortKey="Buchan, H" uniqKey="Buchan H">H Buchan</name>
</author>
<author>
<name sortKey="Green, S" uniqKey="Green S">S Green</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Chan, Wv" uniqKey="Chan W">WV Chan</name>
</author>
<author>
<name sortKey="Pearson, Ta" uniqKey="Pearson T">TA Pearson</name>
</author>
<author>
<name sortKey="Bennett, Gc" uniqKey="Bennett G">GC Bennett</name>
</author>
<author>
<name sortKey="Castillo, G" uniqKey="Castillo G">G Castillo</name>
</author>
<author>
<name sortKey="Cushman, Wc" uniqKey="Cushman W">WC Cushman</name>
</author>
<author>
<name sortKey="Gaziano, Ta" uniqKey="Gaziano T">TA Gaziano</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Cheung, A" uniqKey="Cheung A">A Cheung</name>
</author>
<author>
<name sortKey="Weir, M" uniqKey="Weir M">M Weir</name>
</author>
<author>
<name sortKey="Mayhew, A" uniqKey="Mayhew A">A Mayhew</name>
</author>
<author>
<name sortKey="Kozloff, N" uniqKey="Kozloff N">N Kozloff</name>
</author>
<author>
<name sortKey="Brown, K" uniqKey="Brown K">K Brown</name>
</author>
<author>
<name sortKey="Grimshaw, J" uniqKey="Grimshaw J">J Grimshaw</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Ciapponi, A" uniqKey="Ciapponi A">A Ciapponi</name>
</author>
<author>
<name sortKey="Lewin, S" uniqKey="Lewin S">S Lewin</name>
</author>
<author>
<name sortKey="Bastias, G" uniqKey="Bastias G">G Bastías</name>
</author>
<author>
<name sortKey="Dudley, L" uniqKey="Dudley L">L Dudley</name>
</author>
<author>
<name sortKey="Flottorp, S" uniqKey="Flottorp S">S Flottorp</name>
</author>
<author>
<name sortKey="Gagnon, Mp" uniqKey="Gagnon M">MP Gagnon</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Davey, P" uniqKey="Davey P">P Davey</name>
</author>
<author>
<name sortKey="Brown, E" uniqKey="Brown E">E Brown</name>
</author>
<author>
<name sortKey="Charani, E" uniqKey="Charani E">E Charani</name>
</author>
<author>
<name sortKey="Fenelon, L" uniqKey="Fenelon L">L Fenelon</name>
</author>
<author>
<name sortKey="Gould, Im" uniqKey="Gould I">IM Gould</name>
</author>
<author>
<name sortKey="Holmes, A" uniqKey="Holmes A">A Holmes</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Dolan, P" uniqKey="Dolan P">P Dolan</name>
</author>
<author>
<name sortKey="Hallsworth, M" uniqKey="Hallsworth M">M Hallsworth</name>
</author>
<author>
<name sortKey="Halpern, D" uniqKey="Halpern D">D Halpern</name>
</author>
<author>
<name sortKey="King, D" uniqKey="King D">D King</name>
</author>
<author>
<name sortKey=" Vlaev, I" uniqKey=" Vlaev I">I  Vlaev</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Dudley, L" uniqKey="Dudley L">L Dudley</name>
</author>
<author>
<name sortKey="Hviding, K" uniqKey="Hviding K">K Hviding</name>
</author>
<author>
<name sortKey="Paulsen, E" uniqKey="Paulsen E">E Paulsen</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Cochrane Effective, Practice" uniqKey="Cochrane Effective P">Practice Cochrane Effective</name>
</author>
<author>
<name sortKey="Organisation Of Care, Epoc" uniqKey="Organisation Of Care ">(EPOC) Organisation of Care</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Flottorp, Sa" uniqKey="Flottorp S">SA Flottorp</name>
</author>
<author>
<name sortKey="Oxman, Ad" uniqKey="Oxman A">AD Oxman</name>
</author>
<author>
<name sortKey="Krause, J" uniqKey="Krause J">J Krause</name>
</author>
<author>
<name sortKey="Musila, Nr" uniqKey="Musila N">NR Musila</name>
</author>
<author>
<name sortKey="Wensing, M" uniqKey="Wensing M">M Wensing</name>
</author>
<author>
<name sortKey="Godycki Cwirko, M" uniqKey="Godycki Cwirko M">M Godycki-Cwirko</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="French, Sd" uniqKey="French S">SD French</name>
</author>
<author>
<name sortKey="Green, Se" uniqKey="Green S">SE Green</name>
</author>
<author>
<name sortKey="O Connor, Da" uniqKey="O Connor D">DA O'Connor</name>
</author>
<author>
<name sortKey="Mckenzie, Je" uniqKey="Mckenzie J">JE McKenzie</name>
</author>
<author>
<name sortKey="Francis, Jj" uniqKey="Francis J">JJ Francis</name>
</author>
<author>
<name sortKey="Michie, S" uniqKey="Michie S">S Michie</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Fretheim, A" uniqKey="Fretheim A">A Fretheim</name>
</author>
<author>
<name sortKey="Oxman, Ad" uniqKey="Oxman A">AD Oxman</name>
</author>
<author>
<name sortKey="Lavis, Jn" uniqKey="Lavis J">JN Lavis</name>
</author>
<author>
<name sortKey="Lewin, S" uniqKey="Lewin S">S Lewin</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="F Nhus, Ms" uniqKey="F Nhus M">MS Fønhus</name>
</author>
<author>
<name sortKey="Dalsb, Tk" uniqKey="Dalsb T">TK Dalsbø</name>
</author>
<author>
<name sortKey="Johansen, M" uniqKey="Johansen M">M Johansen</name>
</author>
<author>
<name sortKey="Fretheim, A" uniqKey="Fretheim A">A Fretheim</name>
</author>
<author>
<name sortKey="Skirbekk, H" uniqKey="Skirbekk H">H Skirbekk</name>
</author>
<author>
<name sortKey="Flottorp, S" uniqKey="Flottorp S">S Flottorp</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Graham, W" uniqKey="Graham W">W Graham</name>
</author>
<author>
<name sortKey="Davidson, L" uniqKey="Davidson L">L Davidson</name>
</author>
<author>
<name sortKey="Campbell, S" uniqKey="Campbell S">S Campbell</name>
</author>
<author>
<name sortKey="Clar, C" uniqKey="Clar C">C Clar</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Grimshaw, Jm" uniqKey="Grimshaw J">JM Grimshaw</name>
</author>
<author>
<name sortKey="Shirran, L" uniqKey="Shirran L">L Shirran</name>
</author>
<author>
<name sortKey="Thomas, R" uniqKey="Thomas R">R Thomas</name>
</author>
<author>
<name sortKey="Mowatt, G" uniqKey="Mowatt G">G Mowatt</name>
</author>
<author>
<name sortKey="Fraser, C" uniqKey="Fraser C">C Fraser</name>
</author>
<author>
<name sortKey="Bero, L" uniqKey="Bero L">L Bero</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Grol, R" uniqKey="Grol R">R Grol</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Grol, R" uniqKey="Grol R">R Grol</name>
</author>
<author>
<name sortKey="Grimshaw, Jm" uniqKey="Grimshaw J">JM Grimshaw</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Grol, R" uniqKey="Grol R">R Grol</name>
</author>
<author>
<name sortKey="Wensing, M" uniqKey="Wensing M">M Wensing</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Grol, Rp" uniqKey="Grol R">RP Grol</name>
</author>
<author>
<name sortKey="Bosch, Mc" uniqKey="Bosch M">MC Bosch</name>
</author>
<author>
<name sortKey="Hulscher, Me" uniqKey="Hulscher M">ME Hulscher</name>
</author>
<author>
<name sortKey="Eccles, Mp" uniqKey="Eccles M">MP Eccles</name>
</author>
<author>
<name sortKey="Wensing, M" uniqKey="Wensing M">M Wensing</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Guyatt, Gh" uniqKey="Guyatt G">GH Guyatt</name>
</author>
<author>
<name sortKey="Oxman, Ad" uniqKey="Oxman A">AD Oxman</name>
</author>
<author>
<name sortKey="Kunz, R" uniqKey="Kunz R">R Kunz</name>
</author>
<author>
<name sortKey="Vist, Ge" uniqKey="Vist G">GE Vist</name>
</author>
<author>
<name sortKey="Falck Ytter, Y" uniqKey="Falck Ytter Y">Y Falck-Ytter</name>
</author>
<author>
<name sortKey="Schunemann, Hj" uniqKey="Schunemann H">HJ Schunemann</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Hall, Ak" uniqKey="Hall A">AK Hall</name>
</author>
<author>
<name sortKey="Cole Lewis, H" uniqKey="Cole Lewis H">H Cole-Lewis</name>
</author>
<author>
<name sortKey="Bernhardt, Jm" uniqKey="Bernhardt J">JM Bernhardt</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Herrera, Ca" uniqKey="Herrera C">CA Herrera</name>
</author>
<author>
<name sortKey="Ciapponi, A" uniqKey="Ciapponi A">A Ciapponi</name>
</author>
<author>
<name sortKey="Bastias, G" uniqKey="Bastias G">G Bastías</name>
</author>
<author>
<name sortKey="Lewin, S" uniqKey="Lewin S">S Lewin</name>
</author>
<author>
<name sortKey="Garcia Marti, S" uniqKey="Garcia Marti S">S Garcia Marti</name>
</author>
<author>
<name sortKey="Okwundu, Ci" uniqKey="Okwundu C">CI Okwundu</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Krause, J" uniqKey="Krause J">J Krause</name>
</author>
<author>
<name sortKey="Vanlieshout, J" uniqKey="Vanlieshout J">J VanLieshout</name>
</author>
<author>
<name sortKey="Klomp, R" uniqKey="Klomp R">R Klomp</name>
</author>
<author>
<name sortKey="Huntink, E" uniqKey="Huntink E">E Huntink</name>
</author>
<author>
<name sortKey="Aakhus, E" uniqKey="Aakhus E">E Aakhus</name>
</author>
<author>
<name sortKey="Flottorp, S" uniqKey="Flottorp S">S Flottorp</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Lavis, Jn" uniqKey="Lavis J">JN Lavis</name>
</author>
<author>
<name sortKey="Oxman, Ad" uniqKey="Oxman A">AD Oxman</name>
</author>
<author>
<name sortKey="Souza, Nm" uniqKey="Souza N">NM Souza</name>
</author>
<author>
<name sortKey="Lewin, S" uniqKey="Lewin S">S Lewin</name>
</author>
<author>
<name sortKey="Gruen, Rl" uniqKey="Gruen R">RL Gruen</name>
</author>
<author>
<name sortKey="Fretheim, A" uniqKey="Fretheim A">A Fretheim</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Lavis, Jn" uniqKey="Lavis J">JN Lavis</name>
</author>
<author>
<name sortKey="Wilson, Mg" uniqKey="Wilson M">MG Wilson</name>
</author>
<author>
<name sortKey="Moat, Ka" uniqKey="Moat K">KA Moat</name>
</author>
<author>
<name sortKey="Hammill, Ac" uniqKey="Hammill A">AC Hammill</name>
</author>
<author>
<name sortKey="Boyko, Ja" uniqKey="Boyko J">JA Boyko</name>
</author>
<author>
<name sortKey="Grimshaw, Jm" uniqKey="Grimshaw J">JM Grimshaw</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Lewin, S" uniqKey="Lewin S">S Lewin</name>
</author>
<author>
<name sortKey="Lavis, Jn" uniqKey="Lavis J">JN Lavis</name>
</author>
<author>
<name sortKey="Oxman, Ad" uniqKey="Oxman A">AD Oxman</name>
</author>
<author>
<name sortKey="Bastias, G" uniqKey="Bastias G">G Bastías</name>
</author>
<author>
<name sortKey="Chopra, M" uniqKey="Chopra M">M Chopra</name>
</author>
<author>
<name sortKey="Ciapponi, A" uniqKey="Ciapponi A">A Ciapponi</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Mahtani, Kr" uniqKey="Mahtani K">KR Mahtani</name>
</author>
<author>
<name sortKey="Heneghan, Cj" uniqKey="Heneghan C">CJ Heneghan</name>
</author>
<author>
<name sortKey="Glasziou, Pp" uniqKey="Glasziou P">PP Glasziou</name>
</author>
<author>
<name sortKey="Perera, R" uniqKey="Perera R">R Perera</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Mauger Rothenberg, B" uniqKey="Mauger Rothenberg B">B Mauger Rothenberg</name>
</author>
<author>
<name sortKey="Marbella, A" uniqKey="Marbella A">A Marbella</name>
</author>
<author>
<name sortKey="Pines, E" uniqKey="Pines E">E Pines</name>
</author>
<author>
<name sortKey="Chopra, R" uniqKey="Chopra R">R Chopra</name>
</author>
<author>
<name sortKey="Black, Er" uniqKey="Black E">ER Black</name>
</author>
<author>
<name sortKey="Aronson, N" uniqKey="Aronson N">N Aronson</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Mcglynn, Ea" uniqKey="Mcglynn E">EA McGlynn</name>
</author>
<author>
<name sortKey="Asch, Sm" uniqKey="Asch S">SM Asch</name>
</author>
<author>
<name sortKey="Adams, J" uniqKey="Adams J">J Adams</name>
</author>
<author>
<name sortKey="Keesey, J" uniqKey="Keesey J">J Keesey</name>
</author>
<author>
<name sortKey="Hicks, J" uniqKey="Hicks J">J Hicks</name>
</author>
<author>
<name sortKey="Decristofaro, A" uniqKey="Decristofaro A">A DeCristofaro</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Michie, S" uniqKey="Michie S">S Michie</name>
</author>
<author>
<name sortKey="Johnston, M" uniqKey="Johnston M">M Johnston</name>
</author>
<author>
<name sortKey="Abraham, C" uniqKey="Abraham C">C Abraham</name>
</author>
<author>
<name sortKey="Lawton, R" uniqKey="Lawton R">R Lawton</name>
</author>
<author>
<name sortKey="Parker, D" uniqKey="Parker D">D Parker</name>
</author>
<author>
<name sortKey="Walker, A" uniqKey="Walker A">A Walker</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Michie, S" uniqKey="Michie S">S Michie</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Michie, S" uniqKey="Michie S">S Michie</name>
</author>
<author>
<name sortKey="Vanstralen, Mm" uniqKey="Vanstralen M">MM vanStralen</name>
</author>
<author>
<name sortKey="West, R" uniqKey="West R">R West</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Mostofian, F" uniqKey="Mostofian F">F Mostofian</name>
</author>
<author>
<name sortKey="Ruban, C" uniqKey="Ruban C">C Ruban</name>
</author>
<author>
<name sortKey="Simunovic, N" uniqKey="Simunovic N">N Simunovic</name>
</author>
<author>
<name sortKey="Bhandari, M" uniqKey="Bhandari M">M Bhandari</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Mundell, Wc" uniqKey="Mundell W">WC Mundell</name>
</author>
<author>
<name sortKey="Kennedy, Cs" uniqKey="Kennedy C">CS Kennedy</name>
</author>
<author>
<name sortKey="Szostek, Jh" uniqKey="Szostek J">JH Szostek</name>
</author>
<author>
<name sortKey="Cook, Da" uniqKey="Cook D">DA Cook</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Murthy, L" uniqKey="Murthy L">L Murthy</name>
</author>
<author>
<name sortKey="Shepperd, S" uniqKey="Shepperd S">S Shepperd</name>
</author>
<author>
<name sortKey="Clarke, Mj" uniqKey="Clarke M">MJ Clarke</name>
</author>
<author>
<name sortKey="Garner, Se" uniqKey="Garner S">SE Garner</name>
</author>
<author>
<name sortKey="Lavis, Jn" uniqKey="Lavis J">JN Lavis</name>
</author>
<author>
<name sortKey="Perrier, L" uniqKey="Perrier L">L Perrier</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Nieuwlaat, R" uniqKey="Nieuwlaat R">R Nieuwlaat</name>
</author>
<author>
<name sortKey="Wilczynski, N" uniqKey="Wilczynski N">N Wilczynski</name>
</author>
<author>
<name sortKey="Navarro, T" uniqKey="Navarro T">T Navarro</name>
</author>
<author>
<name sortKey="Hobson, N" uniqKey="Hobson N">N Hobson</name>
</author>
<author>
<name sortKey="Jeffery, R" uniqKey="Jeffery R">R Jeffery</name>
</author>
<author>
<name sortKey="Keepanasseril, A" uniqKey="Keepanasseril A">A Keepanasseril</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Oluoch, T" uniqKey="Oluoch T">T Oluoch</name>
</author>
<author>
<name sortKey="Santas, X" uniqKey="Santas X">X Santas</name>
</author>
<author>
<name sortKey="Kwaro, D" uniqKey="Kwaro D">D Kwaro</name>
</author>
<author>
<name sortKey="Were, M" uniqKey="Were M">M Were</name>
</author>
<author>
<name sortKey="Biondich, P" uniqKey="Biondich P">P Biondich</name>
</author>
<author>
<name sortKey="Bailey, C" uniqKey="Bailey C">C Bailey</name>
</author>
<author>
<name sortKey="Abu Hanna, A" uniqKey="Abu Hanna A">A Abu-Hanna</name>
</author>
<author>
<name sortKey="Dekeizer, N" uniqKey="Dekeizer N">N deKeizer</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Oxman, Ad" uniqKey="Oxman A">AD Oxman</name>
</author>
<author>
<name sortKey="Lavis, Jn" uniqKey="Lavis J">JN Lavis</name>
</author>
<author>
<name sortKey="Lewin, S" uniqKey="Lewin S">S Lewin</name>
</author>
<author>
<name sortKey="Fretheim, A" uniqKey="Fretheim A">A Fretheim</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Oxman, Ad" uniqKey="Oxman A">AD Oxman</name>
</author>
<author>
<name sortKey="Fretheim, A" uniqKey="Fretheim A">A Fretheim</name>
</author>
<author>
<name sortKey="Lavis, Jn" uniqKey="Lavis J">JN Lavis</name>
</author>
<author>
<name sortKey="Lewin, S" uniqKey="Lewin S">S Lewin</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Pantoja, T" uniqKey="Pantoja T">T Pantoja</name>
</author>
<author>
<name sortKey="Green, Me" uniqKey="Green M">ME Green</name>
</author>
<author>
<name sortKey="Grimshaw, J" uniqKey="Grimshaw J">J Grimshaw</name>
</author>
<author>
<name sortKey="Denig, P" uniqKey="Denig P">P Denig</name>
</author>
<author>
<name sortKey="Durieux, P" uniqKey="Durieux P">P Durieux</name>
</author>
<author>
<name sortKey="Gill, P" uniqKey="Gill P">P Gill</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Petry, Nm" uniqKey="Petry N">NM Petry</name>
</author>
<author>
<name sortKey="Rash, Cj" uniqKey="Rash C">CJ Rash</name>
</author>
<author>
<name sortKey="Byrne, S" uniqKey="Byrne S">S Byrne</name>
</author>
<author>
<name sortKey="Ashraf, S" uniqKey="Ashraf S">S Ashraf</name>
</author>
<author>
<name sortKey="White, Wb" uniqKey="White W">WB White</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Rada, G" uniqKey="Rada G">G Rada</name>
</author>
<author>
<name sortKey="Perez, D" uniqKey="Perez D">D Pérez</name>
</author>
<author>
<name sortKey="Capurro, D" uniqKey="Capurro D">D Capurro</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Rolfe, A" uniqKey="Rolfe A">A Rolfe</name>
</author>
<author>
<name sortKey="Cash Gibson, L" uniqKey="Cash Gibson L">L Cash-Gibson</name>
</author>
<author>
<name sortKey="Car, J" uniqKey="Car J">J Car</name>
</author>
<author>
<name sortKey="Sheikh, A" uniqKey="Sheikh A">A Sheikh</name>
</author>
<author>
<name sortKey="Mckinstry, B" uniqKey="Mckinstry B">B McKinstry</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Rosen, Ma" uniqKey="Rosen M">MA Rosen</name>
</author>
<author>
<name sortKey="Hunt, Ea" uniqKey="Hunt E">EA Hunt</name>
</author>
<author>
<name sortKey="Pronovost, Pj" uniqKey="Pronovost P">PJ Pronovost</name>
</author>
<author>
<name sortKey="Federowicz, Ma" uniqKey="Federowicz M">MA Federowicz</name>
</author>
<author>
<name sortKey="Weaver, Sj" uniqKey="Weaver S">SJ Weaver</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Rosenbaum, Se" uniqKey="Rosenbaum S">SE Rosenbaum</name>
</author>
<author>
<name sortKey="Glenton, C" uniqKey="Glenton C">C Glenton</name>
</author>
<author>
<name sortKey="Wiysonge, Cs" uniqKey="Wiysonge C">CS Wiysonge</name>
</author>
<author>
<name sortKey="Abalos, E" uniqKey="Abalos E">E Abalos</name>
</author>
<author>
<name sortKey="Mignini, L" uniqKey="Mignini L">L Mignini</name>
</author>
<author>
<name sortKey="Young, T" uniqKey="Young T">T Young</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Rowe, Ak" uniqKey="Rowe A">AK Rowe</name>
</author>
<author>
<name sortKey="Sy, Rowe" uniqKey="Sy R">Rowe Sy</name>
</author>
<author>
<name sortKey="Peters, Ka" uniqKey="Peters K">KA Peters</name>
</author>
<author>
<name sortKey="Holloway, Jc" uniqKey="Holloway J">JC Holloway</name>
</author>
<author>
<name sortKey="Ross Degnan, D" uniqKey="Ross Degnan D">D Ross-Degnan</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Ryman, Tk" uniqKey="Ryman T">TK Ryman</name>
</author>
<author>
<name sortKey="Dietz, V" uniqKey="Dietz V">V Dietz</name>
</author>
<author>
<name sortKey="Cairns, Kl" uniqKey="Cairns K">KL Cairns</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Schunemann, Hj" uniqKey="Schunemann H">HJ Schünemann</name>
</author>
<author>
<name sortKey="Oxman, Ad" uniqKey="Oxman A">AD Oxman</name>
</author>
<author>
<name sortKey="Higgins, Jpt" uniqKey="Higgins J">JPT Higgins</name>
</author>
<author>
<name sortKey="Vist, Ge" uniqKey="Vist G">GE Vist</name>
</author>
<author>
<name sortKey="Glasziou, P" uniqKey="Glasziou P">P Glasziou</name>
</author>
<author>
<name sortKey="Guyatt, Gh" uniqKey="Guyatt G">GH Guyatt</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Schunemann, Hj" uniqKey="Schunemann H">HJ Schünemann</name>
</author>
<author>
<name sortKey="Oxman, Ad" uniqKey="Oxman A">AD Oxman</name>
</author>
<author>
<name sortKey="Vist, Ge" uniqKey="Vist G">GE Vist</name>
</author>
<author>
<name sortKey="Higgins, Jpt" uniqKey="Higgins J">JPT Higgins</name>
</author>
<author>
<name sortKey="Deeks, Jj" uniqKey="Deeks J">JJ Deeks</name>
</author>
<author>
<name sortKey="Glasziou, P" uniqKey="Glasziou P">P Glasziou</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Scott, Sd" uniqKey="Scott S">SD Scott</name>
</author>
<author>
<name sortKey="Albretch, L" uniqKey="Albretch L">L Albretch</name>
</author>
<author>
<name sortKey="O Leary, K" uniqKey="O Leary K">K O'Leary</name>
</author>
<author>
<name sortKey="Ball, Gd" uniqKey="Ball G">GD Ball</name>
</author>
<author>
<name sortKey="Hartling, L" uniqKey="Hartling L">L Hartling</name>
</author>
<author>
<name sortKey="Hofmeyer, A" uniqKey="Hofmeyer A">A Hofmeyer</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Squires, Je" uniqKey="Squires J">JE Squires</name>
</author>
<author>
<name sortKey="Sullivan, K" uniqKey="Sullivan K">K Sullivan</name>
</author>
<author>
<name sortKey="Eccles, Mp" uniqKey="Eccles M">MP Eccles</name>
</author>
<author>
<name sortKey="Worswick, J" uniqKey="Worswick J">J Worswick</name>
</author>
<author>
<name sortKey="Grimshaw, Jm" uniqKey="Grimshaw J">JM Grimshaw</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Steinman, Ma" uniqKey="Steinman M">MA Steinman</name>
</author>
<author>
<name sortKey="Ranji, Sr" uniqKey="Ranji S">SR Ranji</name>
</author>
<author>
<name sortKey="Shojania, Kg" uniqKey="Shojania K">KG Shojania</name>
</author>
<author>
<name sortKey="Gonzales, R" uniqKey="Gonzales R">R Gonzales</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Tannenbaum, Si" uniqKey="Tannenbaum S">SI Tannenbaum</name>
</author>
<author>
<name sortKey="Cerasoli, Cp" uniqKey="Cerasoli C">CP Cerasoli</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Wensing, M" uniqKey="Wensing M">M Wensing</name>
</author>
<author>
<name sortKey="Bosch, M" uniqKey="Bosch M">M Bosch</name>
</author>
<author>
<name sortKey="Foy, R" uniqKey="Foy R">R Foy</name>
</author>
<author>
<name sortKey="Van Derweijden, T" uniqKey="Van Derweijden T">T van derWeijden</name>
</author>
<author>
<name sortKey="Eccles, M" uniqKey="Eccles M">M Eccles</name>
</author>
<author>
<name sortKey="Grol, R" uniqKey="Grol R">R Grol</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Wensing, M" uniqKey="Wensing M">M Wensing</name>
</author>
<author>
<name sortKey="Wollersheim, H" uniqKey="Wollersheim H">H Wollersheim</name>
</author>
<author>
<name sortKey="Grol, R" uniqKey="Grol R">R Grol</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Wensing, M" uniqKey="Wensing M">M Wensing</name>
</author>
<author>
<name sortKey="Oxman, Ad" uniqKey="Oxman A">AD Oxman</name>
</author>
<author>
<name sortKey="Baker, R" uniqKey="Baker R">R Baker</name>
</author>
<author>
<name sortKey="Godycki Cwirko, M" uniqKey="Godycki Cwirko M">M Godycki-Cwirko</name>
</author>
<author>
<name sortKey="Flottorp, S" uniqKey="Flottorp S">S Flottorp</name>
</author>
<author>
<name sortKey="Szecsenyi, J" uniqKey="Szecsenyi J">J Szecsenyi</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Wiysonge, Cs" uniqKey="Wiysonge C">CS Wiysonge</name>
</author>
<author>
<name sortKey="Herrera, Ca" uniqKey="Herrera C">CA Herrera</name>
</author>
<author>
<name sortKey="Ciapponi, A" uniqKey="Ciapponi A">A Ciapponi</name>
</author>
<author>
<name sortKey="Lewin, S" uniqKey="Lewin S">S Lewin</name>
</author>
<author>
<name sortKey="Garcia Marti, S" uniqKey="Garcia Marti S">S Garcia Marti</name>
</author>
<author>
<name sortKey="Opiyo, N" uniqKey="Opiyo N">N Opiyo</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Wong, Ca" uniqKey="Wong C">CA Wong</name>
</author>
<author>
<name sortKey="Cummings, Gg" uniqKey="Cummings G">GG Cummings</name>
</author>
<author>
<name sortKey="Ducharme, L" uniqKey="Ducharme L">L Ducharme</name>
</author>
</analytic>
</biblStruct>
<biblStruct></biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Pantoja, T" uniqKey="Pantoja T">T Pantoja</name>
</author>
<author>
<name sortKey="Opiyo, N" uniqKey="Opiyo N">N Opiyo</name>
</author>
<author>
<name sortKey="Ciapponi, A" uniqKey="Ciapponi A">A Ciapponi</name>
</author>
<author>
<name sortKey="Dudley, L" uniqKey="Dudley L">L Dudley</name>
</author>
<author>
<name sortKey="Gagnon, Mp" uniqKey="Gagnon M">MP Gagnon</name>
</author>
<author>
<name sortKey="Herrera, Ca" uniqKey="Herrera C">CA Herrera</name>
</author>
</analytic>
</biblStruct>
</listBibl>
</div1>
</back>
</TEI>
<pmc article-type="review-article">
<pmc-dir>properties open_access</pmc-dir>
<front>
<journal-meta>
<journal-id journal-id-type="nlm-ta">Cochrane Database Syst Rev</journal-id>
<journal-id journal-id-type="iso-abbrev">Cochrane Database Syst Rev</journal-id>
<journal-id journal-id-type="publisher-id">cd</journal-id>
<journal-title-group>
<journal-title>The Cochrane Database of Systematic Reviews</journal-title>
</journal-title-group>
<issn pub-type="epub">1469-493X</issn>
<publisher>
<publisher-name>John Wiley & Sons, Ltd</publisher-name>
<publisher-loc>Chichester, UK</publisher-loc>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="pmid">28895659</article-id>
<article-id pub-id-type="pmc">5621088</article-id>
<article-id pub-id-type="doi">10.1002/14651858.CD011086.pub2</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Review</subject>
</subj-group>
</article-categories>
<title-group>
<article-title>Implementation strategies for health systems in low-income countries: an overview of systematic reviews</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name>
<surname>Pantoja</surname>
<given-names>Tomas</given-names>
</name>
<xref ref-type="aff" rid="au1">1</xref>
<xref ref-type="aff" rid="au2">2</xref>
<xref ref-type="corresp" rid="cor1"></xref>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Opiyo</surname>
<given-names>Newton</given-names>
</name>
<xref ref-type="aff" rid="au3">3</xref>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Lewin</surname>
<given-names>Simon</given-names>
</name>
<xref ref-type="aff" rid="au4">4</xref>
<xref ref-type="aff" rid="au5">5</xref>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Paulsen</surname>
<given-names>Elizabeth</given-names>
</name>
<xref ref-type="aff" rid="au4">4</xref>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Ciapponi</surname>
<given-names>Agustín</given-names>
</name>
<xref ref-type="aff" rid="au6">6</xref>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Wiysonge</surname>
<given-names>Charles S</given-names>
</name>
<xref ref-type="aff" rid="au7">7</xref>
<xref ref-type="aff" rid="au8">8</xref>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Herrera</surname>
<given-names>Cristian A</given-names>
</name>
<xref ref-type="aff" rid="au2">2</xref>
<xref ref-type="aff" rid="au9">9</xref>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Rada</surname>
<given-names>Gabriel</given-names>
</name>
<xref ref-type="aff" rid="au2">2</xref>
<xref ref-type="aff" rid="au10">10</xref>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Peñaloza</surname>
<given-names>Blanca</given-names>
</name>
<xref ref-type="aff" rid="au1">1</xref>
<xref ref-type="aff" rid="au2">2</xref>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Dudley</surname>
<given-names>Lilian</given-names>
</name>
<xref ref-type="aff" rid="au11">11</xref>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Gagnon</surname>
<given-names>Marie-Pierre</given-names>
</name>
<xref ref-type="aff" rid="au12">12</xref>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Garcia Marti</surname>
<given-names>Sebastian</given-names>
</name>
<xref ref-type="aff" rid="au13">13</xref>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Oxman</surname>
<given-names>Andrew D</given-names>
</name>
<xref ref-type="aff" rid="au4">4</xref>
</contrib>
<aff id="au1">
<label>1</label>
<institution>Department of Family Medicine, Faculty of Medicine, Pontificia Universidad Católica de Chile</institution>
<addr-line>Santiago, Chile</addr-line>
</aff>
<aff id="au2">
<label>2</label>
<institution>Evidence Based Health Care Program, Pontificia Universidad Católica de Chile</institution>
<addr-line>Santiago, Chile</addr-line>
</aff>
<aff id="au3">
<label>3</label>
<institution>Cochrane Editorial Unit, Cochrane</institution>
<addr-line>London, UK</addr-line>
</aff>
<aff id="au4">
<label>4</label>
<institution>Norwegian Institute of Public Health</institution>
<addr-line>Oslo, Norway</addr-line>
</aff>
<aff id="au5">
<label>5</label>
<institution>Health Systems Research Unit, South African Medical Research Council</institution>
<addr-line>Tygerberg, South Africa</addr-line>
</aff>
<aff id="au6">
<label>6</label>
<institution>Argentine Cochrane Centre, Institute for Clinical Effectiveness and Health Policy (IECS-CONICET)</institution>
<addr-line>Buenos Aires, Argentina</addr-line>
</aff>
<aff id="au7">
<label>7</label>
<institution>Cochrane South Africa, South African Medical Research Council</institution>
<addr-line>Cape Town, South Africa</addr-line>
</aff>
<aff id="au8">
<label>8</label>
<institution>Centre for Evidence-based Health Care, Faculty of Medicine and Health Sciences, Stellenbosch University</institution>
<addr-line>Cape Town, South Africa</addr-line>
</aff>
<aff id="au9">
<label>9</label>
<institution>Department of Public Health, School of Medicine, Pontificia Universidad Católica de Chile</institution>
<addr-line>Santiago, Chile</addr-line>
</aff>
<aff id="au10">
<label>10</label>
<institution>Department of Internal Medicine and Evidence-Based Healthcare Program, Faculty of Medicine, Pontificia Universidad Católica de Chile</institution>
<addr-line>Santiago, Chile</addr-line>
</aff>
<aff id="au11">
<label>11</label>
<institution>Division of Community Health, Faculty of Medicine and Health Sciences, Stellenbosch University</institution>
<addr-line>Cape Town, South Africa</addr-line>
</aff>
<aff id="au12">
<label>12</label>
<institution>Population Health and Optimal Health Practices Research Unit, CHU de Québec - Université Laval Research Centre</institution>
<addr-line>Québec City, Canada</addr-line>
</aff>
<aff id="au13">
<label>13</label>
<institution>Institute for Clinical Effectiveness and Health Policy</institution>
<addr-line>Buenos Aires, Argentina</addr-line>
</aff>
</contrib-group>
<author-notes>
<corresp id="cor1">Department of Family Medicine, Faculty of Medicine, Pontificia Universidad Católica de Chile, Centro Medico San Joaquin, Vicuña Mackenna 4686, Macul, Santiago, Chile.
<email>tpantoja@gmail.com</email>
,
<email>tpantoja@med.puc.cl</email>
.</corresp>
</author-notes>
<pub-date pub-type="epub">
<day>12</day>
<month>9</month>
<year>2017</year>
</pub-date>
<issue>9</issue>
<elocation-id>CD011086</elocation-id>
<permissions>
<copyright-statement>Copyright © 2016 The Authors. Cochrane Database of Systematic Reviews published by John Wiley & Sons, Ltd. on behalf of The Cochrane Collaboration.</copyright-statement>
<copyright-year>2016</copyright-year>
<license license-type="open-access" xlink:href="http://creativecommons.org/licenses/by-nc/3.0">
<license-p>This is an open access article under the terms of the
<ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/licenses/by-nc/3.0">Creative Commons Attribution-Non-Commercial</ext-link>
Licence, which permits use, distribution and reproduction in any medium, provided the original work is properly cited and is not used for commercial purposes.</license-p>
</license>
</permissions>
<abstract>
<sec>
<title>Background</title>
<p>A key function of health systems is implementing interventions to improve health, but coverage of essential health interventions remains low in low-income countries. Implementing interventions can be challenging, particularly if it entails complex changes in clinical routines; in collaborative patterns among different healthcare providers and disciplines; in the behaviour of providers, patients or other stakeholders; or in the organisation of care. Decision-makers may use a range of strategies to implement health interventions, and these choices should be based on evidence of the strategies' effectiveness.</p>
</sec>
<sec>
<title>Objectives</title>
<p>To provide an overview of the available evidence from up-to-date systematic reviews about the effects of implementation strategies for health systems in low-income countries. Secondary objectives include identifying needs and priorities for future evaluations and systematic reviews on alternative implementation strategies and informing refinements of the framework for implementation strategies presented in the overview.</p>
</sec>
<sec>
<title>Methods</title>
<p>We searched Health Systems Evidence in November 2010 and PDQ-Evidence up to December 2016 for systematic reviews. We did not apply any date, language or publication status limitations in the searches. We included well-conducted systematic reviews of studies that assessed the effects of implementation strategies on professional practice and patient outcomes and that were published after April 2005. We excluded reviews with limitations important enough to compromise the reliability of the review findings. Two overview authors independently screened reviews, extracted data and assessed the certainty of evidence using GRADE. We prepared SUPPORT Summaries for eligible reviews, including key messages, 'Summary of findings' tables (using GRADE to assess the certainty of the evidence) and assessments of the relevance of findings to low-income countries.</p>
</sec>
<sec>
<title>Main results</title>
<p>We identified 7272 systematic reviews and included 39 of them in this overview. An additional four reviews provided supplementary information. Of the 39 reviews, 32 had only minor limitations and 7 had important methodological limitations. Most studies in the reviews were from high-income countries. There were no studies from low-income countries in eight reviews.</p>
<p>Implementation strategies addressed in the reviews were grouped into four categories – strategies targeting:</p>
<p>1. healthcare organisations (e.g. strategies to change organisational culture; 1 review);</p>
<p>2. healthcare workers by type of intervention (e.g. printed educational materials; 14 reviews);</p>
<p>3. healthcare workers to address a specific problem (e.g. unnecessary antibiotic prescription; 9 reviews);</p>
<p>4. healthcare recipients (e.g. medication adherence; 15 reviews).</p>
<p>Overall, we found the following interventions to have desirable effects on at least one outcome with moderate- or high-certainty evidence and no moderate- or high-certainty evidence of undesirable effects.</p>
<p>1.
<bold>Strategies targeted at healthcare workers</bold>
: educational meetings, nutrition training of health workers, educational outreach, practice facilitation, local opinion leaders, audit and feedback, and tailored interventions.</p>
<p>2.
<bold>Strategies targeted at healthcare workers for specific types of problems</bold>
: training healthcare workers to be more patient-centred in clinical consultations, use of birth kits, strategies such as clinician education and patient education to reduce antibiotic prescribing in ambulatory care settings, and in-service neonatal emergency care training.</p>
<p>3.
<bold>Strategies targeted at healthcare recipients</bold>
: mass media interventions to increase uptake of HIV testing; intensive self-management and adherence, intensive disease management programmes to improve health literacy; behavioural interventions and mobile phone text messages for adherence to antiretroviral therapy; a one time incentive to start or continue tuberculosis prophylaxis; default reminders for patients being treated for active tuberculosis; use of sectioned polythene bags for adherence to malaria medication; community-based health education, and reminders and recall strategies to increase vaccination uptake; interventions to increase uptake of cervical screening (invitations, education, counselling, access to health promotion nurse and intensive recruitment); health insurance information and application support.</p>
</sec>
<sec>
<title>Authors' conclusions</title>
<p>Reliable systematic reviews have evaluated a wide range of strategies for implementing evidence-based interventions in low-income countries. Most of the available evidence is focused on strategies targeted at healthcare workers and healthcare recipients and relates to process-based outcomes. Evidence of the effects of strategies targeting healthcare organisations is scarce.</p>
</sec>
<sec>
<title>Implementation strategies for health systems in low-income countries</title>
<p>
<bold>What is the aim of this overview?</bold>
</p>
<p>The aim of this Cochrane Overview is to provide a broad summary of what is known about the effects of strategies for implementing interventions to improve health in low-income countries.</p>
<p>This overview is based on 39 relevant systematic reviews. Each of these reviews searched for studies that evaluated the different types of implementation strategies within the scope of the question addressed by the review. The reviews included a total of 1332 studies.</p>
<p>This overview is one of a series of four Cochrane Overviews that evaluate different health system arrangements.</p>
<p>
<bold>What was studied in the overview?</bold>
</p>
<p>A key function of health systems is implementing interventions to improve health. Coverage of essential health interventions remains low in low-income countries. Decision-makers may use a range of strategies to implement health interventions, and these choices should be based on evidence of the strategies' effectiveness.</p>
<p>
<bold>What are the main results of the overview?</bold>
</p>
<p>The following implementation strategies had desirable effects on at least one outcome with moderate- or high-certainty evidence and no moderate- or high-certainty evidence of undesirable effects.</p>
<p>
<bold>Strategies targeted at healthcare workers</bold>
</p>
<p>- Educational meetings.</p>
<p>- Nutrition training of health workers.</p>
<p>- Educational outreach (vs. no intervention).</p>
<p>- Practice facilitation.</p>
<p>- Local opinion leaders.</p>
<p>- Audit and feedback.</p>
<p>- Tailored interventions (vs. no intervention).</p>
<p>
<bold>Strategies targeted at healthcare workers for specific types of problems</bold>
</p>
<p>- Training healthcare workers to be more patient-centred in clinical consultations.</p>
<p>- Use of birth kits.</p>
<p>- Clinician education and patient education to reduce antibiotic prescribing in ambulatory care settings.</p>
<p>- In-service neonatal emergency care training.</p>
<p>
<bold>Strategies targeted at healthcare recipients</bold>
</p>
<p>- Mass media interventions to increase immediate uptake of HIV testing (leaflets and gain-framed videos).</p>
<p>- Intensive self-management and adherence, intensive disease management to improve health literacy.</p>
<p>- Behavioural interventions and mobile phone text messages for adherence to antiretroviral therapy.</p>
<p>- A one-time incentive to start or continue tuberculosis prophylaxis.</p>
<p>- Default reminders for patients being treated for active tuberculosis.</p>
<p>- Use of sectioned polythene bags for adherence to malaria medication.</p>
<p>- Community-based health education, and reminders and recall strategies for vaccination uptake.</p>
<p>- Providing free insecticide-treated bednets.</p>
<p>- Interventions to improve uptake of cervical screening (invitations, education, counselling, access to health promotion nurse, and intensive recruitment).</p>
<p>- Health insurance information and application support.</p>
<p>The following implementation strategies had low- or very low-certainty evidence (or no studies available) for all the outcomes that were considered.</p>
<p>
<bold>Strategies targeted at healthcare organisations</bold>
</p>
<p>- Strategies to improve organisational culture.</p>
<p>
<bold>Strategies targeted at healthcare workers</bold>
</p>
<p>- Printed educational materials.</p>
<p>- Internet-based learning.</p>
<p>- Interprofessional education.</p>
<p>- Teaching critical appraisal.</p>
<p>- Educational outreach (vs. another intervention).</p>
<p>- Pharmacist-provided services.</p>
<p>- Safety checklists for use by medical care teams in acute hospital settings.</p>
<p>- Tailored interventions (vs. non-tailored interventions, and interventions targeted at organisational and individual barriers vs. interventions targeted at individual barriers only).</p>
<p>- Interventions to encourage the use of systematic reviews in clinical decision-making.</p>
<p>
<bold>Strategies targeted at healthcare workers for specific types of problems</bold>
</p>
<p>- Interventions to improve handwashing.</p>
<p>- Interventions to reduce unnecessary caesarean section rates.</p>
<p>- Training of traditional birth attendants.</p>
<p>- Skilled birth attendance.</p>
<p>- Training of traditional healers about STD and HIV medicine.</p>
<p>
<bold>Strategies targeted at healthcare recipients</bold>
</p>
<p>- Providing information/education for promoting HIV testing (multimedia).</p>
<p>- Providing written medicine information.</p>
<p>- Single interventions to improve health literacy.</p>
<p>- Interventions to improve medication adherence.</p>
<p>- Adherence – TB (immediate versus deferred incentives; cash vs. non-cash incentive; different levels of cash incentives; incentives vs. other interventions).</p>
<p>- Adherence – malarial medication (blister packed tablets and capsules compared to tablets and capsules in paper envelopes; tablets in sectioned polythene bags compared to bottled syrup).</p>
<p>- Training of healthcare workers, home visits, and monetary incentives to improve immunisation coverage.</p>
<p>- Risk factor assessment to improve the uptake of cervical cancer screening.</p>
<p>
<bold>How up to date is this overview?</bold>
</p>
<p>The overview authors searched for systematic reviews that had been published up to 17 December 2016.</p>
</sec>
</abstract>
</article-meta>
</front>
<body>
<sec id="CD011086-sec1-0001">
<title>Background</title>
<p>This is one of four overviews of systematic reviews of strategies for improving health systems in low-income countries (
<xref rid="b82" ref-type="bibr">Ciapponi 2014</xref>
;
<xref rid="b99" ref-type="bibr">Herrera 2014</xref>
;
<xref rid="b134" ref-type="bibr">Wiysonge 2014</xref>
). The aim is to provide broad overviews of the evidence about the effects of alternative delivery, financial and governance arrangements, and implementation strategies based on systematic reviews. This overview addresses implementation strategies.</p>
<p>The scope of each of the four overviews is summarised below.</p>
<p>
<list list-type="order">
<list-item>
<p>Delivery arrangements include changes in who receives care and when, who provides care, the working conditions of those who provide care, coordination of care amongst different providers, where care is provided, the use of information and communication technology to deliver care, and the quality and safety systems in place (
<xref rid="b82" ref-type="bibr">Ciapponi 2014</xref>
).</p>
</list-item>
<list-item>
<p>Financial arrangements include changes in how funds are collected and services purchased, different insurance schemes, and the use of targeted financial incentives or disincentives (
<xref rid="b134" ref-type="bibr">Wiysonge 2014</xref>
).</p>
</list-item>
<list-item>
<p>Governance arrangements include changes in rules or processes that determine authority and accountability for health policies, organisations, commercial products and health professionals, and the involvement of stakeholders in decision-making (
<xref rid="b99" ref-type="bibr">Herrera 2014</xref>
).</p>
</list-item>
<list-item>
<p>Implementation strategies include interventions designed to bring about changes in healthcare organisations, the behaviour of healthcare professionals or the use of health services by healthcare recipients.</p>
</list-item>
</list>
</p>
<p>Healthcare systems worldwide are faced with the challenge of improving the quality and safety of care they deliver in order to improve health outcomes. However, in many cases they fail to use the best available evidence to inform decisions about the implementation of specific healthcare interventions, resulting in suboptimal outcomes and inefficiencies (
<xref rid="b106" ref-type="bibr">McGlynn 2003</xref>
). Even when there is consensus around a clear evidence-informed course of action, its implementation can be difficult, particularly if it requires complex changes in clinical routines, better collaboration among disciplines, changes in patients' behaviour, or changes in the organisation of care (
<xref rid="b96" ref-type="bibr">Grol 2007</xref>
). Effective strategies targeted at multiple levels of the healthcare system are therefore needed to implement improvements in clinical care and the organisation of health services. Outcomes that can potentially be affected by implementation strategies include healthcare recipients' outcomes (health and health behaviours), the quality or utilisation of healthcare services, resource use, healthcare provider outcomes (such as sick leave), and social outcomes (such as poverty or employment) (
<xref rid="b86" ref-type="bibr">EPOC 2017</xref>
). Impacts on these outcomes can be intended and desirable or unintended and undesirable. In addition, the effects of implementation strategies on these outcomes can either reduce or increase inequities.</p>
<p>Health systems in low-income countries differ from those in high-income countries in terms of the availability of resources and access to services. Thus, some problems in high-income countries are not relevant to low-income countries, such as how best to implement the delivery of expensive technologies that are not available in low-income countries. Similarly, some problems in low-income countries are not relevant to high-income countries, such as how to implement the delivery of services that are already widely available or not needed in high-income countries. Our focus in this overview was specifically on implementation strategies in low-income countries. By low-income countries we mean countries that the World Bank classifies as low or lower-middle-income (
<xref rid="b136" ref-type="bibr">World Bank 2016</xref>
). Because upper-middle-income countries often have a mixture of health systems with problems similar to both those in low-income countries and high-income countries, our focus is relevant to middle-income countries but excludes consideration of conditions that are not relevant in low-income countries and are relevant in middle-income countries.</p>
<sec>
<title>Description of the interventions</title>
<p>Health system administrators can use a wide range of implementation strategies to improve health systems. Different authors have used a number of approaches to classify these (
<xref rid="b72" ref-type="bibr">Abraham 2008</xref>
;
<xref rid="b76" ref-type="bibr">Bero 1998</xref>
;
<xref rid="b84" ref-type="bibr">Dolan 2010</xref>
;
<xref rid="b92" ref-type="bibr">Grimshaw 2001</xref>
;
<xref rid="b93" ref-type="bibr">Grol 1997</xref>
;
<xref rid="b94" ref-type="bibr">Grol 2003</xref>
;
<xref rid="b109" ref-type="bibr">Michie 2011</xref>
). For this overview we have used a pragmatic approach based on the level of the healthcare system targeted by the intervention: healthcare organisations, healthcare workers, and healthcare recipients (
<xref ref-type="table" rid="tbl1">Table 1</xref>
;
<xref rid="b86" ref-type="bibr">EPOC 2017</xref>
). This approach allows an intuitive matching of the barriers identified for the implementation of specific courses of action and the strategies proposed to address them, as illustrated in
<xref ref-type="table" rid="tbl2">Table 2</xref>
. We also have included reviews of alternative interventions targeted at specific types of problems that are common in low-income countries, including problems with different types of healthcare worker practice and with the utilisation of health services by healthcare recipients (
<xref ref-type="table" rid="tbl1">Table 1</xref>
;
<xref rid="b86" ref-type="bibr">EPOC 2017</xref>
).</p>
</sec>
<sec>
<title>How the intervention might work</title>
<p>Different interventions might work through different mechanisms. There is a plethora of contending theories from the social and behavioural sciences that attempt to explain behaviour change. Many of these have been applied to healthcare professionals and organisations in attempts to explain how different strategies to implement improvements might work (
<xref rid="b96" ref-type="bibr">Grol 2007</xref>
;
<xref rid="b108" ref-type="bibr">Michie 2008</xref>
;
<xref rid="b131" ref-type="bibr">Wensing 2005</xref>
).
<xref rid="b107" ref-type="bibr">Michie 2005</xref>
, for example, identified 33 psychological theories relevant to the implementation of evidence-based practice. These theories contained 128 constructs (components of the theories) that they categorised into 12 domains. In another review of a broader range of theories relevant to quality improvement,
<xref rid="b131" ref-type="bibr">Wensing 2005</xref>
included 29 theories that focused on individuals, social context, organisations and structures. There was limited evidence to support the theories, particularly regarding change of professional practice or organisation of care. Like
<xref rid="b107" ref-type="bibr">Michie 2005</xref>
, they found substantial overlap in the factors described by the various theories, which they reduced to a list of 30 factors. More recently,
<xref rid="b109" ref-type="bibr">Michie 2011</xref>
reviewed 19 frameworks of behaviour change interventions that can be used to characterise interventions and explain how they might work. Based on a synthesis of these frameworks, they developed a new framework called the 'behavioural change wheel' which includes three essential conditions for change and nine intervention functions that address these. The three conditions are capability, opportunity and motivation. The nine intervention functions aimed at addressing deficits in one or more of these conditions are education, persuasion, incentivisation, coercion, training, enablement, modelling, environmental restructuring and restrictions.</p>
<p>Logically, implementation strategies should address determinants of practice, that is, factors that prevent or enable improvements. However, our understanding of how to identify determinants and match appropriate implementation strategies to identified determinants is limited (
<xref rid="b2" ref-type="bibr">Baker 2015</xref>
;
<xref rid="b133" ref-type="bibr">Wensing 2011</xref>
), although there are several frameworks or checklists designed to facilitate this (
<xref rid="b87" ref-type="bibr">Flottorp 2013</xref>
;
<xref rid="b100" ref-type="bibr">Krause 2014</xref>
).
<xref ref-type="table" rid="tbl2">Table 2</xref>
shows examples of how different implementation strategies might work by addressing different determinants of organisational change, healthcare worker practice, and utilisation of health services by healthcare recipients.</p>
</sec>
<sec>
<title>Why it is important to do this overview</title>
<p>Although there are an increasing number of studies and systematic reviews about the effects of different implementation strategies (e.g.
<xref rid="b74" ref-type="bibr">Arnold 2005</xref>
;
<xref rid="b2" ref-type="bibr">Baker 2015</xref>
;
<xref rid="b83" ref-type="bibr">Davey 2013</xref>
;
<xref rid="b8" ref-type="bibr">Flodgren 2011</xref>
;
<xref rid="b9" ref-type="bibr">Forsetlund 2009</xref>
;
<xref rid="b10" ref-type="bibr">Giguère 2012</xref>
;
<xref rid="b11" ref-type="bibr">Gould 2010</xref>
;
<xref rid="b15" ref-type="bibr">Ivers 2012</xref>
;
<xref rid="b112" ref-type="bibr">Murthy 2012</xref>
;
<xref rid="b24" ref-type="bibr">O'Brien 2007</xref>
;
<xref rid="b25" ref-type="bibr">Opiyo 2015</xref>
;
<xref rid="b27" ref-type="bibr">Oyo-Ita 2016</xref>
;
<xref rid="b29" ref-type="bibr">Parmelli 2011</xref>
;
<xref rid="b32" ref-type="bibr">Reeves 2013</xref>
;
<xref rid="b122" ref-type="bibr">Rosenbaum 2011</xref>
;
<xref rid="b33" ref-type="bibr">Sibley 2012</xref>
;
<xref rid="b36" ref-type="bibr">Sorsdahl 2009</xref>
), much of this literature is not easily accessible to policymakers and other stakeholders making decisions about how to implement improvements in their health systems. Our aim is to facilitate access to this information by providing a broad overview of the evidence from systematic reviews about the effects of alternative implementation strategies in low-income countries. Such a broad overview can help policymakers and other stakeholders to identify strategies for implementing improvements in their health systems. This overview also can help to identify needs and priorities for evaluating alternative implementation strategies, as well as priorities for systematic reviews of the effects of implementation strategies. The overview can also help to refine the framework outlined in
<xref ref-type="table" rid="tbl1">Table 1</xref>
for considering alternative implementation strategies.</p>
<p>Changes in health systems are complex. They may be difficult to evaluate, the applicability of the findings of evaluations from one setting to another may be uncertain, and synthesising the findings of evaluations may be difficult. However, the alternative to well-designed evaluations is poorly designed evaluations, the alternative to systematic reviews is non-systematic reviews, and the alternative to using the findings of systematic reviews to inform decisions is making decisions without the support of this rigorous evidence. Other types of information, including context-specific information and judgments (including judgments about the applicability of the findings of systematic reviews in a specific context) are still needed. Nevertheless, this overview can help people make decisions about implementation strategies by summarising the findings of available systematic reviews, including estimates of the effects of implementing specific strategies and the certainty of those estimates. The overview can also help identify important uncertainties identified by those systematic reviews as well as where new or updated systematic reviews are needed. Finally, the overview can help to inform judgments about the relevance of the available evidence in a specific context (
<xref rid="b122" ref-type="bibr">Rosenbaum 2011</xref>
).</p>
</sec>
</sec>
<sec>
<title>Objectives</title>
<p>To provide an overview of the available evidence from up-to-date systematic reviews about the effects of implementation strategies for health systems in low-income countries. Secondary objectives include identifying needs and priorities for future evaluations and systematic reviews on alternative implementation strategies and informing refinements of the framework for implementation strategies presented in the overview (
<xref ref-type="table" rid="tbl1">Table 1</xref>
).</p>
</sec>
<sec>
<title>Methods</title>
<p>We used the methods described below in all four overviews of health system arrangements and implementation strategies in low-income countries (
<xref rid="b82" ref-type="bibr">Ciapponi 2014</xref>
;
<xref rid="b99" ref-type="bibr">Herrera 2014</xref>
;
<xref rid="b134" ref-type="bibr">Wiysonge 2014</xref>
).</p>
<sec>
<title>Criteria for considering reviews for inclusion</title>
<p>We included reviews that:</p>
<p>
<list list-type="bullet">
<list-item>
<p>assessed the effects of implementation strategies (as defined in
<xref ref-type="sec" rid="CD011086-sec1-0001">Background</xref>
) for health systems improvement;</p>
</list-item>
<list-item>
<p>had a Methods section with explicit selection criteria;</p>
</list-item>
<list-item>
<p>reported at least one of the following types of outcomes: patient outcomes (health and health behaviours), the quality or utilisation of healthcare services, resource use, healthcare provider outcomes (such as sick leave) or social outcomes (such as poverty or employment);</p>
</list-item>
<list-item>
<p>were relevant to low-income countries as classified by the World Bank (
<xref rid="b136" ref-type="bibr">World Bank 2016</xref>
); and</p>
</list-item>
<list-item>
<p>were published after April 2005.</p>
</list-item>
</list>
</p>
<p>Judgments about relevance to low-income countries are sometimes difficult to make, and we are aware that evidence from high-income countries is not directly applicable to low-income countries. We based these judgments on an assessment of the likelihood that the implementation strategies considered in a review address a problem that is important in low-income countries, would be feasible, and would be of interest to decision-makers in low-income countries, regardless of where the included studies took place. So, for example, we excluded strategies that require technology that is not widely available in low-income countries. At least two of the overview authors made judgments about the relevance to low-income countries and discussed with the other review authors whenever there was uncertainty.</p>
<p>We excluded reviews that only searched for and included studies from a single high-income country due to concerns about the wider applicability of the findings of such reviews. However, we included reviews that only included studies from high-income countries if the interventions were relevant for low-income countries.</p>
<p>We excluded reviews published before April 2005 as these were highly unlikely to be up-to-date. We excluded reviews with methodological limitations important enough to compromise the reliability of the review findings (
<xref ref-type="sec" rid="CD011086-sec2-0014">Appendix 1</xref>
).</p>
</sec>
<sec>
<title>Search methods for identification of reviews</title>
<p>We searched
<ext-link ext-link-type="uri" xlink:href="http://www.mcmasterhealthforum.org/hse/">Health Systems Evidence</ext-link>
in November 2010 using the following filters:</p>
<p>
<list list-type="order">
<list-item>
<p>health system topics = implementation arrangements;</p>
</list-item>
<list-item>
<p>type of synthesis = systematic review or Cochrane Review;</p>
</list-item>
<list-item>
<p>type of question = effectiveness; and</p>
</list-item>
<list-item>
<p>publication date range = 2000 to 2010.</p>
</list-item>
</list>
</p>
<p>We conducted subsequent searches using PDQ ('pretty darn quick')-Evidence, which was launched in 2012. We searched PDQ up to 17 December 2016, using the filter 'Systematic Reviews' with no other restrictions. We updated that search, excluding records that were entered into PDQ-Evidence prior to the date of the previous search.</p>
<p>
<ext-link ext-link-type="uri" xlink:href="https://www.pdq-evidence.org/en/">PDQ-Evidence</ext-link>
is a database of evidence for decisions about health systems, which is derived from the Epistemonikos database of systematic reviews (
<xref rid="b119" ref-type="bibr">Rada 2013</xref>
). It includes systematic reviews, overviews of reviews (including evidence-based policy briefs) and studies included in systematic reviews. Epistemonikos and PDQ-Evidence search the following databases with no language or publication status restrictions.</p>
<p>
<list list-type="order">
<list-item>
<p>Cochrane Database of Systematic Reviews (CDSR).</p>
</list-item>
<list-item>
<p>PubMed.</p>
</list-item>
<list-item>
<p>Embase.</p>
</list-item>
<list-item>
<p>Database of Abstracts of Reviews of Effectiveness (DARE).</p>
</list-item>
<list-item>
<p>Health Technology Assessment Database.</p>
</list-item>
<list-item>
<p>CINAHL.</p>
</list-item>
<list-item>
<p>LILACS.</p>
</list-item>
<list-item>
<p>PsycINFO.</p>
</list-item>
<list-item>
<p>Evidence for Policy and Practice Information and Co-ordinating Centre (EPPI-Centre) Evidence Library.</p>
</list-item>
<list-item>
<p>3ie Systematic Reviews and Policy Briefs.</p>
</list-item>
<list-item>
<p>World Health Organization (WHO) Database.</p>
</list-item>
<list-item>
<p>Campbell Library.</p>
</list-item>
<list-item>
<p>Supporting the Use of Research Evidence (SURE) Guides for Preparing and Using Evidence-Based Policy Briefs.</p>
</list-item>
<list-item>
<p>European Observatory on Health Systems and Policies.</p>
</list-item>
<list-item>
<p>UK Department for International Development (DFID).</p>
</list-item>
<list-item>
<p>National Institute for Health and Care Excellence (NICE) public health guidelines and systematic reviews.</p>
</list-item>
<list-item>
<p>Guide to Community Preventive Services.</p>
</list-item>
<list-item>
<p>Canadian Agency for Drugs and Technologies in Health (CADTH) Rx for Change.</p>
</list-item>
<list-item>
<p>McMaster Plus KT+.</p>
</list-item>
<list-item>
<p>McMaster Health Forum Evidence Briefs.</p>
</list-item>
</list>
</p>
<p>
<xref ref-type="sec" rid="CD011086-sec2-0015">Appendix 2</xref>
presents the detailed search strategies for PubMed, Embase, LILACS, CINAHL and PsycINFO. We screened all records in the other databases. PDQ staff and volunteers update these searches weekly for Pubmed and monthly for the other databases, screening records continually and adding new reviews to the database daily.</p>
<p>In addition, we screened all of the Cochrane Effective Practice and Organisation of Care (EPOC) Group systematic reviews in Archie (i.e. the Cochrane central server for managing documents) and the reference lists of relevant policy briefs and overviews of reviews.</p>
</sec>
<sec>
<title>Data collection and analysis</title>
<sec>
<title>Selection of reviews</title>
<p>Two of the overview authors (NO and TP) independently screened the titles and abstracts found in PDQ-Evidence to identify reviews that appeared to meet the inclusion criteria. Two other authors (AO and SL) screened all of the titles and abstracts that could not be confidently included or excluded after the first screening to identify any additional eligible reviews. One of the overview authors screened the reference lists.</p>
<p>One of the overview authors (NO or TP) applied the selection criteria to the full text of potentially eligible reviews and assessed the reliability of reviews that met all of the other selection criteria (
<xref ref-type="sec" rid="CD011086-sec2-0014">Appendix 1</xref>
). Two other authors (AO or SL) independently checked these judgments.</p>
</sec>
<sec>
<title>Data extraction and management</title>
<p>We summarised each included review using the approach developed by the
<ext-link ext-link-type="uri" xlink:href="http://www.supportsummaries.org/">SUPPORT Collaboration</ext-link>
(
<xref rid="b122" ref-type="bibr">Rosenbaum 2011</xref>
). We used standardised forms to extract data on the background of the review; the interventions, participants, settings and outcomes; the key findings; and considerations of applicability, equity, economics, and monitoring and evaluation. We assessed the certainty of the evidence for the main comparisons using the GRADE approach (
<xref rid="b86" ref-type="bibr">EPOC 2017</xref>
;
<xref rid="b97" ref-type="bibr">Guyatt 2008</xref>
;
<xref rid="b125" ref-type="bibr">Schünemann 2011a</xref>
;
<xref rid="b126" ref-type="bibr">Schünemann 2011b</xref>
).</p>
<p>Each completed SUPPORT Summary was peer-reviewed and published on an
<ext-link ext-link-type="uri" xlink:href="http://www.supportsummaries.org/">open access website</ext-link>
, where there are details about
<ext-link ext-link-type="uri" xlink:href="http://www.supportsummaries.org/support-summaries/how-support-summaries-are-prepared/">how the summaries were prepared</ext-link>
, including how we assessed the applicability of the findings, impacts on equity, economic considerations, and the need for monitoring and evaluation. We describe our rationale for the criteria that we used for these assessments in the SUPPORT Tools for evidence-informed health Policymaking (
<xref rid="b89" ref-type="bibr">Fretheim 2009</xref>
;
<xref rid="b101" ref-type="bibr">Lavis 2009</xref>
;
<xref rid="b115" ref-type="bibr">Oxman 2009a</xref>
;
<xref rid="b116" ref-type="bibr">Oxman 2009b</xref>
). As noted there, "a local applicability assessment must be done by individuals with a very good understanding of on-the-ground realities and constraints, health system arrangements, and the baseline conditions in the specific setting" (
<xref rid="b101" ref-type="bibr">Lavis 2009</xref>
). In this overview we have made broad assessments of the applicability of findings from studies in high-income countries to low-income countries using the criteria described in the
<ext-link ext-link-type="uri" xlink:href="http://www.supportsummaries.org/support-summaries/how-support-summaries-are-prepared/">SUPPORT Summaries</ext-link>
database with input from people with relevant experience and expertise in low-income countries.</p>
</sec>
<sec>
<title>Assessment of methodological quality of included reviews</title>
<p>We assessed the reliability of systematic reviews that met the inclusion criteria using criteria developed by the SUPPORT and SURE collaborations (
<xref ref-type="sec" rid="CD011086-sec2-0014">Appendix 1</xref>
). Based on these criteria, we categorised each review as having:</p>
<p>
<list list-type="bullet">
<list-item>
<p>only minor limitations;</p>
</list-item>
<list-item>
<p>limitations that were important enough that it would be worthwhile to search for another systematic review and to interpret the results of this review cautiously, if a better review could not be found;</p>
</list-item>
<list-item>
<p>limitations important enough to compromise the reliability of the review findings. We did not include these reviews in the overview.</p>
</list-item>
</list>
</p>
</sec>
<sec>
<title>Data synthesis</title>
<p>We describe the methods used to prepare a SUPPORT Summary of each review in detail on the
<ext-link ext-link-type="uri" xlink:href="http://www.supportsummaries.org/support-summaries/how-support-summaries-are-prepared/">SUPPORT Summaries website</ext-link>
. Briefly, for each included systematic review we prepared a table summarising what the review authors searched for and what they found along with 'Summary of findings' tables for each main comparison, and we assessed the relevance of the findings for low-income countries. The SUPPORT Summaries include key messages, important background information, a summary of the findings of the review, and structured assessments of the relevance of the review for low-income countries. We subjected the SUPPORT Summaries to review by the lead author of each review, at least one content area expert, people with practical experience in low-income settings, and a Cochrane EPOC Group editor (AO or SL). The authors of the SUPPORT Summaries responded to each comment and made appropriate revisions, and the summaries underwent copy-editing. The editor determined whether the summary authors had adequately addressed the comments and whether the summary was ready for publication on the
<ext-link ext-link-type="uri" xlink:href="http://www.supportsummaries.org/">SUPPORT Summary website</ext-link>
.</p>
<p>We organised the review using a modification of the taxonomy for health systems arrangements used by
<ext-link ext-link-type="uri" xlink:href="http://www.healthsystemsevidence.org/">Health Systems Evidence</ext-link>
(
<xref rid="b102" ref-type="bibr">Lavis 2015</xref>
). We adjusted the framework iteratively to ensure that we appropriately categorised all of the included reviews and that we included and logically organised all relevant health system arrangements and implementation strategies. We prepared a table listing the included reviews as well as the types of implementation strategies for which we were not able to identify a reliable, up-to-date review (
<xref ref-type="table" rid="tbl3">Table 3</xref>
). We also prepared a table of excluded reviews (
<xref ref-type="table" rid="tbl4">Table 4</xref>
), detailing reviews that addressed a question for which another (more up-to-date or reliable) review was included, reviews that were published before April 2005 (for which a SUPPORT Summary had previously been prepared), reviews with results that we did not consider transferable to low-income countries, and reviews with limitations important enough to compromise the reliability of the review findings.</p>
<p>We described the characteristics of the included reviews in
<xref ref-type="sec" rid="CD011086-sec2-0016">Appendix 3</xref>
that includes the date of the last search, any important limitations, what the review authors searched for and what they found. We summarise our detailed assessments of the reliability of the included reviews in a separate table (
<xref ref-type="table" rid="tbl5">Table 5</xref>
) showing whether individual reviews met each criterion in
<xref ref-type="sec" rid="CD011086-sec2-0014">Appendix 1</xref>
.</p>
<p>Our structured synthesis of the findings of the overview was based on two tables. We summarised the main findings of each review in a table that included the key messages from each SUPPORT Summary (
<xref ref-type="table" rid="tbl6">Table 6</xref>
). In a second table (
<xref ref-type="table" rid="tbl7">Table 7</xref>
), we reported the direction of the results and the certainty of the evidence for each of the following type of outcomes: health and other patient outcomes; access, coverage or utilisation; quality of care; resource use; social outcomes; impacts on equity; healthcare provider outcomes; adverse effects (not captured by undesirable effects on any of the preceding types of outcomes), and any other important outcome (that did not fit into any of the preceding types of outcomes) (
<xref rid="b86" ref-type="bibr">EPOC 2017</xref>
). We categorised the direction of results as: a desirable effect, little or no effect, an uncertain effect (very low certainty evidence), no included studies, an undesirable effect, not reported (i.e. not specified as a type of outcome that the review authors considered by ), or not relevant (i.e. no plausible mechanism by which the type of health system arrangement could affect the type of outcomes).</p>
<p>We took into account other relevant considerations besides the findings of the included reviews when drawing conclusions about implications for practice (
<xref rid="b86" ref-type="bibr">EPOC 2017</xref>
). This included considerations related to the applicability of the findings and likely impacts on equity. Our conclusions about implications for systematic reviews were based on types of implementation strategies for which we were unable to find a reliable, up-to-date review and limitations identified in the included reviews. Our conclusions about implications for future evaluations were based on the findings of the included reviews (
<xref rid="b86" ref-type="bibr">EPOC 2017</xref>
).</p>
</sec>
</sec>
</sec>
<sec>
<title>Results</title>
<p>We identified 7272 systematic reviews of health systems arrangements and implementation strategies. We excluded 6926 reviews from this overview following a review of titles and abstracts. We retrieved the full texts of 82 reviews for further detailed assessment. Of these, we excluded 32 reviews: 6 because they had important methodological limitations, 11 that were out-of-date, 11 that focused on an area already covered by one of the included reviews and 4 that were of limited relevance to low-income countries (
<xref ref-type="table" rid="tbl4">Table 4</xref>
). We included 39 systematic reviews published between 2005 and 2016 in this overview. In addition, four reviews provided supplementary numerical data or methodological information used in a SUPPORT Summary (
<xref ref-type="fig" rid="fig1">Figure 1</xref>
;
<xref ref-type="sec" rid="CD011086-sec2-0017">Appendix 4</xref>
). Seven related reviews were similar to one of the primary reviews. We did not prepare SUPPORT Summaries for the related reviews, and they did not contribute data to the summaries or the overview because of substantial overlap with one of the primary reviews. Following the screening of the subsequent searches of PDQ-Evidence, we identified five ongoing reviews of implementation strategies (
<xref rid="b79" ref-type="bibr">Brennan 2009</xref>
;
<xref rid="b85" ref-type="bibr">Dudley 2009</xref>
;
<xref rid="b90" ref-type="bibr">Fønhus 2016</xref>
;
<xref rid="b117" ref-type="bibr">Pantoja 2014b</xref>
;
<xref rid="b123" ref-type="bibr">Rowe 2015</xref>
); six additional systematic reviews of implementation strategies that are awaiting assessment (
<xref rid="b75" ref-type="bibr">Baldwin 2011</xref>
;
<xref rid="b105" ref-type="bibr">Mauger Rothenberg 2012</xref>
;
<xref rid="b111" ref-type="bibr">Mundell 2013</xref>
;
<xref rid="b114" ref-type="bibr">Oluoch 2012</xref>
;
<xref rid="b120" ref-type="bibr">Rolfe 2014</xref>
;
<xref rid="b130" ref-type="bibr">Tannenbaum 2013</xref>
;
<xref ref-type="sec" rid="CD011086-sec2-0018">Appendix 5</xref>
); and a number of other reviews that are awaiting classification and also need to be checked for relevance to this overview (
<xref ref-type="sec" rid="CD011086-sec2-0018">Appendix 5</xref>
).
<fig id="fig1" position="float">
<label>Figure 1</label>
<caption>
<p>Flow diagram</p>
</caption>
<graphic xlink:href="CD011086-0001-f01"></graphic>
</fig>
</p>
<sec>
<title>Description of included reviews</title>
<p>Of the 39 included systematic reviews, 27 were Cochrane Reviews and 12 were non-Cochrane reviews. Fifteen of the reviews were updates of earlier reviews (
<xref rid="b2" ref-type="bibr">Baker 2015</xref>
;
<xref rid="b4" ref-type="bibr">Berkman 2011</xref>
;
<xref rid="b7" ref-type="bibr">Everett 2011</xref>
;
<xref rid="b9" ref-type="bibr">Forsetlund 2009</xref>
;
<xref rid="b10" ref-type="bibr">Giguère 2012</xref>
;
<xref rid="b11" ref-type="bibr">Gould 2010</xref>
;
<xref rid="b12" ref-type="bibr">Haynes 2008</xref>
;
<xref rid="b13" ref-type="bibr">Horsley 2011</xref>
;
<xref rid="b15" ref-type="bibr">Ivers 2012</xref>
;
<xref rid="b20" ref-type="bibr">Liu 2014</xref>
;
<xref rid="b21" ref-type="bibr">Lutge 2015</xref>
;
<xref rid="b24" ref-type="bibr">O'Brien 2007</xref>
;
<xref rid="b27" ref-type="bibr">Oyo-Ita 2016</xref>
;
<xref rid="b32" ref-type="bibr">Reeves 2013</xref>
;
<xref rid="b33" ref-type="bibr">Sibley 2012</xref>
).</p>
<p>The reviews reported results from 1332 studies (
<xref ref-type="sec" rid="CD011086-sec2-0016">Appendix 3</xref>
). Study designs included: 710 randomised trials; 26 non-randomised trials; 34 controlled before-after studies; 50 interrupted time series; 69 repeated measures studies; and 243 other designs (cross-sectional, cohort, historical or ecological, and quasi-experimental studies). The number of studies included in each review ranged from 0 in
<xref rid="b29" ref-type="bibr">Parmelli 2011</xref>
to 201 in
<xref rid="b5" ref-type="bibr">Cook 2008</xref>
. Dates of most recent searches in the reviews ranged from April 2004 to May 2016.</p>
<p>Most studies in the reviews were from the USA, the UK, Canada, the Netherlands and Australia. There were no studies from low-income countries in eight reviews (
<xref rid="b3" ref-type="bibr">Baskerville 2012</xref>
;
<xref rid="b6" ref-type="bibr">Dwamena 2012</xref>
;
<xref rid="b13" ref-type="bibr">Horsley 2011</xref>
;
<xref rid="b17" ref-type="bibr">Jia 2014</xref>
;
<xref rid="b31" ref-type="bibr">Ranji 2008</xref>
;
<xref rid="b32" ref-type="bibr">Reeves 2013</xref>
;
<xref rid="b34" ref-type="bibr">Simoni 2006</xref>
;
<xref rid="b38" ref-type="bibr">Vidanapathirana 2005</xref>
). Study settings varied and included outpatient and inpatient settings in hospitals, health centres, families, workplaces and community settings (
<xref ref-type="sec" rid="CD011086-sec2-0016">Appendix 3</xref>
). The health professionals included in the reviews were physicians, nurses, pharmacists, psychologists, dentists, social workers and traditional healers. The participants included in the reviews were children, adults and pregnant mothers. Outcomes examined included healthcare provider performance, quality of care, patient outcomes, access to care, coverage, utilisation of health services, resource use, impacts on equity and adverse effects (
<xref ref-type="table" rid="tbl7">Table 7</xref>
,
<xref ref-type="sec" rid="CD011086-sec2-0016">Appendix 3</xref>
).</p>
<p>Implementation strategies addressed in the reviews were grouped into four categories based on the level of the healthcare system targeted by the intervention (
<xref ref-type="table" rid="tbl1">Table 1</xref>
;
<xref ref-type="table" rid="tbl3">Table 3</xref>
).</p>
<p>
<list list-type="order">
<list-item>
<p>Strategies targeting healthcare organisations (e.g. strategies to change organisational culture) (1 review).</p>
</list-item>
<list-item>
<p>Strategies targeting healthcare workers (e.g. printed educational materials) (14 reviews).</p>
</list-item>
<list-item>
<p>Strategies targeting healthcare workers to address a specific problem (e.g. unnecessary use of antibiotics) (9 reviews).</p>
</list-item>
<list-item>
<p>Strategies targeting healthcare recipients (e.g. medication adherence) (15 reviews).</p>
</list-item>
</list>
</p>
</sec>
<sec>
<title>Methodological quality of included reviews</title>
<p>We have summarised our assessment of the methodological quality (reliability) of the included reviews in
<xref ref-type="table" rid="tbl5">Table 5</xref>
. We judged 32 reviews to have only minor limitations. We judged the other seven reviews to have methodological limitations that were important enough to make it worthwhile to search for another systematic review or to interpret the review results cautiously, if no better review were available (
<xref rid="b3" ref-type="bibr">Baskerville 2012</xref>
;
<xref rid="b12" ref-type="bibr">Haynes 2008</xref>
;
<xref rid="b19" ref-type="bibr">Ko 2011</xref>
;
<xref rid="b23" ref-type="bibr">Nicolson 2009</xref>
;
<xref rid="b31" ref-type="bibr">Ranji 2008</xref>
).</p>
<p>We assessed the included reviews as being well conducted in relation to the identification, selection and critical appraisal of the included studies. However, we assessed the comprehensiveness of the search for evidence as only partially achieved in 19 reviews. We also assessed the included reviews as being well conducted in relation to the analysis of the available evidence, with only a few of them presenting limitations related to descriptions of the extent of heterogeneity (
<xref rid="b12" ref-type="bibr">Haynes 2008</xref>
;
<xref rid="b23" ref-type="bibr">Nicolson 2009</xref>
;
<xref rid="b30" ref-type="bibr">Perrier 2011</xref>
;
<xref rid="b31" ref-type="bibr">Ranji 2008</xref>
), the methods used to synthesise the evidence (
<xref rid="b12" ref-type="bibr">Haynes 2008</xref>
;
<xref rid="b19" ref-type="bibr">Ko 2011</xref>
;
<xref rid="b23" ref-type="bibr">Nicolson 2009</xref>
;
<xref rid="b28" ref-type="bibr">Pande 2013</xref>
;
<xref rid="b30" ref-type="bibr">Perrier 2011</xref>
), and the examination of factors that might explain differences in the results of included studies (
<xref rid="b11" ref-type="bibr">Gould 2010</xref>
;
<xref rid="b23" ref-type="bibr">Nicolson 2009</xref>
;
<xref rid="b28" ref-type="bibr">Pande 2013</xref>
;
<xref rid="b31" ref-type="bibr">Ranji 2008</xref>
).</p>
</sec>
<sec>
<title>Effect of interventions</title>
<p>We used a pragmatic approach to group the interventions assessed in the overview based on the level of the healthcare system targeted by the intervention: healthcare organisations, healthcare workers, and healthcare recipients. Additionally, for interventions targeted at healthcare workers, we distinguished reviews evaluating a specific type of intervention from those evaluating interventions for a specific problem that we considered especially relevant to low-income countries (
<xref ref-type="table" rid="tbl3">Table 3</xref>
).</p>
<p>We report here the main findings using plain language statements based on GRADE 'Summary of findings' tables that we prepared for each included review (
<xref rid="b86" ref-type="bibr">EPOC 2017</xref>
). The 'Summary of findings' tables are available in the
<ext-link ext-link-type="uri" xlink:href="http://www.supportsummaries.org/support-summaries/how-support-summaries-are-prepared/">SUPPORT Summaries</ext-link>
database.</p>
<sec>
<title>Strategies targeted at healthcare organisations</title>
<sec>
<title>Organisational culture</title>
<p>One review assessed the effects of strategies to change organisational culture to improve healthcare performance but did not find any eligible studies (
<xref rid="b29" ref-type="bibr">Parmelli 2011</xref>
). It was therefore not possible to draw any conclusions about the impacts of this type of organisational intervention.</p>
</sec>
<sec>
<title>Continuous quality improvement</title>
<p>Continuous quality improvement (CQI) comprises improvement of organisational processes, use of structured problem-solving processes incorporating statistical methods and measurement to diagnose problems and monitor progress, use of teams including employees from multiple departments and from different organisational levels, empowerment of employees to identify quality problems and create opportunities to correct them, and an explicit focus on 'customers'. None of the included reviews assessed the effects of CQI strategies. One Cochrane Review on this topic is in progress (
<xref rid="b79" ref-type="bibr">Brennan 2009</xref>
).</p>
</sec>
</sec>
<sec>
<title>Strategies targeted at healthcare workers by type of intervention</title>
<p>In order to give a general comparative picture of the range of effects found for this group of interventions we summarised the findings in
<xref ref-type="sec" rid="CD011086-sec2-0019">Appendix 6</xref>
. Additionally we present the specific findings for each strategy below.</p>
<sec>
<title>Educational materials</title>
<p>One review assessed the effects of printed educational materials on professional practice. The review found 45 studies done in a variety of settings (e.g. outpatient, inpatient, community) and involving different healthcare professionals (e.g. physicians, nurses, allied health professionals in the field of community health) (
<xref rid="b10" ref-type="bibr">Giguère 2012</xref>
). Printed educational materials may slightly improve practice outcomes (e.g. diagnosis, prescribing, referral practices) among healthcare providers, when used alone and compared to no intervention (low-certainty evidence). There were no studies assessing the effects of these materials on patient outcomes.</p>
</sec>
<sec>
<title>Internet-based learning</title>
<p>Internet-based learning refers to any educational intervention delivered to healthcare workers through the Internet. This approach is intended to allow learners to participate at a time and place convenient to them and to facilitate innovation in instructional methods. It also potentially allows instruction to be tailored to the individual's needs.</p>
<p>One review assessing the effects of Internet-based learning in health professions found 201 studies addressing a wide range of topics and using a range of modalities for teaching and learning (
<xref rid="b5" ref-type="bibr">Cook 2008</xref>
). Compared with no intervention, Internet-based learning may improve health workers' knowledge (low-certainty evidence), but it is unclear whether it improves health professionals' skills and behaviours, or if it leads to beneficial effects on patients (very low-certainty evidence). When compared to other forms of teaching and learning, Internet-based learning may improve knowledge, but may not improve satisfaction, skills, behaviour and patient outcomes (low-certainty evidence).</p>
</sec>
<sec>
<title>Educational meetings and workshops</title>
<p>Four reviews were included in this category (
<xref rid="b9" ref-type="bibr">Forsetlund 2009</xref>
;
<xref rid="b32" ref-type="bibr">Reeves 2013</xref>
;
<xref rid="b13" ref-type="bibr">Horsley 2011</xref>
;
<xref rid="b37" ref-type="bibr">Sunguya 2013</xref>
).</p>
<p>The first review assessed the effects of educational meetings and workshops on professional practice and healthcare outcomes (
<xref rid="b9" ref-type="bibr">Forsetlund 2009</xref>
). The review identified 81 studies. Findings showed that educational meetings alone or combined with other interventions probably improve professional practice and healthcare outcomes for patients (moderate-certainty evidence). Combined interactive and didactic (lecture-based) educational meetings may be slightly more effective than didactic educational meetings alone (low-certainty evidence).</p>
<p>The second review assessed the effects of interprofessional education (IPE) on professional practice and healthcare outcomes (
<xref rid="b32" ref-type="bibr">Reeves 2013</xref>
). The review identified 15 studies. Compared with separate, profession-specific educational interventions or no education intervention, IPE may lead to improvements in outcomes for patients, adherence to clinical guidelines, and clinical processes (e.g. shared decisions on surgical incisions) (low-certainty evidence).</p>
<p>The third review assessed the effects of teaching health professionals critical appraisal skills on their knowledge (
<xref rid="b13" ref-type="bibr">Horsley 2011</xref>
). The review identified three studies. Teaching critical appraisal skills, compared to usual practice, may improve health professionals' knowledge on how to critically appraise research papers (low-certainty evidence). Effects on critical appraisal skills were uncertain. None of the studies evaluated process of care or patient-related outcomes</p>
<p>The final review assessed the effect of nutrition training of health workers on caregivers’ feeding practices for children aged six months to two years (
<xref rid="b37" ref-type="bibr">Sunguya 2013</xref>
). The review identified ten studies. Nutrition training of health workers, compared to usual care, increases daily energy intake, feeding frequency, and consumption of targeted food items. The certainty of evidence was high. None of the included studies assessed cost or health outcomes (such the proportion of undernourished children or children with adverse health outcomes).</p>
</sec>
<sec>
<title>Local consensus processes</title>
<p>Consensus development processes are decision-making processes that aim to help a group of people reach agreement about a given issue. Healthcare workers have used local consensus processes to achieve agreement on clinical policies and guidelines. None of the included reviews assessed the effects of local consensus processes.</p>
</sec>
<sec>
<title>Educational outreach</title>
<p>Three reviews assessed the effects of educational outreach interventions on professional practice and healthcare outcomes (
<xref rid="b3" ref-type="bibr">Baskerville 2012</xref>
;
<xref rid="b24" ref-type="bibr">O'Brien 2007</xref>
;
<xref rid="b28" ref-type="bibr">Pande 2013</xref>
). Educational outreach visits entail the use of a trained person from outside the practice setting to meet with healthcare professionals in their practice in order to provide information with the intent of improving practice, for example feedback about health worker performance. This type of face-to-face visit is also called academic detailing and educational visiting.</p>
<p>A review assessing the effects of educational outreach visits on professional practice and practice outcomes found 69 studies (
<xref rid="b24" ref-type="bibr">O'Brien 2007</xref>
). Educational outreach visits alone or combined with other interventions probably improve the quality of care delivered to patients (moderate-certainty evidence). For prescribing, the effects are relatively consistent (high-certainty evidence); for other types of professional performance, the effects vary widely from small to modest improvements (moderate-certainty evidence). The effects on patient outcomes were uncertain (very low-certainty evidence).</p>
<p>Practice facilitation is a multifaceted approach whereby skilled individuals, either internal or external to a primary care setting, promote the adoption and use of evidence-based guidelines. A review assessing the effects of practice facilitation on evidence-based practice behaviours identified 23 studies (
<xref rid="b3" ref-type="bibr">Baskerville 2012</xref>
). All of them took place in high-income countries. The use of practice facilitation probably improves the adoption of evidence-based guidelines (moderate-certainty evidence).</p>
<p>Another review assessing the effect of additional pharmacist-provided services included one study of strategies targeted at healthcare professionals, comparing educational outreach to usual care (
<xref rid="b28" ref-type="bibr">Pande 2013</xref>
). The findings showed that when pharmacists provide additional services targeted at health professionals, such as educational outreach visits, patient outcomes may improve (low-certainty evidence). Effects on healthcare cost were uncertain (no studies were found).</p>
</sec>
<sec>
<title>Local opinion leaders</title>
<p>Opinion leaders are individuals in a community or organisation who have a substantial influence on what the rest of the community or organisation does. Because of their influence, opinion leaders may be able to persuade healthcare providers to use the best available evidence when managing patients. A review assessing the effects of local opinion leaders on healthcare professional behaviour and patient outcomes found 18 studies conducted in both hospital and primary care settings (
<xref rid="b8" ref-type="bibr">Flodgren 2011</xref>
). Local opinion leaders, acting alone or in concert with other interventions, probably improve healthcare workers' adherence to desired practice (moderate-certainty evidence). None of the included studies assessed patient outcomes.</p>
</sec>
<sec>
<title>Patient-mediated interventions</title>
<p>Patient-mediated interventions include any intervention aimed at changing the performance of healthcare professionals through interactions with patients or information provided by or to patients. A Cochrane Review of patient-mediated interventions is in progress (
<xref rid="b90" ref-type="bibr">Fønhus 2016</xref>
).</p>
</sec>
<sec>
<title>Audit and feedback</title>
<p>A review assessing the effects of audit and feedback on the practice of healthcare professionals and patient outcomes identified 140 studies using a wide range of interventions with respect to their content, format, timing and source (
<xref rid="b15" ref-type="bibr">Ivers 2012</xref>
). Overall they found that interventions that include audit and feedback (alone or as a core component of a multifaceted intervention), compared with usual care, probably improve adherence to desired practice (moderate-certainty evidence) and probably lead to little difference in patient outcomes (moderate-certainty evidence). Compared with a number of educational interventions (e.g. reminders, educational outreach) and organisational, financial or patient-mediated interventions, audit and feedback probably leads to little or no difference in compliance with desired practice or patient outcomes (moderate-certainty evidence).</p>
</sec>
<sec>
<title>Reminders</title>
<p>One review assessed if using safety checklists improved patient safety in acute hospital settings compared to not using them. The review included nine studies that evaluated a wide variety of checklist designs as well as training on use of the checklists (
<xref rid="b19" ref-type="bibr">Ko 2011</xref>
). The findings showed that surgical safety checklists may reduce death rates and major complications within 30 days after surgery (low-certainty evidence). It was uncertain whether safety checklists improve adherence to guidelines or patient safety in intensive care units, emergency departments or acute care settings (very low-certainty evidence).</p>
<p>One Cochrane Review on the effects of manual paper reminders on professional practice outcomes is in progress (
<xref rid="b117" ref-type="bibr">Pantoja 2014b</xref>
). We excluded two Cochrane Reviews assessing the effects of computer-generated or onscreen reminders because of their limited relevance to low-income countries (
<xref rid="b40" ref-type="bibr">Arditi 2012</xref>
;
<xref rid="b65" ref-type="bibr">Shojania 2009</xref>
).</p>
</sec>
<sec>
<title>Tailored interventions</title>
<p>A range of barriers may impede changes to health professional behaviour. Change may be more likely if implementation strategies address specific barriers. A review assessing the effects of interventions tailored to address specific barriers to change on professional practice and healthcare outcomes identified 26 studies. The review found that these interventions were probably more likely to improve professional practice than no intervention or dissemination of guidelines alone (moderate-certainty evidence). However, it is uncertain whether tailored interventions are more likely to improve professional practice than non-tailored interventions, or whether tailored interventions targeted at organisational and individual barriers are more likely to improve professional practice than tailored interventions targeted only at individual barriers (very low-certainty evidence). A recent update of this review identified six additional trials but without any change to the conclusions (
<xref rid="b2" ref-type="bibr">Baker 2015</xref>
).</p>
</sec>
<sec>
<title>Multifaceted interventions</title>
<p>Multifaceted interventions are those including more than one of the interventions described above. Four reviews examined the effects of multifaceted interventions on professional practice and/or patient outcomes.</p>
<p>One review assessed the effectiveness of interventions for seeking, appraising and applying evidence from systematic reviews in clinical decisions. It included five trials in middle- and high-income countries evaluating multifaceted interventions (
<xref rid="b30" ref-type="bibr">Perrier 2011</xref>
). It is uncertain whether multifaceted interventions, such as training and workshops, improve informed decision-making by healthcare workers in low-income countries (very low-certainty evidence).</p>
<p>Three reviews compared the effects of multifaceted interventions to audit and feedback (
<xref rid="b15" ref-type="bibr">Ivers 2012</xref>
), educational meetings (
<xref rid="b9" ref-type="bibr">Forsetlund 2009</xref>
), and outreach visits (
<xref rid="b24" ref-type="bibr">O'Brien 2007</xref>
). In the case of audit and feedback and outreach visits, the authors found that combining the core intervention with other interventions led to a larger effect size than using the core intervention alone. However, the results were inconsistent or based on indirect comparisons. On the other hand,
<xref rid="b9" ref-type="bibr">Forsetlund 2009</xref>
did not find relevant differences between the effects of multifaceted interventions and educational meetings alone.</p>
</sec>
</sec>
<sec>
<title>Strategies targeted at healthcare workers by type of problem</title>
<p>In order to have a general comparative picture of the range of effects found for this group of interventions, we have summarised the findings in
<xref ref-type="sec" rid="CD011086-sec2-0020">Appendix 7</xref>
. Additionally we present specific findings for each strategy below.</p>
<sec>
<title>Communication with patients</title>
<p>One review assessed the effects of interventions for health providers that aim to promote patient-centred care (PCC) in clinical consultations (
<xref rid="b6" ref-type="bibr">Dwamena 2012</xref>
). The review included 45 studies of training related to a variety of PCC skills (e.g. disease-specific training for providers and patients). Compared to no intervention, there was moderate-certainty evidence that patient-centred training probably improves patient health status (e.g. clinical outcomes), and there was low-certainty evidence that it may improve the patient-provider consultation process (e.g. the communication of treatment options) and may slightly improve patient satisfaction with the consultation and patient behaviour (e.g. attendance at follow-up consultation).</p>
</sec>
<sec>
<title>Handwashing</title>
<p>A review of interventions to improve hand hygiene adherence in patient care and reduce healthcare-associated infections identified four hospital-based studies (
<xref rid="b11" ref-type="bibr">Gould 2010</xref>
). This review found that compared to usual care, educational interventions may increase hand hygiene compliance (low-certainty evidence). Compared to usual care, multifaceted marketing campaigns may increase the use of hand hygiene products (low-certainty evidence), but the effects on healthcare-associated infections are uncertain (very low-certainty evidence).</p>
</sec>
<sec>
<title>Obstetric care</title>
<p>Four reviews examined strategies for improving obstetric care in pregnant women. The first review assessed the effects of non-clinical interventions for reducing unnecessary caesarean section rates, based on 16 studies in community and hospital settings (
<xref rid="b18" ref-type="bibr">Khunpradit 2011</xref>
). Compared to standard prenatal care, the following non-clinical interventions may decrease caesarean section rates: nurse-led relaxation, birth preparation classes for mothers, implementation of guidelines with mandatory second opinion and with support from local opinion leaders, and audit and feedback given to individual care providers (low-certainty evidence). Prenatal education and support programmes, computerised patient decision aids, decision-aid booklets and intensive group therapy may have little or no overall effect on caesarean section rates (low-certainty evidence).</p>
<p>The second review included studies of training traditional birth attendants (TBAs) and included six studies from rural communities (
<xref rid="b33" ref-type="bibr">Sibley 2012</xref>
). The review found that the training of untrained TBAs may reduce neonatal deaths and stillbirths, pregnancy-related haemorrhage, and puerperal sepsis, and increase referral of pregnant women with obstetric complications (low-certainty evidence). However, such training may increase the number of pregnant women with obstructed labour (low-certainty evidence). The effect of providing training to untrained TBAs on maternal mortality was uncertain (very low-certainty evidence). Also, the effect of providing additional training (on newborn resuscitation and breastfeeding) to TBAs who already have some formal training on maternal mortality, morbidity, stillbirths, neonatal deaths, exclusive breastfeeding, and advice about immediate feeding of colostrum was uncertain (very low-certainty evidence).</p>
<p>The third review (21 studies) assessed the effects of skilled birth attendance and emergency obstetric care on stillbirths and perinatal mortality (
<xref rid="b39" ref-type="bibr">Yakoob 2011</xref>
). Participants in the studies included 'village midwives', professional midwives, and trained traditional birth attendants. Compared to usual care, skilled birth attendance may reduce stillbirths and perinatal mortality (low-certainty evidence). The effect of alternative ways of providing emergency care on stillbirths was uncertain (very low-certainty evidence).</p>
<p>The fourth review included nine studies and assessed the effects of birth kits on newborn and maternal outcomes (
<xref rid="b14" ref-type="bibr">Hundley 2012</xref>
). A birth kit was defined as any disposable kit intended for routine use in the intrapartum period, specifically at the delivery of the baby. Compared with no intervention, the use of birth kits (alongside with education or topical antimicrobial): reduces puerperal sepsis and neonatal tetanus-related mortality (high-certainty evidence), probably reduces maternal mortality, haemorrhage and neonatal mortality (moderate-certainty evidence), and may reduce neonatal sepsis (low-certainty evidence).</p>
</sec>
<sec>
<title>Prescribing antibiotics</title>
<p>One review assessed the effects of interventions to improve antibiotic prescribing in ambulatory settings. The review focused on the effectiveness of strategies to reduce antibiotic prescribing for acute outpatient illnesses for which antibiotics are often prescribed inappropriately, and included 43 studies (
<xref rid="b31" ref-type="bibr">Ranji 2008</xref>
). Most of the studies in the review focused on prescribing for acute respiratory tract infections. Interventions assessed included: clinician education (distribution of materials, educational meetings, educational outreach, educational workshops with or without guideline distribution); patient education (written educational materials, educational meetings); and clinician education plus other interventions (e.g. audit and feedback, patient education). Strategies such as clinician education and patient education alone or combined with audit and feedback probably reduce antibiotic prescribing in ambulatory care settings (moderate-certainty evidence). The effects of the interventions on the proportion of patients treated with appropriate antibiotics and on clinical outcomes were not reported.</p>
</sec>
<sec>
<title>Seriously ill newborn care</title>
<p>A review of the effects of in-service training of health professionals on emergency care of seriously ill newborns and children identified two hospital-based studies (
<xref rid="b25" ref-type="bibr">Opiyo 2015</xref>
). In-service neonatal emergency care training probably improves provider practices (i.e. increases adequate resuscitation and preparedness for resuscitation, probably decreases the frequency of inappropriate and potentially harmful resuscitation practices) (moderate-certainty evidence) and may reduce mortality in newborns requiring resuscitation (low-certainty evidence).</p>
</sec>
<sec>
<title>Quality of care for sexually transmitted diseases and HIV</title>
<p>One review examined the effectiveness of interventions for educating traditional healers about sexually transmitted diseases (STDs) and HIV and identified two studies (
<xref rid="b36" ref-type="bibr">Sorsdahl 2009</xref>
). The studies assessed the impact of short training courses on STDs, HIV and other related health issues (e.g. family planning). Training of traditional healers may increase their knowledge of STDs and HIV (signs and symptoms, prevention), patient management practices, and referral practice (low- to moderate-certainty evidence). Training may lead to little or no difference in the incidence of HIV/AIDS risk behaviour and traditional healers' self-reported referral practices (low-certainty evidence).</p>
</sec>
</sec>
<sec>
<title>Strategies targeted at healthcare recipients</title>
<sec>
<title>Providing information or education</title>
<p>Four reviews examined the effects of providing information or education on health issues to healthcare recipients. None of the studies included in these reviews was from a low-income country.</p>
<p>The first review assessed the effect of mass media interventions for promoting HIV testing and included 14 studies in diverse populations (
<xref rid="b38" ref-type="bibr">Vidanapathirana 2005</xref>
). Despite substantial heterogeneity in the populations studied, media used, duration and frequency of interventions, and study designs, each study showed that mass media increased initial uptake of HIV testing (high-certainty evidence). However, the initial increase in uptake of HIV tests may not be sustained in the long-term (low-certainty evidence). Mass media interventions may lead to an increase in the number of infected people diagnosed through voluntary counselling and testing.</p>
<p>The second review (25 studies) addressed the effects of written information about prescribed and over-the-counter medicines (
<xref rid="b23" ref-type="bibr">Nicolson 2009</xref>
). Written medicine information may lead to little or no difference in adherence to instructions compared with no written information (low-certainty evidence). None of the included studies assessed health outcomes.</p>
<p>The third review (128 studies) focused on the effects of health literacy interventions (e.g. simplifying the presentation of information) (
<xref rid="b4" ref-type="bibr">Berkman 2011</xref>
). Some mixed strategies such as intensive self-management and adherence interventions probably improve the use of healthcare across health literacy levels (moderate-certainty evidence). It is uncertain whether single strategies improve the use of healthcare services, health outcomes, resource use, or disparities in the use of healthcare services (very low-certainty evidence).</p>
<p>The fourth review (11 studies) assessed the effect of additional pharmacist-provided services targeted at patients versus usual care (
<xref rid="b28" ref-type="bibr">Pande 2013</xref>
). The intervention comprised patient education, counselling, complete pharmaceutical care follow-up, and bespoke educational booklets explaining disease, medication and lifestyle modifications. The findings showed that pharmacist-provided services targeted at patients may reduce the use of specific health services (e.g. hospital admissions, general practitioner visits), reduce patients' medication costs, and improve some clinical outcomes (low-certainty evidence).</p>
</sec>
<sec>
<title>Medication adherence</title>
<p>One review examined the effects of interventions to improve patient adherence to medication (
<xref rid="b12" ref-type="bibr">Haynes 2008</xref>
). The review identified 78 studies conducted in many different settings, most of which were in high-income countries. Nine studies evaluated 10 different interventions to increase short-term adherence in very diverse conditions. The interventions evaluated were: the provision of more detailed instructions to patients (4 studies), the use of dose-dispensing units of medication (1 study), counselling about the target disease of the patients (3 studies), the use of different medication formulations (1 study) and augmented pharmacy services (1 study). It is uncertain whether interventions to increase adherence to short-term treatments improve adherence or patient outcomes (very low-certainty evidence).</p>
<p>Seventy-one studies evaluated 81 different interventions to increase adherence in diverse chronic conditions, including: asthma and chronic obstructive pulmonary disease (12 studies), hypertension (12 studies), diabetes (6 studies), HIV (12 studies), rheumatoid arthritis (2 studies), dyslipidemia (5 studies), mental health conditions (14 studies), epilepsy (1 study), heart failure (1 study) and ischaemic heart disease (1 study). Some studies focused on specific medications, such as oral anticoagulant therapy (1 study) and contraception (1 study). Two studies evaluated interventions to increase adherence to complex regimens in the elderly. Interventions aimed at increasing adherence to long-term treatments may improve the adherence to medications (low-certainty evidence), but it is uncertain whether interventions to increase adherence to long-term treatments improve patient outcomes (very low-certainty evidence).</p>
<p>The update of this review, which identified 109 additional studies, reported similar effects on adherence (
<xref rid="b113" ref-type="bibr">Nieuwlaat 2014</xref>
). However, it was not possible to prepare 'Summary of findings' tables for the update of
<xref rid="b12" ref-type="bibr">Haynes 2008</xref>
. The update found five randomised trials from the previous review to be ineligible and excluded them. Notably, review authors found 17 of the 182 trials to be at 'low risk of bias', and "generally involved complex interventions with multiple components, trying to overcome barriers to adherence by means of tailored ongoing support from allied health professionals such as pharmacists, who often delivered intense education, counselling (including motivational interviewing or cognitive behavioral therapy by professionals) or daily treatment support (or both), and sometimes additional support from family or peers. Only five of these trials reported improvements in both adherence and clinical outcomes, and no common intervention characteristics were apparent. Even the most effective interventions did not lead to large improvements in adherence or clinical outcomes". We did not assess the certainty of evidence for these outcomes as this would not have been reliable given the synthesis approach used in the updated review.</p>
</sec>
<sec>
<title>Adherence to antiretroviral therapy</title>
<p>Three reviews addressed strategies for improving adherence to antiretroviral therapy (ART) in patients with HIV/AIDs.</p>
<p>
<xref rid="b34" ref-type="bibr">Simoni 2006</xref>
and
<xref rid="b35" ref-type="bibr">Simoni 2010</xref>
examined the effects of patient support strategies and education for improving ART adherence.
<xref rid="b34" ref-type="bibr">Simoni 2006</xref>
included 19 studies of the effects of a range of behavioural interventions (didactic information on ART, interactive discussions addressing cognitions, motivations, and expectations, cue dosing or cognitive-behaviour therapy, reminders such as pagers).
<xref rid="b35" ref-type="bibr">Simoni 2010</xref>
identified 10 additional studies. These reviews found that behavioural interventions probably lead to slightly better adherence to highly active antiretroviral therapy (HAART) (moderate-certainty evidence), and they may slightly improve the number of patients with undetectable viral load (a laboratory measure of successful HAART) (low-certainty evidence). Authors identified no studies measuring patient outcomes such as morbidity and mortality, and only one included study took place in a low-income country.</p>
<p>
<xref rid="b22" ref-type="bibr">Mbuagbaw 2013</xref>
focused on mobile text messaging for promoting adherence to ART. The review included three randomised trials. It found that mobile phone text messages compared to standard care improve adherence to ART for up to 12 months (high-certainty evidence) but may lead to little or no difference in mortality or loss to follow-up after up to 12 months (low-certainty evidence). Weekly text messages probably improve adherence compared to daily text messages, and interactive text messages probably improve adherence compared to non-interactive text messages (moderate-certainty evidence).</p>
</sec>
<sec>
<title>Adherence to malaria treatment</title>
<p>A review of the effects of unit-dose packaged treatment on treatment failure and treatment adherence in people with uncomplicated malaria identified five studies (
<xref rid="b26" ref-type="bibr">Orton 2005</xref>
). Use of blister packs, compared to tablets and capsules in paper envelopes, may improve adherence to treatment for malaria and may lead to slightly fewer treatment failures (low-certainty evidence). No studies reported adverse effects. Use of sectioned polythene bags, compared to bottled syrup, may improve adherence to treatment in children under 5 years with malaria but may increase vomiting (low-certainty evidence). It is uncertain whether there is a difference in clinical outcomes (very low-certainty evidence). Compared to paper envelopes, use of sectioned polythene bags probably improves adherence to treatment (moderate-certainty evidence), may slightly decrease treatment failures in children aged over seven years and adults with malaria (low-certainty evidence), and may lead to little if any difference in adverse events (low-certainty evidence). It is uncertain whether the use of sectioned polythene bags, compared with unsectioned bags, impacts on treatment adherence or patient outcomes (very low-certainty evidence), or on adverse events (not reported).</p>
</sec>
<sec>
<title>Adherence to anti-tuberculosis therapy</title>
<p>Two reviews examined strategies for improving adherence to drugs to prevent or cure tuberculosis (TB).</p>
<p>The first review included 11 studies and assessed the effects of material incentives given to patients undergoing diagnostic testing for TB or receiving drug therapy to prevent or cure TB (
<xref rid="b21" ref-type="bibr">Lutge 2015</xref>
). Most of the studies took place in high-income countries. Compared to routine care, cash-and non-cash incentives probably increase health service utilisation (return visits for tuberculin skin test reading, start or continuation of treatment) (low- to moderate-certainty evidence). They may not improve completion of TB prophylaxis (low-certainty evidence), and it is uncertain if they improve completion of treatment for active TB (very low-certainty evidence). Cash incentives may slightly improve patient return for tuberculin skin test reading and completion of TB prophylaxis compared to non-cash incentives (low-certainty evidence). Immediate (compared to deferred) incentives may not improve adherence to anti-tuberculosis treatment (low-certainty evidence).</p>
<p>The second review assessed the effects of reminder systems aimed at reminding patients to take their TB medication or attend appointments (pre-appointment reminders) or to contact patients who have missed an appointment with default reminders (
<xref rid="b20" ref-type="bibr">Liu 2014</xref>
). The review included six trials of pre-appointment reminders and three trials of default reminders. Five studies took place in the USA, two in India and one each in Spain and Irak. For patients being treated for active TB, pre-appointment reminders may increase clinic attendance and the number of patients completing treatment (low-certainty evidence), and default reminders probably increase the number of patients completing treatment (moderate-certainty evidence) and may increase clinic attendance (low-certainty evidence). For people on TB prophylaxis, pre-appointment reminders may increase clinic attendance (low-certainty evidence). For people undergoing screening for TB, pre-appointment reminders may have little or no effect on the number of people who return to clinic for the result of their skin test (low-certainty evidence).</p>
</sec>
<sec>
<title>Insecticide-treated bednets for malaria</title>
<p>A review of the effects of strategies to increase ownership and use of insecticide-treated bednets (ITNs) to prevent malaria identified 10 studies (
<xref rid="b1" ref-type="bibr">Augustincic Polec 2015</xref>
). Providing free ITNs, compared to subsidised ITNs, probably increases ITN ownership among households and women attending prenatal clinics (moderate certainty evidence). Providing free ITNs also probably results in increased ITN ownership compared to households paying full price or receiving a loan (moderate certainty evidence). The review also found that providing education on the proper use of ITNs may increase the number of people and children under five years sleeping under bednets (low-certainty evidence).</p>
</sec>
<sec>
<title>Immunisation coverage</title>
<p>One review of intervention strategies to improve immunisation coverage identified six studies (
<xref rid="b27" ref-type="bibr">Oyo-Ita 2016</xref>
). It found that health education (evidence-based discussions, distribution of posters and leaflets, information campaigns) compared to usual care, may increase the uptake of routine childhood vaccination (low- to moderate-certainty evidence). However, the authors noted that intervention costs should be carefully considered before implementation. Another review evaluated the effects of patient reminder and recall systems to improve immunisation coverage (
<xref rid="b16" ref-type="bibr">Jacobson Vann 2005</xref>
), finding that reminders and recall strategies probably increase routine childhood vaccination uptake (moderate-certainty evidence).</p>
</sec>
<sec>
<title>Access to healthcare services</title>
<p>One review of interventions to increase the uptake of cervical cancer screening identified 36 studies in diverse settings (community clinics, primary care, health maintenance organisations) (
<xref rid="b7" ref-type="bibr">Everett 2011</xref>
). Compared to usual care or no intervention, invitations to attend cervical screening programmes, education, counselling, access to health prevention nurses, and intensive recruitment probably increase uptake of cervical cancer screening (moderate-certainty evidence). Risk factor assessments, photo-comic books, and message framing may lead to little or no difference on the uptake of screening (low- to moderate-certainty evidence).</p>
<p>A second review assessed the effects of outreach strategies to increase health insurance coverage for vulnerable populations (
<xref rid="b17" ref-type="bibr">Jia 2014</xref>
). The review included one study that compared handing out application forms in the emergency department of hospitals to routine care. The findings showed that handing out application forms in the hospital emergency department probably increases the enrolment of children in health insurance schemes (moderate-certainty evidence). The other study assessed the effects of health insurance information and application support compared with routine care. It found that health insurance information and application support probably increases the enrolment of children in health insurance schemes, leads to continuous enrolment of children in insurance schemes, decreases the mean time taken to obtain insurance for children, and leads to parental satisfaction with the process of enrolment (moderate-certainty evidence).</p>
</sec>
</sec>
</sec>
</sec>
<sec>
<title>Discussion</title>
<sec>
<title>Summary of main results</title>
<p>The available evidence from 39 systematic reviews of implementation strategies relevant to health systems in low-income countries covers a range of strategies (targeted at health professionals, patients, and organisations) in diverse settings (geographical and clinical environments), disease conditions, and populations (of both health professionals and patients). The estimates of effects and certainty of the estimates for the different strategies varied.
<xref ref-type="table" rid="tbl8">Table 8</xref>
provides a summary of the main findings, organised into the following categories.</p>
<p>
<list list-type="bullet">
<list-item>
<p>Interventions found to have desirable effects on at least one outcome with moderate- or high-certainty evidence and no moderate- or high-certainty evidence of undesirable effects.</p>
</list-item>
<list-item>
<p>Interventions found to have at least one outcome with little or no effect with moderate- or high-certainty evidence and no moderate- or high-certainty evidence of desirable or undesirable effects.</p>
</list-item>
<list-item>
<p>Interventions for which the certainty of the evidence was low or very low (or no studies were found) for all outcomes examined.</p>
</list-item>
</list>
</p>
</sec>
<sec>
<title>Overall completeness and applicability of evidence</title>
<p>There was extensive evidence for the effects of strategies targeting healthcare workers and healthcare recipients. However, we identified only one systematic review on strategies targeting healthcare organisations (
<xref rid="b29" ref-type="bibr">Parmelli 2011</xref>
), and that review did not find any eligible studies. Evidence of the effects of some interventions is not included in this overview because we did not find an eligible systematic review, even though there may be primary studies evaluating those interventions.
<xref ref-type="table" rid="tbl7">Table 7</xref>
summarises the outcomes examined in the individual reviews. Few studies in the reviews considered equity outcomes (differential effects of interventions for disadvantaged populations, such as pregnant women, children aged under five, rural poor) (
<xref rid="b1" ref-type="bibr">Augustincic Polec 2015</xref>
;
<xref rid="b4" ref-type="bibr">Berkman 2011</xref>
;
<xref rid="b19" ref-type="bibr">Ko 2011</xref>
;
<xref rid="b9" ref-type="bibr">Forsetlund 2009</xref>
;
<xref rid="b27" ref-type="bibr">Oyo-Ita 2016</xref>
). Similarly, few of the reviews included studies that examined the costs and cost-effectiveness of interventions (
<xref rid="b1" ref-type="bibr">Augustincic Polec 2015</xref>
;
<xref rid="b15" ref-type="bibr">Ivers 2012</xref>
;
<xref rid="b27" ref-type="bibr">Oyo-Ita 2016</xref>
;
<xref rid="b24" ref-type="bibr">O'Brien 2007</xref>
;
<xref rid="b28" ref-type="bibr">Pande 2013</xref>
). The sparse economic and equity data (in comparison to effectiveness data) limit assessment of the efficiency of the interventions that we examined.</p>
<p>We assessed the applicability of summarised evidence in the 'relevance' section of the
<ext-link ext-link-type="uri" xlink:href="http://www.supportsummaries.org/">SUPPORT Summaries</ext-link>
, incorporating these judgments into our assessments of the certainty of the evidence. In general, it was difficult to draw generalisable conclusions regarding the applicability of findings to low-income countries given that in most of the cases the evidence came from studies conducted in high-income countries (USA, UK, Canada, Netherlands, Australia) with very different on-the-ground realities and important differences in health system arrangements compared to low-income countries. This was particularly so for interventions that require substantial resources, advanced technology or specialised skills for their delivery (e.g. Internet-based learning (
<xref rid="b5" ref-type="bibr">Cook 2008</xref>
), mass media interventions (
<xref rid="b38" ref-type="bibr">Vidanapathirana 2005</xref>
), health literacy interventions (
<xref rid="b4" ref-type="bibr">Berkman 2011</xref>
), and educational outreach visits (
<xref rid="b24" ref-type="bibr">O'Brien 2007</xref>
;
<xref rid="b28" ref-type="bibr">Pande 2013</xref>
)), and for interventions that are complex and require substantial changes in the organisation of care.</p>
<p>However, there are a limited number of interventions in the included reviews where most of the evidence is from low- and middle-income countries and are likely to be applicable to low-income countries. This may be the case for free insecticide-treated bednets for malaria prevention (
<xref rid="b1" ref-type="bibr">Augustincic Polec 2015</xref>
), skilled birth attendance (
<xref rid="b39" ref-type="bibr">Yakoob 2011</xref>
), mobile phone messaging to improve adherence to ART (
<xref rid="b22" ref-type="bibr">Mbuagbaw 2013</xref>
), anti-malarial drugs packed in unit doses (
<xref rid="b26" ref-type="bibr">Orton 2005</xref>
), and hand-hygiene interventions (
<xref rid="b11" ref-type="bibr">Gould 2010</xref>
).</p>
<sec>
<title>Certainty of the evidence</title>
<p>Some of the included reviews had specific methodological limitations related to the identification, selection and critical appraisal of the included studies, and the analysis of the available evidence. However, the included reviews were for the most part well conducted (
<xref ref-type="table" rid="tbl5">Table 5</xref>
). The certainty of the effect estimates for the different strategies varied, ranging from very low, for example for the effect of single interventions to improve health literacy, to high, indicating that the research provides a very good indication of the likely effect (for example, for educational outreach interventions to improve prescribing by health professionals) (
<xref ref-type="table" rid="tbl7">Table 7</xref>
).</p>
</sec>
</sec>
<sec>
<title>Potential biases in the overview process</title>
<p>Although the searches used for PDQ-Evidence are relatively comprehensive, it is possible that we did not identify some relevant reviews. We also excluded reviews that were published prior to April 2005. It is possible that some of those reviews provide information that is still useful and that might supplement information provided by the included reviews. Although this cut-off was arbitrary, it is unlikely that we excluded a substantial amount of useful information. Fourteen of the included reviews were published before 2010, and it is possible that more recent research would change their conclusions.</p>
<p>Classifying the interventions in the included reviews was sometimes uncertain and required judgment. In particular, the distinction between 'delivery arrangements' (covered in
<xref rid="b82" ref-type="bibr">Ciapponi 2014</xref>
) and 'implementation strategies' was not always clear. Likewise, classifying interventions in reviews that addressed a problem (such as improving referrals from primary to secondary care) rather than a category of interventions (such as audit and feedback) was not always straightforward. There also are other ways of categorising implementation strategies (
<xref rid="b88" ref-type="bibr">French 2012</xref>
;
<xref rid="b109" ref-type="bibr">Michie 2011</xref>
). Although these judgments and differences in approaches to characterising implementation interventions are unlikely to have introduced bias into this overview, they might result in some confusion, since there is no universally agreed upon classification system for implementation interventions. Moreover, any system for categorising health system interventions is, to some extent, arbitrary. A unified taxonomy for classifying health system interventions – such as the one recently published by
<xref rid="b102" ref-type="bibr">Lavis 2015</xref>
– could facilitate explicit and systematic synthesis and interpretation of the existing body of evidence on health systems interventions.</p>
<p>Judgments about the relevance of some interventions to low-income countries were sometimes difficult to make, as were judgments about the applicability of some of the findings of the included reviews (
<xref rid="b101" ref-type="bibr">Lavis 2009</xref>
). While these judgments might have been biased, this seems unlikely. At least two of the authors of this overview assessed the eligibility of systematic reviews for inclusion, and judgments about the applicability of the findings of included reviews were made by the authors of each SUPPORT Summary, externally peer reviewed, and then reviewed by at least two authors of this overview. Our general approach has been inclusive rather than exclusive so that readers can assess for themselves the relevance of the included reviews. Similarly, our approach has been to assume that findings are applicable to low-income countries, unless there are relevant explicit differences between the settings where the studies took place and settings in low-income countries, or specific factors that would likely modify the effects in low-income countries.</p>
<p>An important limitation of our overview is that it depends on the findings of systematic reviews that have not used consistent methods. Although there are potential advantages of a broad review that would include all relevant implementation strategies (e.g.
<xref rid="b46" ref-type="bibr">Grimshaw 2004</xref>
;
<xref rid="b123" ref-type="bibr">Rowe 2015</xref>
), such broad reviews require a substantial investment of time and resources, are difficult to keep up-to-date, and risk duplicating efforts when there are many reliable reviews that are more focused. An optimal approach that might be possible in the future would be to have a number of focused reviews using standard methods, such as EPOC reviews, together with an overview of those reviews.</p>
</sec>
<sec>
<title>Agreements and disagreements with other studies or reviews</title>
<p>We identified 10 related overviews of reviews published in the last 10 years (
<xref rid="b73" ref-type="bibr">Althabe 2008</xref>
;
<xref rid="b77" ref-type="bibr">Bloom 2005</xref>
;
<xref rid="b78" ref-type="bibr">Boaz 2011</xref>
;
<xref rid="b80" ref-type="bibr">Chan 2017</xref>
;
<xref rid="b81" ref-type="bibr">Cheung 2012</xref>
;
<xref rid="b98" ref-type="bibr">Hall 2015</xref>
;
<xref rid="b103" ref-type="bibr">Lewin 2008</xref>
;
<xref rid="b110" ref-type="bibr">Mostofian 2015</xref>
;
<xref rid="b128" ref-type="bibr">Squires 2014</xref>
;
<xref rid="b132" ref-type="bibr">Wensing 2006</xref>
). These overviews addressed a range of implementation strategies, disease conditions and behaviours in diverse settings and populations. Similarly to our overview, most of the studies included in those overviews were from high-income countries, and data on patient outcomes, equity, costs and cost-effectiveness were scarce. We describe the findings of the seven overviews below.</p>
<p>
<xref rid="b77" ref-type="bibr">Bloom 2005</xref>
included 26 reviews and assessed the effectiveness of continuing medical education (CME) tools and techniques for changing physician clinical practices and improving patient health outcomes. The findings showed that interactive techniques (audit/feedback, academic detailing/outreach and reminders) were most effective for simultaneously changing physician care and patient outcomes. Clinical practice guidelines and opinion leaders were found to be less effective. Didactic presentations and distribution of printed information had little or no beneficial effect for changing physician practice. These findings mostly agree with ours regarding the effects of strategies targeted at healthcare workers by type of intervention (with the exception of the possible effects of printed materials found in our overview).</p>
<p>
<xref rid="b132" ref-type="bibr">Wensing 2006</xref>
included 36 reviews and assessed organisational strategies (defined as planned re-arrangements of one or more aspects of the organisation of patient care) to implement improvements in patient care. The findings showed that revision of professional roles and computer systems for knowledge management generally improved professional performance. Multidisciplinary teams, integrated care services and computer systems generally improved patient outcomes. Integrated care services led to cost savings. The benefits of quality management remained uncertain. Most of these findings agree with those from our overview.</p>
<p>
<xref rid="b103" ref-type="bibr">Lewin 2008</xref>
examined the effectiveness of health systems arrangements and implementation strategies (with a particular focus on evidence relevant to primary healthcare). Five included reviews assessed strategies to change professional behaviours or performance. The strategies assessed were guideline dissemination, audit and feedback, educational outreach visits, and educational meetings. These interventions resulted in small to moderate (but important) improvements in professional performance and health outcomes. These findings are mostly similar to those reported in our overview as our findings are based on the same or more recent versions of the same systematic reviews (
<xref rid="b2" ref-type="bibr">Baker 2015</xref>
;
<xref rid="b9" ref-type="bibr">Forsetlund 2009</xref>
;
<xref rid="b15" ref-type="bibr">Ivers 2012</xref>
;
<xref rid="b24" ref-type="bibr">O'Brien 2007</xref>
). The only difference was our exclusion of the review on guideline dissemination strategies because it was published more than 10 years ago (
<xref rid="b46" ref-type="bibr">Grimshaw 2004</xref>
).</p>
<p>
<xref rid="b73" ref-type="bibr">Althabe 2008</xref>
identified 23 reviews and assessed strategies for improving the quality of healthcare in maternal and child health in low- and middle-income countries. Seventeen of the reviews focused on continuing education and quality improvement, two addressed financial and reimbursement strategies, and four examined organisation of care strategies. Some of these reviews were included in this overview. The overview found that interactive workshops, reminders, multifaceted interventions, audit and feedback, and mass media interventions had small to moderate positive effects on professional practice. Educational outreach visits improved prescribing but had variable effects on other behaviours. Multifaceted interventions were not more effective than single interventions. There was little evidence on the use of financial, regulatory or organisational interventions. Although these authors used a slightly different classification to the one used in this overview, the findings were relatively similar, with only minor changes related to updated versions of some reviews.</p>
<p>
<xref rid="b78" ref-type="bibr">Boaz 2011</xref>
assessed the effectiveness of interventions to increase the use of research in clinical practice. It identified 13 reviews containing 313 primary studies. The overview found that multifaceted interventions are more likely to improve practice (small to moderate effects) than single interventions (audit and feedback, computerised decision support, opinion leaders) (small effects). These findings disagree with what we found (see results for multifaceted interventions) and with another recent overview that did not find evidence supporting the effectiveness of multifaceted interventions over single interventions (
<xref rid="b128" ref-type="bibr">Squires 2014</xref>
). Disagreements in the conclusions of these overviews could be due to differences in the evidence base examined, that is, differences in the reliability of included reviews and the included interventions.</p>
<p>
<xref rid="b81" ref-type="bibr">Cheung 2012</xref>
assessed the effectiveness of reminders in changing professional behaviour in clinical settings. It included 35 systematic reviews and found that moderate improvements in provider behaviour can occur with the use of reminders. Most of these reviews assessed computerised reminders, which were excluded from our overview because we considered them not to be highly relevant to low-income country settings.</p>
<p>
<xref rid="b128" ref-type="bibr">Squires 2014</xref>
evaluated the effectiveness of multifaceted interventions versus single-component interventions in changing healthcare professionals' behaviour in clinical settings. Twenty-five reviews were included: five reviews found no evidence of a relationship between the number of intervention components and the effect size. Eight reviews reported direct (non-statistical) comparisons of multifaceted to single-component interventions. Multifaceted interventions were found to be effective in four reviews, and the remaining four reviews found that multifaceted interventions had either mixed effects or were generally ineffective compared to single interventions. Twenty-three reviews indirectly compared the effectiveness of multifaceted to single interventions, and most (15 reviews) showed similar effectiveness for multifaceted and single interventions when compared to controls. Of the remaining eight reviews, six found single interventions to be generally effective while multifaceted interventions had mixed effectiveness. The authors concluded that the overview provides no evidence that multifaceted interventions are more effective than single-component interventions. As noted above, these findings agree with what we found in our overview for at least three strategies targeted at healthcare workers (audit and feedback, educational meetings, and outreach visits).</p>
<p>
<xref rid="b110" ref-type="bibr">Mostofian 2015</xref>
assessed the effectiveness of interventions aimed at changing physician practice patterns through the implementation of clinical research findings and clinical guidelines in surgical settings and general practice. They identified 14 reviews covering a wide range of interventions: audit and feedback, computerised decision support systems, continuing medical education, financial incentives, local opinion leaders, marketing, passive dissemination of information, patient-mediated interventions, reminders, and multifaceted interventions. Active approaches, such as academic detailing, led to greater effects than traditional passive approaches, such as distribution of educational materials. These findings mostly agree with our results about the effects of strategies targeted at healthcare workers by type of intervention (with the exception of the possible effects of printed materials found in our overview) and are in agreement with the findings of
<xref rid="b77" ref-type="bibr">Bloom 2005</xref>
. The differences regarding 'passive approaches' could be related to the methods used to analyse the results, which were based to some extent on vote counting and on descriptions by the authors of the reviews (
<xref rid="b110" ref-type="bibr">Mostofian 2015</xref>
).</p>
<p>
<xref rid="b98" ref-type="bibr">Hall 2015</xref>
evaluated the effectiveness of text-messaging interventions (TMI) on health outcomes and behaviour change in community settings. They identified 15 reviews including 228 studies with diverse study designs (randomised trials, quasi-experimental designs and observational studies) and assessing interventions for a variety of health-behaviour topics related to health promotion, disease prevention and chronic disease self-management. Six of the included reviews conducted or included meta-analyses. According to the authors almost all of the 15 reviews, extremely diverse intervention characteristics showed positive effects on diverse health behaviours. Likewise, all of the meta-analyses assessed concluded that TMIs had a statistically significant positive effect on health outcomes or health behaviours. These findings are in agreement with ours regarding TMI for adherence to antiretroviral therapy and anti-tuberculosis treatments (
<xref rid="b20" ref-type="bibr">Liu 2014</xref>
;
<xref rid="b22" ref-type="bibr">Mbuagbaw 2013</xref>
). However, readers should interpret the findings of the overview by Hall and colleagues cautiously because the included studies were at high risk of bias and had small sample sizes and short intervention durations.</p>
<p>
<xref rid="b80" ref-type="bibr">Chan 2017</xref>
assessed the effectiveness of strategies to enhance the adoption and implementation of clinical practice guidelines focusing on four interventions: reminders, educational outreach visits, audit and feedback, and provider incentives. They included 55 studies, 39 systematic reviews, and 16 overviews of reviews. Using vote counting, the authors found that audit and feedback and educational outreach visits were generally effective in improving both process of care and clinical outcomes; provider incentives showed mixed effectiveness for improving both processes of care and clinical outcomes; and reminders showed mixed effectiveness for improving process of care outcomes and were generally ineffective for clinical outcomes. Despite differences in the analytical approaches, those findings are similar to what we found in our overview regarding the effectiveness of audit and feedback and educational outreach visits (
<xref rid="b15" ref-type="bibr">Ivers 2012</xref>
;
<xref rid="b24" ref-type="bibr">O'Brien 2007</xref>
). On the other hand, our findings regarding the effects of reminders on patient outcomes are more positive (
<xref rid="b19" ref-type="bibr">Ko 2011</xref>
), possibly due to differences in the settings where reminders were evaluated.</p>
</sec>
</sec>
<sec>
<title>Authors' conclusions</title>
<p>Investigators have evaluated a wide range of strategies for implementing evidence-based interventions in low-income countries using sound systematic review methods. These strategies have been targeted at different levels in the health systems and have addressed a range of outcomes. Most of the available evidence is focused on strategies targeted at healthcare workers and recipients, and assessment of process of care outcomes. Strategies targeting healthcare organisations are scarce. Limitations of the available evidence include wide variations in settings, targeted behaviours, estimates of effects, and certainty of the evidence for the implementation strategies examined.</p>
<sec>
<title>Implications for practice</title>
<p>We found moderate- or high-certainty evidence that a number of interventions had desirable effects on at least one outcome, with no moderate- or high-certainty evidence of undesirable effects (
<xref ref-type="table" rid="tbl8">Table 8</xref>
). On the other hand, the certainty of the evidence was low or very low (or no studies were found) for all outcomes examined for a number of interventions. These findings may help to distinguish interventions for which there is clear evidence of impact on at least one outcome from interventions for which there is important uncertainty about their potential effects. Additionally we identified a "middle ground" with interventions that showed little or no effect for at least one outcome with moderate or high-certainty evidence and no moderate- or high-certainty evidence of other desirable or undesirable effects. This implies that those interventions could not have a relevant impact on the outcomes assessed and they should not be considered a priority for implementation.</p>
<sec>
<title>Implications for research</title>
<p>Based on the included reviews, we have identified gaps in primary research because of uncertainty about the applicability of the evidence to low-income countries (
<xref ref-type="table" rid="tbl9">Table 9</xref>
), low-certainty evidence, or a lack of studies (
<xref ref-type="table" rid="tbl8">Table 8</xref>
). In 18 out of the 39 included reviews, all or most of the studies took place in high-income settings; and in 25 of the 39 reviews there was at least one comparison where the certainty about the effects was low or there were no studies to inform an estimate of the intervention's effects. Furthermore, the included reviews rarely evaluated social outcomes, resource use, impacts on equity, and adverse (undesirable or unintended) effects (
<xref ref-type="table" rid="tbl7">Table 7</xref>
). All of the included reviews found that primary research is needed for at least one of these four types of outcomes (
<xref ref-type="table" rid="tbl7">Table 7</xref>
). This highlights the need for conducting studies assessing specific comparisons (
<xref ref-type="table" rid="tbl9">Table 9</xref>
) in low-income settings and including all relevant outcomes.</p>
<p>We identified five topics for which we could not identify an up-to-date systematic review but did find a review in progress (
<xref ref-type="table" rid="tbl10">Table 10</xref>
). We also identified one topic for which we did not find a up-to-date systematic review or one in progress: strategies other than handwashing targeted at healthcare-associated infections.</p>
</sec>
</sec>
</sec>
</body>
<back>
<ack>
<p>We would like to thank the following editors and peer referees who provided comments to improve the overview: Sasha Shepperd (editor), Alex Rowe, Shaun Treweek, Michel Wensing and Meggan Harris for copy-editing the overview.</p>
<p>We would also like to acknowledge the following colleagues who helped to produce the SUPPORT Summaries upon which this overview is based: Peter Steinmann, Andrea Darzi, Nour Hemadi, Michael Gathu, Mercy Mulaku, Dimelza Osorio, Jesse Uneke, Signe Flottorp and Jimmy Volmink.</p>
<p>We would also like to thank Susan Munabi-Babigumira, Atle Fretheim, Simon Goudie and Hanna Bergman for editing some of the SUPPORT Summaries, as well as the review authors and others who have provided feedback on the SUPPORT Summaries.</p>
<p>Charles S Wiysonge's work is supported by the South African Medical Research Council and the National Research Foundation of South Africa (Grant Numbers: 106035 and 108571).</p>
<p>The Norwegian Satellite of the Effective Practice and Organisation of Care (EPOC) Group receives funding from the Norwegian Agency for Development Co-operation (Norad), via the Norwegian Institute of Public Health to support review authors in the production of their reviews.</p>
<p>This overview is a product of the Effective Health Care Research Consortium, which provided funding to make this overview open access. The Consortium is funded by UK aid from the UK Government for the benefit of developing countries (Grant: 5242). The views expressed in this overview do not necessarily reflect UK government policy.</p>
</ack>
<ref-list>
<title>References</title>
<ref id="b1">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Augustincic Polec</surname>
<given-names>L</given-names>
</name>
<name>
<surname>O'Neill</surname>
<given-names>J</given-names>
</name>
<name>
<surname>Welch</surname>
<given-names>V</given-names>
</name>
<name>
<surname>Ueffing</surname>
<given-names>E</given-names>
</name>
<name>
<surname>Tanjong Ghogomu</surname>
<given-names>E</given-names>
</name>
<name>
<surname>Pardo Pardo</surname>
<given-names>J</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Strategies to increase the ownership and use of insecticide-treated bednets to prevent malaria</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2015</year>
<issue>3</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD009186.pub2">10.1002/14651858.CD009186.pub2</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b2">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Baker</surname>
<given-names>R</given-names>
</name>
<name>
<surname>Camosso-Stefinovic</surname>
<given-names>J</given-names>
</name>
<name>
<surname>Gillies</surname>
<given-names>C</given-names>
</name>
<name>
<surname>Shaw</surname>
<given-names>EJ</given-names>
</name>
<name>
<surname>Cheater</surname>
<given-names>F</given-names>
</name>
<name>
<surname>Flottorp</surname>
<given-names>S</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Tailored interventions to address determinants of practice</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2015</year>
<issue>4</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD005470.pub3">10.1002/14651858.CD005470.pub3</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b3">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Baskerville</surname>
<given-names>NB</given-names>
</name>
<name>
<surname>Liddy</surname>
<given-names>C</given-names>
</name>
<name>
<surname>Hogg</surname>
<given-names>W</given-names>
</name>
</person-group>
<article-title>Systematic review and meta-analysis of practice facilitation within primary care settings</article-title>
<source>Annals of Family Medicine</source>
<year>2012</year>
<volume>10</volume>
<issue>1</issue>
<fpage>63</fpage>
<lpage>74</lpage>
<pub-id pub-id-type="pmid">22230833</pub-id>
</element-citation>
</ref>
<ref id="b4">
<element-citation publication-type="other">
<person-group person-group-type="author">
<name>
<surname>Berkman</surname>
<given-names>ND</given-names>
</name>
<name>
<surname>Sheridan</surname>
<given-names>SL</given-names>
</name>
<name>
<surname>Donahue</surname>
<given-names>KE</given-names>
</name>
<name>
<surname>Halpern</surname>
<given-names>DJ</given-names>
</name>
<name>
<surname>Viera</surname>
<given-names>A</given-names>
</name>
<name>
<surname>Crotty</surname>
<given-names>K</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Health literacy interventions and outcomes: an updated systematic review</article-title>
<comment>Rockville (MD): Agency for Healthcare Research and Quality (prepared by RTI International–University of North Carolina Evidence-based Practice Center under contract No. 290-2007-10056-I); 2011 March. AHRQ Publication Number 11- E006</comment>
</element-citation>
</ref>
<ref id="b5">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Cook</surname>
<given-names>DA</given-names>
</name>
<name>
<surname>Levinson</surname>
<given-names>AJ</given-names>
</name>
<name>
<surname>Garside</surname>
<given-names>S</given-names>
</name>
<name>
<surname>Dupras</surname>
<given-names>DM</given-names>
</name>
<name>
<surname>Erwin</surname>
<given-names>PJ</given-names>
</name>
<name>
<surname>Montori</surname>
<given-names>VM</given-names>
</name>
</person-group>
<article-title>Internet-based learning in the health professions: a meta-analysis</article-title>
<source>JAMA</source>
<year>2008</year>
<volume>300</volume>
<issue>10</issue>
<fpage>1181</fpage>
<lpage>96</lpage>
<pub-id pub-id-type="pmid">18780847</pub-id>
</element-citation>
</ref>
<ref id="b6">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Jorgenson</surname>
<given-names>S</given-names>
</name>
<name>
<surname>Sadigh</surname>
<given-names>G</given-names>
</name>
<name>
<surname>Sikorskii</surname>
<given-names>A</given-names>
</name>
<name>
<surname>Lewin</surname>
<given-names>S</given-names>
</name>
<name>
<surname>Smith</surname>
<given-names>RC</given-names>
</name>
<name>
<surname>Coffey</surname>
<given-names>J</given-names>
</name>
<name>
<surname>Olomu</surname>
<given-names>A</given-names>
</name>
</person-group>
<article-title>Interventions for providers to promote a patient-centred approach in clinical consultations</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2012</year>
<issue>12</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD003267.pub2">10.1002/14651858.CD003267.pub2</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b7">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Everett</surname>
<given-names>T</given-names>
</name>
<name>
<surname>Bryant</surname>
<given-names>A</given-names>
</name>
<name>
<surname>Griffin</surname>
<given-names>MF</given-names>
</name>
<name>
<surname>Martin-Hirsch</surname>
<given-names>PPL</given-names>
</name>
<name>
<surname>Forbes</surname>
<given-names>CA</given-names>
</name>
<name>
<surname>Jepson</surname>
<given-names>RG</given-names>
</name>
</person-group>
<article-title>Interventions targeted at women to encourage the uptake of cervical screening</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2011</year>
<issue>5</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD002834.pub2">10.1002/14651858.CD002834.pub2</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b8">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Flodgren</surname>
<given-names>G</given-names>
</name>
<name>
<surname>Parmelli</surname>
<given-names>E</given-names>
</name>
<name>
<surname>Doumit</surname>
<given-names>G</given-names>
</name>
<name>
<surname>Gattellari</surname>
<given-names>M</given-names>
</name>
<name>
<surname>O'Brien</surname>
<given-names>MA</given-names>
</name>
<name>
<surname>Grimshaw</surname>
<given-names>J</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Local opinion leaders: effects on professional practice and health care outcomes</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2011</year>
<issue>8</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD000125.pub4">10.1002/14651858.CD000125.pub4</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b9">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Forsetlund</surname>
<given-names>L</given-names>
</name>
<name>
<surname>Bjørndal</surname>
<given-names>A</given-names>
</name>
<name>
<surname>Rashidian</surname>
<given-names>A</given-names>
</name>
<name>
<surname>Jamtvedt</surname>
<given-names>G</given-names>
</name>
<name>
<surname>O'Brien</surname>
<given-names>MA</given-names>
</name>
<name>
<surname>Wolf</surname>
<given-names>F</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Continuing education meetings and workshops: effects on professional practice and health care outcomes</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2009</year>
<issue>2</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD003030.pub2">10.1002/14651858.CD003030.pub2</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b10">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Giguère</surname>
<given-names>A</given-names>
</name>
<name>
<surname>Légaré</surname>
<given-names>F</given-names>
</name>
<name>
<surname>Grimshaw</surname>
<given-names>J</given-names>
</name>
<name>
<surname>Turcotte</surname>
<given-names>S</given-names>
</name>
<name>
<surname>Fiander</surname>
<given-names>M</given-names>
</name>
<name>
<surname>Grudniewicz</surname>
<given-names>A</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Printed educational materials: effects on professional practice and healthcare outcomes</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2012</year>
<issue>10</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD004398.pub3">10.1002/14651858.CD004398.pub3</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b11">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Gould</surname>
<given-names>DJ</given-names>
</name>
<name>
<surname>Moralejo</surname>
<given-names>D</given-names>
</name>
<name>
<surname>Drey</surname>
<given-names>N</given-names>
</name>
<name>
<surname>Chudleigh</surname>
<given-names>JH</given-names>
</name>
</person-group>
<article-title>Interventions to improve hand hygiene compliance in patient care</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2010</year>
<issue>9</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD005186.pub3">10.1002/14651858.CD005186.pub3</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b12">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Haynes</surname>
<given-names>RB</given-names>
</name>
<name>
<surname>Ackloo</surname>
<given-names>E</given-names>
</name>
<name>
<surname>Sahota</surname>
<given-names>N</given-names>
</name>
<name>
<surname>McDonald</surname>
<given-names>HP</given-names>
</name>
<name>
<surname>Yao</surname>
<given-names>X</given-names>
</name>
</person-group>
<article-title>Interventions for enhancing medication adherence</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2008</year>
<issue>2</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD000011.pub3">10.1002/14651858.CD000011.pub3</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b13">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Horsley</surname>
<given-names>T</given-names>
</name>
<name>
<surname>Hyde</surname>
<given-names>C</given-names>
</name>
<name>
<surname>Santesso</surname>
<given-names>N</given-names>
</name>
<name>
<surname>Parkes</surname>
<given-names>J</given-names>
</name>
<name>
<surname>Milne</surname>
<given-names>R</given-names>
</name>
<name>
<surname>Stewart</surname>
<given-names>R</given-names>
</name>
</person-group>
<article-title>Teaching critical appraisal skills in healthcare settings</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2011</year>
<issue>11</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD001270.pub2">10.1002/14651858.CD001270.pub2</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b14">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Hundley</surname>
<given-names>VA</given-names>
</name>
<name>
<surname>Avan</surname>
<given-names>BI</given-names>
</name>
<name>
<surname>Braunholtz</surname>
<given-names>D</given-names>
</name>
<name>
<surname>Graham</surname>
<given-names>WJ</given-names>
</name>
</person-group>
<article-title>Are birth kits a good idea? A systematic review of the evidence</article-title>
<source>Midwifery</source>
<year>2012</year>
<volume>28</volume>
<issue>2</issue>
<fpage>204</fpage>
<lpage>15</lpage>
<pub-id pub-id-type="pmid">21561691</pub-id>
</element-citation>
</ref>
<ref id="b15">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Ivers</surname>
<given-names>N</given-names>
</name>
<name>
<surname>Jamtvedt</surname>
<given-names>G</given-names>
</name>
<name>
<surname>Flottorp</surname>
<given-names>S</given-names>
</name>
<name>
<surname>Young</surname>
<given-names>JM</given-names>
</name>
<name>
<surname>Odgaard-Jensen</surname>
<given-names>J</given-names>
</name>
<name>
<surname>French</surname>
<given-names>SD</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Audit and feedback: effects on professional practice and healthcare outcomes</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2012</year>
<issue>6</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD000259.pub3">10.1002/14651858.CD000259.pub3</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b16">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Jacobson Vann</surname>
<given-names>JC</given-names>
</name>
<name>
<surname>Szilagyi</surname>
<given-names>P</given-names>
</name>
</person-group>
<article-title>Patient reminder and patient recall systems for improving immunization rates</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2005</year>
<issue>3</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD003941.pub2">10.1002/14651858.CD003941.pub2</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b17">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Jia</surname>
<given-names>L</given-names>
</name>
<name>
<surname>Yuan</surname>
<given-names>B</given-names>
</name>
<name>
<surname>Lu</surname>
<given-names>Y</given-names>
</name>
<name>
<surname>Garner</surname>
<given-names>P</given-names>
</name>
<name>
<surname>Meng</surname>
<given-names>Q</given-names>
</name>
<name>
<surname>Huang</surname>
<given-names>F</given-names>
</name>
</person-group>
<article-title>Strategies for expanding health insurance coverage in vulnerable populations</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2014</year>
<issue>11</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD008194.pub2">10.1002/14651858.CD008194.pub2</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b18">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Khunpradit</surname>
<given-names>S</given-names>
</name>
<name>
<surname>Tavender</surname>
<given-names>E</given-names>
</name>
<name>
<surname>Lumbiganon</surname>
<given-names>P</given-names>
</name>
<name>
<surname>Laopaiboon</surname>
<given-names>M</given-names>
</name>
<name>
<surname>Wasiak</surname>
<given-names>J</given-names>
</name>
<name>
<surname>Gruen</surname>
<given-names>RL</given-names>
</name>
</person-group>
<article-title>Non-clinical interventions for reducing unnecessary caesarean section</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2011</year>
<issue>6</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD005528.pub2">10.1002/14651858.CD005528.pub2</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b19">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Ko</surname>
<given-names>HC</given-names>
</name>
<name>
<surname>Turner</surname>
<given-names>TJ</given-names>
</name>
<name>
<surname>Finnigan</surname>
<given-names>MA</given-names>
</name>
</person-group>
<article-title>Systematic review of safety checklists for use by medical care teams in acute hospital settings-limited evidence of effectiveness</article-title>
<source>BMC Health Serv Res</source>
<year>2011</year>
<volume>11</volume>
<fpage>211</fpage>
<pub-id pub-id-type="pmid">21884618</pub-id>
</element-citation>
</ref>
<ref id="b20">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Liu</surname>
<given-names>Q</given-names>
</name>
<name>
<surname>Abba</surname>
<given-names>K</given-names>
</name>
<name>
<surname>Alejandria</surname>
<given-names>MM</given-names>
</name>
<name>
<surname>Sinclair</surname>
<given-names>D</given-names>
</name>
<name>
<surname>Balanag</surname>
<given-names>VM</given-names>
</name>
<name>
<surname>Lansang</surname>
<given-names>MAD</given-names>
</name>
</person-group>
<article-title>Reminder systems to improve patient adherence to tuberculosis clinic appointments for diagnosis and treatment</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2014</year>
<issue>11</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD006594.pub3">10.1002/14651858.CD006594.pub3</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b21">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Lutge</surname>
<given-names>EE</given-names>
</name>
<name>
<surname>Wiysonge</surname>
<given-names>CS</given-names>
</name>
<name>
<surname>Knight</surname>
<given-names>SE</given-names>
</name>
<name>
<surname>Sinclair</surname>
<given-names>D</given-names>
</name>
<name>
<surname>Volmink</surname>
<given-names>J</given-names>
</name>
</person-group>
<article-title>Incentives and enablers to improve adherence in tuberculosis</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2015</year>
<issue>9</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD007952.pub3">10.1002/14651858.CD007952.pub3</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b22">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Mbuagbaw</surname>
<given-names>L</given-names>
</name>
<name>
<surname>van derKop</surname>
<given-names>ML</given-names>
</name>
<name>
<surname>Lester</surname>
<given-names>RT</given-names>
</name>
<name>
<surname>Thirumurthy</surname>
<given-names>H</given-names>
</name>
<name>
<surname>Pop-Eleches</surname>
<given-names>C</given-names>
</name>
<name>
<surname>Ye</surname>
<given-names>C</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Mobile phone text messages for improving adherence to antiretroviral therapy (ART): an individual patient data meta-analysis of randomised trials</article-title>
<source>BMJ Open</source>
<year>2013</year>
<volume>3</volume>
<fpage>e003950</fpage>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1136/bmjopen-2013-003950">10.1136/bmjopen-2013-003950</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b23">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Nicolson</surname>
<given-names>DJ</given-names>
</name>
<name>
<surname>Knapp</surname>
<given-names>P</given-names>
</name>
<name>
<surname>Raynor</surname>
<given-names>DK</given-names>
</name>
<name>
<surname>Spoor</surname>
<given-names>P</given-names>
</name>
</person-group>
<article-title>Written information about individual medicines for consumers</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2009</year>
<issue>2</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD002104.pub3">10.1002/14651858.CD002104.pub3</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b24">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>O'Brien</surname>
<given-names>MA</given-names>
</name>
<name>
<surname>Rogers</surname>
<given-names>S</given-names>
</name>
<name>
<surname>Jamtvedt</surname>
<given-names>G</given-names>
</name>
<name>
<surname>Oxman</surname>
<given-names>AD</given-names>
</name>
<name>
<surname>Odgaard-Jensen</surname>
<given-names>J</given-names>
</name>
<name>
<surname>Kristoffersen</surname>
<given-names>DT</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Educational outreach visits: effects on professional practice and health care outcomes</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2007</year>
<issue>4</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD000409.pub2">10.1002/14651858.CD000409.pub2</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b25">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Opiyo</surname>
<given-names>N</given-names>
</name>
<name>
<surname>English</surname>
<given-names>M</given-names>
</name>
</person-group>
<article-title>Opiyo N, English M. In-service training for health professionals to improve care of seriously ill newborns and children in low-income countries</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2015</year>
<issue>5</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD007071.pub3">10.1002/14651858.CD007071.pub3</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b26">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Orton</surname>
<given-names>LC</given-names>
</name>
<name>
<surname>Barnish</surname>
<given-names>G</given-names>
</name>
</person-group>
<article-title>Unit-dose packaged drugs for treating malaria</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2005</year>
<issue>2</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD004614.pub2">10.1002/14651858.CD004614.pub2</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b27">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Oyo-Ita</surname>
<given-names>A</given-names>
</name>
<name>
<surname>Wiysonge</surname>
<given-names>C</given-names>
</name>
<name>
<surname>Oringanje</surname>
<given-names>C</given-names>
</name>
<name>
<surname>Nwachukwu</surname>
<given-names>CE</given-names>
</name>
<name>
<surname>Oduwole</surname>
<given-names>O</given-names>
</name>
<name>
<surname>Meremikwu</surname>
<given-names>MM</given-names>
</name>
</person-group>
<article-title>Interventions for improving coverage of child immunisation in low- and middle-income countries</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2016</year>
<issue>7</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD008145.pub3">10.1002/14651858.CD008145.pub3</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b28">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Pande</surname>
<given-names>S</given-names>
</name>
<name>
<surname>Hiller</surname>
<given-names>JE</given-names>
</name>
<name>
<surname>Nkansah</surname>
<given-names>N</given-names>
</name>
<name>
<surname>Bero</surname>
<given-names>L</given-names>
</name>
</person-group>
<article-title>The effect of pharmacist-provided non-dispensing services on patient outcomes, health service utilisation and costs in low- and middle-income countries</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2013</year>
<issue>2</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD010398">10.1002/14651858.CD010398</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b29">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Parmelli</surname>
<given-names>E</given-names>
</name>
<name>
<surname>Flodgren</surname>
<given-names>G</given-names>
</name>
<name>
<surname>Schaafsma</surname>
<given-names>ME</given-names>
</name>
<name>
<surname>Baillie</surname>
<given-names>N</given-names>
</name>
<name>
<surname>Beyer</surname>
<given-names>FR</given-names>
</name>
<name>
<surname>Eccles</surname>
<given-names>MP</given-names>
</name>
</person-group>
<article-title>The effectiveness of strategies to change organisational culture to improve healthcare performance</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2011</year>
<issue>1</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD008315.pub2">10.1002/14651858.CD008315.pub2</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b30">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Perrier</surname>
<given-names>L</given-names>
</name>
<name>
<surname>Mrklas</surname>
<given-names>K</given-names>
</name>
<name>
<surname>Shepperd</surname>
<given-names>S</given-names>
</name>
<name>
<surname>Dobbins</surname>
<given-names>M</given-names>
</name>
<name>
<surname>McKibbon</surname>
<given-names>KA</given-names>
</name>
<name>
<surname>Straus</surname>
<given-names>SE</given-names>
</name>
</person-group>
<article-title>Interventions encouraging the use of systematic reviews in clinical decision-making: a systematic review</article-title>
<source>Journal of General Internal Medicine</source>
<year>2011</year>
<volume>26</volume>
<issue>4</issue>
<fpage>419</fpage>
<lpage>26</lpage>
<pub-id pub-id-type="pmid">20953729</pub-id>
</element-citation>
</ref>
<ref id="b31">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Ranji</surname>
<given-names>SR</given-names>
</name>
<name>
<surname>Steinman</surname>
<given-names>M</given-names>
</name>
<name>
<surname>Shojania</surname>
<given-names>K</given-names>
</name>
<name>
<surname>Gonzalez</surname>
<given-names>R</given-names>
</name>
</person-group>
<article-title>Interventions to reduce unnecessary antibiotic prescribing. A systematic review and quantitative analysis</article-title>
<source>Medical Care</source>
<year>2008</year>
<volume>46</volume>
<issue>8</issue>
<fpage>847</fpage>
<lpage>62</lpage>
<pub-id pub-id-type="pmid">18665065</pub-id>
</element-citation>
</ref>
<ref id="b32">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Reeves</surname>
<given-names>S</given-names>
</name>
<name>
<surname>Perrier</surname>
<given-names>L</given-names>
</name>
<name>
<surname>Goldman</surname>
<given-names>J</given-names>
</name>
<name>
<surname>Freeth</surname>
<given-names>D</given-names>
</name>
<name>
<surname>Zwarenstein</surname>
<given-names>M</given-names>
</name>
</person-group>
<article-title>Interprofessional education: effects on professional practice and healthcare outcomes (update)</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2013</year>
<issue>3</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD002213.pub3">10.1002/14651858.CD002213.pub3</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b33">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Sibley</surname>
<given-names>LM</given-names>
</name>
<name>
<surname>Sipe</surname>
<given-names>TA</given-names>
</name>
<name>
<surname>Barry</surname>
<given-names>D</given-names>
</name>
</person-group>
<article-title>Traditional birth attendant training for improving health behaviours and pregnancy outcomes</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2012</year>
<issue>8</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD005460.pub3">10.1002/14651858.CD005460.pub3</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b34">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Simoni</surname>
<given-names>JM</given-names>
</name>
<name>
<surname>Pearson</surname>
<given-names>CR</given-names>
</name>
<name>
<surname>Pantalone</surname>
<given-names>DW</given-names>
</name>
<name>
<surname>Marks</surname>
<given-names>G</given-names>
</name>
<name>
<surname>Crepaz</surname>
<given-names>N</given-names>
</name>
</person-group>
<article-title>Efficacy of interventions in improving highly active antiretroviral therapy adherence and HIV-1 RNA viral load. A meta-analytic review of randomized controlled trials</article-title>
<source>Journal of Acquired Immune Deficiency Syndrome</source>
<year>2006</year>
<volume>43</volume>
<issue>Suppl 1</issue>
<fpage>S23</fpage>
<lpage>35</lpage>
</element-citation>
</ref>
<ref id="b35">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Simoni</surname>
<given-names>JM</given-names>
</name>
<name>
<surname>Amico</surname>
<given-names>KR</given-names>
</name>
<name>
<surname>Smith</surname>
<given-names>L</given-names>
</name>
<name>
<surname>Nelson</surname>
<given-names>K</given-names>
</name>
</person-group>
<article-title>Antiretroviral adherence interventions: translating research findings to the real world clinic</article-title>
<source>Current HIV/AIDS Reports</source>
<year>2010</year>
<volume>7</volume>
<issue>1</issue>
<fpage>44</fpage>
<lpage>51</lpage>
<pub-id pub-id-type="pmid">20425057</pub-id>
</element-citation>
</ref>
<ref id="b36">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Sorsdahl</surname>
<given-names>K</given-names>
</name>
<name>
<surname>Ipser</surname>
<given-names>JC</given-names>
</name>
<name>
<surname>Stein</surname>
<given-names>DJ</given-names>
</name>
</person-group>
<article-title>Interventions for educating traditional healers about STD and HIV medicine</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2009</year>
<issue>4</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD007190.pub2">10.1002/14651858.CD007190.pub2</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b37">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Sunguya</surname>
<given-names>BF</given-names>
</name>
<name>
<surname>Poudel</surname>
<given-names>KC</given-names>
</name>
<name>
<surname>Mlunde</surname>
<given-names>LB</given-names>
</name>
<name>
<surname>Shakya</surname>
<given-names>P</given-names>
</name>
<name>
<surname>Urassa</surname>
<given-names>DP</given-names>
</name>
<name>
<surname>Jimba</surname>
<given-names>M</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Effectiveness of nutrition training of health workers toward improving caregivers' feeding practices for children aged six months to two years: a systematic review</article-title>
<source>Nutrition Journal</source>
<year>2013</year>
<season>May 20</season>
<volume>12</volume>
<fpage>66</fpage>
<pub-id pub-id-type="pmid">23688174</pub-id>
</element-citation>
</ref>
<ref id="b38">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Vidanapathirana</surname>
<given-names>J</given-names>
</name>
<name>
<surname>Abramson</surname>
<given-names>MJ</given-names>
</name>
<name>
<surname>Forbes</surname>
<given-names>A</given-names>
</name>
<name>
<surname>Fairley</surname>
<given-names>C</given-names>
</name>
</person-group>
<article-title>Mass media interventions for promoting HIV testing</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2005</year>
<issue>3</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD004775.pub2">10.1002/14651858.CD004775.pub2</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b39">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Yakoob</surname>
<given-names>MY</given-names>
</name>
<name>
<surname>Ali</surname>
<given-names>MA</given-names>
</name>
<name>
<surname>Ali</surname>
<given-names>MU</given-names>
</name>
<name>
<surname>Imdad</surname>
<given-names>A</given-names>
</name>
<name>
<surname>Lawn</surname>
<given-names>JE</given-names>
</name>
<name>
<surname>Van DenBroek</surname>
<given-names>N</given-names>
</name>
<name>
<surname>Bhutta</surname>
<given-names>ZA</given-names>
</name>
</person-group>
<article-title>The effect of providing skilled birth attendance and emergency obstetric care in preventing stillbirths</article-title>
<source>BMC Public Health</source>
<year>2011</year>
<volume>11</volume>
<issue>Suppl 3</issue>
<fpage>S7</fpage>
</element-citation>
</ref>
<ref id="b40">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Arditi</surname>
<given-names>C</given-names>
</name>
<name>
<surname>Rège-Walther</surname>
<given-names>M</given-names>
</name>
<name>
<surname>Wyatt</surname>
<given-names>JC</given-names>
</name>
<name>
<surname>Durieux</surname>
<given-names>P</given-names>
</name>
<name>
<surname>Burnand</surname>
<given-names>B</given-names>
</name>
</person-group>
<article-title>Computer-generated reminders delivered on paper to healthcare professionals; effects on professional practice and health care outcomes</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2012</year>
<issue>12</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD001175.pub3">10.1002/14651858.CD001175.pub3</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b41">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Beilby</surname>
<given-names>JJ</given-names>
</name>
<name>
<surname>Silagy</surname>
<given-names>CA</given-names>
</name>
</person-group>
<article-title>Trials of providing costing information to general practitioners: a systematic review</article-title>
<source>Medical Journal of Australia</source>
<year>1997</year>
<volume>167</volume>
<issue>2</issue>
<fpage>89</fpage>
<lpage>92</lpage>
<pub-id pub-id-type="pmid">9251695</pub-id>
</element-citation>
</ref>
<ref id="b42">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Bordley</surname>
<given-names>WC</given-names>
</name>
<name>
<surname>Chelminski</surname>
<given-names>A</given-names>
</name>
<name>
<surname>Margolis</surname>
<given-names>PA</given-names>
</name>
<name>
<surname>Kraus</surname>
<given-names>R</given-names>
</name>
<name>
<surname>Szilagyi</surname>
<given-names>PG</given-names>
</name>
<name>
<surname>Vann</surname>
<given-names>JJ</given-names>
</name>
</person-group>
<article-title>The effect of audit and feedback on immunization delivery: a systematic review</article-title>
<source>American Journal of Preventive Medicine</source>
<year>2000</year>
<volume>18</volume>
<issue>4</issue>
<fpage>343</fpage>
<lpage>50</lpage>
<pub-id pub-id-type="pmid">10788739</pub-id>
</element-citation>
</ref>
<ref id="b43">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Chaillet</surname>
<given-names>N</given-names>
</name>
<name>
<surname>Dubé</surname>
<given-names>E</given-names>
</name>
<name>
<surname>Dugas</surname>
<given-names>M</given-names>
</name>
<name>
<surname>Audibert</surname>
<given-names>F</given-names>
</name>
<name>
<surname>Tourigny</surname>
<given-names>C</given-names>
</name>
<name>
<surname>Fraser</surname>
<given-names>WD</given-names>
</name>
<name>
<surname>Dumont</surname>
<given-names>A</given-names>
</name>
</person-group>
<article-title>Evidence-based strategies for implementing guidelines in obstetrics: a systematic review</article-title>
<source>Obstetrics & Gynecology</source>
<year>2006</year>
<volume>108</volume>
<issue>5</issue>
<fpage>1234</fpage>
<lpage>45</lpage>
<pub-id pub-id-type="pmid">17077251</pub-id>
</element-citation>
</ref>
<ref id="b44">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Fudickar</surname>
<given-names>A</given-names>
</name>
<name>
<surname>Hörle</surname>
<given-names>K</given-names>
</name>
<name>
<surname>Wiltfang</surname>
<given-names>J</given-names>
</name>
<name>
<surname>Bein</surname>
<given-names>B</given-names>
</name>
</person-group>
<article-title>The effect of the WHO surgical safety checklist on complication rate and communication</article-title>
<source>Dtsch Arztebl Int</source>
<year>2012</year>
<volume>109</volume>
<issue>42</issue>
<fpage>695</fpage>
<lpage>701</lpage>
<pub-id pub-id-type="pmid">23264813</pub-id>
</element-citation>
</ref>
<ref id="b45">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Grilli</surname>
<given-names>R</given-names>
</name>
<name>
<surname>Ramsay</surname>
<given-names>C</given-names>
</name>
<name>
<surname>Minozzi</surname>
<given-names>S</given-names>
</name>
</person-group>
<article-title>Mass media interventions: effects on health services utilisation</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2002</year>
<issue>1</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD000389">10.1002/14651858.CD000389</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b46">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Grimshaw</surname>
<given-names>JM</given-names>
</name>
<name>
<surname>Thomas</surname>
<given-names>RE</given-names>
</name>
<name>
<surname>MacLennan</surname>
<given-names>G</given-names>
</name>
<name>
<surname>Fraser</surname>
<given-names>C</given-names>
</name>
<name>
<surname>Ramsay</surname>
<given-names>CR</given-names>
</name>
<name>
<surname>Vale</surname>
<given-names>L</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Effectiveness and efficiency of guideline dissemination and implementation strategies</article-title>
<source>Health Technol Assessment</source>
<year>2004</year>
<volume>8</volume>
<issue>6</issue>
<fpage>1</fpage>
<lpage>72</lpage>
</element-citation>
</ref>
<ref id="b47">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Horvath</surname>
<given-names>T</given-names>
</name>
<name>
<surname>Azman</surname>
<given-names>H</given-names>
</name>
<name>
<surname>Kennedy</surname>
<given-names>GE</given-names>
</name>
<name>
<surname>Rutherford</surname>
<given-names>GW</given-names>
</name>
</person-group>
<article-title>Mobile phone text messaging for promoting adherence to antiretroviral therapy in patients with HIV infection</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2012</year>
<issue>3</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD009756">10.1002/14651858.CD009756</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b48">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Hulscher</surname>
<given-names>ME</given-names>
</name>
<name>
<surname>Wensing</surname>
<given-names>M</given-names>
</name>
<name>
<surname>van DerWeijden</surname>
<given-names>T</given-names>
</name>
<name>
<surname>Grol</surname>
<given-names>R</given-names>
</name>
</person-group>
<article-title>Interventions to implement prevention in primary care</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2001</year>
<issue>1</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD000362">10.1002/14651858.CD000362</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b49">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Ioannidis</surname>
<given-names>JP</given-names>
</name>
<name>
<surname>Lau</surname>
<given-names>J</given-names>
</name>
</person-group>
<article-title>Evidence on interventions to reduce medical errors: an overview and recommendations for future research</article-title>
<source>Journal of General Internal Medicine</source>
<year>2001</year>
<volume>16</volume>
<issue>5</issue>
<fpage>325</fpage>
<lpage>34</lpage>
<pub-id pub-id-type="pmid">11359552</pub-id>
</element-citation>
</ref>
<ref id="b50">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Jayaraman</surname>
<given-names>S</given-names>
</name>
<name>
<surname>Sethi</surname>
<given-names>D</given-names>
</name>
</person-group>
<article-title>Advanced trauma life support training for hospital staff</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2009</year>
<issue>2</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD004173.pub3">10.1002/14651858.CD004173.pub3</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b51">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Jayaraman</surname>
<given-names>S</given-names>
</name>
<name>
<surname>Sethi</surname>
<given-names>D</given-names>
</name>
</person-group>
<article-title>Advanced trauma life support training for ambulance crews</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2010</year>
<issue>1</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD003109.pub2">10.1002/14651858.CD003109.pub2</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b52">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kendrick</surname>
<given-names>D</given-names>
</name>
<name>
<surname>Hewitt</surname>
<given-names>M</given-names>
</name>
<name>
<surname>Dewey</surname>
<given-names>M</given-names>
</name>
<name>
<surname>Elkan</surname>
<given-names>R</given-names>
</name>
<name>
<surname>Blair</surname>
<given-names>M</given-names>
</name>
<name>
<surname>Robinson</surname>
<given-names>J</given-names>
</name>
<etal></etal>
</person-group>
<article-title>The effect of home visiting programmes on uptake of childhood immunization: a systematic review and meta-analysis</article-title>
<source>Journal of Public Health Medicine</source>
<year>2000</year>
<volume>22</volume>
<issue>1</issue>
<fpage>90</fpage>
<lpage>8</lpage>
<pub-id pub-id-type="pmid">10774910</pub-id>
</element-citation>
</ref>
<ref id="b53">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Lam-Antoniades</surname>
<given-names>M</given-names>
</name>
<name>
<surname>Ratnapalan</surname>
<given-names>S</given-names>
</name>
<name>
<surname>Tait</surname>
<given-names>G</given-names>
</name>
</person-group>
<article-title>Electronic continuing education in the health professions: an update on evidence from RCTs</article-title>
<source>Journal of Continuing Education in the Health Professions</source>
<year>2009</year>
<volume>29</volume>
<issue>1</issue>
<fpage>44</fpage>
<lpage>51</lpage>
<pub-id pub-id-type="pmid">19288566</pub-id>
</element-citation>
</ref>
<ref id="b54">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Lee</surname>
<given-names>ACC</given-names>
</name>
<name>
<surname>Lawn</surname>
<given-names>JE</given-names>
</name>
<name>
<surname>Cousens</surname>
<given-names>S</given-names>
</name>
<name>
<surname>Kumar</surname>
<given-names>V</given-names>
</name>
<name>
<surname>Osrin</surname>
<given-names>D</given-names>
</name>
<name>
<surname>Bhutta</surname>
<given-names>ZA</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Linking families and facilities for care at birth: What works to avert intrapartum-related deaths?</article-title>
<source>International Journal of Gynecology & Obstetrics</source>
<year>2009</year>
<volume>107</volume>
<fpage>65</fpage>
<lpage>88</lpage>
<pub-id pub-id-type="pmid">19577233</pub-id>
</element-citation>
</ref>
<ref id="b55">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Legare</surname>
<given-names>F</given-names>
</name>
<name>
<surname>Ratte</surname>
<given-names>S</given-names>
</name>
<name>
<surname>Stacey</surname>
<given-names>D</given-names>
</name>
<name>
<surname>Kryworuchko</surname>
<given-names>J</given-names>
</name>
<name>
<surname>Gravel</surname>
<given-names>K</given-names>
</name>
<name>
<surname>Graham</surname>
<given-names>ID</given-names>
</name>
<name>
<surname>Turcotte</surname>
<given-names>S</given-names>
</name>
</person-group>
<article-title>Interventions for improving the adoption of shared decision making by healthcare professionals</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2010</year>
<issue>5</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD006732.pub2">10.1002/14651858.CD006732.pub2</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b56">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Minkman</surname>
<given-names>M</given-names>
</name>
<name>
<surname>Ahaus</surname>
<given-names>K</given-names>
</name>
<name>
<surname>Huijsman</surname>
<given-names>R</given-names>
</name>
</person-group>
<article-title>Performance improvement based on integrated quality management models: what evidence do we have? A systematic literature review</article-title>
<source>International Journal for Quality in Health Care</source>
<year>2007</year>
<volume>19</volume>
<issue>2</issue>
<fpage>90</fpage>
<lpage>104</lpage>
<pub-id pub-id-type="pmid">17277010</pub-id>
</element-citation>
</ref>
<ref id="b57">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Naikoba</surname>
<given-names>S</given-names>
</name>
<name>
<surname>Hayward</surname>
<given-names>A</given-names>
</name>
</person-group>
<article-title>The effectiveness of interventions aimed at increasing handwashing in healthcare workers - a systematic review</article-title>
<source>Journal of Hospital Infections</source>
<year>2001</year>
<volume>47</volume>
<issue>3</issue>
<fpage>173</fpage>
<lpage>80</lpage>
</element-citation>
</ref>
<ref id="b58">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Nglazi</surname>
<given-names>MD</given-names>
</name>
<name>
<surname>Bekker</surname>
<given-names>LG</given-names>
</name>
<name>
<surname>Wood</surname>
<given-names>R</given-names>
</name>
<name>
<surname>Hussey</surname>
<given-names>GD</given-names>
</name>
<name>
<surname>Wiysonge</surname>
<given-names>CS</given-names>
</name>
</person-group>
<article-title>Mobile phone text messaging for promoting adherence to anti-tuberculosis treatment: a systematic review</article-title>
<source>BMC Infectious Diseases</source>
<year>2013</year>
<volume>13</volume>
<fpage>566</fpage>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1186/1471-2334-13-566.">10.1186/1471-2334-13-566.</ext-link>
]</comment>
<pub-id pub-id-type="pmid">24295439</pub-id>
</element-citation>
</ref>
<ref id="b59">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Pattinson</surname>
<given-names>RC</given-names>
</name>
<name>
<surname>Say</surname>
<given-names>L</given-names>
</name>
<name>
<surname>Makin</surname>
<given-names>JD</given-names>
</name>
<name>
<surname>Bastos</surname>
<given-names>MH</given-names>
</name>
</person-group>
<article-title>Critical incident audit and feedback to improve perinatal and maternal mortality and morbidity</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2005</year>
<issue>4</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD002961.pub2">10.1002/14651858.CD002961.pub2</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b60">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Pearce</surname>
<given-names>J</given-names>
</name>
<name>
<surname>Mann</surname>
<given-names>MK</given-names>
</name>
<name>
<surname>Jones</surname>
<given-names>C</given-names>
</name>
<name>
<surname>vanBuschbach</surname>
<given-names>S</given-names>
</name>
<name>
<surname>Olff</surname>
<given-names>M</given-names>
</name>
<name>
<surname>Bisson</surname>
<given-names>JI</given-names>
</name>
</person-group>
<article-title>The most effective way of delivering a train-the-trainers program: a systematic review</article-title>
<source>Journal of Continuing Education in the Health Professions</source>
<year>2012</year>
<volume>32</volume>
<issue>3</issue>
<fpage>215</fpage>
<lpage>26</lpage>
<pub-id pub-id-type="pmid">23173243</pub-id>
</element-citation>
</ref>
<ref id="b61">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Rowe</surname>
<given-names>RE</given-names>
</name>
<name>
<surname>Garcia</surname>
<given-names>J</given-names>
</name>
<name>
<surname>Macfarlane</surname>
<given-names>AJ</given-names>
</name>
<name>
<surname>Davidson</surname>
<given-names>LL</given-names>
</name>
</person-group>
<article-title>Improving communication between health professionals and women in maternity care: a structured review</article-title>
<source>Health Expectations</source>
<year>2002</year>
<volume>5</volume>
<issue>1</issue>
<fpage>63</fpage>
<lpage>83</lpage>
<pub-id pub-id-type="pmid">11906542</pub-id>
</element-citation>
</ref>
<ref id="b62">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Rueda</surname>
<given-names>S</given-names>
</name>
<name>
<surname>Park-Wyllie</surname>
<given-names>LY</given-names>
</name>
<name>
<surname>Bayoumi</surname>
<given-names>AM</given-names>
</name>
<name>
<surname>Tynan</surname>
<given-names>AM</given-names>
</name>
<name>
<surname>Antoniou</surname>
<given-names>TA</given-names>
</name>
<name>
<surname>Rourke</surname>
<given-names>SB</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Patient support and education for promoting adherence to highly active antiretroviral therapy for HIV/AIDS</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2006</year>
<issue>3</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD001442.pub2">10.1002/14651858.CD001442.pub2</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b63">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Safdar</surname>
<given-names>N</given-names>
</name>
<name>
<surname>Abad</surname>
<given-names>C</given-names>
</name>
</person-group>
<article-title>Educational interventions for prevention of healthcare-associated infection: a systematic review</article-title>
<source>Critical Care Medicine</source>
<year>2008</year>
<volume>36</volume>
<issue>3</issue>
<fpage>933</fpage>
<lpage>40</lpage>
<pub-id pub-id-type="pmid">18431283</pub-id>
</element-citation>
</ref>
<ref id="b64">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Shea</surname>
<given-names>B</given-names>
</name>
<name>
<surname>Andersson</surname>
<given-names>N</given-names>
</name>
<name>
<surname>Henry</surname>
<given-names>D</given-names>
</name>
</person-group>
<article-title>Increasing the demand for childhood vaccination in developing countries: a systematic review</article-title>
<source>BMC International Health and Human Rights</source>
<year>2009</year>
<volume>9</volume>
<issue>Suppl 1</issue>
<fpage>S5</fpage>
<pub-id pub-id-type="pmid">19828063</pub-id>
</element-citation>
</ref>
<ref id="b65">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Shojania</surname>
<given-names>KG</given-names>
</name>
<name>
<surname>Jennings</surname>
<given-names>A</given-names>
</name>
<name>
<surname>Mayhew</surname>
<given-names>A</given-names>
</name>
<name>
<surname>Ramsay</surname>
<given-names>CR</given-names>
</name>
<name>
<surname>EcclesMp</surname>
</name>
<name>
<surname>Grimshaw</surname>
<given-names>J</given-names>
</name>
</person-group>
<article-title>The effects of on-screen, point of care computer reminders on processes and outcomes of care</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2009</year>
<issue>3</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD001096.pub2">10.1002/14651858.CD001096.pub2</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b66">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Smith</surname>
<given-names>LA</given-names>
</name>
<name>
<surname>Jones</surname>
<given-names>C</given-names>
</name>
<name>
<surname>Meek</surname>
<given-names>S</given-names>
</name>
<name>
<surname>Webster</surname>
<given-names>J</given-names>
</name>
</person-group>
<article-title>Provider practice and user behavior interventions to improve prompt and effective treatment of malaria: do we know what works?</article-title>
<source>American Journal of Tropical Medicine and Hygiene</source>
<year>2009</year>
<volume>80</volume>
<issue>3</issue>
<fpage>326</fpage>
<lpage>35</lpage>
<pub-id pub-id-type="pmid">19270276</pub-id>
</element-citation>
</ref>
<ref id="b67">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Smits</surname>
<given-names>PB</given-names>
</name>
<name>
<surname>Verbeek</surname>
<given-names>JH</given-names>
</name>
<name>
<surname>deBuisonjé</surname>
<given-names>CD</given-names>
</name>
</person-group>
<article-title>Problem based learning in continuing medical education: a review of controlled evaluation studies</article-title>
<source>BMJ</source>
<year>2002</year>
<volume>324</volume>
<fpage>153</fpage>
<lpage>6</lpage>
<pub-id pub-id-type="pmid">11799034</pub-id>
</element-citation>
</ref>
<ref id="b68">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Sowden</surname>
<given-names>AJ</given-names>
</name>
</person-group>
<article-title>Mass media interventions for preventing smoking in young people</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2000</year>
<issue>2</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD001006">10.1002/14651858.CD001006</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b69">
<element-citation publication-type="other">
<person-group person-group-type="author">
<name>
<surname>Turner</surname>
<given-names>T</given-names>
</name>
<name>
<surname>Harris</surname>
<given-names>C</given-names>
</name>
<name>
<surname>Molyneux</surname>
<given-names>E</given-names>
</name>
</person-group>
<article-title>What is the evidence for effectiveness of WHO guidelines for the care of children in hospitals in developing countries?</article-title>
<year>2005</year>
<comment>International Child Health Review Collaboration</comment>
</element-citation>
</ref>
<ref id="b70">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Wafula</surname>
<given-names>FN</given-names>
</name>
<name>
<surname>Goodman</surname>
<given-names>CA</given-names>
</name>
</person-group>
<article-title>Are interventions for improving the quality of services provided by specialized drug shops effective in sub-Saharan Africa? A systematic review</article-title>
<source>International Journal for Quality in Health Care</source>
<year>2010</year>
<volume>22</volume>
<issue>4</issue>
<fpage>316</fpage>
<lpage>23</lpage>
<pub-id pub-id-type="pmid">20430823</pub-id>
</element-citation>
</ref>
<ref id="b71">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Zedler</surname>
<given-names>BK</given-names>
</name>
<name>
<surname>Kakad</surname>
<given-names>P</given-names>
</name>
<name>
<surname>Colilla</surname>
<given-names>S</given-names>
</name>
<name>
<surname>Murrelle</surname>
<given-names>L</given-names>
</name>
<name>
<surname>Shah</surname>
<given-names>NR</given-names>
</name>
</person-group>
<article-title>Does packaging with a calendar feature improve adherence to self-administered medication for long-term use? A systematic review</article-title>
<source>Clinical Therapy</source>
<year>2011</year>
<volume>33</volume>
<issue>1</issue>
<fpage>62</fpage>
<lpage>73</lpage>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1016/j.clinthera.2011.02.003">10.1016/j.clinthera.2011.02.003</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b72">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Abraham</surname>
<given-names>C</given-names>
</name>
<name>
<surname>Michie</surname>
<given-names>S</given-names>
</name>
</person-group>
<article-title>A taxonomy of behavior change techniques used in interventions</article-title>
<source>Health Psychology</source>
<year>2008</year>
<volume>27</volume>
<issue>3</issue>
<fpage>379</fpage>
<lpage>87</lpage>
<pub-id pub-id-type="pmid">18624603</pub-id>
</element-citation>
</ref>
<ref id="b73">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Althabe</surname>
<given-names>F</given-names>
</name>
<name>
<surname>Bergel</surname>
<given-names>E</given-names>
</name>
<name>
<surname>Cafferata</surname>
<given-names>ML</given-names>
</name>
<name>
<surname>Gibbons</surname>
<given-names>L</given-names>
</name>
<name>
<surname>Ciapponi</surname>
<given-names>A</given-names>
</name>
<name>
<surname>Alemán</surname>
<given-names>A</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Strategies for improving the quality of health care in maternal and child health in low- and middle-income countries: an overview of systematic reviews</article-title>
<source>Paediatric Perinatal Epidemiology</source>
<year>2008</year>
<volume>22</volume>
<issue>Suppl 1</issue>
<fpage>42</fpage>
<lpage>60</lpage>
<pub-id pub-id-type="pmid">18237352</pub-id>
</element-citation>
</ref>
<ref id="b74">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Arnold</surname>
<given-names>SR</given-names>
</name>
<name>
<surname>Straus</surname>
<given-names>SE</given-names>
</name>
</person-group>
<article-title>Interventions to improve antibiotic prescribing practices in ambulatory care</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2005</year>
<issue>4</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD003539.pub2">10.1002/14651858.CD003539.pub2</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b75">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Baldwin</surname>
<given-names>K</given-names>
</name>
<name>
<surname>Namdari</surname>
<given-names>S</given-names>
</name>
<name>
<surname>Donegan</surname>
<given-names>D</given-names>
</name>
<name>
<surname>Kamath</surname>
<given-names>AF</given-names>
</name>
<name>
<surname>Mehta</surname>
<given-names>S</given-names>
</name>
</person-group>
<article-title>Early effects of resident work-hour restrictions on patient safety: a systematic review and plea for improved studies</article-title>
<source>Journal of Bone and Joint Surgery</source>
<year>2011</year>
<volume>93</volume>
<issue>2</issue>
<fpage>e5</fpage>
<pub-id pub-id-type="pmid">21248206</pub-id>
</element-citation>
</ref>
<ref id="b76">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Bero</surname>
<given-names>LA</given-names>
</name>
<name>
<surname>Grilli</surname>
<given-names>R</given-names>
</name>
<name>
<surname>Grimshaw</surname>
<given-names>JM</given-names>
</name>
<name>
<surname>Harvey</surname>
<given-names>E</given-names>
</name>
<name>
<surname>Oxman</surname>
<given-names>AD</given-names>
</name>
<name>
<surname>Thomson</surname>
<given-names>MA</given-names>
</name>
</person-group>
<article-title>Closing the gap between research and practice: an overview of systematic reviews of interventions to promote the implementation of research findings</article-title>
<source>BMJ</source>
<year>1998</year>
<volume>317</volume>
<issue>7156</issue>
<fpage>465</fpage>
<lpage>8</lpage>
<pub-id pub-id-type="pmid">9703533</pub-id>
</element-citation>
</ref>
<ref id="b77">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Bloom</surname>
<given-names>BS</given-names>
</name>
</person-group>
<article-title>Effects of continuing medical education on improving physician clinical care and patient health: A review of systematic reviews</article-title>
<source>International Journal of Technology Assessment in Health Care</source>
<year>2005</year>
<volume>21</volume>
<issue>3</issue>
<fpage>380</fpage>
<lpage>5</lpage>
<pub-id pub-id-type="pmid">16110718</pub-id>
</element-citation>
</ref>
<ref id="b78">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Boaz</surname>
<given-names>A</given-names>
</name>
<name>
<surname>Baeza</surname>
<given-names>J</given-names>
</name>
<name>
<surname>Fraser</surname>
<given-names>A</given-names>
</name>
</person-group>
<collab>European Implementation Score Collaborative Group (EIS)</collab>
<article-title>Effective implementation of research into practice: an overview of systematic reviews of the health literature</article-title>
<source>BMC Research Notes</source>
<year>2011</year>
<volume>4</volume>
<fpage>212</fpage>
<pub-id pub-id-type="pmid">21696585</pub-id>
</element-citation>
</ref>
<ref id="b79">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Brennan</surname>
<given-names>S</given-names>
</name>
<name>
<surname>McKenzie</surname>
<given-names>J</given-names>
</name>
<name>
<surname>Whitty</surname>
<given-names>P</given-names>
</name>
<name>
<surname>Buchan</surname>
<given-names>H</given-names>
</name>
<name>
<surname>Green</surname>
<given-names>S</given-names>
</name>
</person-group>
<article-title>Continuous quality improvement: effects on professional practice and healthcare outcomes</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2009</year>
<issue>4</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD003319.pub2">10.1002/14651858.CD003319.pub2</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b80">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Chan</surname>
<given-names>WV</given-names>
</name>
<name>
<surname>Pearson</surname>
<given-names>TA</given-names>
</name>
<name>
<surname>Bennett</surname>
<given-names>GC</given-names>
</name>
<name>
<surname>Castillo</surname>
<given-names>G</given-names>
</name>
<name>
<surname>Cushman</surname>
<given-names>WC</given-names>
</name>
<name>
<surname>Gaziano</surname>
<given-names>TA</given-names>
</name>
<etal></etal>
</person-group>
<article-title>ACC/AHA Special Report: Clinical Practice Guideline Implementation Strategies: A Summary of Systematic Reviews by the NHLBI Implementation Science Work Group: A Report of the American College of Cardiology/American Heart Association Task Force on Clinical Practice Guidelines [1076-1092]</article-title>
<source>Journal of the American College of Cardiology</source>
<year>2017</year>
<volume>69</volume>
<issue>8</issue>
<fpage>1076</fpage>
<lpage>1092</lpage>
<pub-id pub-id-type="pmid">28132746</pub-id>
</element-citation>
</ref>
<ref id="b81">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Cheung</surname>
<given-names>A</given-names>
</name>
<name>
<surname>Weir</surname>
<given-names>M</given-names>
</name>
<name>
<surname>Mayhew</surname>
<given-names>A</given-names>
</name>
<name>
<surname>Kozloff</surname>
<given-names>N</given-names>
</name>
<name>
<surname>Brown</surname>
<given-names>K</given-names>
</name>
<name>
<surname>Grimshaw</surname>
<given-names>J</given-names>
</name>
</person-group>
<article-title>Overview of systematic reviews of the effectiveness of reminders in improving healthcare professional behavior</article-title>
<source>Systematic Reviews</source>
<year>2012</year>
<volume>1</volume>
<fpage>36</fpage>
<pub-id pub-id-type="pmid">22898173</pub-id>
</element-citation>
</ref>
<ref id="b82">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Ciapponi</surname>
<given-names>A</given-names>
</name>
<name>
<surname>Lewin</surname>
<given-names>S</given-names>
</name>
<name>
<surname>Bastías</surname>
<given-names>G</given-names>
</name>
<name>
<surname>Dudley</surname>
<given-names>L</given-names>
</name>
<name>
<surname>Flottorp</surname>
<given-names>S</given-names>
</name>
<name>
<surname>Gagnon</surname>
<given-names>MP</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Delivery arrangements for health systems in low-income countries: an overview of systematic reviews</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2014</year>
<issue>5</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD011083">10.1002/14651858.CD011083</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b83">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Davey</surname>
<given-names>P</given-names>
</name>
<name>
<surname>Brown</surname>
<given-names>E</given-names>
</name>
<name>
<surname>Charani</surname>
<given-names>E</given-names>
</name>
<name>
<surname>Fenelon</surname>
<given-names>L</given-names>
</name>
<name>
<surname>Gould</surname>
<given-names>IM</given-names>
</name>
<name>
<surname>Holmes</surname>
<given-names>A</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Interventions to improve antibiotic prescribing practices for hospital inpatients</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2013</year>
<issue>4</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD003543.pub3">10.1002/14651858.CD003543.pub3</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b84">
<element-citation publication-type="other">
<person-group person-group-type="author">
<name>
<surname>Dolan</surname>
<given-names>P</given-names>
</name>
<name>
<surname>Hallsworth</surname>
<given-names>M</given-names>
</name>
<name>
<surname>Halpern</surname>
<given-names>D</given-names>
</name>
<name>
<surname>King</surname>
<given-names>D</given-names>
</name>
<name>
<surname> Vlaev</surname>
<given-names>I</given-names>
</name>
</person-group>
<article-title>MINDSPACE: Influencing behaviour through public policy. UK Cabinet Office & Institute for Government. 2010</article-title>
<comment>
<ext-link ext-link-type="uri" xlink:href="Availablefromwww.instituteforgovernment.org.uk/publications/mindspace">Available from www.instituteforgovernment.org.uk/publications/mindspace</ext-link>
</comment>
</element-citation>
</ref>
<ref id="b85">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Dudley</surname>
<given-names>L</given-names>
</name>
<name>
<surname>Hviding</surname>
<given-names>K</given-names>
</name>
<name>
<surname>Paulsen</surname>
<given-names>E</given-names>
</name>
</person-group>
<article-title>The effectiveness of policies promoting facility-based deliveries in reducing maternal and infant morbidity and mortality in low- and middle-income countries</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2009</year>
<issue>3</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD007918">10.1002/14651858.CD007918</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b86">
<element-citation publication-type="other">
<person-group person-group-type="author">
<name>
<surname>Cochrane Effective</surname>
<given-names>Practice</given-names>
</name>
<name>
<surname>Organisation of Care</surname>
<given-names>(EPOC)</given-names>
</name>
</person-group>
<article-title>EPOC resources for review authors, 2017</article-title>
<comment>
<ext-link ext-link-type="uri" xlink:href="Availableatepoc.cochrane.org/epoc-resources-review-authors">Available at epoc.cochrane.org/epoc-resources-review-authors</ext-link>
</comment>
</element-citation>
</ref>
<ref id="b87">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Flottorp</surname>
<given-names>SA</given-names>
</name>
<name>
<surname>Oxman</surname>
<given-names>AD</given-names>
</name>
<name>
<surname>Krause</surname>
<given-names>J</given-names>
</name>
<name>
<surname>Musila</surname>
<given-names>NR</given-names>
</name>
<name>
<surname>Wensing</surname>
<given-names>M</given-names>
</name>
<name>
<surname>Godycki-Cwirko</surname>
<given-names>M</given-names>
</name>
<etal></etal>
</person-group>
<article-title>A checklist for identifying determinants of practice: a systematic review and synthesis of frameworks and taxonomies of factors that prevent or enable improvements in healthcare professional practice</article-title>
<source>Implementation Science</source>
<year>2013</year>
<volume>8</volume>
<fpage>35</fpage>
<pub-id pub-id-type="pmid">23522377</pub-id>
</element-citation>
</ref>
<ref id="b88">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>French</surname>
<given-names>SD</given-names>
</name>
<name>
<surname>Green</surname>
<given-names>SE</given-names>
</name>
<name>
<surname>O'Connor</surname>
<given-names>DA</given-names>
</name>
<name>
<surname>McKenzie</surname>
<given-names>JE</given-names>
</name>
<name>
<surname>Francis</surname>
<given-names>JJ</given-names>
</name>
<name>
<surname>Michie</surname>
<given-names>S</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Developing theory-informed behaviour change interventions to implement evidence into practice: a systematic approach using theTheoretical Domains Framework</article-title>
<source>Implementation Science</source>
<year>2012</year>
<volume>7</volume>
<fpage>38</fpage>
<pub-id pub-id-type="pmid">22531013</pub-id>
</element-citation>
</ref>
<ref id="b89">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Fretheim</surname>
<given-names>A</given-names>
</name>
<name>
<surname>Oxman</surname>
<given-names>AD</given-names>
</name>
<name>
<surname>Lavis</surname>
<given-names>JN</given-names>
</name>
<name>
<surname>Lewin</surname>
<given-names>S</given-names>
</name>
</person-group>
<article-title>SUPPORT Tools for evidence-informed health Policymaking (STP). 18. Planning monitoring and evaluation of policies</article-title>
<source>Health Research Policy and Systems</source>
<year>2009</year>
<volume>7</volume>
<issue>Suppl 1</issue>
<fpage>S18</fpage>
<pub-id pub-id-type="pmid">20018108</pub-id>
</element-citation>
</ref>
<ref id="b90">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Fønhus</surname>
<given-names>MS</given-names>
</name>
<name>
<surname>Dalsbø</surname>
<given-names>TK</given-names>
</name>
<name>
<surname>Johansen</surname>
<given-names>M</given-names>
</name>
<name>
<surname>Fretheim</surname>
<given-names>A</given-names>
</name>
<name>
<surname>Skirbekk</surname>
<given-names>H</given-names>
</name>
<name>
<surname>Flottorp</surname>
<given-names>S</given-names>
</name>
</person-group>
<article-title>Patient-mediated interventions to improve professional practice</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2016</year>
<issue>12</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD012472">10.1002/14651858.CD012472</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b91">
<element-citation publication-type="other">
<person-group person-group-type="author">
<name>
<surname>Graham</surname>
<given-names>W</given-names>
</name>
<name>
<surname>Davidson</surname>
<given-names>L</given-names>
</name>
<name>
<surname>Campbell</surname>
<given-names>S</given-names>
</name>
<name>
<surname>Clar</surname>
<given-names>C</given-names>
</name>
</person-group>
<article-title>What are the effects of interventions to improve the uptake of evidence from health research into policy in low- and middle-income countries?</article-title>
<comment>Aberdeen (UK): University of Aberdeen; 2011 January. DFID systematic review report Nº 40032846</comment>
</element-citation>
</ref>
<ref id="b92">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Grimshaw</surname>
<given-names>JM</given-names>
</name>
<name>
<surname>Shirran</surname>
<given-names>L</given-names>
</name>
<name>
<surname>Thomas</surname>
<given-names>R</given-names>
</name>
<name>
<surname>Mowatt</surname>
<given-names>G</given-names>
</name>
<name>
<surname>Fraser</surname>
<given-names>C</given-names>
</name>
<name>
<surname>Bero</surname>
<given-names>L</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Changing provider behavior: an overview of systematic reviews of interventions</article-title>
<source>Medical Care</source>
<year>2001</year>
<volume>39</volume>
<issue>8 Suppl 2</issue>
<fpage>II2</fpage>
<lpage>45</lpage>
<pub-id pub-id-type="pmid">11583120</pub-id>
</element-citation>
</ref>
<ref id="b93">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Grol</surname>
<given-names>R</given-names>
</name>
</person-group>
<article-title>Beliefs and evidence in changing clinical practice</article-title>
<source>BMJ</source>
<year>1997</year>
<volume>315</volume>
<issue>7105</issue>
<fpage>418</fpage>
<lpage>21</lpage>
<pub-id pub-id-type="pmid">9277610</pub-id>
</element-citation>
</ref>
<ref id="b94">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Grol</surname>
<given-names>R</given-names>
</name>
<name>
<surname>Grimshaw</surname>
<given-names>JM</given-names>
</name>
</person-group>
<article-title>From best evidence to best practice: effective implementation of change in patients' care</article-title>
<source>Lancet</source>
<year>2003</year>
<volume>362</volume>
<issue>9391</issue>
<fpage>1225</fpage>
<lpage>30</lpage>
<pub-id pub-id-type="pmid">14568747</pub-id>
</element-citation>
</ref>
<ref id="b95">
<element-citation publication-type="book">
<person-group person-group-type="author">
<name>
<surname>Grol</surname>
<given-names>R</given-names>
</name>
<name>
<surname>Wensing</surname>
<given-names>M</given-names>
</name>
</person-group>
<person-group person-group-type="editor">
<name>
<surname>Grol</surname>
<given-names>R</given-names>
</name>
<name>
<surname>Wensing</surname>
<given-names>M</given-names>
</name>
<name>
<surname>Eccles</surname>
<given-names>M</given-names>
</name>
</person-group>
<article-title>Chapter 8: Selection of strategies</article-title>
<source>Improving Patient Care. The Implementation of Change in Clinical Practice</source>
<year>2005</year>
<edition>1st Edition</edition>
<publisher-loc>Edinburgh</publisher-loc>
<publisher-name>Elsevier Butterworth Heinemann</publisher-name>
<fpage>122</fpage>
<lpage>134</lpage>
</element-citation>
</ref>
<ref id="b96">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Grol</surname>
<given-names>RP</given-names>
</name>
<name>
<surname>Bosch</surname>
<given-names>MC</given-names>
</name>
<name>
<surname>Hulscher</surname>
<given-names>ME</given-names>
</name>
<name>
<surname>Eccles</surname>
<given-names>MP</given-names>
</name>
<name>
<surname>Wensing</surname>
<given-names>M</given-names>
</name>
</person-group>
<article-title>Planning and studying improvement in patient care: the use of theoretical perspectives</article-title>
<source>Milbank Quarterly</source>
<year>2007</year>
<volume>85</volume>
<issue>1</issue>
<fpage>93</fpage>
<lpage>138</lpage>
<pub-id pub-id-type="pmid">17319808</pub-id>
</element-citation>
</ref>
<ref id="b97">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Guyatt</surname>
<given-names>GH</given-names>
</name>
<name>
<surname>Oxman</surname>
<given-names>AD</given-names>
</name>
<name>
<surname>Kunz</surname>
<given-names>R</given-names>
</name>
<name>
<surname>Vist</surname>
<given-names>GE</given-names>
</name>
<name>
<surname>Falck-Ytter</surname>
<given-names>Y</given-names>
</name>
<name>
<surname>Schunemann</surname>
<given-names>HJ</given-names>
</name>
<etal></etal>
</person-group>
<article-title>What is "quality of evidence" and why is it important to clinicians?</article-title>
<source>BMJ</source>
<year>2008</year>
<volume>336</volume>
<issue>7651</issue>
<fpage>995</fpage>
<lpage>98</lpage>
<pub-id pub-id-type="pmid">18456631</pub-id>
</element-citation>
</ref>
<ref id="b98">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Hall</surname>
<given-names>AK</given-names>
</name>
<name>
<surname>Cole-Lewis</surname>
<given-names>H</given-names>
</name>
<name>
<surname>Bernhardt</surname>
<given-names>JM</given-names>
</name>
</person-group>
<article-title>Mobile text messaging for health: a systematic review of reviews</article-title>
<source>Annual Review of Public Health</source>
<year>2015</year>
<volume>36</volume>
<fpage>393</fpage>
<lpage>415</lpage>
</element-citation>
</ref>
<ref id="b99">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Herrera</surname>
<given-names>CA</given-names>
</name>
<name>
<surname>Ciapponi</surname>
<given-names>A</given-names>
</name>
<name>
<surname>Bastías</surname>
<given-names>G</given-names>
</name>
<name>
<surname>Lewin</surname>
<given-names>S</given-names>
</name>
<name>
<surname>Garcia Marti</surname>
<given-names>S</given-names>
</name>
<name>
<surname>Okwundu</surname>
<given-names>CI</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Governance arrangements for health systems in low-income countries: an overview of systematic reviews</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2014</year>
<issue>4</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD011085">10.1002/14651858.CD011085</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b100">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Krause</surname>
<given-names>J</given-names>
</name>
<name>
<surname>VanLieshout</surname>
<given-names>J</given-names>
</name>
<name>
<surname>Klomp</surname>
<given-names>R</given-names>
</name>
<name>
<surname>Huntink</surname>
<given-names>E</given-names>
</name>
<name>
<surname>Aakhus</surname>
<given-names>E</given-names>
</name>
<name>
<surname>Flottorp</surname>
<given-names>S</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Identifying determinants of care for tailoring implementation in chronic diseases: an evaluation of different methods</article-title>
<source>Implementation Science</source>
<year>2014</year>
<volume>9</volume>
<fpage>102</fpage>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1186/s13012-014-0102-3">0.1186/s13012-014-0102-3</ext-link>
; PUBMED: 25112492]</comment>
<pub-id pub-id-type="pmid">25112492</pub-id>
</element-citation>
</ref>
<ref id="b101">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Lavis</surname>
<given-names>JN</given-names>
</name>
<name>
<surname>Oxman</surname>
<given-names>AD</given-names>
</name>
<name>
<surname>Souza</surname>
<given-names>NM</given-names>
</name>
<name>
<surname>Lewin</surname>
<given-names>S</given-names>
</name>
<name>
<surname>Gruen</surname>
<given-names>RL</given-names>
</name>
<name>
<surname>Fretheim</surname>
<given-names>A</given-names>
</name>
</person-group>
<article-title>SUPPORT Tools for evidence-informed health policymaking (STP) 9: assessing the applicability of the findings of asystematic review</article-title>
<source>Health Research Policy and Systems</source>
<year>2009</year>
<volume>7 Suppl 1</volume>
<fpage>S9</fpage>
<pub-id pub-id-type="pmid">20018116</pub-id>
</element-citation>
</ref>
<ref id="b102">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Lavis</surname>
<given-names>JN</given-names>
</name>
<name>
<surname>Wilson</surname>
<given-names>MG</given-names>
</name>
<name>
<surname>Moat</surname>
<given-names>KA</given-names>
</name>
<name>
<surname>Hammill</surname>
<given-names>AC</given-names>
</name>
<name>
<surname>Boyko</surname>
<given-names>JA</given-names>
</name>
<name>
<surname>Grimshaw</surname>
<given-names>JM</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Developing and refining the methods for a 'one-stop shop' for research evidence about health systems</article-title>
<source>Health Research Policy and Systems</source>
<year>2015</year>
<volume>13</volume>
<issue>10</issue>
<fpage>1</fpage>
<lpage>10</lpage>
<pub-id pub-id-type="pmid">25552353</pub-id>
</element-citation>
</ref>
<ref id="b103">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Lewin</surname>
<given-names>S</given-names>
</name>
<name>
<surname>Lavis</surname>
<given-names>JN</given-names>
</name>
<name>
<surname>Oxman</surname>
<given-names>AD</given-names>
</name>
<name>
<surname>Bastías</surname>
<given-names>G</given-names>
</name>
<name>
<surname>Chopra</surname>
<given-names>M</given-names>
</name>
<name>
<surname>Ciapponi</surname>
<given-names>A</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Supporting the delivery of cost-effective interventions in primary health-care systems in low-income and middle-income countries: an overview of systematic reviews</article-title>
<source>Lancet</source>
<year>2008</year>
<volume>372</volume>
<issue>9642</issue>
<fpage>928</fpage>
<lpage>39</lpage>
<pub-id pub-id-type="pmid">18790316</pub-id>
</element-citation>
</ref>
<ref id="b104">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Mahtani</surname>
<given-names>KR</given-names>
</name>
<name>
<surname>Heneghan</surname>
<given-names>CJ</given-names>
</name>
<name>
<surname>Glasziou</surname>
<given-names>PP</given-names>
</name>
<name>
<surname>Perera</surname>
<given-names>R</given-names>
</name>
</person-group>
<article-title>Reminder packaging for improving adherence to self-administered long-term medications</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2011</year>
<issue>9</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD005025.pub3">10.1002/14651858.CD005025.pub3</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b105">
<element-citation publication-type="other">
<person-group person-group-type="author">
<name>
<surname>Mauger Rothenberg</surname>
<given-names>B</given-names>
</name>
<name>
<surname>Marbella</surname>
<given-names>A</given-names>
</name>
<name>
<surname>Pines</surname>
<given-names>E</given-names>
</name>
<name>
<surname>Chopra</surname>
<given-names>R</given-names>
</name>
<name>
<surname>Black</surname>
<given-names>ER</given-names>
</name>
<name>
<surname>Aronson</surname>
<given-names>N</given-names>
</name>
</person-group>
<article-title>Prevention of healthcare-associated infections. Closing the quality gap: revisiting the state of the science</article-title>
<year>2012</year>
<comment>AHRQ Publication No. 12(13)-E012-EF</comment>
</element-citation>
</ref>
<ref id="b106">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>McGlynn</surname>
<given-names>EA</given-names>
</name>
<name>
<surname>Asch</surname>
<given-names>SM</given-names>
</name>
<name>
<surname>Adams</surname>
<given-names>J</given-names>
</name>
<name>
<surname>Keesey</surname>
<given-names>J</given-names>
</name>
<name>
<surname>Hicks</surname>
<given-names>J</given-names>
</name>
<name>
<surname>DeCristofaro</surname>
<given-names>A</given-names>
</name>
<etal></etal>
</person-group>
<article-title>The quality of health care delivered to adults in the United States</article-title>
<source>New England Journal of Medicine</source>
<year>2003</year>
<volume>348</volume>
<fpage>2635</fpage>
<lpage>45</lpage>
<pub-id pub-id-type="pmid">12826639</pub-id>
</element-citation>
</ref>
<ref id="b107">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Michie</surname>
<given-names>S</given-names>
</name>
<name>
<surname>Johnston</surname>
<given-names>M</given-names>
</name>
<name>
<surname>Abraham</surname>
<given-names>C</given-names>
</name>
<name>
<surname>Lawton</surname>
<given-names>R</given-names>
</name>
<name>
<surname>Parker</surname>
<given-names>D</given-names>
</name>
<name>
<surname>Walker</surname>
<given-names>A</given-names>
</name>
</person-group>
<article-title>Making psychological theory useful for implementing evidence based practice: a consensus approach</article-title>
<source>Quality & Safety in Health Care</source>
<year>2005</year>
<volume>14</volume>
<issue>1</issue>
<fpage>26</fpage>
<lpage>33</lpage>
<pub-id pub-id-type="pmid">15692000</pub-id>
</element-citation>
</ref>
<ref id="b108">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Michie</surname>
<given-names>S</given-names>
</name>
</person-group>
<article-title>Designing and implementing behaviour change interventions to improve population health</article-title>
<source>Journal of Health Services Research & Policy</source>
<year>2008</year>
<volume>13</volume>
<issue>Suppl 3</issue>
<fpage>64</fpage>
<lpage>9</lpage>
<pub-id pub-id-type="pmid">18806194</pub-id>
</element-citation>
</ref>
<ref id="b109">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Michie</surname>
<given-names>S</given-names>
</name>
<name>
<surname>vanStralen</surname>
<given-names>MM</given-names>
</name>
<name>
<surname>West</surname>
<given-names>R</given-names>
</name>
</person-group>
<article-title>The Behaviour Change Wheel: a new method for characterising and designing behaviour change interventions</article-title>
<source>Implementation Science</source>
<year>2011</year>
<volume>6</volume>
<fpage>42</fpage>
<pub-id pub-id-type="pmid">21513547</pub-id>
</element-citation>
</ref>
<ref id="b110">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Mostofian</surname>
<given-names>F</given-names>
</name>
<name>
<surname>Ruban</surname>
<given-names>C</given-names>
</name>
<name>
<surname>Simunovic</surname>
<given-names>N</given-names>
</name>
<name>
<surname>Bhandari</surname>
<given-names>M</given-names>
</name>
</person-group>
<article-title>Changing physician behavior: what works?</article-title>
<source>American Journal of Managed Care</source>
<year>2015</year>
<volume>21</volume>
<issue>1</issue>
<fpage>75</fpage>
<lpage>84</lpage>
<pub-id pub-id-type="pmid">25880152</pub-id>
</element-citation>
</ref>
<ref id="b111">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Mundell</surname>
<given-names>WC</given-names>
</name>
<name>
<surname>Kennedy</surname>
<given-names>CS</given-names>
</name>
<name>
<surname>Szostek</surname>
<given-names>JH</given-names>
</name>
<name>
<surname>Cook</surname>
<given-names>DA</given-names>
</name>
</person-group>
<article-title>Simulation technology for resuscitation training: a systematic review and meta-analysis</article-title>
<source>Resuscitation</source>
<year>2013</year>
<volume>84</volume>
<fpage>1174</fpage>
<lpage>83</lpage>
<pub-id pub-id-type="pmid">23624247</pub-id>
</element-citation>
</ref>
<ref id="b112">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Murthy</surname>
<given-names>L</given-names>
</name>
<name>
<surname>Shepperd</surname>
<given-names>S</given-names>
</name>
<name>
<surname>Clarke</surname>
<given-names>MJ</given-names>
</name>
<name>
<surname>Garner</surname>
<given-names>SE</given-names>
</name>
<name>
<surname>Lavis</surname>
<given-names>JN</given-names>
</name>
<name>
<surname>Perrier</surname>
<given-names>L</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Interventions to improve the use of systematic reviews in decision-making by health system managers, policy makers and clinicians</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2012</year>
<issue>9</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD009401.pub2">10.1002/14651858.CD009401.pub2</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b113">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Nieuwlaat</surname>
<given-names>R</given-names>
</name>
<name>
<surname>Wilczynski</surname>
<given-names>N</given-names>
</name>
<name>
<surname>Navarro</surname>
<given-names>T</given-names>
</name>
<name>
<surname>Hobson</surname>
<given-names>N</given-names>
</name>
<name>
<surname>Jeffery</surname>
<given-names>R</given-names>
</name>
<name>
<surname>Keepanasseril</surname>
<given-names>A</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Interventions for enhancing medication adherence</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2014</year>
<issue>11</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD000011.pub4">10.1002/14651858.CD000011.pub4</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b114">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Oluoch</surname>
<given-names>T</given-names>
</name>
<name>
<surname>Santas</surname>
<given-names>X</given-names>
</name>
<name>
<surname>Kwaro</surname>
<given-names>D</given-names>
</name>
<name>
<surname>Were</surname>
<given-names>M</given-names>
</name>
<name>
<surname>Biondich</surname>
<given-names>P</given-names>
</name>
<name>
<surname>Bailey</surname>
<given-names>C</given-names>
</name>
<name>
<surname>Abu-Hanna</surname>
<given-names>A</given-names>
</name>
<name>
<surname>deKeizer</surname>
<given-names>N</given-names>
</name>
</person-group>
<article-title>The effect of electronic medical record-based clinical decision support on HIV care in resource-constrained settings: a systematic review</article-title>
<source>International Journal of Medical Informatics</source>
<year>2012</year>
<volume>81</volume>
<fpage>e83</fpage>
<lpage>e92</lpage>
<pub-id pub-id-type="pmid">22921485</pub-id>
</element-citation>
</ref>
<ref id="b115">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Oxman</surname>
<given-names>AD</given-names>
</name>
<name>
<surname>Lavis</surname>
<given-names>JN</given-names>
</name>
<name>
<surname>Lewin</surname>
<given-names>S</given-names>
</name>
<name>
<surname>Fretheim</surname>
<given-names>A</given-names>
</name>
</person-group>
<article-title>SUPPORT Tools for evidence-informed health Policymaking (STP). 10. Taking equity into consideration when assessing the findings of a systematic review</article-title>
<source>Health Research Policy and Systems</source>
<year>2009</year>
<volume>7</volume>
<issue>Suppl 1</issue>
<fpage>S13</fpage>
<pub-id pub-id-type="pmid">20018103</pub-id>
</element-citation>
</ref>
<ref id="b116">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Oxman</surname>
<given-names>AD</given-names>
</name>
<name>
<surname>Fretheim</surname>
<given-names>A</given-names>
</name>
<name>
<surname>Lavis</surname>
<given-names>JN</given-names>
</name>
<name>
<surname>Lewin</surname>
<given-names>S</given-names>
</name>
</person-group>
<article-title>SUPPORT Tools for evidence-informed health Policymaking (STP). 12. Finding and using research evidence about resource use and costs</article-title>
<source>Health Research Policy and Systems</source>
<year>2009</year>
<volume>7</volume>
<issue>Suppl 1</issue>
<fpage>S15</fpage>
<pub-id pub-id-type="pmid">20018105</pub-id>
</element-citation>
</ref>
<ref id="b117">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Pantoja</surname>
<given-names>T</given-names>
</name>
<name>
<surname>Green</surname>
<given-names>ME</given-names>
</name>
<name>
<surname>Grimshaw</surname>
<given-names>J</given-names>
</name>
<name>
<surname>Denig</surname>
<given-names>P</given-names>
</name>
<name>
<surname>Durieux</surname>
<given-names>P</given-names>
</name>
<name>
<surname>Gill</surname>
<given-names>P</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Manual paper reminders: effects on professional practice and health care outcomes</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2014</year>
<issue>9</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD001174.pub3">10.1002/14651858.CD001174.pub3</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b118">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Petry</surname>
<given-names>NM</given-names>
</name>
<name>
<surname>Rash</surname>
<given-names>CJ</given-names>
</name>
<name>
<surname>Byrne</surname>
<given-names>S</given-names>
</name>
<name>
<surname>Ashraf</surname>
<given-names>S</given-names>
</name>
<name>
<surname>White</surname>
<given-names>WB</given-names>
</name>
</person-group>
<article-title>Financial reinforcers for improving medication adherence: findings from a meta-analysis</article-title>
<source>American Journal of Medicine</source>
<year>2012</year>
<volume>125</volume>
<issue>9</issue>
<fpage>888</fpage>
<lpage>96</lpage>
<pub-id pub-id-type="pmid">22800876</pub-id>
</element-citation>
</ref>
<ref id="b119">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Rada</surname>
<given-names>G</given-names>
</name>
<name>
<surname>Pérez</surname>
<given-names>D</given-names>
</name>
<name>
<surname>Capurro</surname>
<given-names>D</given-names>
</name>
</person-group>
<article-title>Epistemonikos: a free, relational, collaborative, multilingual database of health evidence</article-title>
<source>Studies in Health Technology and Informatics</source>
<year>2013</year>
<volume>192</volume>
<fpage>486</fpage>
<lpage>90</lpage>
<pub-id pub-id-type="pmid">23920602</pub-id>
</element-citation>
</ref>
<ref id="b120">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Rolfe</surname>
<given-names>A</given-names>
</name>
<name>
<surname>Cash-Gibson</surname>
<given-names>L</given-names>
</name>
<name>
<surname>Car</surname>
<given-names>J</given-names>
</name>
<name>
<surname>Sheikh</surname>
<given-names>A</given-names>
</name>
<name>
<surname>McKinstry</surname>
<given-names>B</given-names>
</name>
</person-group>
<article-title>Interventions for improving patients' trust in doctors and groups of doctors</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2014</year>
<issue>3</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD004134.pub3">10.1002/14651858.CD004134.pub3</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b121">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Rosen</surname>
<given-names>MA</given-names>
</name>
<name>
<surname>Hunt</surname>
<given-names>EA</given-names>
</name>
<name>
<surname>Pronovost</surname>
<given-names>PJ</given-names>
</name>
<name>
<surname>Federowicz</surname>
<given-names>MA</given-names>
</name>
<name>
<surname>Weaver</surname>
<given-names>SJ</given-names>
</name>
</person-group>
<article-title>In situ simulation in continuing education for the health care professions: a systematic review</article-title>
<source>Journal of Continuing Education of the Health Professions</source>
<year>2012</year>
<volume>32</volume>
<issue>4</issue>
<fpage>243</fpage>
<lpage>54</lpage>
</element-citation>
</ref>
<ref id="b122">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Rosenbaum</surname>
<given-names>SE</given-names>
</name>
<name>
<surname>Glenton</surname>
<given-names>C</given-names>
</name>
<name>
<surname>Wiysonge</surname>
<given-names>CS</given-names>
</name>
<name>
<surname>Abalos</surname>
<given-names>E</given-names>
</name>
<name>
<surname>Mignini</surname>
<given-names>L</given-names>
</name>
<name>
<surname>Young</surname>
<given-names>T</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Evidence summaries tailored to health policy-makers in low- and middle-income countries</article-title>
<source>Bulletin of the World Health Organization</source>
<year>2011</year>
<volume>89</volume>
<fpage>54</fpage>
<lpage>61</lpage>
<pub-id pub-id-type="pmid">21346891</pub-id>
</element-citation>
</ref>
<ref id="b123">
<element-citation publication-type="other">
<person-group person-group-type="author">
<name>
<surname>Rowe</surname>
<given-names>AK</given-names>
</name>
<name>
<surname>Sy</surname>
<given-names>Rowe</given-names>
</name>
<name>
<surname>Peters</surname>
<given-names>KA</given-names>
</name>
<name>
<surname>Holloway</surname>
<given-names>JC</given-names>
</name>
<name>
<surname>Ross-Degnan</surname>
<given-names>D</given-names>
</name>
</person-group>
<article-title>The health care provider performance review: a systematic review of the effectiveness of strategies to improve health care provider performance in low- and middle-income countries</article-title>
<comment>(presentation of preliminary results, as supplied prior to 10 July 2017). Provided by Dr. Samantha Rowe, US Centers for Disease Control and Prevention, Atlanta, GA</comment>
</element-citation>
</ref>
<ref id="b124">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Ryman</surname>
<given-names>TK</given-names>
</name>
<name>
<surname>Dietz</surname>
<given-names>V</given-names>
</name>
<name>
<surname>Cairns</surname>
<given-names>KL</given-names>
</name>
</person-group>
<article-title>Too little but not too late: results of a literature review to improve routine immunization programs in developing countries</article-title>
<source>BMC Health Services Research</source>
<year>2008</year>
<volume>8</volume>
<fpage>134</fpage>
<pub-id pub-id-type="pmid">18570677</pub-id>
</element-citation>
</ref>
<ref id="b125">
<element-citation publication-type="other">
<person-group person-group-type="author">
<name>
<surname>Schünemann</surname>
<given-names>HJ</given-names>
</name>
<name>
<surname>Oxman</surname>
<given-names>AD</given-names>
</name>
<name>
<surname>Higgins</surname>
<given-names>JPT</given-names>
</name>
<name>
<surname>Vist</surname>
<given-names>GE</given-names>
</name>
<name>
<surname>Glasziou</surname>
<given-names>P</given-names>
</name>
<name>
<surname>Guyatt</surname>
<given-names>GH</given-names>
</name>
</person-group>
<article-title>Chapter 11: Presenting results and 'Summary of findings' tables. In: Higgins JPT, Green S (editors), Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 (updated March 2011). The Cochrane Collaboration, 2011</article-title>
<comment>
<ext-link ext-link-type="uri" xlink:href="Availablefromwww.cochrane-handbook.org">Available from www.cochrane-handbook.org</ext-link>
</comment>
</element-citation>
</ref>
<ref id="b126">
<element-citation publication-type="other">
<person-group person-group-type="author">
<name>
<surname>Schünemann</surname>
<given-names>HJ</given-names>
</name>
<name>
<surname>Oxman</surname>
<given-names>AD</given-names>
</name>
<name>
<surname>Vist</surname>
<given-names>GE</given-names>
</name>
<name>
<surname>Higgins</surname>
<given-names>JPT</given-names>
</name>
<name>
<surname>Deeks</surname>
<given-names>JJ</given-names>
</name>
<name>
<surname>Glasziou</surname>
<given-names>P</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Chapter 12: Interpreting results and drawing conclusions. In: Higgins JPT, Green S (editors), Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 (updated March 2011). The Cochrane Collaboration, 2011</article-title>
<comment>
<ext-link ext-link-type="uri" xlink:href="Availablefromwww.cochrane-handbook.org">Available from www.cochrane-handbook.org</ext-link>
</comment>
</element-citation>
</ref>
<ref id="b127">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Scott</surname>
<given-names>SD</given-names>
</name>
<name>
<surname>Albretch</surname>
<given-names>L</given-names>
</name>
<name>
<surname>O'Leary</surname>
<given-names>K</given-names>
</name>
<name>
<surname>Ball</surname>
<given-names>GD</given-names>
</name>
<name>
<surname>Hartling</surname>
<given-names>L</given-names>
</name>
<name>
<surname>Hofmeyer</surname>
<given-names>A</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Systematic review of knowledge translation strategies in the allied health professions</article-title>
<source>Implementation Science</source>
<year>2012</year>
<volume>7</volume>
<fpage>70</fpage>
<pub-id pub-id-type="pmid">22831550</pub-id>
</element-citation>
</ref>
<ref id="b128">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Squires</surname>
<given-names>JE</given-names>
</name>
<name>
<surname>Sullivan</surname>
<given-names>K</given-names>
</name>
<name>
<surname>Eccles</surname>
<given-names>MP</given-names>
</name>
<name>
<surname>Worswick</surname>
<given-names>J</given-names>
</name>
<name>
<surname>Grimshaw</surname>
<given-names>JM</given-names>
</name>
</person-group>
<article-title>Are multifaceted interventions more effective than single-component interventions in changing health-care professionals’ behaviours? An overview of systematic reviews</article-title>
<source>Implementation Science</source>
<year>2014</year>
<volume>9</volume>
<fpage>152</fpage>
<pub-id pub-id-type="pmid">25287951</pub-id>
</element-citation>
</ref>
<ref id="b129">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Steinman</surname>
<given-names>MA</given-names>
</name>
<name>
<surname>Ranji</surname>
<given-names>SR</given-names>
</name>
<name>
<surname>Shojania</surname>
<given-names>KG</given-names>
</name>
<name>
<surname>Gonzales</surname>
<given-names>R</given-names>
</name>
</person-group>
<article-title>Improving antibiotic selection: a systematic review and quantitative analysis of quality improvement strategies</article-title>
<source>Medical Care</source>
<year>2006</year>
<volume>44</volume>
<issue>7</issue>
<fpage>617</fpage>
<lpage>28</lpage>
<pub-id pub-id-type="pmid">16799356</pub-id>
</element-citation>
</ref>
<ref id="b130">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Tannenbaum</surname>
<given-names>SI</given-names>
</name>
<name>
<surname>Cerasoli</surname>
<given-names>CP</given-names>
</name>
</person-group>
<article-title>Do team and individual debriefs enhance performance? A meta-analysis</article-title>
<source>Human Factors</source>
<year>2013</year>
<volume>55</volume>
<issue>1</issue>
<fpage>231</fpage>
<lpage>45</lpage>
<pub-id pub-id-type="pmid">23516804</pub-id>
</element-citation>
</ref>
<ref id="b131">
<element-citation publication-type="other">
<person-group person-group-type="author">
<name>
<surname>Wensing</surname>
<given-names>M</given-names>
</name>
<name>
<surname>Bosch</surname>
<given-names>M</given-names>
</name>
<name>
<surname>Foy</surname>
<given-names>R</given-names>
</name>
<name>
<surname>van derWeijden</surname>
<given-names>T</given-names>
</name>
<name>
<surname>Eccles</surname>
<given-names>M</given-names>
</name>
<name>
<surname>Grol</surname>
<given-names>R</given-names>
</name>
</person-group>
<article-title>Factors in theories on behaviour change to guide implementation and quality improvement in health care</article-title>
<year>2005</year>
<comment>Centre for Quality of Care Research (WOK)</comment>
</element-citation>
</ref>
<ref id="b132">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Wensing</surname>
<given-names>M</given-names>
</name>
<name>
<surname>Wollersheim</surname>
<given-names>H</given-names>
</name>
<name>
<surname>Grol</surname>
<given-names>R</given-names>
</name>
</person-group>
<article-title>Organizational interventions to implement improvements inpatient care: a structured review of reviews</article-title>
<source>Implementation Science</source>
<year>2006</year>
<volume>1</volume>
<fpage>2</fpage>
<pub-id pub-id-type="pmid">16722567</pub-id>
</element-citation>
</ref>
<ref id="b133">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Wensing</surname>
<given-names>M</given-names>
</name>
<name>
<surname>Oxman</surname>
<given-names>AD</given-names>
</name>
<name>
<surname>Baker</surname>
<given-names>R</given-names>
</name>
<name>
<surname>Godycki-Cwirko</surname>
<given-names>M</given-names>
</name>
<name>
<surname>Flottorp</surname>
<given-names>S</given-names>
</name>
<name>
<surname>Szecsenyi</surname>
<given-names>J</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Tailored implementation for chronic diseases (TICD): a project protocol</article-title>
<source>Implementation Science</source>
<year>2011</year>
<volume>6</volume>
<fpage>103</fpage>
<pub-id pub-id-type="pmid">21899753</pub-id>
</element-citation>
</ref>
<ref id="b134">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Wiysonge</surname>
<given-names>CS</given-names>
</name>
<name>
<surname>Herrera</surname>
<given-names>CA</given-names>
</name>
<name>
<surname>Ciapponi</surname>
<given-names>A</given-names>
</name>
<name>
<surname>Lewin</surname>
<given-names>S</given-names>
</name>
<name>
<surname>Garcia Marti</surname>
<given-names>S</given-names>
</name>
<name>
<surname>Opiyo</surname>
<given-names>N</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Financial arrangements for health systems in low-income countries: an overview of systematic reviews</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2014</year>
<issue>4</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD011084">10.1002/14651858.CD011084</ext-link>
]</comment>
</element-citation>
</ref>
<ref id="b135">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Wong</surname>
<given-names>CA</given-names>
</name>
<name>
<surname>Cummings</surname>
<given-names>GG</given-names>
</name>
<name>
<surname>Ducharme</surname>
<given-names>L</given-names>
</name>
</person-group>
<article-title>The relationship between nursing leadership and patient outcomes: a systematic review</article-title>
<source>Journal of Nursing Management</source>
<year>2013</year>
<volume>21</volume>
<issue>5</issue>
<fpage>709</fpage>
<lpage>24</lpage>
<pub-id pub-id-type="pmid">23865924</pub-id>
</element-citation>
</ref>
<ref id="b136">
<element-citation publication-type="other">
<collab>The World Bank Group</collab>
<article-title>Data. Countries and Economies, 2016</article-title>
<comment>
<ext-link ext-link-type="uri" xlink:href="Availablefromdata.worldbank.org/country/">Available fromdata.worldbank.org/country/</ext-link>
(accessed prior to 7 July 2017).</comment>
</element-citation>
</ref>
<ref id="b137">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Pantoja</surname>
<given-names>T</given-names>
</name>
<name>
<surname>Opiyo</surname>
<given-names>N</given-names>
</name>
<name>
<surname>Ciapponi</surname>
<given-names>A</given-names>
</name>
<name>
<surname>Dudley</surname>
<given-names>L</given-names>
</name>
<name>
<surname>Gagnon</surname>
<given-names>MP</given-names>
</name>
<name>
<surname>Herrera</surname>
<given-names>CA</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Implementation strategies for health systems in low-income countries: an overview of systematic reviews</article-title>
<source>Cochrane Database of Systematic Reviews</source>
<year>2014</year>
<issue>5</issue>
<comment>[DOI:
<ext-link ext-link-type="doi" xlink:href="10.1002/14651858.CD011086">10.1002/14651858.CD011086</ext-link>
]</comment>
</element-citation>
</ref>
</ref-list>
<sec>
<title>Additional Tables</title>
<table-wrap id="tbl1" position="float">
<label>Table 1</label>
<caption>
<p>Types of implementation strategies</p>
</caption>
<table frame="border" rules="groups">
<tbody>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Implementation strategy</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>Definition</bold>
</th>
</tr>
<tr>
<td align="left" colspan="2" rowspan="1">
<bold>Targeted at healthcare organisations</bold>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Change of organisational culture</td>
<td align="left" rowspan="1" colspan="1">Strategies to change organisational culture</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Continuous quality improvement</td>
<td align="left" rowspan="1" colspan="1">Improvement of quality through improvement of organisational processes, use of structured problem-solving processes incorporating statistical methods and measurement to diagnose problems and monitor progress, use of teams including employees from multiple departments and from different organisational levels, empowering employees to identify quality problems and improvement opportunities and to take action on these, and an explicit focus on 'customers'</td>
</tr>
<tr>
<td align="left" colspan="2" rowspan="1">
<bold>Targeted at healthcare worker practice – types of interventions</bold>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Printed educational materials</td>
<td align="left" rowspan="1" colspan="1">Distribution of printed recommendations for clinical care, including clinical practice guidelines. The materials can be delivered personally or through mass mailings.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Internet-based or computerised educational materials</td>
<td align="left" rowspan="1" colspan="1">Distribution of electronic recommendations for clinical care, including clinical practice guidelines. The materials are usually delivered through mass mailings and/or published in web pages.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Educational meetings</td>
<td align="left" rowspan="1" colspan="1">Courses, workshops or other educational meetings</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Local consensus processes</td>
<td align="left" rowspan="1" colspan="1">Formal or informal local consensus processes aimed at promoting implementation of guidelines</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Educational outreach visits</td>
<td align="left" rowspan="1" colspan="1">Personal visits by a trained person to healthcare workers in their own setting</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Local opinion leaders</td>
<td align="left" rowspan="1" colspan="1">The identification and use of local opinion leaders to promote implementation of guidelines</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Audit and feedback</td>
<td align="left" rowspan="1" colspan="1">A summary of healthcare workers' performance over a specified period of time, given to them in a written, electronic or verbal format</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Patient-mediated interventions</td>
<td align="left" rowspan="1" colspan="1">The use of patients to change professional practice</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Reminders</td>
<td align="left" rowspan="1" colspan="1">Manual or computerised interventions that prompt healthcare workers to perform some action</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Tailored interventions</td>
<td align="left" rowspan="1" colspan="1">Interventions to change practice that are selected based on an assessment of barriers to change</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Multifaceted interventions</td>
<td align="left" rowspan="1" colspan="1">Combinations of two or more strategies to change practice</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Multidisciplinary teams</td>
<td align="left" rowspan="1" colspan="1">Strategies to promote inter or multidisciplinary team work</td>
</tr>
<tr>
<td align="left" colspan="2" rowspan="1">
<bold>Targeted at healthcare worker practice – types of problems</bold>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Communication with patients</td>
<td align="left" rowspan="1" colspan="1">Strategies for improving communication with patients</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Handwashing</td>
<td align="left" rowspan="1" colspan="1">Strategies for improving hand hygiene compliance in patient care</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Obstetrics</td>
<td align="left" rowspan="1" colspan="1">Strategies for improving obstetric care</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Healthcare-associated infections</td>
<td align="left" rowspan="1" colspan="1">Strategies for decreasing healthcare associated infections</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Patient-centred approach</td>
<td align="left" rowspan="1" colspan="1">Strategies for promoting a patient-centred approach in clinical consultations</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Prescribing</td>
<td align="left" rowspan="1" colspan="1">Strategies for improving prescribing</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Prescribing antibiotics</td>
<td align="left" rowspan="1" colspan="1">Strategies for improving the use of antibiotics</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Seriously ill newborn care</td>
<td align="left" rowspan="1" colspan="1">Strategies for improving the care of seriously ill newborns</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Traditional birth attendants</td>
<td align="left" rowspan="1" colspan="1">Strategies for improving care delivered by traditional birth attendants</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Traditional healers</td>
<td align="left" rowspan="1" colspan="1">Strategies for improving care delivered by traditional healers</td>
</tr>
<tr>
<td align="left" colspan="2" rowspan="1">
<bold>Targeted at healthcare recipient use of health services – types of interventions</bold>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Information and education provision</td>
<td align="left" rowspan="1" colspan="1">Strategies to enable consumers to know about programmes/policies to be implemented (e.g. mass media campaigns)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Skill and competencies acquisition</td>
<td align="left" rowspan="1" colspan="1">Strategies focused on the acquisition of skills relevant to the use of health services (e.g. lay healthcare workers)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Facilitation of communication and decision-making</td>
<td align="left" rowspan="1" colspan="1">Strategies to involve healthcare recipients in decision-making about programmes/policies to be implemented (e.g. communication skills training for patients)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Behaviour change support</td>
<td align="left" rowspan="1" colspan="1">Strategies focusing on the adoption or promotion of health and treatment behaviours such as adherence to medicines</td>
</tr>
<tr>
<td align="left" colspan="2" rowspan="1">
<bold>Targeted at healthcare recipient use of health services – types of problem</bold>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Adherence – antiretroviral drugs for human immunodeficiency virus infection/acquired immunodeficiency syndrome (HIV/AIDS)</td>
<td align="left" rowspan="1" colspan="1"> Strategies for improving adherence to antiretroviral drugs for HIV/AIDS</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Adherence – medication</td>
<td align="left" rowspan="1" colspan="1"> Strategies for improving medication adherence</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Adherence – tuberculosis</td>
<td align="left" rowspan="1" colspan="1"> Strategies for improving tuberculosis medication adherence</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Facility-based deliveries</td>
<td align="left" rowspan="1" colspan="1"> Strategies for promoting facility-based deliveries</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Immunisation coverage</td>
<td align="left" rowspan="1" colspan="1"> Strategies for improving immunisation coverage</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Access to healthcare services</td>
<td align="left" rowspan="1" colspan="1"> Strategies for increasing use of healthcare services by specific populations</td>
</tr>
</tbody>
</table>
</table-wrap>
<table-wrap id="tbl2" position="float">
<label>Table 2</label>
<caption>
<p>Examples of implementation strategies to address different types of barriers
<sup>a</sup>
</p>
</caption>
<table frame="border" rules="groups">
<tbody>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Level</bold>
</th>
<th align="left" colspan="2" rowspan="1">
<bold>Determinants</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>Examples of implementation strategies</bold>
</th>
</tr>
<tr>
<td align="left" rowspan="3" colspan="1">Healthcare organisations</td>
<td align="left" rowspan="1" colspan="1">Inadequate internal
<break></break>
communication</td>
<td align="left" rowspan="1" colspan="1">Necessary communication between different levels of the health system may be lacking</td>
<td align="left" rowspan="1" colspan="1">Structured referral sheets, involvement of consultants in primary care educational activities</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Inadequate
<break></break>
processes</td>
<td align="left" rowspan="1" colspan="1">Processes for outreach and receiving, referring and transferring patients may not be adequate to implement the option or the types of effective care at which the option is targeted</td>
<td align="left" rowspan="1" colspan="1">Redesign of processes to facilitate appropriate and efficient utilisation of services (continuous quality improvement)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Inadequate
<break></break>
leadership</td>
<td align="left" rowspan="1" colspan="1">There may be insufficient leadership to implement the option or the types of effective care at which the option is targeted</td>
<td align="left" rowspan="1" colspan="1">Identification of effective leaders; engagement of opinion leaders; establishment of leadership systems</td>
</tr>
<tr>
<td align="left" rowspan="4" colspan="1">Healthcare workers</td>
<td align="left" rowspan="1" colspan="1">Knowledge</td>
<td align="left" rowspan="1" colspan="1">Healthcare workers may be unaware of the likely impacts of the option or of the types of effective care at which the option is targeted</td>
<td align="left" rowspan="1" colspan="1">Dissemination of educational materials</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Competency</td>
<td align="left" rowspan="1" colspan="1">Healthcare workers may not feel competent or may lack competency</td>
<td align="left" rowspan="1" colspan="1">Educational meetings or outreach visits</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Attitudes</td>
<td align="left" rowspan="1" colspan="1">Healthcare workers may not agree that implementing the option or the types of effective care at which the option is targeted is important</td>
<td align="left" rowspan="1" colspan="1">Disseminate information regarding the size of the problem, including relevant comparisons; use opinion leaders</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Motivation to change</td>
<td align="left" rowspan="1" colspan="1">Healthcare workers may not be motivated to change their practices</td>
<td align="left" rowspan="1" colspan="1">Dissemination of information that is designed to motivate healthcare workers to change their practice; financial or other incentives; reduce the burden of changing practices</td>
</tr>
<tr>
<td align="left" rowspan="5" colspan="1">Healthcare recipients</td>
<td align="left" rowspan="1" colspan="1">Knowledge</td>
<td align="left" rowspan="1" colspan="1">People may be unaware of the likely impacts of the option or of the types of effective care at which the option is targeted</td>
<td align="left" rowspan="1" colspan="1">Disseminate information that is reliable and accessible, e.g. using the mass media or community healthcare workers</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Competency (skill)</td>
<td align="left" rowspan="1" colspan="1">People may not have the necessary skills to use the types of effective care at which the option is targeted</td>
<td align="left" rowspan="1" colspan="1">Provide training and support</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Attitudes</td>
<td align="left" rowspan="1" colspan="1">People may not agree that implementing the option or the types of effective care at which the option is targeted is important</td>
<td align="left" rowspan="1" colspan="1">Disseminate information regarding the size of the problem, including relevant comparisons</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Access to care</td>
<td align="left" rowspan="1" colspan="1">People may not have access to the types of effective care at which the option is targeted due to financial constraints or lack of transportation</td>
<td align="left" rowspan="1" colspan="1">Reduce financial or physical barriers to care</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Motivation to change</td>
<td align="left" rowspan="1" colspan="1">People may not be motivated to change their behaviours, for example by seeking types of effective care at which the option is targeted</td>
<td align="left" rowspan="1" colspan="1">Dissemination of information that is designed to motivate people to, for example, seek care; use financial or material incentives</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn>
<p>
<sup>a</sup>
Adapted from
<xref rid="b95" ref-type="bibr">Grol 2005</xref>
.</p>
</fn>
</table-wrap-foot>
</table-wrap>
<table-wrap id="tbl3" position="float">
<label>Table 3</label>
<caption>
<p>Included reviews</p>
</caption>
<table frame="border" rules="groups">
<tbody>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Implementation strategy</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>Included reviews</bold>
</th>
</tr>
<tr>
<td align="left" colspan="2" rowspan="1">
<bold>Strategies targeted at healthcareorganisations</bold>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Organisational culture</td>
<td align="left" rowspan="1" colspan="1">The effectiveness of strategies to change organisational culture to improve healthcare performance (
<xref rid="b29" ref-type="bibr">Parmelli 2011</xref>
)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Continuous quality improvement</td>
<td align="left" rowspan="1" colspan="1">No eligible systematic review identified</td>
</tr>
<tr>
<td align="left" colspan="2" rowspan="1">
<bold>Strategies targeted at healthcareworkers by type of intervention</bold>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Educational materials</td>
<td align="left" rowspan="1" colspan="1">Printed educational materials: effects on professional practice and healthcare outcomes (
<xref rid="b10" ref-type="bibr">Giguère 2012</xref>
)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Internet based learning</td>
<td align="left" rowspan="1" colspan="1">Internet-based learning in the health professions: a meta-analysis (
<xref rid="b5" ref-type="bibr">Cook 2008</xref>
)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Educational meetings</td>
<td align="left" rowspan="1" colspan="1">Continuing education meetings and workshops: effects on professional practice and healthcare outcomes (
<xref rid="b9" ref-type="bibr">Forsetlund 2009</xref>
)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Educational meetings</td>
<td align="left" rowspan="1" colspan="1">Interprofessional education: effects on professional practice and healthcare outcomes (
<xref rid="b32" ref-type="bibr">Reeves 2013</xref>
)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Educational meetings</td>
<td align="left" rowspan="1" colspan="1">Teaching critical appraisal skills in healthcare settings (
<xref rid="b13" ref-type="bibr">Horsley 2011</xref>
)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Educational meetings</td>
<td align="left" rowspan="1" colspan="1">Effectiveness of nutrition training of health workers toward improving caregivers' feeding practices for children aged six months to two years: a systematic review (
<xref rid="b37" ref-type="bibr">Sunguya 2013</xref>
)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Local consensus processes</td>
<td align="left" rowspan="1" colspan="1">No eligible systematic review identified</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Educational outreach</td>
<td align="left" rowspan="1" colspan="1">Educational outreach visits: effects on professional practice and healthcare outcomes (
<xref rid="b24" ref-type="bibr">O'Brien 2007</xref>
)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Educational outreach</td>
<td align="left" rowspan="1" colspan="1">Systematic review and meta-analysis of practice facilitation within primary care settings (
<xref rid="b3" ref-type="bibr">Baskerville 2012</xref>
)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Educational outreach</td>
<td align="left" rowspan="1" colspan="1">Effectiveness of pharmacist provided services on patient outcomes, health-service utilisation and costs in low- and middle-income countries (
<xref rid="b28" ref-type="bibr">Pande 2013</xref>
)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Local opinion leaders</td>
<td align="left" rowspan="1" colspan="1">Local opinion leaders: effects on professional practice and healthcare outcomes (
<xref rid="b8" ref-type="bibr">Flodgren 2011</xref>
)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Patient-mediated interventions</td>
<td align="left" rowspan="1" colspan="1">No eligible systematic review identified</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Audit and feedback</td>
<td align="left" rowspan="1" colspan="1">Audit and feedback: effects on professional practice and healthcare outcomes (
<xref rid="b15" ref-type="bibr">Ivers 2012</xref>
)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Reminders</td>
<td align="left" rowspan="1" colspan="1">Systematic review of safety checklists for use by medical care teams in acute hospital settings—limited evidence of effectiveness (
<xref rid="b19" ref-type="bibr">Ko 2011</xref>
)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Tailored interventions</td>
<td align="left" rowspan="1" colspan="1">Tailored interventions to overcome identified barriers to change: effects on professional practice and healthcare outcomes (
<xref rid="b2" ref-type="bibr">Baker 2015</xref>
)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Multifaceted interventions</td>
<td align="left" rowspan="1" colspan="1">Interventions encouraging the use of systematic reviews in clinical decision-making: a systematic review (
<xref rid="b30" ref-type="bibr">Perrier 2011</xref>
)</td>
</tr>
<tr>
<td align="left" colspan="2" rowspan="1">
<bold>Strategies targeted at healthcareworkers by type of problem</bold>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Communication with patients</td>
<td align="left" rowspan="1" colspan="1">Training healthcare providers to be more 'patient-centred' in clinical consultations (
<xref rid="b6" ref-type="bibr">Dwamena 2012</xref>
)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Handwashing</td>
<td align="left" rowspan="1" colspan="1">Interventions to improve hand hygiene compliance in patient care (
<xref rid="b11" ref-type="bibr">Gould 2010</xref>
)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Obstetrics</td>
<td align="left" rowspan="1" colspan="1">Non-clinical interventions for reducing unnecessary caesarean section (
<xref rid="b18" ref-type="bibr">Khunpradit 2011</xref>
)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Obstetrics</td>
<td align="left" rowspan="1" colspan="1">Traditional birth attendant training for improving health behaviours and pregnancy outcomes (
<xref rid="b33" ref-type="bibr">Sibley 2012</xref>
)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Obstetrics</td>
<td align="left" rowspan="1" colspan="1">The effect of providing skilled birth attendance and emergency obstetric care in preventing stillbirths (
<xref rid="b39" ref-type="bibr">Yakoob 2011</xref>
)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Obstetrics</td>
<td align="left" rowspan="1" colspan="1">The effects of birth kits to on newborn and maternal outcomes (
<xref rid="b14" ref-type="bibr">Hundley 2012</xref>
)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Prescribing antibiotics</td>
<td align="left" rowspan="1" colspan="1">Interventions to reduce unnecessary antibiotic prescribing: a systematic review and quantitative analysis (
<xref rid="b31" ref-type="bibr">Ranji 2008</xref>
)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Seriously ill newborn care</td>
<td align="left" rowspan="1" colspan="1">In-service training for health professionals to improve care of the seriously ill newborn or child in low and middle-income countries (
<xref rid="b25" ref-type="bibr">Opiyo 2015</xref>
)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Quality of care for STD and HIV</td>
<td align="left" rowspan="1" colspan="1">Interventions for educating traditional healers about STD and HIV medicine (
<xref rid="b36" ref-type="bibr">Sorsdahl 2009</xref>
)</td>
</tr>
<tr>
<td align="left" colspan="2" rowspan="1">
<bold>Strategies targeted at healthcarerecipients</bold>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Providing information/education</td>
<td align="left" rowspan="1" colspan="1">Mass media interventions for promoting HIV testing. (
<xref rid="b38" ref-type="bibr">Vidanapathirana 2005</xref>
)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Providing information/education</td>
<td align="left" rowspan="1" colspan="1">Written information about individual medicines for consumers (
<xref rid="b23" ref-type="bibr">Nicolson 2009</xref>
)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Providing information/education</td>
<td align="left" rowspan="1" colspan="1">Health literacy interventions and outcomes: an updated systematic review (
<xref rid="b4" ref-type="bibr">Berkman 2011</xref>
)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Adherence
<break></break>
- medication</td>
<td align="left" rowspan="1" colspan="1">Interventions for enhancing medication adherence (
<xref rid="b12" ref-type="bibr">Haynes 2008</xref>
)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Adherence
<break></break>
– ART for HIV/AIDS</td>
<td align="left" rowspan="1" colspan="1">Efficacy of interventions in improving highly active antiretroviral therapy adherence and HIV-1 RNA viral load. A meta-analytic review of randomized controlled trials (
<xref rid="b34" ref-type="bibr">Simoni 2006</xref>
)
<break></break>
Antiretroviral adherence interventions: translating research findings to the real world clinic (
<xref rid="b35" ref-type="bibr">Simoni 2010</xref>
)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Adherence
<break></break>
– ART for HIV/AIDS</td>
<td align="left" rowspan="1" colspan="1">Mobile pone text messages for improving adherence to antiretroviral therapy (ART): an individual patient data meta-analysis of randomised trials (
<xref rid="b22" ref-type="bibr">Mbuagbaw 2013</xref>
)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Adherence
<break></break>
– TB</td>
<td align="left" rowspan="1" colspan="1">Incentives and enablers to improve adherence in tuberculosis (
<xref rid="b21" ref-type="bibr">Lutge 2015</xref>
)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Adherence
<break></break>
– TB</td>
<td align="left" rowspan="1" colspan="1">Reminder systems and late patient tracers in the diagnosis and management of tuberculosis (
<xref rid="b20" ref-type="bibr">Liu 2014</xref>
)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Adherence
<break></break>
– malaria medication</td>
<td align="left" rowspan="1" colspan="1">Effects of unit-dose packaged treatment on treatment failure and treatment adherence in people with uncomplicated malaria (
<xref rid="b26" ref-type="bibr">Orton 2005</xref>
)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Facility-based deliveries</td>
<td align="left" rowspan="1" colspan="1">No eligible systematic review identified</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Immunisation coverage</td>
<td align="left" rowspan="1" colspan="1">Interventions for improving coverage of child immunization in low-income and middle-income countries. (
<xref rid="b27" ref-type="bibr">Oyo-Ita 2016</xref>
)
<break></break>
Patient reminder and patient recall systems for improving immunization rates.(
<xref rid="b16" ref-type="bibr">Jacobson Vann 2005</xref>
)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Malaria</td>
<td align="left" rowspan="1" colspan="1">Strategies to increase the ownership and use of insecticide-treated bednets to prevent malaria (
<xref rid="b1" ref-type="bibr">Augustincic Polec 2015</xref>
)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Access to healthcare services</td>
<td align="left" rowspan="1" colspan="1">Interventions targeted at women to encourage the uptake of cervical screening (
<xref rid="b7" ref-type="bibr">Everett 2011</xref>
)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Access to healthcare services</td>
<td align="left" rowspan="1" colspan="1">Outreach strategies for increasing health insurance coverage for vulnerable populations (
<xref rid="b17" ref-type="bibr">Jia 2014</xref>
)</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn>
<p>
<bold>ART</bold>
: antiretroviral therapy.</p>
</fn>
</table-wrap-foot>
</table-wrap>
<table-wrap id="tbl4" position="float">
<label>Table 4</label>
<caption>
<p>Excluded reviews</p>
</caption>
<table frame="border" rules="groups">
<tbody>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Review ID</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>Title</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>Reasons for exclusion</bold>
</th>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b40" ref-type="bibr">Arditi 2012</xref>
</td>
<td align="left" rowspan="1" colspan="1">Computer-generated reminders delivered on paper to healthcare professionals; effects on professional practice and healthcare outcomes</td>
<td align="left" rowspan="1" colspan="1">Limited relevance to low-income countries</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b41" ref-type="bibr">Beilby 1997</xref>
</td>
<td align="left" rowspan="1" colspan="1">Trials of providing costing information to general practitioners: a systematic review</td>
<td align="left" rowspan="1" colspan="1">Search out-of-date</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b42" ref-type="bibr">Bordley 2000</xref>
</td>
<td align="left" rowspan="1" colspan="1">The effect of audit and feedback on immunization delivery: a systematic review</td>
<td align="left" rowspan="1" colspan="1">Search out-of-date</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b43" ref-type="bibr">Chaillet 2006</xref>
</td>
<td align="left" rowspan="1" colspan="1">Evidence-based strategies for implementing guidelines in obstetrics: a systematic review</td>
<td align="left" rowspan="1" colspan="1">Major methodological limitations</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b44" ref-type="bibr">Fudickar 2012</xref>
</td>
<td align="left" rowspan="1" colspan="1">The effect of the WHO surgical safety checklist on complication rate and communication</td>
<td align="left" rowspan="1" colspan="1">Major limitations</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b45" ref-type="bibr">Grilli 2002</xref>
</td>
<td align="left" rowspan="1" colspan="1">Mass media interventions: effects on health services utilisation</td>
<td align="left" rowspan="1" colspan="1">Search out-of-date</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b46" ref-type="bibr">Grimshaw 2004</xref>
</td>
<td align="left" rowspan="1" colspan="1">Effectiveness and efficiency of guideline dissemination and implementation strategies</td>
<td align="left" rowspan="1" colspan="1">Search out-of-date</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b47" ref-type="bibr">Horvath 2012</xref>
</td>
<td align="left" rowspan="1" colspan="1">Mobile phone text messaging for promoting adherence to antiretroviral therapy in patients with HIV infection</td>
<td align="left" rowspan="1" colspan="1">Addressed by
<xref rid="b22" ref-type="bibr">Mbuagbaw 2013</xref>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b48" ref-type="bibr">Hulscher 2001</xref>
</td>
<td align="left" rowspan="1" colspan="1">Interventions to implement prevention in primary care</td>
<td align="left" rowspan="1" colspan="1">Search out-of-date</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b49" ref-type="bibr">Ioannidis 2001</xref>
</td>
<td align="left" rowspan="1" colspan="1">Evidence on interventions to reduce medical errors: an overview and recommendations for future research</td>
<td align="left" rowspan="1" colspan="1">Search out-of-date</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b51" ref-type="bibr">Jayaraman 2010</xref>
</td>
<td align="left" rowspan="1" colspan="1">Advanced trauma life support training for ambulance crews</td>
<td align="left" rowspan="1" colspan="1">Addressed by
<xref rid="b9" ref-type="bibr">Forsetlund 2009</xref>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b50" ref-type="bibr">Jayaraman 2009</xref>
</td>
<td align="left" rowspan="1" colspan="1">Advanced trauma life support training for hospital staff</td>
<td align="left" rowspan="1" colspan="1">Addressed by
<xref rid="b9" ref-type="bibr">Forsetlund 2009</xref>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b52" ref-type="bibr">Kendrick 2000</xref>
</td>
<td align="left" rowspan="1" colspan="1">The effect of home visiting programmes on uptake of childhood immunization: a systematic review and meta-analysis</td>
<td align="left" rowspan="1" colspan="1">Search out-of-date</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b53" ref-type="bibr">Lam-Antoniades 2009</xref>
</td>
<td align="left" rowspan="1" colspan="1">Electronic continuing education in the health professions: an update on evidence from RCTs</td>
<td align="left" rowspan="1" colspan="1">Addressed by
<xref rid="b5" ref-type="bibr">Cook 2008</xref>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b54" ref-type="bibr">Lee 2009</xref>
</td>
<td align="left" rowspan="1" colspan="1">Linking families and facilities for care at birth: What works to avert intrapartum-related deaths?</td>
<td align="left" rowspan="1" colspan="1">Important limitations</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b55" ref-type="bibr">Legare 2010</xref>
</td>
<td align="left" rowspan="1" colspan="1">Interventions for improving the adoption of shared decision making by healthcare professionals</td>
<td align="left" rowspan="1" colspan="1">Limited relevance to low-income countries.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b56" ref-type="bibr">Minkman 2007</xref>
</td>
<td align="left" rowspan="1" colspan="1">Performance improvement based on integrated quality management models: what evidence do we have? A systematic literature review</td>
<td align="left" rowspan="1" colspan="1">Limited relevance to low-income countries</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b57" ref-type="bibr">Naikoba 2001</xref>
</td>
<td align="left" rowspan="1" colspan="1">The effectiveness of interventions aimed at increasing handwashing in healthcare workers- a systematic review</td>
<td align="left" rowspan="1" colspan="1">Search out-of-date</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b58" ref-type="bibr">Nglazi 2013</xref>
</td>
<td align="left" rowspan="1" colspan="1">Mobile phone text messaging for promoting adherence to anti-tuberculosis treatment: a systematic review</td>
<td align="left" rowspan="1" colspan="1">Addressed by
<xref rid="b20" ref-type="bibr">Liu 2014</xref>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b59" ref-type="bibr">Pattinson 2005</xref>
</td>
<td align="left" rowspan="1" colspan="1">Critical incident audit and feedback to improve perinatal and maternal mortality and morbidity</td>
<td align="left" rowspan="1" colspan="1">Addressed by
<xref rid="b15" ref-type="bibr">Ivers 2012</xref>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b60" ref-type="bibr">Pearce 2012</xref>
</td>
<td align="left" rowspan="1" colspan="1">The most effective way of delivering a train-the-trainers program: a systematic review</td>
<td align="left" rowspan="1" colspan="1">Addressed by
<xref rid="b9" ref-type="bibr">Forsetlund 2009</xref>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b61" ref-type="bibr">Rowe 2002</xref>
</td>
<td align="left" rowspan="1" colspan="1">Improving communication between health professionals and women in maternity care: a structured review</td>
<td align="left" rowspan="1" colspan="1">Search out-of-date</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b62" ref-type="bibr">Rueda 2006</xref>
</td>
<td align="left" rowspan="1" colspan="1">Patient support and education for promoting adherence to highly active antiretroviral therapy for HIV/AIDS</td>
<td align="left" rowspan="1" colspan="1">Major methodological limitations</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b63" ref-type="bibr">Safdar 2008</xref>
</td>
<td align="left" rowspan="1" colspan="1">Educational interventions for prevention of healthcare-associated infection: a systematic review</td>
<td align="left" rowspan="1" colspan="1">Addressed by
<xref rid="b9" ref-type="bibr">Forsetlund 2009</xref>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b64" ref-type="bibr">Shea 2009</xref>
</td>
<td align="left" rowspan="1" colspan="1">Increasing the demand for childhood vaccination in developing countries: a systematic review</td>
<td align="left" rowspan="1" colspan="1">Addressed by
<xref rid="b27" ref-type="bibr">Oyo-Ita 2016</xref>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b65" ref-type="bibr">Shojania 2009</xref>
</td>
<td align="left" rowspan="1" colspan="1">The effects of on-screen, point of care computer reminders on processes and outcomes of care</td>
<td align="left" rowspan="1" colspan="1">Limited relevance to low-income countries</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b66" ref-type="bibr">Smith 2009</xref>
</td>
<td align="left" rowspan="1" colspan="1">Provider practice and user behavior interventions to improve prompt and effective treatment of malaria: do we know what works?</td>
<td align="left" rowspan="1" colspan="1">Major limitations</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b67" ref-type="bibr">Smits 2002</xref>
</td>
<td align="left" rowspan="1" colspan="1">Problem based learning in continuing medical education: a review of controlled evaluation studies</td>
<td align="left" rowspan="1" colspan="1">Search out-of-date</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b68" ref-type="bibr">Sowden 2000</xref>
</td>
<td align="left" rowspan="1" colspan="1">Mass media interventions for preventing smoking in young people</td>
<td align="left" rowspan="1" colspan="1">Search out-of-date</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b69" ref-type="bibr">Turner 2005</xref>
</td>
<td align="left" rowspan="1" colspan="1">What is the evidence for effectiveness of WHO guidelines for the care of children in hospitals in developing countries?</td>
<td align="left" rowspan="1" colspan="1">Major methodological limitations</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b70" ref-type="bibr">Wafula 2010</xref>
</td>
<td align="left" rowspan="1" colspan="1">Are interventions for improving the quality of services provided by specialized drug shops effective in sub-Saharan Africa? A systematic review</td>
<td align="left" rowspan="1" colspan="1">Addressed by
<xref rid="b9" ref-type="bibr">Forsetlund 2009</xref>
and
<xref rid="b24" ref-type="bibr">O'Brien 2007</xref>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b71" ref-type="bibr">Zedler 2011</xref>
</td>
<td align="left" rowspan="1" colspan="1">Does packaging with a calendar feature improve adherence to self-administered medication for long-term use? A systematic review</td>
<td align="left" rowspan="1" colspan="1">Addressed by
<xref rid="b12" ref-type="bibr">Haynes 2008</xref>
</td>
</tr>
</tbody>
</table>
</table-wrap>
<table-wrap id="tbl5" position="float">
<label>Table 5</label>
<caption>
<p>Reliability of included reviews</p>
</caption>
<table frame="border" rules="groups">
<tbody>
<tr>
<th align="left" rowspan="2" colspan="1">
<bold>Review</bold>
</th>
<th align="left" colspan="6" rowspan="1">
<bold>A. Identification, selection and critical appraisal of studies
<sup>a</sup>
</bold>
</th>
<th align="left" colspan="6" rowspan="1">
<bold>B. Analysis
<sup>b</sup>
</bold>
</th>
<th align="left" colspan="2" rowspan="1">C. Overall
<sup>c</sup>
</th>
</tr>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>1. Selection criteria</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>2. Search</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>3. Up-to-date</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>4. Study selection</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>5. Risk of bias</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>6. Overall</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>1. Study characteristics</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>2. Analytic methods</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>3. Heterogeneity</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>4. Appropriate synthesis</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>5. Exploratory factors</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>6. Overall</bold>
</th>
<th align="left" rowspan="1" colspan="1">1. Other considerations</th>
<th align="left" rowspan="1" colspan="1">2. Reliability of the review</th>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b2" ref-type="bibr">Baker 2015</xref>
</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b3" ref-type="bibr">Baskerville 2012</xref>
</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">-</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b4" ref-type="bibr">Berkman 2011</xref>
</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b5" ref-type="bibr">Cook 2008</xref>
</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b6" ref-type="bibr">Dwamena 2012</xref>
</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b7" ref-type="bibr">Everett 2011</xref>
</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b8" ref-type="bibr">Flodgren 2011</xref>
</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b9" ref-type="bibr">Forsetlund 2009</xref>
</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b10" ref-type="bibr">Giguère 2012</xref>
</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b11" ref-type="bibr">Gould 2010</xref>
</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b12" ref-type="bibr">Haynes 2008</xref>
</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">NA</td>
<td align="left" rowspan="1" colspan="1">-</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">-</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b13" ref-type="bibr">Horsley 2011</xref>
</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b14" ref-type="bibr">Hundley 2012</xref>
</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b15" ref-type="bibr">Ivers 2012</xref>
</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b16" ref-type="bibr">Jacobson Vann 2005</xref>
</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">-</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">-</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b17" ref-type="bibr">Jia 2014</xref>
</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">NA</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b18" ref-type="bibr">Khunpradit 2011</xref>
</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b19" ref-type="bibr">Ko 2011</xref>
</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">-</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">-</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">-</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">-</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b20" ref-type="bibr">Liu 2014</xref>
</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b21" ref-type="bibr">Lutge 2015</xref>
</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b22" ref-type="bibr">Mbuagbaw 2013</xref>
</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">-</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b23" ref-type="bibr">Nicolson 2009</xref>
</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">-</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">-</td>
<td align="left" rowspan="1" colspan="1">-</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">-</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b24" ref-type="bibr">O'Brien 2007</xref>
</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b25" ref-type="bibr">Opiyo 2015</xref>
</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b26" ref-type="bibr">Orton 2005</xref>
</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">NA</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b27" ref-type="bibr">Oyo-Ita 2016</xref>
</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">NA</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b28" ref-type="bibr">Pande 2013</xref>
</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b29" ref-type="bibr">Parmelli 2011</xref>
<sup>d</sup>
</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">NA</td>
<td align="left" rowspan="1" colspan="1">NA</td>
<td align="left" rowspan="1" colspan="1">NA</td>
<td align="left" rowspan="1" colspan="1">NA</td>
<td align="left" rowspan="1" colspan="1">NA</td>
<td align="left" rowspan="1" colspan="1">NA</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b30" ref-type="bibr">Perrier 2011</xref>
</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b1" ref-type="bibr">Augustincic Polec 2015</xref>
</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1"></td>
<td align="left" rowspan="1" colspan="1">+</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b31" ref-type="bibr">Ranji 2008</xref>
</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">-</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">-</td>
<td align="left" rowspan="1" colspan="1">-</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">-</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b32" ref-type="bibr">Reeves 2013</xref>
</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b33" ref-type="bibr">Sibley 2012</xref>
</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b34" ref-type="bibr">Simoni 2006</xref>
</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">-</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b35" ref-type="bibr">Simoni 2010</xref>
</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">-</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b36" ref-type="bibr">Sorsdahl 2009</xref>
</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b37" ref-type="bibr">Sunguya 2013</xref>
</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b38" ref-type="bibr">Vidanapathirana 2005</xref>
</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<xref rid="b39" ref-type="bibr">Yakoob 2011</xref>
</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">?</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
<td align="left" rowspan="1" colspan="1">+</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn>
<p>
<sup>a</sup>
<bold>A. Identification, selection and critical appraisal of studies</bold>
</p>
</fn>
<fn>
<p>1.
<bold>Selection criteria</bold>
: were the criteria used for deciding which studies to include in the review reported? (+ yes; ? can't tell/partially; − no)</p>
</fn>
<fn>
<p>2.
<bold>Search</bold>
: was the search for evidence reasonably comprehensive? (+ yes; ? can't tell/partially; − no)</p>
</fn>
<fn>
<p>3.
<bold>Up-to-date</bold>
: is the review reasonably up-to-date? (+ yes; ? can't tell/partially; − no)</p>
</fn>
<fn>
<p>4.
<bold>Study selection</bold>
: was bias in the selection of articles avoided? (+ yes; ? can't tell/partially; − no)</p>
</fn>
<fn>
<p>5.
<bold>Risk of bias</bold>
: did the authors use appropriate criteria to assess the risk for bias in analysing the studies that are included? (+ yes; ? can't tell/partially; − no)</p>
</fn>
<fn>
<p>6.
<bold>Overall</bold>
: how would you rate the methods used to identify, include and critically appraise studies? (+ only minor limitations, − important limitations)</p>
</fn>
<fn>
<p>
<sup>b</sup>
<bold>B. Analysis</bold>
</p>
</fn>
<fn>
<p>1.
<bold>Study characteristics</bold>
: were the characteristics and results of the included studies reliably reported? (+ yes; ? can't tell/partially; − no; NA: not applicable, i.e. no studies or data)</p>
</fn>
<fn>
<p>2.
<bold>Analytic methods</bold>
: were the methods used by the review authors to analyse the findings of the included studies reported? (+ yes; ? can't tell/partially; − no; NA: not applicable, i.e. no studies or data)</p>
</fn>
<fn>
<p>3.
<bold>Heterogeneity</bold>
: did the review describe the extent of heterogeneity? (+ yes; ? can't tell/partially; − no; NA: not applicable, i.e. no studies or data)</p>
</fn>
<fn>
<p>4.
<bold>Appropriate synthesis</bold>
: were the findings of the relevant studies combined (or not combined) appropriately relative to the primary question the review addresses and the available data? (+ yes; ? can't tell/partially; − no; NA: not applicable, i.e. no studies or data)</p>
</fn>
<fn>
<p>5.
<bold>Exploratory factors</bold>
: did the review examine the extent to which specific factors might explain differences in the results of the included studies? (+ yes; ? can't tell/partially; − no; NA: not applicable, i.e. no studies or data)</p>
</fn>
<fn>
<p>6.
<bold>Overall</bold>
: how would you rate the methods used to analyse the findings relative to the primary question addressed in the review? (+ only minor limitations, − important limitations; NA: not applicable, i.e. no studies or data)</p>
</fn>
<fn>
<p>
<sup>c</sup>
<bold>C. Overall</bold>
</p>
</fn>
<fn>
<p>1.
<bold>Other considerations</bold>
: are there any other aspects of the review not mentioned before which lead you to question the results? (+ yes; ? can't tell/partially; − no)</p>
</fn>
<fn>
<p>2.
<bold>Reliability of the review</bold>
: based on the above assessments of the methods how would you rate the reliability of the review? (+ only minor limitations, − important limitations)</p>
</fn>
<fn>
<p>
<sup>d</sup>
This was an empty review.</p>
</fn>
</table-wrap-foot>
</table-wrap>
<table-wrap id="tbl6" position="float">
<label>Table 6</label>
<caption>
<p>Key messages of included reviews</p>
</caption>
<table frame="border" rules="groups">
<tbody>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Implementation strategy</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>Key messages</bold>
</th>
</tr>
<tr>
<td align="left" colspan="2" rowspan="1">
<bold>Strategies targeted at healthcareorganisations</bold>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Organisational culture</bold>
<break></break>
Effectiveness of strategies to change organisational culture to improve healthcare performance (
<xref rid="b29" ref-type="bibr">Parmelli 2011</xref>
)</td>
<td align="left" rowspan="1" colspan="1">➡ Strategies to improve organisational culture include:
<break></break>
<list list-type="bullet">
<list-item>
<p>leadership commitment and action through the clear communication of values and concerns related to the decisions taken, the reinforcement of desired behaviours during crisis periods, the use of role models, the allocation of rewards, and clear criteria for the selection and dismissal of employees;</p>
</list-item>
<list-item>
<p>programmes to improve job satisfaction, organisational commitment, teamwork and morale.</p>
</list-item>
</list>
<break></break>
➡ It is uncertain whether any of these strategies to improve organisational culture are effective in changing healthcare performance, as no studies met the review's inclusion criteria.
<break></break>
➡ The implementation of strategies to improve organisational culture should include well-designed evaluations.</td>
</tr>
<tr>
<td align="left" colspan="2" rowspan="1">
<bold>Strategies targeted at healthcareworkers by type of intervention</bold>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Educational materials</bold>
<break></break>
Printed educational materials: effects on professional practice and healthcare outcomes (
<xref rid="b10" ref-type="bibr">Giguère 2012</xref>
)</td>
<td align="left" rowspan="1" colspan="1">➡ When used alone, printed educational materials may slightly improve practice outcomes among healthcare providers, compared to no intervention.
<break></break>
➡ The effects of printed educational materials on patient outcomes are uncertain.
<break></break>
➡ Of the 45 studies included in the review, 44 were from high-income countries. Rigorous studies from low-income countries are needed to assess the impacts of printed educational materials on professional practice in these settings.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Internet-based learning</bold>
<break></break>
Internet-based learning in the health professions: a meta-analysis (
<xref rid="b5" ref-type="bibr">Cook 2008</xref>
)</td>
<td align="left" rowspan="1" colspan="1">➡ Internet-based learning methods compared with no intervention may improve health professionals' knowledge, but it is uncertain whether they improve skills and behaviours of health professionals, or if they lead to beneficial effects on patients.
<break></break>
<list list-type="bullet">
<list-item>
<p>Practise exercises, tutorials, online discussions and longer duration courses may improve the effects of internet-based learning.</p>
</list-item>
</list>
<break></break>
➡ It is uncertain whether Internet-based learning by health professions improves knowledge or other outcomes when compared to other forms of teaching and learning.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Educational meetings</bold>
<break></break>
Continuing education meetings and workshops: effects on professional practice and healthcare outcomes (
<xref rid="b9" ref-type="bibr">Forsetlund 2009</xref>
)</td>
<td align="left" rowspan="1" colspan="1">➡ Educational meetings alone or combined with other interventions probably improve professional practice and healthcare outcomes for patients.
<break></break>
➡ Educational meetings may be more effective with higher attendance at the educational meetings; mixed interactive plus didactic educational meetings may be more effective compared to only interactive or only didactic educational meetings.
<break></break>
➡ Educational meetings may not be effective for complex behaviours, and they may be less effective for less serious outcomes.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Educational meetings</bold>
<break></break>
Interprofessional education: effects on professional practice and healthcare outcomes (
<xref rid="b32" ref-type="bibr">Reeves 2013</xref>
)</td>
<td align="left" rowspan="1" colspan="1">➡ Interprofessional education may lead to improved outcomes for patients and greater patient satisfaction.
<break></break>
➡ Interprofessional education may improve professionals' adherence to guidelines or standards.
<break></break>
➡ It is uncertain whether interprofessional education improves collaborative behaviours among professionals, the competencies of professionals to work together in delivering care or clinical processes.
<break></break>
➡ None of the included studies were conducted in low-income countries. The extent to which these findings are applicable to these settings is uncertain.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Educational meetings</bold>
<break></break>
Teaching critical appraisal skills in healthcare settings (
<xref rid="b13" ref-type="bibr">Horsley 2011</xref>
)</td>
<td align="left" rowspan="1" colspan="1">➡ Teaching critical appraisal skills to health professionals may improve their knowledge of how to critically appraise research papers.
<break></break>
➡ It is uncertain whether teaching critical appraisal skills to health professionals leads to actual changes in their critical appraisal skills.
<break></break>
➡ We did not find any studies that evaluated the impact of teaching critical appraisal skills on processes of care or patient outcomes.
<break></break>
➡ None of the included studies were from low-income countries.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Educational meetings</bold>
<break></break>
Effectiveness of nutrition training of health workers toward improving caregivers' feeding practices for children aged six months to two years: a systematic review (
<xref rid="b37" ref-type="bibr">Sunguya 2013</xref>
)</td>
<td align="left" rowspan="1" colspan="1">➡ Nutrition training of health workers increases daily energy intake of children aged 6 months to 2 years.
<break></break>
➡ Nutrition training of health workers increases feeding frequency of children under 2 years of age.
<break></break>
➡ Children whose caregivers are counselled by trained health workers have a higher consumption of targeted food items compared to their counterparts.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Educational outreach</bold>
<break></break>
Educational outreach visits: effects on professional practice and healthcare outcomes (
<xref rid="b24" ref-type="bibr">O'Brien 2007</xref>
)</td>
<td align="left" rowspan="1" colspan="1">➡ The quality of care delivered to patients:
<break></break>
<list list-type="bullet">
<list-item>
<p>is improved by educational outreach visits alone; and</p>
</list-item>
<list-item>
<p>may be improved more by educational outreach visits plus organisational changes than by educational outreach visits alone.</p>
</list-item>
</list>
<break></break>
➡ For prescribing, the effects are relatively consistent and small, but potentially important.
<break></break>
➡ For other types of professional performance, the effects vary more widely.
<break></break>
➡ Educational outreach visits may not be effective in low-income countries if resources are not available to provide clinical and managerial support.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Educational outreach</bold>
<break></break>
Practice facilitation within primary care settings (
<xref rid="b3" ref-type="bibr">Baskerville 2012</xref>
)</td>
<td align="left" rowspan="1" colspan="1">➡ The use of practice facilitation as a multifaceted approach probably improves the adoption of evidence-based guidelines in primary care settings.
<break></break>
➡ All studies of the effects of practice facilitation took place in high-income countries. Further research is needed to determine the effectiveness and cost implications of practice facilitation in low-income countries.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Educational outreach</bold>
<break></break>
Pharmacist-provided non-dispensing services: effects on patient outcomes, health service utilisation and costs (
<xref rid="b28" ref-type="bibr">Pande 2013</xref>
)</td>
<td align="left" rowspan="1" colspan="1">➡ The provision of additional services by pharmacists targeted at patients, such as patient health education and follow-up, may lead to:
<break></break>
<list list-type="bullet">
<list-item>
<p>a decrease in the rate of hospitalisation, general practice visits and emergency room visits;</p>
</list-item>
<list-item>
<p>a reduction in patients' medication costs;</p>
</list-item>
<list-item>
<p>improvements in some clinical outcomes.</p>
</list-item>
</list>
<break></break>
➡ The provision of additional services by pharmacists targeted at healthcare professionals, such as educational outreach visits, may improve patient outcomes.
<break></break>
➡ The applicability of the findings to low-income countries may be limited by pharmacist numbers, patients and physicians' attitudes to pharmacists, pharmacists' training, and laws governing pharmaceutical practice.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Local opinion leaders</bold>
<break></break>
Local opinion leaders: effects on professional practice and healthcare outcomes (
<xref rid="b8" ref-type="bibr">Flodgren 2011</xref>
)</td>
<td align="left" rowspan="1" colspan="1">➡ Opinion leaders probably influence the behaviour of healthcare professionals.
<break></break>
➡ Patient outcome data were not reported by studies included in the review.
<break></break>
➡ Most of the studies included in this review took place in high-income countries.
<break></break>
➡ Rigorous studies from low-income countries are needed to fully understand the applicability of these findings to low-income country healthcare settings.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Audit and feedback</bold>
<break></break>
Audit and feedback: effects on professional practice and healthcare outcomes (
<xref rid="b15" ref-type="bibr">Ivers 2012</xref>
)</td>
<td align="left" rowspan="1" colspan="1">➡ Interventions that include audit and feedback (alone or as a core component of a multifaceted intervention) probably improve professionals' adherence to desired practice compared with usual care.
<break></break>
➡ Audit and feedback may be more effective when baseline professional performance is low; when the source of the feedback is a supervisor or senior colleague; when the feedback is delivered at least monthly; when it is provided both verbally and in a written format; and when it includes both explicit targets and an action plan.
<break></break>
➡ The effects on patient outcomes of interventions that include audit and feedback may range from little if any effect to some improvement, compared with usual care.
<break></break>
➡ We found few randomised trials of audit and feedback in low-income countries. Audit and feedback is difficult to implement if reliable, routinely collected data are not readily available.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Reminders</bold>
<break></break>
Safety checklists for use by medical care teams in acute hospital settings (
<xref rid="b19" ref-type="bibr">Ko 2011</xref>
)</td>
<td align="left" rowspan="1" colspan="1">➡ Surgical safety checklists may improve death rates and major complications within 30 days after surgery.
<break></break>
➡ It is uncertain whether safety checklists improve adherence to guidelines or patient safety in intensive care units, emergency departments or acute care settings.
<break></break>
➡ Randomised trials are needed to inform decisions about the use of safety checklists in acute hospital settings.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Tailored interventions</bold>
<break></break>
Tailored interventions to overcome identified barriers to change: effects on professional practice and healthcare outcomes (
<xref rid="b2" ref-type="bibr">Baker 2015</xref>
)</td>
<td align="left" rowspan="1" colspan="1">➡ Interventions tailored to address identified barriers are probably more likely to improve professional practice than no intervention or the dissemination of guidelines alone.
<break></break>
➡ It is uncertain whether tailored interventions are more likely to improve professional practice than non-tailored interventions.
<break></break>
➡ Little is known about how best to identify barriers to improving professional practice and how to tailor interventions to address these barriers.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Multifaceted interventions</bold>
<break></break>
Interventions encouraging the use of systematic reviews in clinical decision-making (
<xref rid="b30" ref-type="bibr">Perrier 2011</xref>
)</td>
<td align="left" rowspan="1" colspan="1">➡ It is uncertain whether targeted multifaceted or single interventions (such as training) improve informed decision-making by practitioners.
<break></break>
➡ Multifaceted interventions may improve awareness and use of evidence-based resources, such as searching for systematic reviews using online libraries.
<break></break>
➡ None of the included studies took place in a low-income country.</td>
</tr>
<tr>
<td align="left" colspan="2" rowspan="1">
<bold>Strategies targeted at healthcareworkers by type of problem</bold>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Communication with patients</bold>
<break></break>
Training healthcare providers to be more 'patient-centred' in clinical consultations (
<xref rid="b6" ref-type="bibr">Dwamena 2012</xref>
)</td>
<td align="left" rowspan="1" colspan="1">➡ Patient-centred training for providers (with or without co-interventions):
<break></break>
<list list-type="bullet">
<list-item>
<p>may improve consultation processes, including the extent to which care is patient centred, compared with no intervention;</p>
</list-item>
<list-item>
<p>may slightly improve patient satisfaction with care, compared with no intervention;</p>
</list-item>
<list-item>
<p>may slightly improve patient health behaviours, compared with no intervention;</p>
</list-item>
<list-item>
<p>probably improves patient health outcomes, compared with no intervention.</p>
</list-item>
</list>
<break></break>
➡ This review identified no studies from low- and middle-income countries.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Handwashing</bold>
<break></break>
Interventions to improve hand hygiene compliance in patient care (
<xref rid="b11" ref-type="bibr">Gould 2010</xref>
)</td>
<td align="left" rowspan="1" colspan="1">➡ Educational interventions may increase hand hygiene guidance compliance.
<break></break>
➡ Multifaceted marketing campaigns may increase the use of hand hygiene products.
<break></break>
➡ It is uncertain whether marketing campaigns decrease healthcare-associated infections.
<break></break>
➡ Rigorous evaluation of interventions to increase hand hygiene compliance are needed.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Obstetrics</bold>
<break></break>
Non-clinical interventions for reducing unnecessary caesarean section (
<xref rid="b18" ref-type="bibr">Khunpradit 2011</xref>
)</td>
<td align="left" rowspan="1" colspan="1">➡ Interventions that may reduce unnecessary caesarean sections include: nurse-led relaxation training, birth preparation classes, education of local opinion leaders, and review of each delivery that does not meet guideline criteria plus a 24-hour in-house coverage system.
<break></break>
➡ A mandatory second opinion and post-caesarean section presentation of cases may reduce repeat caesarean section rates.
<break></break>
➡ Interventions that may have little or no overall effect on caesarean section rates include: a prenatal education support programme for vaginal birth after caesarean sections, intensive group therapy for women with fear of childbirth, decision aids, a mandatory second opinion and post-caesarean section presentation of cases, audit and feedback, childbirth education classes for primary care nurses, changes in fees for vaginal deliveries or caesarean sections, and mandatory peer review.
<break></break>
➡ To the extent that reducing unnecessary caesarean sections is a priority, interventions to achieve this goal should be evaluated in randomised trials or interrupted time series studies and the cost-effectiveness of effective interventions should be evaluated.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Obstetrics</bold>
<break></break>
Traditional birth attendant training for improving health behaviours and pregnancy outcomes (
<xref rid="b33" ref-type="bibr">Sibley 2012</xref>
)</td>
<td align="left" rowspan="1" colspan="1">➡ Initial training of TBAs may:
<break></break>
<list list-type="bullet">
<list-item>
<p>reduce neonatal mortality, stillbirths, maternal mortality, the frequency of haemorrhage, and puerperal sepsis; and</p>
</list-item>
<list-item>
<p>increase referrals of pregnant women with obstetric complications and the frequency of pregnant women with obstructed labour.</p>
</list-item>
</list>
<break></break>
➡ Additional TBA training may:
<break></break>
<list list-type="bullet">
<list-item>
<p>reduce neonatal mortality; and</p>
</list-item>
<list-item>
<p>lead to little or no difference in stillbirths, maternal mortality, maternal morbidity, exclusive breastfeeding, and advice about immediate feeding of colostrum.</p>
</list-item>
</list>
<break></break>
➡ Most of the included studies took place in resource-limited settings in low-income countries.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Obstetrics</bold>
<break></break>
The effect of providing skilled birth attendance and emergency obstetric care in preventing stillbirths (
<xref rid="b39" ref-type="bibr">Yakoob 2011</xref>
)</td>
<td align="left" rowspan="1" colspan="1">➡ Skilled birth attendance may reduce stillbirths and perinatal mortality.
<break></break>
➡ It is uncertain what the effects of alternative ways of providing emergency obstetric care are on stillbirths or perinatal mortality.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Obstetrics</bold>
<break></break>
Birth kits (
<xref rid="b14" ref-type="bibr">Hundley 2012</xref>
)</td>
<td align="left" rowspan="1" colspan="1">➡ The use of birth kits (together with education and/or a topical antimicrobial) compared with no intervention:
<break></break>
<list list-type="bullet">
<list-item>
<p>probably reduces neonatal mortality rate;</p>
</list-item>
<list-item>
<p>reduces neonatal tetanus-related mortality;</p>
</list-item>
<list-item>
<p>may reduce neonatal sepsis;</p>
</list-item>
<list-item>
<p>probably reduces maternal mortality;</p>
</list-item>
<list-item>
<p>probably reduces haemorrhage;</p>
</list-item>
<list-item>
<p>reduces puerperal sepsis.</p>
</list-item>
</list>
<break></break>
➡ Most of the included studies took place in low-income countries.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Prescribing antibiotics</bold>
<break></break>
Interventions to reduce unnecessary antibiotic prescribing: a systematic review and quantitative analysis (
<xref rid="b31" ref-type="bibr">Ranji 2008</xref>
)</td>
<td align="left" rowspan="1" colspan="1">➡ Strategies such as clinician education and patient education alone or combined with audit and feedback probably reduce antibiotic prescribing in ambulatory care settings.
<break></break>
➡ The effects of the interventions on the proportion of patients treated with appropriate antibiotics and on clinical outcomes were not reported.
<break></break>
➡ Most of the studies took place in high-income countries.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Seriously ill newborn care</bold>
<break></break>
In-service training for health professionals to improve care of the seriously ill newborn or child in low- and middle-income countries (
<xref rid="b25" ref-type="bibr">Opiyo 2015</xref>
)</td>
<td align="left" rowspan="1" colspan="1">➡ In-service neonatal emergency care training of health professionals probably:
<break></break>
<list list-type="bullet">
<list-item>
<p>increases the proportion of adequate initial resuscitation steps; and</p>
</list-item>
<list-item>
<p>decreases inappropriate and potentially harmful practices per resuscitation.</p>
</list-item>
</list>
<break></break>
➡ In-service neonatal emergency care training of health professionals may reduce mortality in newborns requiring resuscitation.
<break></break>
➡ We found no studies that evaluated the effects of in-service neonatal emergency care training on long-term outcomes or the effects of in-service emergency care training for older children.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Quality of care for STD and HIV</bold>
<break></break>
Interventions for educating traditional healers about STD and HIV medicine (
<xref rid="b36" ref-type="bibr">Sorsdahl 2009</xref>
)</td>
<td align="left" rowspan="1" colspan="1">➡ Training traditional healers may increase their general knowledge about HIV/AIDS, as well as their knowledge about HIV/AIDS signs, symptoms and prevention.
<break></break>
➡ Training traditional healers may improve their HIV/STD patient management practices.
<break></break>
➡ Training traditional healers may lead to little or no difference in the incidence of HIV/AIDS risk behaviours among healers or in their referral practices.
<break></break>
➡ Traditional healers who have received training may refer patients to allopathic health more frequently if their traditional treatment fails.</td>
</tr>
<tr>
<td align="left" colspan="2" rowspan="1">
<bold>Strategies targeted at healthcarerecipients</bold>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Providing information/education</bold>
<break></break>
Mass media interventions for promoting HIV testing (
<xref rid="b38" ref-type="bibr">Vidanapathirana 2005</xref>
)</td>
<td align="left" rowspan="1" colspan="1">➡ Mass media interventions lead to an increase in immediate uptake of HIV testing.
<break></break>
➡ These initial increases in uptake of HIV testing following mass media interventions may not be sustained in the long term.
<break></break>
➡ Mass media interventions may lead to an increase in the number of infected people diagnosed through voluntary counselling and testing.
<break></break>
➡ These findings come from studies conducted in high-income non-endemic countries. Factors that may affect the transferability of these findings to low-income countries include access to television, radio, and print media; availability of (and user-fees for) HIV voluntary counselling and testing; the level of stigma and discrimination against people living with HIV in the community; and the maturity of the HIV epidemic.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Providing information/education</bold>
<break></break>
Written information about individual medicines for consumers (
<xref rid="b23" ref-type="bibr">Nicolson 2009</xref>
)</td>
<td align="left" rowspan="1" colspan="1">➡ Written medicine information may slightly improve knowledge and attitudes about medicines compared with no written information.
<break></break>
➡ Written medicine information may lead to little or no difference in adherence to instructions compared with no written information.
<break></break>
➡ The effect of written medicine information on health outcomes is uncertain. The review did not find studies that evaluated this.
<break></break>
➡ Written medicine information delivered in an 'easy-to-read' format compared with a standard manufacturer's format may lead to little or no difference in knowledge about and behaviours related to medicines, but it may slightly improve attitudes towards the information presented.
<break></break>
➡ Written numerical information about the risks of medicines may slightly improve knowledge and attitudes about medicines compared with the same information as text.
<break></break>
➡ The effects of written medicine information are mediated by the ability to read the information presented. Low literacy levels in low-income countries could make these findings less applicable.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Providing information/education</bold>
<break></break>
Health literacy interventions (
<xref rid="b4" ref-type="bibr">Berkman 2011</xref>
)</td>
<td align="left" rowspan="1" colspan="1">➡ Some single strategies may improve comprehension for people with low health literacy, such as presenting essential information by itself, using the same denominators to present baseline risk and treatment benefit information, and adding icon arrays to numerical presentations of treatment benefit information.
<break></break>
➡ It is uncertain whether single strategies improve the use of healthcare services, health outcomes, resource use or disparities in the use of healthcare services.
<break></break>
➡ Some mixed strategies such as intensive self-management and adherence interventions probably improve the use of healthcare across health literacy levels.
<break></break>
➡ Some mixed strategies such as intensive disease management programmes probably reduce disease prevalence across health literacy levels.
<break></break>
➡ It is uncertain whether mixed strategies improve resource use or disparities in the use of healthcare services.
<break></break>
➡ Only one of the included studies took place in a low-income country.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Adherence</bold>
– medication
<break></break>
Interventions for enhancing medication adherence (
<xref rid="b12" ref-type="bibr">Haynes 2008</xref>
)</td>
<td align="left" rowspan="1" colspan="1">➡ It is uncertain whether interventions to increase adherence to short-term treatments improve adherence or patient outcomes.
<break></break>
➡ Interventions aimed at increasing adherence to long-term treatments may improve adherence, but it is uncertain whether they improve patient outcomes.
<break></break>
➡ Most of the included studies assessed complex interventions with multiple components in high-income countries. Adherence interventions may be difficult to implement in low-income countries where health systems face greater challenges.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Adherence</bold>
– ART for HIV/AIDS
<break></break>
Efficacy of interventions in improving highly active antiretroviral therapy adherence and HIV-1 RNA viral load (
<xref rid="b34" ref-type="bibr">Simoni 2006</xref>
;
<xref rid="b35" ref-type="bibr">Simoni 2010</xref>
)</td>
<td align="left" rowspan="1" colspan="1">➡ Behavioural interventions probably lead to slightly better adherence to HAART.
<break></break>
➡ Behavioural interventions may slightly improve the number of patients with undetectable viral load (a laboratory measure of successful HAART).
<break></break>
➡ We did not find any studies measuring patient outcomes such as morbidity and mortality.
<break></break>
➡ Only one included study took place in a low-income country.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Adherence</bold>
– ART for HIV/AIDS
<break></break>
Mobile phone text messages for improving adherence to antiretroviral therapy (ART) (
<xref rid="b22" ref-type="bibr">Mbuagbaw 2013</xref>
)</td>
<td align="left" rowspan="1" colspan="1">➡ Mobile phone text messages compared to standard care improve adherence to ART for up to 12 months.
<break></break>
➡ Mobile phone text messages compared to standard care may lead to little or no difference in mortality or loss to follow-up after up to 12 months.
<break></break>
➡ Weekly text messages probably improve adherence compared to daily text messages, and interactive text messages probably improve adherence compared to non-interactive text messages.
<break></break>
➡ All studies took place in low-income countries in Africa.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Adherence</bold>
– TB
<break></break>
Material incentives and enablers in the management of tuberculosis (
<xref rid="b21" ref-type="bibr">Lutge 2015</xref>
)</td>
<td align="left" rowspan="1" colspan="1">➡ Sustained material incentives may lead to little or no difference in cure or completion of treatment for active TB, compared to no incentive.
<break></break>
➡ It is not clear if sustained material incentives improve completion of TB prophylaxis, compared to no incentive, because findings varied across studies.
<break></break>
➡ A single, once only incentive may increase the number of people who return to a clinic for reading of their tuberculin skin test, compared to no incentive.
<break></break>
➡ A single, once only incentive probably increases the number of people who return to a clinic to start or continue TB prophylaxis, compared to no incentive.
<break></break>
➡ Compared to a non-cash incentive, cash incentives may slightly increase the number of people who return to a clinic for reading of their tuberculin skin test and may increase the number of people who complete TB prophylaxis.
<break></break>
➡ Compared to counselling or education interventions, material incentives may increase the number of people who return to a clinic for reading of their tuberculin skin test.
<break></break>
➡ Compared to counselling or education interventions, material incentives may lead to little or no difference in the number of people who return to a clinic to start or continue TB prophylaxis or in the number of people who complete TB prophylaxis.
<break></break>
➡ Higher cash incentives may slightly improve the number of people who return to a clinic for reading of their tuberculin skin test, compared to lower cash incentives.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Adherence</bold>
– TB
<break></break>
Reminder systems to improve patient adherence to tuberculosis clinic appointments for diagnosis and treatment (
<xref rid="b20" ref-type="bibr">Liu 2014</xref>
)</td>
<td align="left" rowspan="1" colspan="1">➡ For patients being treated for active TB:
<break></break>
<list list-type="bullet">
<list-item>
<p>default reminders probably increase the number of patients completing treatment and may increase clinic attendance;</p>
</list-item>
<list-item>
<p>pre-appointment reminders may increase clinic attendance and the number of patients completing treatment.</p>
</list-item>
</list>
<break></break>
➡ For people on TB prophylaxis, pre-appointment reminders may increase clinic attendance.
<break></break>
➡ For people undergoing screening for TB, pre-appointment reminders may have little or no effect on the number of people who return to clinic for the result of their skin test.
<break></break>
➡ Due to the low-certainty evidence, more well-designed trials are needed to establish whether reminder systems are effective in different settings, and the best way of delivering reminders, especially in low-income countries.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Adherence</bold>
– malaria medication
<break></break>
Unit-dose packaged drugs for treating malaria (
<xref rid="b26" ref-type="bibr">Orton 2005</xref>
)</td>
<td align="left" rowspan="1" colspan="1">➡ No studies measured treatment failure on or by day 28 after initiation of treatment, which was the primary outcome in this review.
<break></break>
➡ The use of blister packs compared to paper envelopes for antimalarial drugs may improve adherence to treatment and may slightly improve clinical outcomes. No studies reported adverse events.
<break></break>
➡ The use of sectioned polythene bags compared with bottled syrup may improve adherence to treatment in children under 5 years who have malaria, but may increase vomiting. It is uncertain whether there is a difference in clinical outcomes.
<break></break>
➡ The use of sectioned polythene bags compared to paper envelopes for antimalarial drugs probably improves adherence to treatment and may slightly improve clinical outcomes in children over 7 years and adults with malaria. Their use may lead to little if any difference in adverse events.
<break></break>
➡ It is uncertain whether the use of sectioned compared to unsectioned polythene bags leads to a difference in adherence, clinical outcomes or adverse events.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Immunisation coverage</bold>
<break></break>
Interventions for improving coverage of child immunization in low-income and middle-income countries (
<xref rid="b27" ref-type="bibr">Oyo-Ita 2016</xref>
)
<break></break>
Patient reminder and patient recall systems for improving immunization rates (
<xref rid="b16" ref-type="bibr">Jacobson Vann 2005</xref>
)</td>
<td align="left" rowspan="1" colspan="1">➡ Community-based health education probably improves coverage of three doses of diphtheria-tetanus-pertussis vaccine (DTP3). However, the impacts of facility-based health education on coverage of DPT3 may vary from little or no effect to potentially important benefits.
<break></break>
➡ Health education combined with reminders may increase DTP3 coverage.
<break></break>
➡ Training vaccination managers to provide supportive supervision for healthcare provider may have little or no effect on coverage of DTP, oral polio vaccine (OPV) and hepatitis B virus (HBV) vaccine.
<break></break>
➡ Integrating vaccination with other healthcare services may increase DTP3 and measles vaccine coverage and may have little or no effect on BCG coverage.
<break></break>
➡ Household monetary incentives may have little or no effect on achieving full vaccination coverage.
<break></break>
➡ Home visits may improve OPV3 and measles coverage.
<break></break>
➡ Reminders and recall strategies probably increase routine childhood vaccination uptake.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Malaria</bold>
<break></break>
Strategies to increase the ownership and use of insecticide-treated bednets to prevent malaria (
<xref rid="b1" ref-type="bibr">Augustincic Polec 2015</xref>
)</td>
<td align="left" rowspan="1" colspan="1">➡ Providing free insecticide-treated bednets compared to providing subsidised or full market price bednets probably increases the number of pregnant women, adults and children who possess insecticide-treated bednets, but probably leads to little or no difference in appropriate use of bednets.
<break></break>
➡ Education about appropriate use of insecticide-treated bednets may increase the number of adults and children under 5 sleeping under bednets.
<break></break>
➡ Providing incentives to encourage the use of insecticide-treated bednets may lead to little or no difference in use.
<break></break>
➡ The included studies took place in rural communities in Africa, India and Iran.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Access to healthcare services</bold>
<break></break>
Interventions targeted at women to encourage the uptake of cervical screening (
<xref rid="b7" ref-type="bibr">Everett 2011</xref>
)</td>
<td align="left" rowspan="1" colspan="1">➡ Education, counselling, access to health promotion nurse, invitations to attend cervical screening programmes and intensive recruitment probably increase the uptake of cervical screening.
<break></break>
➡ Enhanced risk factor assessment may lead to little or no difference in the uptake of screening.
<break></break>
➡ Photo-comic book and message framing probably lead to little or no difference on the uptake of screening.
<break></break>
➡ Most of the included studies took place in high-income countries.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Access to healthcare services</bold>
<break></break>
Outreach strategies for increasing health insurance coverage for vulnerable populations (
<xref rid="b17" ref-type="bibr">Jia 2014</xref>
)</td>
<td align="left" rowspan="1" colspan="1">➡ Health insurance information and application support probably:
<break></break>
<list list-type="bullet">
<list-item>
<p>increases the enrolment of children in health insurance schemes;</p>
</list-item>
<list-item>
<p>leads to continuous enrolment of children in insurance schemes:</p>
</list-item>
<list-item>
<p>decreases the mean time taken to obtain insurance for children; and</p>
</list-item>
<list-item>
<p>leads to parental satisfaction with the process of enrolment.</p>
</list-item>
</list>
<break></break>
➡ Handing out application forms in the emergency department of hospitals probably increases the enrolment of children in health insurance schemes.
<break></break>
➡ Only 2 studies conducted in high-income countries were included in the review.
<break></break>
<list list-type="bullet">
<list-item>
<p>Rigorous studies are needed that evaluate the effects and costs of different outreach strategies in different countries for expanding the health insurance coverage of vulnerable populations.</p>
</list-item>
<list-item>
<p>The use of the outreach strategies for increasing health insurance coverage in low-income countries should be accompanied by monitoring and evaluation.</p>
</list-item>
</list>
</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn>
<p>
<bold>ART</bold>
: antiretroviral therapy;
<bold>HAART</bold>
: highly active antiretroviral therapy;
<bold>TB</bold>
: tuberculosis.</p>
</fn>
</table-wrap-foot>
</table-wrap>
<table-wrap id="tbl7" position="float">
<label>Table 7</label>
<caption>
<p>Intervention-outcome matrix</p>
</caption>
<table frame="border" rules="groups">
<tbody>
<tr>
<th align="left" rowspan="2" colspan="1">
<bold>Implementation strategy</bold>
</th>
<th align="left" colspan="9" rowspan="1">
<bold>Direction of effects and certainty of the evidence
<sup>a</sup>
</bold>
</th>
</tr>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Patient outcomes</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>Access, coverage, utilisation</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>Quality of care</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>Resource use</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>Social outcomes</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>Impacts on equity</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>Healthcareprovider outcomes</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>Adverse effects
<sup>b</sup>
</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>Other</bold>
</th>
</tr>
<tr>
<td align="left" colspan="10" rowspan="1">
<bold>Strategies targeted at healthcare organisations</bold>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Organisational culture</bold>
<break></break>
(
<xref rid="b29" ref-type="bibr">Parmelli 2011</xref>
)</td>
<td align="left" rowspan="1" colspan="1">NS</td>
<td align="left" rowspan="1" colspan="1">NS</td>
<td align="left" rowspan="1" colspan="1">NS</td>
<td align="left" rowspan="1" colspan="1">NS</td>
<td align="left" rowspan="1" colspan="1">NS</td>
<td align="left" rowspan="1" colspan="1">NS</td>
<td align="left" rowspan="1" colspan="1">NS</td>
<td align="left" rowspan="1" colspan="1">NS</td>
<td align="left" rowspan="1" colspan="1">NS</td>
</tr>
<tr>
<td align="left" colspan="10" rowspan="1">
<bold>Strategies targeted at healthcare workers by type of intervention</bold>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Printed educational materials</bold>
<break></break>
(
<xref rid="b10" ref-type="bibr">Giguère 2012</xref>
)</td>
<td align="left" rowspan="1" colspan="1">?⊕ooo</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕oo
<sup>1</sup>
</td>
<td align="left" rowspan="1" colspan="1">NS</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NS</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Internet-based learning in health professions</bold>
<break></break>
Vs no intervention
<break></break>
(
<xref rid="b5" ref-type="bibr">Cook 2008</xref>
)</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕oo
<sup>2</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Vs non-Internet-based learning
<break></break>
(
<xref rid="b5" ref-type="bibr">Cook 2008</xref>
)</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">⊕⊕oo
<sup>2</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Educational meetings</bold>
<break></break>
Continuing education meetings
<break></break>
(
<xref rid="b9" ref-type="bibr">Forsetlund 2009</xref>
)</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕⊕o</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕⊕o
<sup>1</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Interprofessional education
<break></break>
(
<xref rid="b32" ref-type="bibr">Reeves 2013</xref>
)</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕oo</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕oo
<sup>1</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">?⊕ooo
<sup>3</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Teaching critical appraisal
<break></break>
(
<xref rid="b13" ref-type="bibr">Horsley 2011</xref>
)</td>
<td align="left" rowspan="1" colspan="1">NS</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NS</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕oo
<sup>4</sup>
<break></break>
?⊕ooo
<sup>5</sup>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Nutrition training of health workers
<break></break>
<xref rid="b37" ref-type="bibr">Sunguya 2013</xref>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕⊕⊕
<sup>6</sup>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Educational outreach</bold>
<break></break>
Vs no intervention
<break></break>
<xref rid="b24" ref-type="bibr">O'Brien 2007</xref>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕⊕⊕
<sup>7</sup>
<break></break>
✓⊕⊕⊕o
<sup>8</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Vs another intervention
<break></break>
<xref rid="b24" ref-type="bibr">O'Brien 2007</xref>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕oo
<sup>9</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Practice facilitation
<break></break>
<xref rid="b3" ref-type="bibr">Baskerville 2012</xref>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕⊕o
<sup>1</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Pharmacist-provided services</bold>
targeted at patients, such as patient health education and follow-up
<break></break>
<xref rid="b28" ref-type="bibr">Pande 2013</xref>
</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕oo
<sup>10</sup>
</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕oo
<sup>11</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NS</td>
<td align="left" rowspan="1" colspan="1">NS</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕oo
<sup>12</sup>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Pharmacist-provided services</bold>
targeted at healthcare professionals, such as educational outreach visits
<break></break>
<xref rid="b28" ref-type="bibr">Pande 2013</xref>
</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕oo</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NS</td>
<td align="left" rowspan="1" colspan="1">NS</td>
<td align="left" rowspan="1" colspan="1">NS</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NS</td>
<td align="left" rowspan="1" colspan="1">NS</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Local opinion leaders</bold>
<break></break>
(
<xref rid="b8" ref-type="bibr">Flodgren 2011</xref>
)</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕⊕o
<sup>1</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Audit and feedback</bold>
<break></break>
– (with or without other interventions) vs usual care (
<xref rid="b15" ref-type="bibr">Ivers 2012</xref>
)</td>
<td align="left" rowspan="1" colspan="1">⊕⊕⊕o</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕⊕o
<sup>1</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Audit and feedback</bold>
<break></break>
– compared with other interventions
<break></break>
(
<xref rid="b15" ref-type="bibr">Ivers 2012</xref>
)</td>
<td align="left" rowspan="1" colspan="1">⊕⊕⊕o</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">⊕⊕⊕o
<sup>1</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Reminders</bold>
<break></break>
<bold></bold>
intensive care unit, emergency department and acute care settings
<break></break>
(
<xref rid="b19" ref-type="bibr">Ko 2011</xref>
)</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">?⊕ooo
<sup>1</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Reminders</bold>
<break></break>
<bold></bold>
surgery setting
<break></break>
(
<xref rid="b19" ref-type="bibr">Ko 2011</xref>
)</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕oo
<sup>13</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Tailored interventions</bold>
<break></break>
- Vs no intervention
<break></break>
(
<xref rid="b2" ref-type="bibr">Baker 2015</xref>
)</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕⊕o
<sup>1</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">- Vs non-tailored interventions
<break></break>
(
<xref rid="b2" ref-type="bibr">Baker 2015</xref>
)</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">?⊕ooo
<sup>1</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">- Interventions targeted at organisational and individual barriers vs interventions targeted at individual barriers only
<break></break>
(
<xref rid="b2" ref-type="bibr">Baker 2015</xref>
)</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">?⊕ooo
<sup>1</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Multifaceted interventions</bold>
<break></break>
- Interventions to encourage the use of systematic reviews in clinical decision-making
<break></break>
(
<xref rid="b30" ref-type="bibr">Perrier 2011</xref>
)</td>
<td align="left" rowspan="1" colspan="1">NS</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">?⊕ooo
<sup>14</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NS</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" colspan="10" rowspan="1">
<bold>Strategies targeted at healthcare workers by type of problem</bold>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Communication with patients</bold>
<break></break>
– interventions to promote patient-centred care
<break></break>
<xref rid="b6" ref-type="bibr">Dwamena 2012</xref>
</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕⊕o
<sup>15</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕⊕o
<sup>16</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Handwashing</bold>
<break></break>
– educational interventions and marketing campaigns
<break></break>
<xref rid="b11" ref-type="bibr">Gould 2010</xref>
</td>
<td align="left" rowspan="1" colspan="1">?⊕ooo
<sup>17</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕oo
<sup>18</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕oo
<sup>19</sup>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Obstetrics – non-clinical interventions to reduce unnecessary cesarean section rates</bold>
<break></break>
Guidelines + mandatory second opinion
<break></break>
<xref rid="b18" ref-type="bibr">Khunpradit 2011</xref>
</td>
<td align="left" rowspan="1" colspan="1">?⊕⊕oo</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕oo</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Nurse training/insurance reform/legislative changes/audit & feedback/external peer review
<xref rid="b18" ref-type="bibr">Khunpradit 2011</xref>
</td>
<td align="left" rowspan="1" colspan="1">?⊕⊕oo</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">?⊕⊕oo</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Obstetrics</bold>
<bold>traditional birth attendants (TBA)</bold>
<break></break>
Trained TBAs versus untrained TBA
<break></break>
<xref rid="b33" ref-type="bibr">Sibley 2012</xref>
</td>
<td align="left" rowspan="1" colspan="1">?⊕⊕oo</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">?⊕⊕oo
<sup>20</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Additional TBAs training vs no additional TBA training
<xref rid="b33" ref-type="bibr">Sibley 2012</xref>
</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕oo
<sup>21</sup>
<break></break>
✓⊕⊕oo
<sup>22</sup>
<break></break>
⊕⊕oo
<sup>23</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">⊕⊕oo
<sup>24</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Obstetrics</bold>
– skilled births attendance vs usual care
<xref rid="b39" ref-type="bibr">Yakoob 2011</xref>
</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕oo
<sup>25</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Obstetrics</bold>
– birth kits
<break></break>
<xref rid="b14" ref-type="bibr">Hundley 2012</xref>
</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕⊕⊕
<sup>26</sup>
<break></break>
✓⊕⊕⊕o
<sup>27</sup>
<break></break>
✓⊕⊕oo
<sup>28</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Prescribing antibiotics</bold>
<break></break>
Clinician education with/without other intervention vs no intervention
<break></break>
<xref rid="b31" ref-type="bibr">Ranji 2008</xref>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕⊕o
<sup>29</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Seriously ill newborn care</bold>
– in-service neonatal emergency care training
<break></break>
<xref rid="b25" ref-type="bibr">Opiyo 2015</xref>
</td>
<td align="left" rowspan="1" colspan="1">⊕⊕oo
<sup>30</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕⊕o
<sup>31</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Traditional healers –</bold>
training about STD and HIV medicine
<break></break>
<xref rid="b36" ref-type="bibr">Sorsdahl 2009</xref>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕oo
<sup>32</sup>
<break></break>
⊕⊕oo
<sup>33</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕oo
<sup>34</sup>
</td>
</tr>
<tr>
<td align="left" colspan="10" rowspan="1">
<bold>Strategies targeted at healthcare recipients</bold>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Providing information/education</bold>
<break></break>
multimedia for promoting HIV testing
<break></break>
<xref rid="b38" ref-type="bibr">Vidanapathirana 2005</xref>
</td>
<td align="left" rowspan="1" colspan="1">⊕⊕oo
<sup>35</sup>
</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕oo
<sup>36</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Providing information/education</bold>
– leaflets for promoting HIV testing
<break></break>
<xref rid="b38" ref-type="bibr">Vidanapathirana 2005</xref>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕⊕⊕
<sup>37</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Providing information/education</bold>
– gain-framed versus loss-framed video tapes for promoting HIV testing
<break></break>
<xref rid="b38" ref-type="bibr">Vidanapathirana 2005</xref>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕⊕⊕
<sup>38</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Providing information</bold>
:
<break></break>
written medicine information
<break></break>
<xref rid="b23" ref-type="bibr">Nicolson 2009</xref>
</td>
<td align="left" rowspan="1" colspan="1">NS</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕oo
<sup>39</sup>
<break></break>
⊕⊕oo
<sup>40</sup>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Single interventions to improve health literacy</bold>
(e.g. presenting essential information first, presenting information so that the higher numbers indicate better quality)
<break></break>
<xref rid="b4" ref-type="bibr">Berkman 2011</xref>
</td>
<td align="left" rowspan="1" colspan="1">?⊕ooo</td>
<td align="left" rowspan="1" colspan="1">?⊕ooo</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NS</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">?⊕ooo</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕oo
<sup>41</sup>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Mixed interventions to improve health literacy</bold>
(intensive self-management and adherence and intensive disease management)
<break></break>
<xref rid="b4" ref-type="bibr">Berkman 2011</xref>
</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕⊕o
<sup>42</sup>
</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕⊕o
<sup>43</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">?⊕ooo</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NS</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Adherence</bold>
<break></break>
<bold>– medication</bold>
: interventions to improve adherence to short-term treatments
<break></break>
<xref rid="b12" ref-type="bibr">Haynes 2008</xref>
<sup>44</sup>
</td>
<td align="left" rowspan="1" colspan="1">?⊕⊕oo
<sup>45</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Adherence</bold>
<break></break>
<bold>– medication</bold>
: interventions to improve adherence to long-term treatments (more than 6 months)
<break></break>
<xref rid="b12" ref-type="bibr">Haynes 2008</xref>
<sup>40</sup>
</td>
<td align="left" rowspan="1" colspan="1">?⊕⊕oo
<sup>46</sup>
<break></break>
✓⊕⊕oo
<sup>47</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Adherence</bold>
<break></break>
<bold>– ART for HIV/AIDS</bold>
: behavioural interventions
<break></break>
<xref rid="b34" ref-type="bibr">Simoni 2006</xref>
</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕⊕o
<sup>35</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕oo
<sup>48</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Adherence</bold>
<break></break>
<bold>- ART for HIV/AIDS</bold>
<break></break>
<xref rid="b22" ref-type="bibr">Mbuagbaw 2013</xref>
</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕⊕⊕
<sup>49</sup>
<break></break>
⊕⊕oo
<sup>51</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">⊕⊕oo
<sup>52</sup>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Adherence</bold>
<break></break>
<bold>– TB</bold>
: incentives vs routine care
<break></break>
<xref rid="b21" ref-type="bibr">Lutge 2015</xref>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕oo
<sup>50</sup>
<break></break>
✓⊕⊕⊕o53
<break></break>
?⊕ooo
<sup>54</sup>
<break></break>
⊕⊕oo
<sup>55</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Adherence</bold>
<break></break>
<bold>– TB</bold>
: immediate vs deferred incentives
<break></break>
<xref rid="b21" ref-type="bibr">Lutge 2015</xref>
</td>
<td align="left" rowspan="1" colspan="1">⊕⊕oo
<sup>56</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Adherence</bold>
<break></break>
<bold>– TB</bold>
: cash vs non-cash incentive
<break></break>
<xref rid="b21" ref-type="bibr">Lutge 2015</xref>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕oo
<sup>57</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Adherence</bold>
<break></break>
<bold>– TB</bold>
: different levels of cash incentives
<break></break>
<xref rid="b21" ref-type="bibr">Lutge 2015</xref>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕oo
<sup>58</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Adherence</bold>
<break></break>
<bold>– TB</bold>
: incentives vs other interventions
<break></break>
<xref rid="b21" ref-type="bibr">Lutge 2015</xref>
</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕oo
<sup>59</sup>
</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕oo
<sup>60</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Adherence</bold>
<break></break>
<bold>– TB</bold>
: mobile phone messages reminders
<break></break>
<xref rid="b20" ref-type="bibr">Liu 2014</xref>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕oo
<sup>61</sup>
<break></break>
✓⊕⊕⊕o
<sup>62</sup>
</td>
<td align="left" rowspan="1" colspan="1"></td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Adherence – malaria medication</bold>
: blister packed tablets and capsules vs tablets and capsules in paper envelopes
<break></break>
<xref rid="b26" ref-type="bibr">Orton 2005</xref>
</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕oo
<sup>63</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Adherence – malaria medication</bold>
: tablets in sectioned polythene bags vs bottled syrup
<break></break>
<xref rid="b26" ref-type="bibr">Orton 2005</xref>
</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕oo
<sup>64</sup>
<break></break>
?⊕ooo
<sup>65</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">?⊕⊕oo
<sup>66</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Adherence – malaria medication</bold>
:
<bold>t</bold>
ablets in sectioned polythene bags vs tablets and capsules in paper envelopes
<break></break>
<xref rid="b26" ref-type="bibr">Orton 2005</xref>
</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕⊕o
<sup>67</sup>
<break></break>
✓⊕⊕oo
<sup>68</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">⊕⊕oo
<sup>68</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Adherence – malaria medication</bold>
: tablets in sectioned polythene bags vs polythene bags (unsectioned)
<break></break>
<xref rid="b26" ref-type="bibr">Orton 2005</xref>
</td>
<td align="left" rowspan="1" colspan="1">?⊕ooo
<sup>70</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Immunisation coverage</bold>
: health education
<break></break>
<xref rid="b27" ref-type="bibr">Oyo-Ita 2016</xref>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕⊕o
<sup>71</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Immunisation coverage</bold>
: healthcare providers training
<break></break>
<xref rid="b27" ref-type="bibr">Oyo-Ita 2016</xref>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">⊕⊕oo
<sup>71</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Immunisation coverage</bold>
: home visits
<break></break>
<xref rid="b27" ref-type="bibr">Oyo-Ita 2016</xref>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕oo
<sup>71</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Immunisation coverage</bold>
: monetary incentives (withdrawing of monetary vouchers)
<break></break>
<xref rid="b27" ref-type="bibr">Oyo-Ita 2016</xref>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">⊕⊕oo
<sup>71</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Immunisation coverage</bold>
:
<bold>m</bold>
ultifaceted interventions (monetary incentives + quality assurance + provision of equipment, drugs and materials)
<break></break>
<xref rid="b27" ref-type="bibr">Oyo-Ita 2016</xref>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">⊕⊕oo
<sup>71</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Immunisation coverage</bold>
: reminders and recall systems
<xref rid="b16" ref-type="bibr">Jacobson Vann 2005</xref>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕⊕o
<sup>71</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Malaria:</bold>
Providing free ITNs vs subsidised ITNs
<break></break>
<xref rid="b1" ref-type="bibr">Augustincic Polec 2015</xref>
</td>
<td align="left" rowspan="1" colspan="1">NS</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕⊕o
<sup>72</sup>
<break></break>
⊕⊕⊕o
<sup>73</sup>
</td>
<td align="left" rowspan="1" colspan="1">NS</td>
<td align="left" rowspan="1" colspan="1">NS</td>
<td align="left" rowspan="1" colspan="1">NS</td>
<td align="left" rowspan="1" colspan="1">NS</td>
<td align="left" rowspan="1" colspan="1">NS</td>
<td align="left" rowspan="1" colspan="1">NS</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Malaria:</bold>
Education about appropriate ITN use vs no education
<break></break>
<xref rid="b1" ref-type="bibr">Augustincic Polec 2015</xref>
</td>
<td align="left" rowspan="1" colspan="1">NS</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕oo
<sup>74</sup>
</td>
<td align="left" rowspan="1" colspan="1">NS</td>
<td align="left" rowspan="1" colspan="1">NS</td>
<td align="left" rowspan="1" colspan="1">NS</td>
<td align="left" rowspan="1" colspan="1">NS</td>
<td align="left" rowspan="1" colspan="1">NS</td>
<td align="left" rowspan="1" colspan="1">NS</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Access to healthcare services: Interventions to improve the uptake of cervical cancer screening</bold>
<break></break>
Invitations to attend screening (face-to-face, letter, telephone)
<break></break>
<xref rid="b7" ref-type="bibr">Everett 2011</xref>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕⊕o
<sup>75</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Educational interventions for women
<break></break>
<xref rid="b7" ref-type="bibr">Everett 2011</xref>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕⊕o
<sup>75</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Counselling
<break></break>
<xref rid="b7" ref-type="bibr">Everett 2011</xref>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕⊕o
<sup>75</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Risk factor assessment
<break></break>
<xref rid="b7" ref-type="bibr">Everett 2011</xref>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">⊕⊕oo
<sup>75</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Other interventions (access to a health promotion nurse, intensive recruitment)
<break></break>
<xref rid="b7" ref-type="bibr">Everett 2011</xref>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕⊕o
<sup>75</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Other interventions (photo-comic book, message framing)
<break></break>
<xref rid="b7" ref-type="bibr">Everett 2011</xref>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">⊕⊕⊕o
<sup>75</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Access to healthcare services</bold>
<bold>outreach strategies for increasing health insurance coverage for vulnerable populations</bold>
<break></break>
Health insurance information and application support
<break></break>
<xref rid="b17" ref-type="bibr">Jia 2014</xref>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕⊕o
<sup>76</sup>
</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕⊕o
<sup>77</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Handing out application forms in emergency department of hospitals
<break></break>
<xref rid="b17" ref-type="bibr">Jia 2014</xref>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">✓⊕⊕⊕o
<sup>76</sup>
</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
<td align="left" rowspan="1" colspan="1">NR</td>
</tr>
<tr>
<th align="left" colspan="5" rowspan="1">
<bold>Ratings</bold>
</th>
<th align="left" colspan="5" rowspan="1">
<bold>Implications</bold>
</th>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">⊕⊕⊕⊕
<break></break>
High</td>
<td align="left" colspan="4" rowspan="1">This research provides a very good indication of the likely effect. The likelihood that the effect will be substantially different is low.</td>
<td align="left" colspan="5" rowspan="1">This evidence provides a very good basis for making a decision about whether to implement the intervention. Impact evaluation and monitoring of the impact are unlikely to be needed if it is implemented.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">⊕⊕⊕o
<break></break>
Moderate</td>
<td align="left" colspan="4" rowspan="1">This research provides a good indication of the likely effect. The likelihood that the effect will be substantially different is moderate.</td>
<td align="left" colspan="5" rowspan="1">This evidence provides a good basis for making a decision about whether to implement the intervention. Monitoring of the impact is likely to be needed and impact evaluation may be warranted if it is implemented.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">⊕⊕oo
<break></break>
Low</td>
<td align="left" colspan="4" rowspan="1">This research provides some indication of the likely effect. However, the likelihood that it will be substantially different is high.</td>
<td align="left" colspan="5" rowspan="1">This evidence provides some basis for making a decision about whether to implement the intervention. Impact evaluation is likely to be warranted if it is implemented.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">⊕ooo
<break></break>
Very low</td>
<td align="left" colspan="4" rowspan="1">This research does not provide a reliable indication of the likely effect. The likelihood that the effect will be substantially different is very high.</td>
<td align="left" colspan="5" rowspan="1">This evidence does not provide a good basis for making a decision about whether to implement the intervention. Impact evaluation is very likely to be warranted if it is implemented.</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn>
<p>
<sup>a</sup>
✓: a desirable effect; : little or no effect; ?: an uncertain effect; ✕: an undesirable effect; NS: no studies were included; NR: not reported; NA: no plausible mechanism by which the type of implementation strategy might be expected to have an effect on the type of outcome.</p>
</fn>
<fn>
<p>
<sup>b</sup>
Other than adverse effects on any of the outcomes in the previous columns.</p>
</fn>
<fn>
<p>
<sup>1</sup>
Adherence to recommended practice (guidelines recommendations).</p>
</fn>
<fn>
<p>
<sup>2</sup>
Clinical behaviour end effects on patient care.</p>
</fn>
<fn>
<p>
<sup>3</sup>
Collaborative behaviour and practitioner competencies.</p>
</fn>
<fn>
<p>
<sup>4</sup>
Provider's knowledge.</p>
</fn>
<fn>
<p>
<sup>5</sup>
Provider's skills.</p>
</fn>
<fn>
<p>
<sup>6</sup>
Daily energy intake, feeding frequency, consumption of targeted food items.</p>
</fn>
<fn>
<p>
<sup>7</sup>
Prescribing.</p>
</fn>
<fn>
<p>
<sup>8</sup>
Management of patients at increased cardiovascular risk, with asthma or diabetes; or delivery of preventive services, including counselling for smoking cessation.</p>
</fn>
<fn>
<p>
<sup>9</sup>
Better documentation of care, preventive cardiovascular care or prostate specific antigen testing in primary care.</p>
</fn>
<fn>
<p>
<sup>10</sup>
Hospitalisation, general practice visits and emergency room visits.</p>
</fn>
<fn>
<p>
<sup>11</sup>
Patients' medication costs.</p>
</fn>
<fn>
<p>
<sup>12</sup>
Clinical outcomes (for diabetic and hypertensive patients such as reductions in fasting plasma glucose levels or systolic and diastolic blood pressure).</p>
</fn>
<fn>
<p>
<sup>13</sup>
Death rate and major complications.</p>
</fn>
<fn>
<p>
<sup>14</sup>
Changes in physician performance.</p>
</fn>
<fn>
<p>
<sup>15</sup>
Patient health status (included physiological measures, clinical assessments, patient self-reports of symptom resolution or quality of life; and patient self-esteem).</p>
</fn>
<fn>
<p>
<sup>16</sup>
Patient satisfaction.</p>
</fn>
<fn>
<p>
<sup>17</sup>
Healthcare-associated infections.</p>
</fn>
<fn>
<p>
<sup>18</sup>
Compliance with hand hygiene guidance.</p>
</fn>
<fn>
<p>
<sup>19</sup>
Use of hand hygiene products.</p>
</fn>
<fn>
<p>
<sup>20</sup>
Frequency of referral to emergency obstetrical care.</p>
</fn>
<fn>
<p>
<sup>21</sup>
Maternal mortality.</p>
</fn>
<fn>
<p>
<sup>22</sup>
Maternal morbidity: haemorrhage, infections, obstructed labour and referral to emergency.</p>
</fn>
<fn>
<p>
<sup>23</sup>
Neonatal deaths and stillbirths.</p>
</fn>
<fn>
<p>
<sup>24</sup>
Breastfeeding and appropriate advice about immediate feeding of colostrum.</p>
</fn>
<fn>
<p>
<sup>25</sup>
Stillbirths and perinatal mortality.</p>
</fn>
<fn>
<p>
<sup>26</sup>
Neonatal tetanus-related mortality and puerperal sepsis.</p>
</fn>
<fn>
<p>
<sup>27</sup>
Neonatal mortality, maternal mortality, haemorrhage.</p>
</fn>
<fn>
<p>
<sup>28</sup>
Neonatal sepsis.</p>
</fn>
<fn>
<p>
<sup>29</sup>
Number of patient visits at which an antibiotic is prescribed.</p>
</fn>
<fn>
<p>
<sup>30</sup>
Mortality in all resuscitation episodes.</p>
</fn>
<fn>
<p>
<sup>31</sup>
Proportion of adequate initial resuscitation steps, Inappropriate and potentially harmful practices per resuscitation.</p>
</fn>
<fn>
<p>
<sup>32</sup>
HIV/STI patient management practices.</p>
</fn>
<fn>
<p>
<sup>33</sup>
Incidence of HIV/AIDS risk behaviours and referral practices (self-reported).</p>
</fn>
<fn>
<p>
<sup>34</sup>
Traditional healers' knowledge about STDs and HIV.</p>
</fn>
<fn>
<p>
<sup>35</sup>
Number of people who were positive for HIV antibody testing.</p>
</fn>
<fn>
<p>
<sup>36</sup>
Number of people tested for HIV.</p>
</fn>
<fn>
<p>
<sup>37</sup>
Number of pregnant women taking HIV tests.</p>
</fn>
<fn>
<p>
<sup>38</sup>
Proportion of low-income ethnic minority women being HIV tested.</p>
</fn>
<fn>
<p>
<sup>39</sup>
Knowledge and attitudes about medicines.</p>
</fn>
<fn>
<p>
<sup>40</sup>
Compliance with medicine's instructions.</p>
</fn>
<fn>
<p>
<sup>41</sup>
Comprehension</p>
</fn>
<fn>
<p>
<sup>42</sup>
Disease prevalence</p>
</fn>
<fn>
<p>
<sup>43</sup>
Use of health services.</p>
</fn>
<fn>
<p>
<sup>44</sup>
See
<xref rid="b113" ref-type="bibr">Nieuwlaat 2014</xref>
in the main text for updated findings.</p>
</fn>
<fn>
<p>
<sup>45</sup>
Adherence to medications and various clinical outcomes.</p>
</fn>
<fn>
<p>
<sup>46</sup>
Treatment outcomes.</p>
</fn>
<fn>
<p>
<sup>47</sup>
Adherence to medications.</p>
</fn>
<fn>
<p>
<sup>48</sup>
Undetectable viral load.</p>
</fn>
<fn>
<p>
<sup>49</sup>
Adherence to ART.</p>
</fn>
<fn>
<p>
<sup>50</sup>
Return for tuberculin skin test reading.</p>
</fn>
<fn>
<p>
<sup>51</sup>
Morality.</p>
</fn>
<fn>
<p>
<sup>52</sup>
Loss to follow-up.</p>
</fn>
<fn>
<p>
<sup>53</sup>
Return for start or continuation of treatment.</p>
</fn>
<fn>
<p>
<sup>54</sup>
Completion of treatment for active TB.</p>
</fn>
<fn>
<p>
<sup>55</sup>
Completion of TB prophylaxis.</p>
</fn>
<fn>
<p>
<sup>56</sup>
Adherence to anti-tuberculosis treatment.</p>
</fn>
<fn>
<p>
<sup>57</sup>
Patient return for tuberculin skin test reading and completion of TB prophylaxis.</p>
</fn>
<fn>
<p>
<sup>58</sup>
Patient return for tuberculin skin test reading.</p>
</fn>
<fn>
<p>
<sup>59</sup>
Adherence to anti-tuberculosis prophylaxis.</p>
</fn>
<fn>
<p>
<sup>60</sup>
Return to clinic for completion of treatment and prophylaxis for latent TB.</p>
</fn>
<fn>
<p>
<sup>61</sup>
Clinic attendance.</p>
</fn>
<fn>
<p>
<sup>62</sup>
Completion of TB treatment.</p>
</fn>
<fn>
<p>
<sup>63</sup>
Adherence to malaria treatment and treatment failure.</p>
</fn>
<fn>
<p>
<sup>64</sup>
Adherence to malaria treatment.</p>
</fn>
<fn>
<p>
<sup>65</sup>
Treatment failure.</p>
</fn>
<fn>
<p>
<sup>66</sup>
Number of minor adverse events in malaria treatment.</p>
</fn>
<fn>
<p>
<sup>67</sup>
Adherence to malaria treatment.</p>
</fn>
<fn>
<p>
<sup>68</sup>
Treatment failure.</p>
</fn>
<fn>
<p>
<sup>69</sup>
Incidence of itching, dizziness and other adverse events.</p>
</fn>
<fn>
<p>
<sup>70</sup>
Treatment adherence and treatment failure in malaria.</p>
</fn>
<fn>
<p>
<sup>71</sup>
Routine childhood immunisations.</p>
</fn>
<fn>
<p>
<sup>72</sup>
ITN possession among pregnant women, adults and children.</p>
</fn>
<fn>
<p>
<sup>73</sup>
Appropriate use of ITNs.</p>
</fn>
<fn>
<p>
<sup>74</sup>
ITN use by adults, ITN use by children under 5 years old.</p>
</fn>
<fn>
<p>
<sup>75</sup>
Uptake of screening.</p>
</fn>
<fn>
<p>
<sup>76</sup>
Enrolment into insurance.</p>
</fn>
<fn>
<p>
<sup>77</sup>
Parental satisfaction.</p>
</fn>
</table-wrap-foot>
</table-wrap>
<table-wrap id="tbl8" position="float">
<label>Table 8</label>
<caption>
<p>Summary of effects of interventions and certainty of evidence</p>
</caption>
<table frame="border" rules="groups">
<tbody>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Interventions found to have desirable effects on at least one outcome with moderate- or high-certainty evidenceand no moderate- or high-certainty evidence of undesirable effects</bold>
</th>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Strategies targeted at healthcare workers by type of intervention</bold>
<break></break>
<list list-type="bullet">
<list-item>
<p>Educational meetings (
<xref rid="b9" ref-type="bibr">Forsetlund 2009</xref>
)</p>
</list-item>
<list-item>
<p>Nutrition training of health workers (
<xref rid="b37" ref-type="bibr">Sunguya 2013</xref>
)</p>
</list-item>
<list-item>
<p>Educational outreach (vs no intervention) (
<xref rid="b24" ref-type="bibr">O'Brien 2007</xref>
)</p>
</list-item>
<list-item>
<p>Practice facilitation (
<xref rid="b3" ref-type="bibr">Baskerville 2012</xref>
)</p>
</list-item>
<list-item>
<p>Local opinion leaders (
<xref rid="b8" ref-type="bibr">Flodgren 2011</xref>
)</p>
</list-item>
<list-item>
<p>Audit and feedback (with or without other interventions) vs usual care (
<xref rid="b15" ref-type="bibr">Ivers 2012</xref>
)</p>
</list-item>
<list-item>
<p>Tailored interventions (vs no intervention) (
<xref rid="b2" ref-type="bibr">Baker 2015</xref>
)</p>
</list-item>
</list>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Strategies targeted at healthcare workers by type of problem</bold>
<break></break>
<list list-type="bullet">
<list-item>
<p>Communication with patients (interventions to promote patient-centred care) (
<xref rid="b6" ref-type="bibr">Dwamena 2012</xref>
)</p>
</list-item>
<list-item>
<p>Obstetric care (use of birth kits) (
<xref rid="b14" ref-type="bibr">Hundley 2012</xref>
)</p>
</list-item>
<list-item>
<p>Clinician education (with or without other interventions) (
<xref rid="b31" ref-type="bibr">Ranji 2008</xref>
)</p>
</list-item>
<list-item>
<p>Seriously ill newborn care (in-service neonatal emergency care training) (
<xref rid="b25" ref-type="bibr">Opiyo 2015</xref>
)</p>
</list-item>
</list>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Strategies targeted at healthcare recipients</bold>
<break></break>
<list list-type="bullet">
<list-item>
<p>Providing information/education (leaflets for promoting HIV testing) (
<xref rid="b38" ref-type="bibr">Vidanapathirana 2005</xref>
)</p>
</list-item>
<list-item>
<p>Providing information/education (gain-framed versus loss-framed video tapes for promoting HIV testing) (
<xref rid="b38" ref-type="bibr">Vidanapathirana 2005</xref>
)</p>
</list-item>
<list-item>
<p>Intensive self-management and adherence, intensive disease management programmes to improve health literacy (
<xref rid="b4" ref-type="bibr">Berkman 2011</xref>
)</p>
</list-item>
<list-item>
<p>Adherence – ART for HIV/AIDS (behavioural interventions) (
<xref rid="b34" ref-type="bibr">Simoni 2006</xref>
)</p>
</list-item>
<list-item>
<p>Adherence - ART for HIV/AIDS (mobile text messages) (
<xref rid="b22" ref-type="bibr">Mbuagbaw 2013</xref>
)</p>
</list-item>
<list-item>
<p>Adherence – TB (one time incentives vs routine care) (
<xref rid="b21" ref-type="bibr">Lutge 2015</xref>
)</p>
</list-item>
<list-item>
<p>Adherence - TB (mobile phone messages reminders) (
<xref rid="b20" ref-type="bibr">Liu 2014</xref>
)</p>
</list-item>
<list-item>
<p>Adherence - Malaria medication (sectioned polythene bags compared to paper envelopes) (
<xref rid="b26" ref-type="bibr">Orton 2005</xref>
)</p>
</list-item>
<list-item>
<p>Immunisation coverage (health education) (
<xref rid="b27" ref-type="bibr">Oyo-Ita 2016</xref>
)</p>
</list-item>
<list-item>
<p>Immunisation coverage (reminders and recall systems) (
<xref rid="b16" ref-type="bibr">Jacobson Vann 2005</xref>
)</p>
</list-item>
<list-item>
<p>Providing free insecticide-treated bednets (
<xref rid="b1" ref-type="bibr">Augustincic Polec 2015</xref>
).</p>
</list-item>
<list-item>
<p>Access to healthcare services – interventions to improve the uptake of cervical cancer screening (education, counselling, access to health promotion nurse, invitations to attend screening and intensive recruitment) (
<xref rid="b7" ref-type="bibr">Everett 2011</xref>
</p>
</list-item>
<list-item>
<p>Access to healthcare services - outreach strategies for increasing health insurance coverage for vulnerable populations (health insurance information and application support, handing out application forms in emergency department of hospitals) (
<xref rid="b17" ref-type="bibr">Jia 2014</xref>
)</p>
</list-item>
</list>
</td>
</tr>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Interventions found to have at least one outcome with little or no effect with moderate- or high-certainty evidenceand no moderate- or high-certainty evidence of desirable or undesirable effects</bold>
</th>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Strategies targeted at healthcare workers by type of intervention</bold>
<break></break>
<list list-type="bullet">
<list-item>
<p>Audit and feedback compared with other interventions (
<xref rid="b15" ref-type="bibr">Ivers 2012</xref>
)</p>
</list-item>
<list-item>
<p>Photo-comic book and message framing to improve the update of cervical cancer screening (
<xref rid="b7" ref-type="bibr">Everett 2011</xref>
)</p>
</list-item>
</list>
</td>
</tr>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Interventions for which the certainty of the evidence was low or very low (or no studies were found) for all outcomes examined</bold>
</th>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Strategies targeted at healthcare organisations</bold>
<break></break>
<list list-type="bullet">
<list-item>
<p>Organisational culture (
<xref rid="b29" ref-type="bibr">Parmelli 2011</xref>
)</p>
</list-item>
</list>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Strategies targeted at healthcare workers by type of intervention</bold>
<break></break>
<list list-type="bullet">
<list-item>
<p>Printed educational materials (
<xref rid="b10" ref-type="bibr">Giguère 2012</xref>
)</p>
</list-item>
<list-item>
<p>Internet-based learning in health professions (vs no intervention) (
<xref rid="b5" ref-type="bibr">Cook 2008</xref>
)</p>
</list-item>
<list-item>
<p>Internet-based learning in health professions (vs non-Internet-based learning) (
<xref rid="b5" ref-type="bibr">Cook 2008</xref>
)</p>
</list-item>
<list-item>
<p>Interprofessional education (
<xref rid="b32" ref-type="bibr">Reeves 2013</xref>
)</p>
</list-item>
<list-item>
<p>Teaching critical appraisal (
<xref rid="b13" ref-type="bibr">Horsley 2011</xref>
)</p>
</list-item>
<list-item>
<p>Educational outreach (vs another intervention) (
<xref rid="b24" ref-type="bibr">O'Brien 2007</xref>
)</p>
</list-item>
<list-item>
<p>Pharmacist-provided services targeted at patients (such as patient health education and follow-up) (
<xref rid="b28" ref-type="bibr">Pande 2013</xref>
)</p>
</list-item>
<list-item>
<p>Pharmacist-provided services targeted at healthcare professionals (such as educational outreach visits) (
<xref rid="b28" ref-type="bibr">Pande 2013</xref>
)</p>
</list-item>
<list-item>
<p>Reminders (intensive care unit, emergency department and acute care settings) (
<xref rid="b19" ref-type="bibr">Ko 2011</xref>
)</p>
</list-item>
<list-item>
<p>Reminders (surgery setting) (
<xref rid="b19" ref-type="bibr">Ko 2011</xref>
)</p>
</list-item>
<list-item>
<p>Tailored interventions (vs non-tailored interventions) (
<xref rid="b2" ref-type="bibr">Baker 2015</xref>
)</p>
</list-item>
<list-item>
<p>Tailored interventions (interventions targeted at organisational and individual barriers vs interventions targeted at individual barriers only) (
<xref rid="b2" ref-type="bibr">Baker 2015</xref>
)</p>
</list-item>
<list-item>
<p>Interventions to encourage the use of systematic reviews in clinical decision-making (
<xref rid="b30" ref-type="bibr">Perrier 2011</xref>
)</p>
</list-item>
</list>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Strategies targeted at healthcare workers by type of problem</bold>
<break></break>
<list list-type="bullet">
<list-item>
<p>Handwashing (educational interventions and marketing campaigns) (
<xref rid="b11" ref-type="bibr">Gould 2010</xref>
)</p>
</list-item>
<list-item>
<p>Obstetrics – non-clinical interventions to reduce unnecessary cesarean section rates (guidelines + mandatory second opinion) (
<xref rid="b18" ref-type="bibr">Khunpradit 2011</xref>
)</p>
</list-item>
<list-item>
<p>Obstetrics – non-clinical interventions to reduce unnecessary cesarean section rates (nurse training/insurance reform/legislative changes/audit and feedback/external peer review) (
<xref rid="b18" ref-type="bibr">Khunpradit 2011</xref>
)</p>
</list-item>
<list-item>
<p>Obstetrics – traditional birth attendants (TBA) (trained TBAs versus untrained TBA) (
<xref rid="b33" ref-type="bibr">Sibley 2012</xref>
)</p>
</list-item>
<list-item>
<p>Obstetrics – traditional birth attendants (TBA) (additional TBAs training versus no additional TBA training) (
<xref rid="b33" ref-type="bibr">Sibley 2012</xref>
)</p>
</list-item>
<list-item>
<p>Obstetrics (skilled births attendance versus usual care) (
<xref rid="b39" ref-type="bibr">Yakoob 2011</xref>
)</p>
</list-item>
<list-item>
<p>Training traditional healers about STD and HIV medicine (
<xref rid="b36" ref-type="bibr">Sorsdahl 2009</xref>
)</p>
</list-item>
</list>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Strategies targeted at healthcare recipients</bold>
<break></break>
<list list-type="bullet">
<list-item>
<p>Providing information/education (multimedia for promoting HIV testing) (
<xref rid="b38" ref-type="bibr">Vidanapathirana 2005</xref>
)</p>
</list-item>
<list-item>
<p>Providing information (written medicine information) (
<xref rid="b23" ref-type="bibr">Nicolson 2009</xref>
)</p>
</list-item>
<list-item>
<p>Single interventions to improve health literacy (presenting essential information first, presenting information so that the higher numbers indicate better quality) (
<xref rid="b4" ref-type="bibr">Berkman 2011</xref>
</p>
</list-item>
<list-item>
<p>Adherence – medication (interventions to improve adherence to short-term treatments) (
<xref rid="b12" ref-type="bibr">Haynes 2008</xref>
)</p>
</list-item>
<list-item>
<p>Adherence – medication (interventions to improve adherence to long-term treatments – more than 6 months) (
<xref rid="b12" ref-type="bibr">Haynes 2008</xref>
)</p>
</list-item>
<list-item>
<p>Adherence – TB (immediate versus deferred incentives) (
<xref rid="b21" ref-type="bibr">Lutge 2015</xref>
)</p>
</list-item>
<list-item>
<p>Adherence – TB (cash versus non-cash incentive) (
<xref rid="b21" ref-type="bibr">Lutge 2015</xref>
)</p>
</list-item>
<list-item>
<p>Adherence – TB (different levels of cash incentives) (
<xref rid="b21" ref-type="bibr">Lutge 2015</xref>
)</p>
</list-item>
<list-item>
<p>Adherence – TB (incentives vs other interventions) (
<xref rid="b21" ref-type="bibr">Lutge 2015</xref>
)</p>
</list-item>
<list-item>
<p>Adherence – malarial medication (blister packed tablets and capsules compared to tablets and capsules in paper envelopes) (
<xref rid="b26" ref-type="bibr">Orton 2005</xref>
)</p>
</list-item>
<list-item>
<p>Adherence - malaria medication (tablets in sectioned polythene bags compared to bottled syrup (
<xref rid="b26" ref-type="bibr">Orton 2005</xref>
)</p>
</list-item>
<list-item>
<p>Adherence - malaria medication (tablets in sectioned polythene bags compared to unsectioned polythene bags (
<xref rid="b26" ref-type="bibr">Orton 2005</xref>
)</p>
</list-item>
<list-item>
<p>Immunisation coverage (healthcare providers training) (
<xref rid="b27" ref-type="bibr">Oyo-Ita 2016</xref>
)</p>
</list-item>
<list-item>
<p>Immunisation coverage (home visits) (
<xref rid="b27" ref-type="bibr">Oyo-Ita 2016</xref>
)</p>
</list-item>
<list-item>
<p>Immunisation coverage (monetary incentives – withdrawing of monetary vouchers) (
<xref rid="b27" ref-type="bibr">Oyo-Ita 2016</xref>
)</p>
</list-item>
<list-item>
<p>Immunisation coverage (multifaceted interventions – monetary incentives + quality assurance + provision of equipment, drugs and materials) (
<xref rid="b27" ref-type="bibr">Oyo-Ita 2016</xref>
)</p>
</list-item>
<list-item>
<p>Malaria: education about appropriate use of insecticide-treated bednets (
<xref rid="b1" ref-type="bibr">Augustincic Polec 2015</xref>
)</p>
</list-item>
<list-item>
<p>Risk factor assessment to improve the uptake of cervical cancer screening (
<xref rid="b7" ref-type="bibr">Everett 2011</xref>
)</p>
</list-item>
</list>
</td>
</tr>
</tbody>
</table>
</table-wrap>
<table-wrap id="tbl9" position="float">
<label>Table 9</label>
<caption>
<p>Priorities for primary research</p>
</caption>
<table frame="border" rules="groups">
<tbody>
<tr>
<th align="left" rowspan="2" colspan="1">
<bold>Implementation strategy</bold>
</th>
<th align="left" rowspan="2" colspan="1">
<bold>Systematic review</bold>
</th>
<th align="left" colspan="3" rowspan="1">
<bold>Applicability limitations</bold>
</th>
</tr>
<tr>
<th align="left" colspan="2" rowspan="1">
<bold>Findings</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>Interpretation</bold>
</th>
</tr>
<tr>
<td align="left" colspan="5" rowspan="1">
<bold>Strategies targeted at healthcare workers by type of intervention</bold>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Educational materials</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<xref rid="b10" ref-type="bibr">Giguère 2012</xref>
</td>
<td align="left" colspan="2" rowspan="1">The studies reviewed were mostly from high-income countries. Only one study out of the 45 included was from a middle-income country</td>
<td align="left" rowspan="1" colspan="1">In low-income countries (LICs) where health systems may be weaker, it may be difficult to ensure that up-to-date printed educational materials reach the appropriate providers promptly. It is therefore unclear whether similar effects would be expected in LICs</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Interprofessional education (IPE)</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<xref rid="b32" ref-type="bibr">Reeves 2013</xref>
</td>
<td align="left" colspan="2" rowspan="1">Included studies were done primarily in the USA and UK in varied settings (hospital emergency departments, health maintenance organisations, community mental health provider organisations, primary care practices)</td>
<td align="left" rowspan="1" colspan="1">The impact of IPE interventions in low-income settings is uncertain (differences in the health system contexts, gender relationships and comparable social status of different health professions may influence the effectiveness of IPE in different settings)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Teaching critical appraisal skills in healthcare settings</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<xref rid="b13" ref-type="bibr">Horsley 2011</xref>
</td>
<td align="left" colspan="2" rowspan="1">None of the included studies took place in a low-income country. Interventions assessed included journal club supported by a half-day workshop, critical appraisal materials, listserv discussions and articles and a half-day Critical Appraisal Skills Programme (CASP) workshop</td>
<td align="left" rowspan="1" colspan="1">The impact of critical appraisal educational interventions (workshops, materials) in low-income countries is uncertain</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Educational outreach</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<xref rid="b3" ref-type="bibr">Baskerville 2012</xref>
</td>
<td align="left" colspan="2" rowspan="1">The review did not include any studies conducted in low-income countries that evaluated the use of practice facilitation to promote adoption of evidence-based guidelines</td>
<td align="left" rowspan="1" colspan="1">Practice facilitation might be difficult to implement in low-resource settings, particularly the audit and feedback component, and it might be more difficult to make necessary organisational changes</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Local opinion leaders</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<xref rid="b8" ref-type="bibr">Flodgren 2011</xref>
</td>
<td align="left" colspan="2" rowspan="1">The included trials were from primary care in the USA (6 studies) and Canada (1 study)</td>
<td align="left" rowspan="1" colspan="1">Rigorous studies from low-income countries are needed to fully assess applicability of the findings to all healthcare settings</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Patient-mediated interventions</bold>
(i.e. new clinical information collected directly from patients and given to the provider)</td>
<td align="left" rowspan="1" colspan="1">No updated review identified</td>
<td align="left" colspan="2" rowspan="1"></td>
<td align="left" rowspan="1" colspan="1"></td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Reminders</bold>
</td>
<td align="left" rowspan="1" colspan="1">No updated review identified</td>
<td align="left" colspan="2" rowspan="1"></td>
<td align="left" rowspan="1" colspan="1"></td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Tailored interventions</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<xref rid="b2" ref-type="bibr">Baker 2015</xref>
</td>
<td align="left" colspan="2" rowspan="1">The studies were undertaken in the USA, the UK, Belgium , Canada, Indonesia , Norway, the Netherlands and Portugal</td>
<td align="left" rowspan="1" colspan="1">The impact of tailored interventions in low-income countries is uncertain</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Interventions encouraging use of systematic reviews in clinical decision-making</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<xref rid="b30" ref-type="bibr">Perrier 2011</xref>
</td>
<td align="left" colspan="2" rowspan="1">All studies included in the review took place in middle and high income countries.</td>
<td align="left" rowspan="1" colspan="1">The applicability of these findings to low-income countries is uncertain. Important issues in adopting of such interventions include acceptance by the end user and integration into the healthcare system</td>
</tr>
<tr>
<td align="left" colspan="5" rowspan="1">
<bold>Strategies targeted at healthcare workers by type of problem</bold>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Communication with patients</bold>
– Training healthcare providers to be more 'patient-centred' in clinical consultations</td>
<td align="left" rowspan="1" colspan="1">
<xref rid="b6" ref-type="bibr">Dwamena 2012</xref>
</td>
<td align="left" colspan="2" rowspan="1">This review did not find any study conducted in low- and-middle-income countries, all 43 studies included were from high-income countries</td>
<td align="left" rowspan="1" colspan="1">Although patient-centredness may be an objective of care in many settings, it is not possible to be confident about the applicability of the reported interventions to low-income countries (LICs) and to settings other than primary care, as almost all studies took place in the USA and Europe.
<break></break>
Human resource constrains in some health systems and low motivation to deliver patient-centred care may limit the feasibility and potential of this approach for improving professional practice and health outcomes.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Obstetrics</bold>
– Non-clinical interventions for reducing unnecessary caesarean section</td>
<td align="left" rowspan="1" colspan="1">
<xref rid="b18" ref-type="bibr">Khunpradit 2011</xref>
</td>
<td align="left" colspan="2" rowspan="1">The included studies took place in high-income and middle-income countries</td>
<td align="left" rowspan="1" colspan="1">The evidence for the effectiveness of these interventions in low-income settings is limited; observed effects may be different in low-income settings given differences in contextual factors (e.g. socioeconomic factors)-</td>
</tr>
<tr>
<td align="left" colspan="5" rowspan="1">
<bold>Strategies targeted at healthcare recipients</bold>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Providing information/education</bold>
<break></break>
Mass media interventions for promoting HIV testing</td>
<td align="left" rowspan="1" colspan="1">
<xref rid="b38" ref-type="bibr">Vidanapathirana 2005</xref>
</td>
<td align="left" rowspan="1" colspan="1">All the studies took place in high-income countries</td>
<td align="left" colspan="2" rowspan="1">The degree of diffusion and importance of multimedia (television, radio, etc.) in low-income countries should be considered in order to reach more population with the messages.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Providing information/education –</bold>
Written information about individual medicines for consumers</td>
<td align="left" rowspan="1" colspan="1">
<xref rid="b23" ref-type="bibr">Nicolson 2009</xref>
</td>
<td align="left" rowspan="1" colspan="1">All the trials – except one conducted in Turkey – were carried out in high-income countries</td>
<td align="left" colspan="2" rowspan="1">Implementation of written medicine information (WMI) depends on the health systems' regulatory context. For instance in high-income countries there are specific laws that already governed the use of WMI. Hence its implementation and impact in low-income countries could be different to the findings from this review.
<break></break>
The effects of WMI are mediated by the ability to read the information presented. Hence low literacy levels in a country could make these findings less applicable.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Providing information/education –</bold>
Health literacy interventions and outcomes</td>
<td align="left" rowspan="1" colspan="1">
<xref rid="b4" ref-type="bibr">Berkman 2011</xref>
</td>
<td align="left" rowspan="1" colspan="1">Most studies took place in high-income countries.</td>
<td align="left" colspan="2" rowspan="1">There is insufficient evidence of the effectiveness of these interventions in low-income countries. The effects observed in these studies were limited to clinical environments and a narrow geographical area which may be different in low-income settings given that they have different literacy levels and other contextual factors (e.g. sociodemographic factors).</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Adherence – medication</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<xref rid="b12" ref-type="bibr">Haynes 2008</xref>
</td>
<td align="left" rowspan="1" colspan="1">Most studies took place in high-income countries.</td>
<td align="left" colspan="2" rowspan="1">Almost all the interventions that were effective were complex and included combinations of interventions. Even the most effective interventions did not lead to large improvements in treatment outcomes.
<break></break>
The findings indicate that interventions to improve medication adherence should be used with caution given that there is a high degree of uncertainty about both their effects and costs.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Adherence – ART for HIV/AIDS</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<xref rid="b34" ref-type="bibr">Simoni 2006</xref>
</td>
<td align="left" rowspan="1" colspan="1">All studies took place in high-income countries. The update of the review includes 3 studies in Brazil, China and Mozambique, with mixed results. We are very uncertain if there is a different effect in those settings.</td>
<td align="left" colspan="2" rowspan="1">Some studies use combinations of interventions, so it is difficult to know which component is leading to the observed effects.
<break></break>
There are countless aspects where interventions to improve adherence in HIC and LMIC may differ.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Adherence – TB –</bold>
<break></break>
Material incentives and enablers in the management of tuberculosis</td>
<td align="left" rowspan="1" colspan="1">
<xref rid="b21" ref-type="bibr">Lutge 2015</xref>
</td>
<td align="left" rowspan="1" colspan="1">Most studies took place in the USA;
<break></break>
most studies were conducted in population subgroups</td>
<td align="left" colspan="2" rowspan="1">The findings need to be applied with caution in low- and middle-income countries considering the structural and qualitative differences in health systems, healthcare provision, resources and healthcare-seeking behaviour.
<break></break>
The included studies focus on specific subgroups of patients, such as injection drug users. The findings may therefore not be applicable in the general population.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Access to healthcare services</bold>
– Interventions targeted at women to encourage the uptake of cervical screening</td>
<td align="left" rowspan="1" colspan="1">
<xref rid="b7" ref-type="bibr">Everett 2011</xref>
</td>
<td align="left" rowspan="1" colspan="1">All except one of the studies included in the systematic review took place in high-income countries. One study took place in a middle-income country</td>
<td align="left" colspan="2" rowspan="1">When assessing the transferability of these findings to low-income countries the following factors should be considered.
<break></break>
<list list-type="bullet">
<list-item>
<p>Literacy levels (e.g. for printed materials)</p>
</list-item>
<list-item>
<p>Population migration, and access to remote areas</p>
</list-item>
<list-item>
<p>Availability of resources for the intervention or devices, such as mobile phones, to disseminate messages</p>
</list-item>
<list-item>
<p>Acceptability and costs of the interventions</p>
</list-item>
</list>
</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn>
<p>We only have included priorities for research on the effects of implementation strategies based on the findings of the included systematic reviews.</p>
</fn>
</table-wrap-foot>
</table-wrap>
<table-wrap id="tbl10" position="float">
<label>Table 10</label>
<caption>
<p>Priorities for systematic reviews</p>
</caption>
<table frame="border" rules="groups">
<tbody>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Implementation strategy</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What we found</bold>
</th>
</tr>
<tr>
<td align="left" colspan="2" rowspan="1">
<bold>Strategies targeted at healthcare organisations</bold>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Continuous quality improvement</td>
<td align="left" rowspan="1" colspan="1">Review in progress (
<xref rid="b79" ref-type="bibr">Brennan 2009</xref>
)</td>
</tr>
<tr>
<td align="left" colspan="2" rowspan="1">
<bold>Strategies targeted at healthcare workers by type of intervention</bold>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Patient-mediated interventions</td>
<td align="left" rowspan="1" colspan="1">Review in progress (
<xref rid="b90" ref-type="bibr">Fønhus 2016</xref>
)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Reminders</td>
<td align="left" rowspan="1" colspan="1">Review in progress (
<xref rid="b117" ref-type="bibr">Pantoja 2014b</xref>
)</td>
</tr>
<tr>
<td align="left" colspan="2" rowspan="1">
<bold>Strategies targeted at healthcare workers by type of problem</bold>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Healthcare-associated infections</td>
<td align="left" rowspan="1" colspan="1">No up-to-date review identified</td>
</tr>
<tr>
<td align="left" colspan="2" rowspan="1">
<bold>Strategies targeted at healthcare recipients</bold>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Facility-based deliveries</td>
<td align="left" rowspan="1" colspan="1">Review in progress (
<xref rid="b85" ref-type="bibr">Dudley 2009</xref>
)</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec>
<title>Appendices</title>
<sec id="CD011086-sec2-0014">
<title>Appendix 1. SUPPORT Summaries checklist for making judgments about how much confidence to place in a systematic review</title>
<table-wrap id="d35e14019" position="float">
<table frame="border" rules="groups">
<tbody>
<tr>
<td align="left" colspan="2" rowspan="1">
<bold>Review</bold>
:</td>
</tr>
<tr>
<td align="left" colspan="2" rowspan="1">
<bold>Assessed by</bold>
:</td>
</tr>
<tr>
<td align="left" colspan="2" rowspan="1">
<bold>Date</bold>
:</td>
</tr>
<tr>
<td align="left" colspan="2" rowspan="1">
<bold>Section A</bold>
:
<italic>Methods used to identify, include and critically appraise studies</italic>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>A.1 Were the criteria used for deciding which studies to include in the review reported?</bold>
<break></break>
Did the authors specify:
<break></break>
_ Types of studies
<break></break>
_ Participants
<break></break>
_ Intervention(s)
<break></break>
_ Outcome(s)
<break></break>
<italic>Coding guide - check the answers above</italic>
<break></break>
<italic>YES</italic>
:
<italic>All four should be yes</italic>
</td>
<td align="left" rowspan="1" colspan="1">_ Yes
<break></break>
_ Can't tell/partially
<break></break>
_ No</td>
</tr>
<tr>
<td align="left" colspan="2" rowspan="1">
<italic>Comments (note important limitations or uncertainty)</italic>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>A.2 Was the search for evidence reasonably comprehensive?</bold>
<break></break>
Were the following done:
<break></break>
_ Language bias avoided (no restriction of inclusion based on language)
<break></break>
_ No restriction of inclusion based on publication status
<break></break>
_ Relevant databases searched (including Medline + Cochrane Library)
<break></break>
_ Reference lists in included articles checked
<break></break>
_ Authors/experts contacted
<break></break>
<italic>Coding guide - check the answers above</italic>
:
<break></break>
<italic>YES</italic>
:
<italic>All five should be yes</italic>
<break></break>
<italic>PARTIALLY</italic>
:
<italic>Relevant databases and reference lists are both ticked off</italic>
</td>
<td align="left" rowspan="1" colspan="1">_ Yes
<break></break>
_ Can't tell/partially
<break></break>
_ No</td>
</tr>
<tr>
<td align="left" colspan="2" rowspan="1">
<italic>Comments (note important limitations or uncertainty)</italic>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>A.3 Is the review reasonably up-to-date?</bold>
<break></break>
<italic>Were the searches done recently enough that more recent research is unlikely to be found or to change the results of the review?</italic>
<break></break>
<italic>Coding guide – consider how many years since the last search (e.g. if more than 10 years the review is unlikely to be up-to-date) and whether there is ongoing research</italic>
</td>
<td align="left" rowspan="1" colspan="1">_ Yes
<break></break>
_ Can't tell/not sure
<break></break>
_ No</td>
</tr>
<tr>
<td align="left" colspan="2" rowspan="1">
<italic>Comments (note important limitations or uncertainty)</italic>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>A.4 Was bias in the selection of articles avoided?</bold>
<break></break>
Did the authors specify:
<break></break>
_ Explicit selection criteria
<break></break>
_ Independent screening of full text by at least 2 reviewers
<break></break>
_ List of included studies provided
<break></break>
_ List of excluded studies provided
<break></break>
<italic>Coding guide - check the above</italic>
<break></break>
<italic>YES</italic>
:
<italic>All four should be yes</italic>
</td>
<td align="left" rowspan="1" colspan="1">_ Yes
<break></break>
_ Can't tell/partially
<break></break>
_ No</td>
</tr>
<tr>
<td align="left" colspan="2" rowspan="1">
<italic>Comments (note important limitations or uncertainty)</italic>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>A.5 Did the authors use appropriate criteria to assess the risk for bias in analysing the studies that are included?</bold>
<sup></sup>
<bold>( See Appendix for an example of criteria - Assessing Risk of Bias Criteria for EPOC Reviews)</bold>
<break></break>
_ The criteria used for assessing the risk of bias were reported
<break></break>
_ A table or summary of the assessment of each included study for each criterion was reported
<break></break>
_ Sensible criteria were used that focus on the risk of bias (and not other qualities of the studies, such as precision or applicability)
<break></break>
<italic>Coding guide - check the above</italic>
<break></break>
<italic>YES</italic>
:
<italic>All four should be yes</italic>
</td>
<td align="left" rowspan="1" colspan="1">_ Yes
<break></break>
_ Can't tell/partially
<break></break>
_ No</td>
</tr>
<tr>
<td align="left" colspan="2" rowspan="1">
<italic>Comments (note important limitations or uncertainty)</italic>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>A.6 Overall – how would you rate the methods used to identify, include and critically appraise studies?</bold>
<break></break>
<italic>Summary assessment score A relates to the 5 questions above.</italic>
<break></break>
<italic>If the</italic>
"
<italic>No</italic>
"
<italic>or</italic>
"
<italic>Partial</italic>
"
<italic>option is used for any of the questions above, the review is likely to have important limitations.</italic>
<break></break>
<italic>Examples of major limitations might include not reporting explicit selection criteria, not providing a list of included studies or not assessing the risk of bias in included studies.</italic>
</td>
<td align="left" rowspan="1" colspan="1">_
<bold>Major limitations</bold>
(limitations that are important enough that the results of the review are not reliable and they should not be used in the policy brief)
<break></break>
_
<bold>Important limitations</bold>
(limitations that are important enough that it would be worthwhile to search for another systematic review and to interpret the results of this review cautiously, if a better review cannot be found)
<break></break>
_
<bold>Reliable</bold>
(only minor limitations)</td>
</tr>
<tr>
<td align="left" colspan="2" rowspan="1">
<italic>Comments (note any major limitations or important limitations).</italic>
</td>
</tr>
<tr>
<td align="left" colspan="2" rowspan="1">
<bold>Section B</bold>
:
<italic>Methods used to analyse the findings</italic>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>B.1 Were the characteristics and results of the included studies reliably reported?</bold>
<break></break>
Was there:
<break></break>
_ Independent data extraction by at least 2 reviewers
<break></break>
_ A table or summary of the characteristics of the participants, interventions and outcomes for the included studies
<break></break>
_ A table or summary of the results of the included studies.
<break></break>
<italic>Coding guide - check the answers above</italic>
<break></break>
<italic>YES</italic>
:
<italic>All three should be yes</italic>
</td>
<td align="left" rowspan="1" colspan="1">_ Yes
<break></break>
_ Partially
<break></break>
_ No
<break></break>
_ Not applicable (e.g. no included studies)</td>
</tr>
<tr>
<td align="left" colspan="2" rowspan="1">
<italic>Comments (note important limitations or uncertainty)</italic>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>B.2 Were the methods used by the review authors to analyse the findings of the included studies reported?</bold>
</td>
<td align="left" rowspan="1" colspan="1">_ Yes
<break></break>
_ Partially
<break></break>
_ No
<break></break>
_ Not applicable (e.g. no studies or no data)</td>
</tr>
<tr>
<td align="left" colspan="2" rowspan="1">
<italic>Comments (note important limitations or uncertainty)</italic>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>B.3 Did the review describe the extent of heterogeneity?</bold>
<break></break>
_ Did the review ensure that included studies were similar enough that it made sense to combine them, sensibly divide the included studies into homogeneous groups, or sensibly conclude that it did not make sense to combine or group the included studies?
<break></break>
_ Did the review discuss the extent to which there were important differences in the results of the included studies?
<break></break>
_ If a meta-analysis was done, was the I
<sup>2</sup>
, chi square test for heterogeneity or other appropriate statistic reported?</td>
<td align="left" rowspan="1" colspan="1">_ Yes
<break></break>
_ Can't tell/partially
<break></break>
_ No
<break></break>
_ Not applicable (e.g. no studies or no data)</td>
</tr>
<tr>
<td align="left" colspan="2" rowspan="1">
<italic>Comments (note important limitations or uncertainty)</italic>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>B.4 Were the findings of the relevant studies combined (or not combined) appropriately relative to the primary question the review addresses and the available data?</bold>
<break></break>
<italic>How was the data analysis done?</italic>
<break></break>
_ Descriptive only
<break></break>
_ Vote counting based on direction of effect
<break></break>
_ Vote counting based on statistical significance
<break></break>
_ Description of range of effect sizes
<break></break>
_ Meta-analysis
<break></break>
_ Meta-regression
<break></break>
_ Other: specify
<break></break>
_ Not applicable (e.g. no studies or no data)
<break></break>
<italic>How were the studies weighted in the analysis?</italic>
<break></break>
_ Equal weights (this is what is done when vote counting is used)
<break></break>
_ By quality or study design (this is rarely done)
<break></break>
_ Inverse variance (this is what is typically done in a meta-analysis)
<break></break>
_ Number of participants
<break></break>
_ Other, specify:
<break></break>
_ Not clear
<break></break>
_ Not applicable (e.g. no studies or no data)
<break></break>
<italic>Did the review address unit of analysis errors?</italic>
<break></break>
_ Yes - took clustering into account in the analysis (e.g. used intra-cluster correlation coefficient)
<break></break>
_ No, but acknowledged problem of unit of analysis errors
<break></break>
_ No mention of issue
<break></break>
_ Not applicable - no clustered trials or studies included
<break></break>
<italic>Coding guide - check the answers above</italic>
<break></break>
<italic>If narrative OR vote counting (where quantitative analyses would have been possible) OR inappropriate table, graph or meta-analyses OR unit of analyses errors not addressed (and should have been) the answer is likely NO.</italic>
<break></break>
<italic>If appropriate table, graph or meta-analysis AND appropriate weights AND the extent of heterogeneity was taken into account, the answer is likely YES.</italic>
<break></break>
<italic>If no studies/no data</italic>
:
<italic>NOT APPLICABLE</italic>
<break></break>
<italic>If unsure</italic>
:
<italic>CAN</italic>
'
<italic>T TELL/PARTIALLY</italic>
</td>
<td align="left" rowspan="1" colspan="1">_ Yes
<break></break>
_ Can't tell/partially
<break></break>
_ No
<break></break>
_ Not applicable (e.g. no studies or no data)</td>
</tr>
<tr>
<td align="left" colspan="2" rowspan="1">
<italic>Comments (note important limitations or uncertainty)</italic>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>B.5 Did the review examine the extent to which specific factors might explain differences in the results of the included studies?</bold>
<break></break>
_ Were factors that the review authors considered as likely explanatory factors clearly described?
<break></break>
_ Was a sensible method used to explore the extent to which key factors explained heterogeneity?
<break></break>
_ Descriptive/textual
<break></break>
_ Graphical
<break></break>
_ Meta-regression
<break></break>
_ Other</td>
<td align="left" rowspan="1" colspan="1">_ Yes
<break></break>
_ Can't tell/partially
<break></break>
_ No
<break></break>
_ Not applicable (e.g. too few studies, no important differences in the results of the included studies, or the included studies were so dissimilar that it would not make sense to explore heterogeneity of the results)</td>
</tr>
<tr>
<td align="left" colspan="2" rowspan="1">
<italic>Comments (note important limitations or uncertainty)</italic>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>B.6 Overall - how would you rate the methods used to analyse the findings relative to the primary question addressed in the review?</bold>
<break></break>
<italic>Summary assessment score B relates to the 5 questions in this section, regarding the analysis.</italic>
<break></break>
<italic>If the</italic>
"
<italic>No</italic>
"
<italic>or</italic>
"
<italic>Partial</italic>
"
<italic>option is used for any of the 5 preceding questions, the review is likely to have important limitations.</italic>
<break></break>
<italic>Examples of major limitations might include not reporting critical characteristics of the included studies or not reporting the results of the included studies.</italic>
</td>
<td align="left" rowspan="1" colspan="1">_
<bold>Major limitations</bold>
(limitations that are important enough that the results of the review are not reliable and they should not be used in the policy brief)
<break></break>
_
<bold>Important limitations</bold>
(limitations that are important enough that it would be worthwhile to search for another systematic review and to interpret the results of this review cautiously, if a better review cannot be found)
<break></break>
_
<bold>Reliable</bold>
(only minor limitations)</td>
</tr>
<tr>
<td align="left" colspan="2" rowspan="1">
<italic>Use comments to specify if relevant, to flag uncertainty or need for discussion</italic>
</td>
</tr>
<tr>
<td align="left" colspan="2" rowspan="1">
<bold>Section C</bold>
:
<italic>Overall assessment of the reliability of the review</italic>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>C.1 Are there any other aspects of the review not mentioned before which lead you to question the results?</bold>
</td>
<td align="left" rowspan="1" colspan="1">_ Additional methodological concerns
<break></break>
_ Robustness
<break></break>
_ Interpretation
<break></break>
_ Conflicts of interest (of the review authors or for included studies)
<break></break>
_ Other
<break></break>
_ No other quality issues identified</td>
</tr>
<tr>
<td align="left" colspan="2" rowspan="1">
<bold>C.2 Based on the above assessments of the methods how would you rate the reliability of the review?</bold>
<break></break>
_
<bold>
<underline>Major limitations</underline>
</bold>
(exclude); briefly (and politely) state the reasons for excluding the review by completing the following sentence:
<italic>This review was not included in this policy brief for the following reasons</italic>
:
<break></break>
<italic>Comments (briefly summarise any key messages or useful information that can be drawn from the review for policy makers or managers)</italic>
:
<break></break>
_
<bold>
<underline>Important limitations</underline>
</bold>
; briefly (and politely) state the most important limitations by editing the following sentence, if needed, and specifying what the important limitations are:
<italic>This review has important limitations.</italic>
<break></break>
_
<bold>
<underline>Reliable</underline>
</bold>
; briefly note any comments that should be noted regarding the reliability of this review by editing the following sentence, if needed:
<italic>This is a good quality systematic review with only minor limitations.</italic>
</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec id="CD011086-sec2-0015">
<title>Appendix 2. Search strategies</title>
<sec>
<title>PubMed</title>
<p>
<underline>
<bold>From 2000 to present. Update</bold>
</underline>
<bold>:
<underline>weekly</underline>
</bold>
</p>
<p>#1. MEDLINE[Title/Abstract]</p>
<p>#2. (systematic[Title/Abstract] AND review[Title/Abstract])</p>
<p>#3. meta analysis[Publication Type]</p>
<p>#4. #1 OR #2 OR #3
<bold>(Methods filter for systematic reviews–Clinical Queries–Max Specificity)</bold>
</p>
<p>#5. overview[Title] AND (reviews[Title] OR systematic[Title]</p>
<p>#6. meta-review[Title]</p>
<p>#7. review of reviews[Title]</p>
<p>#8. review[Title] AND systematic reviews[Title]</p>
<p>#9. umbrella[Title] AND (review[Title] OR reviews[Title] OR systematic[Title])</p>
<p>#10. policy[Title] AND (brief[Title] OR evidence[Title])</p>
<p>#11. #5 OR #6 OR #7 OR #8 OR #9 OR #10
<bold>(Methods filter for overviews)</bold>
</p>
<p>#12. #4 OR #11
<bold>(Methods filter for systematic reviews and for overviews)</bold>
</p>
</sec>
<sec>
<title>LILACS</title>
<p>
<underline>
<bold>From 2000 to present. Update: monthly</bold>
</underline>
</p>
<p>(TW:"revision sistematica" OR TW:"revisao sistematica" OR TW:"systematic review" OR MH:"review literature as topic" OR MH:"meta-analysis as topic" OR PT:"meta-analysis")</p>
<p>
<bold>OR</bold>
</p>
<p>(PT:revision
<bold>AND</bold>
(TW:metaanal$ OR TW:"meta-analysis" OR TW:"metaanalise" OR TW:"meta-analisis" OR TI:overview$ OR TW:"estudio sistematico" OR TW:"systematic study" OR TW:"estudo sistematico" OR TI:review OR TI:revisao OR TI:revision OR TI:systematic OR TI:sistematico))</p>
<p>
<bold>OR</bold>
</p>
<p>((TW:overview OR TW:"estudio sistematico" OR TW:"systematic study" OR TW:"estudo sistematico")
<bold>AND</bold>
(TI:review OR TI:revisao OR TI:revision OR TI:systematic OR TI:sistematico))</p>
</sec>
<sec>
<title>CINAHL (EBSCO)</title>
<p>
<underline>
<bold>From 2000 to present. Update: monthly</bold>
</underline>
</p>
<p>((TI meta analys* or AB meta analys*) or (TI systematic review or AB systematic review))</p>
</sec>
<sec>
<title>PsycINFO (EBSCO)</title>
<p>
<underline>
<bold>From 2000 to present. Update: monthly</bold>
</underline>
</p>
<p>meta-analysis OR search*</p>
</sec>
<sec>
<title>EMBASE (Ovid)</title>
<p>
<underline>
<bold>From 2000 to present. Update: monthly</bold>
</underline>
</p>
<p>meta-analysis.tw. OR systematic review.tw</p>
</sec>
</sec>
<sec id="CD011086-sec2-0016">
<title>Appendix 3. Characteristics of included reviews</title>
<table-wrap id="d35e14706" position="float">
<table frame="border" rules="groups">
<tbody>
<tr>
<td align="left" colspan="3" rowspan="1">
<bold>Strategies targeted at healthcareorganisations</bold>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<bold>Organisational culture</bold>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<xref rid="b29" ref-type="bibr">Parmelli 2011</xref>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Review objective: to determine the effectiveness of strategies to change organisational culture in order to improve healthcare performance and considering – when possible – different patterns of organisational culture.</td>
</tr>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Types of</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors searched for</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors found</bold>
</th>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Study designs and Interventions</bold>
</td>
<td align="left" rowspan="1" colspan="1">Any strategy intended to change organisational culture in order to improve healthcare performance. The comparator could be normal care or any other active intervention. The following study designs were considered: randomised trials, non-randomised trials, controlled before-after studies and interrupted time series studies</td>
<td align="left" rowspan="1" colspan="1">No available studies eligible for inclusion in this review</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Participants</bold>
</td>
<td align="left" rowspan="1" colspan="1">Healthcare organisations applying strategies to change organisational culture</td>
<td align="left" rowspan="1" colspan="1">No available studies eligible for inclusion in this review</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Settings</bold>
</td>
<td align="left" rowspan="1" colspan="1">Any type of healthcare organisation in any country</td>
<td align="left" rowspan="1" colspan="1">No available studies eligible for inclusion in this review</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Outcomes</bold>
</td>
<td align="left" rowspan="1" colspan="1">Professional performance such as prescription rates, evidence-based practice, quality of care, and efficiency. Patient outcomes such as mortality, condition-specific measures of outcomes, quality of life, functional health status, and patient satisfaction. Organisational performance indicators such as wait times, inpatient hospital stay times, and staff turnover rates</td>
<td align="left" rowspan="1" colspan="1">No available studies eligible for inclusion in this review</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Date of most recent search: October 2009</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Limitations: this is a well-conducted systematic review with only minor limitations. However, it did not identify any studies that met the inclusion criteria.</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<bold>Strategies targeted at healthcare workers by type of interventions</bold>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<bold>Educational materials</bold>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<xref rid="b10" ref-type="bibr">Giguère 2012</xref>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Review objective: to determine the effects of printed educational materials (PEMs) in improving professional practice and patient outcomes</td>
</tr>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Types of</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors searched for</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors found</bold>
</th>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Study designs and Interventions</bold>
</td>
<td align="left" rowspan="1" colspan="1">Randomised trials, non-randomised trials, controlled before-after studies, and interrupted time series studies assessing the effects of printed educational materials, such as clinical practice guidelines, journals, and monographs, delivered personally, through mass mailing or passively via wider channels such as the Internet or mass media</td>
<td align="left" rowspan="1" colspan="1">45 studies: 8 cluster-randomised trials, 6 randomised trials, and 31 interrupted time series studies. Most studies (36/45) evaluated a single PEM. 2 studies evaluated simultaneously several PEMs (respectively 12 and 11 distinct PEMs) that presented similar characteristics; and 3 interrupted time series studies assessed more than 2 PEMs with very similar characteristics. The 45 studies included the following PEMS: 23 journal publications, 16 evidence-based guidelines, 6 newsletters, 3 summaries of clinical guidelines and 1 clinical article reprint</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Participants</bold>
</td>
<td align="left" rowspan="1" colspan="1">Any type of healthcare professionals</td>
<td align="left" rowspan="1" colspan="1">Physicians, psychologists, psychiatrists, nurses, critical care fellows, Masters-level therapists, and allied health professionals in the field of community health</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Settings</bold>
</td>
<td align="left" rowspan="1" colspan="1">Studies originating from any setting</td>
<td align="left" rowspan="1" colspan="1">Country: Canada (12 studies), USASA (11 studies), UK (11 studies), Spain (1 study), Belgium (1 study), The Netherlands (2 studies), Finland (1 study), Ireland (1 study), Germany (1 study), Italy (1 study), Japan (2 studies), Brazil (1 study), USA and Canada (1 study)
<break></break>
Healthcare setting: general family or community-based practice (10 studies), outpatient (ambulatory) settings (9 studies), hospitals (6 studies), mixed settings (3 studies), municipal health centre (1 study), managed behavioural healthcare organisation (1 study), clinical setting unclear (15 studies)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Outcomes</bold>
</td>
<td align="left" rowspan="1" colspan="1">Any objective measure either of professional practice (e.g. the number of tests ordered, prescriptions for a particular drug) or of patient health outcomes (e.g. blood pressure, complications after surgery)</td>
<td align="left" rowspan="1" colspan="1">Prescribing/treatment (39 studies); financial (resource use) (2 studies); general management of a problem (8 studies); diagnosis (4 studies); procedures (7 studies); referrals (4 studies); test ordering (5 studies); surgery (5 studies); patient education/advice (4 studies); clinical prevention service (3 studies); screening (2 studies); reporting (1 study); discharge planning (2 studies); patient health outcome (4 studies)</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Date of most recent search: June 2011</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Limitations: this is a well-conducted systematic review with only minor limitations.</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<bold>Internet-based education</bold>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<xref rid="b5" ref-type="bibr">Cook 2008</xref>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Review objective: to assess the effects of internet-based learning for health professionals.</td>
</tr>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Types of</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors searched for</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors found</bold>
</th>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Study designs and Interventions</bold>
</td>
<td align="left" rowspan="1" colspan="1">Internet-based learning for health professionals at any stage of training or practice</td>
<td align="left" rowspan="1" colspan="1">201 studies (including observational and experimental designs) of Internet-based learning for health professionals, addressing a wide range of topics, and using a range of modalities for teaching and learning</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Participants</bold>
</td>
<td align="left" rowspan="1" colspan="1">Health profession learners (including students and practising physicians, nurses, dentists, pharmacists and others)</td>
<td align="left" rowspan="1" colspan="1">Health profession learners</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Settings</bold>
</td>
<td align="left" rowspan="1" colspan="1">All settings and languages</td>
<td align="left" rowspan="1" colspan="1">All settings</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Outcomes</bold>
</td>
<td align="left" rowspan="1" colspan="1">Satisfaction; learning (knowledge, attitudes, skills); behaviours or effects on patients</td>
<td align="left" rowspan="1" colspan="1">Knowledge, skills, behaviours and effects on patients, satisfaction</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Date of most recent search: January 2008</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Limitations: the review is from 2008 and the studies up to 2007. New information is likely to be available.</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<bold>Educational meetings</bold>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<xref rid="b9" ref-type="bibr">Forsetlund 2009</xref>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Review objective: to address the following questions: Do educational meetings and workshops improve professional practice and healthcare outcomes? What are the effects of educational meetings compared with the effects of other interventions? and Can changes in how educational meetings are done increase the effects?</td>
</tr>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Types of</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors searched for</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors found</bold>
</th>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Study designs and Interventions</bold>
</td>
<td align="left" rowspan="1" colspan="1">The following types of educational meetings: conferences, lectures, workshops, seminars, symposia and courses. Only randomised trials were included</td>
<td align="left" rowspan="1" colspan="1">81 trials (74 cluster-randomised trials, 7 randomised by providers). Targeted behaviours were preventive care (11 studies), test ordering (3 studies), screening (6 studies), prescribing (13 studies), general management of a wide array of problems (41) and other (7 studies). The interventions were multifaceted in 32 studies.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Participants</bold>
</td>
<td align="left" rowspan="1" colspan="1">Studies involving qualified health professionals or health professionals in post-graduate training were included. Studies involving only undergraduate students were excluded.</td>
<td align="left" rowspan="1" colspan="1">The health professionals were physicians in most trials, nurses (2 studies), pharmacists (3 studies), prescribers (1 study), or mixed providers (18 studies).</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Settings</bold>
</td>
<td align="left" rowspan="1" colspan="1">All healthcare settings (primary care and hospital care)</td>
<td align="left" rowspan="1" colspan="1">General practice (43 studies), community-based care (16 studies), hospital-based care (17 studies) and 'other type of settings' (5 studies). Studies were from USA (28 studies), UK (14 studies), Netherlands (10 studies), Canada (4 studies), Australia (3 studies), Norway (3 studies), France (2 studies), Indonesia (2 studies), South-Africa (2 studies); Sweden, Denmark, Belgium, Spain, Scotland, Mali, Thailand, Peru, Mexico, Zambia, Sri Lanka, New Zealand and Brazil (1 study each)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Outcomes</bold>
</td>
<td align="left" rowspan="1" colspan="1">All objectively measured health professional practice behaviours or patient outcomes</td>
<td align="left" rowspan="1" colspan="1">There was wide variation in the outcome measures and number of outcomes measured. Median follow-up was 6 months (range 14 days to 2 years)</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Date of most recent search: March 2006</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Limitations: this is a well-conducted systematic review with only minor limitations.</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<bold>Educational meetings</bold>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<xref rid="b32" ref-type="bibr">Reeves 2013</xref>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Review objective: to assess the effects of interprofessional education on professional practice and healthcare outcomes</td>
</tr>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Types of</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors searched for</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors found</bold>
</th>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Study designs and Interventions</bold>
</td>
<td align="left" rowspan="1" colspan="1">Randomised trials, controlled before-after studies and interrupted time series studies of interprofessional education interventions. These included all types of educational, training, learning or teaching initiatives involving more than one profession in joint, interactive learning with the explicit purpose of improving interprofessional collaboration or the health and well-being of patients</td>
<td align="left" rowspan="1" colspan="1">15 studies: randomised trials (8 studies), controlled before-after studies (5 studies) and interrupted time series studies (2 studies).
<break></break>
The interprofessional education interventions assessed were varied, and included (among others): communication skills training, teamwork and team planning interventions, and behaviour change training (interactive workshops).</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Participants</bold>
</td>
<td align="left" rowspan="1" colspan="1">Health and social care professionals</td>
<td align="left" rowspan="1" colspan="1">A range of health and social care professionals including (among others): physicians, nurses, nutritionists, optometrists, social workers, physician assistants, psychiatrists, mental health workers, medicine residents, pharmacy students, obstetricians and anaesthetists</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Settings</bold>
</td>
<td align="left" rowspan="1" colspan="1">Any health or social care setting</td>
<td align="left" rowspan="1" colspan="1">Countries: USA (12 studies), UK (2 studies), Mexico (1 study)
<break></break>
Healthcare settings: hospital emergency departments, community mental health provider organisations, primary care clinics, and a health maintenance organisation</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Outcomes</bold>
</td>
<td align="left" rowspan="1" colspan="1">Objectively measured or self-reported patient/client outcomes, healthcare process outcomes</td>
<td align="left" rowspan="1" colspan="1">Patient outcomes, guideline adherence rates, patient satisfaction, clinical process outcomes, collaborative behaviour, medical error rates, professionals competencies</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Date of most recent search: August 2011</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Limitations: this is a well-conducted systematic review with only minor limitations.</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<bold>Educational meetings</bold>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<xref rid="b13" ref-type="bibr">Horsley 2011</xref>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Review objective: to assess the effects of teaching critical appraisal skills to health professionals on the process of care, patient outcomes and knowledge of health professionals.</td>
</tr>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Types of</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors searched for</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors found</bold>
</th>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Study designs and Interventions</bold>
</td>
<td align="left" rowspan="1" colspan="1">Randomised trials, non-randomised trials, controlled before-after studies, and interrupted time series studies that examined the effectiveness of educational interventions teaching critical appraisal to health professionals</td>
<td align="left" rowspan="1" colspan="1">3 randomised trials of: journal club supported by a half-day workshop (1 study); critical appraisal materials ( a package including papers with methodological reviews), list-serve discussions and articles (1 study); and a half-day workshop based on a Critical Appraisal Skills Programme (CASP) (1 study)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Participants</bold>
</td>
<td align="left" rowspan="1" colspan="1">Any qualified healthcare professionals (including managers and purchasers) with direct patient care. Studies involving students were excluded</td>
<td align="left" rowspan="1" colspan="1">Interns (1 study) and physicians (2 studies)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Settings</bold>
</td>
<td align="left" rowspan="1" colspan="1">Any clinical setting</td>
<td align="left" rowspan="1" colspan="1">USA, UK and Canada</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Outcomes</bold>
</td>
<td align="left" rowspan="1" colspan="1">Process of care, patient mortality, morbidity, quality of life and satisfaction</td>
<td align="left" rowspan="1" colspan="1">Knowledge (2 studies) and critical appraisal skills (3 studies)</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Date of most recent search: June 2011</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Limitations: this was generally a well-conducted systematic review with only minor limitations.</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<bold>Educational meetings</bold>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<xref rid="b37" ref-type="bibr">Sunguya 2013</xref>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Review objective: to examine the effectiveness of nutrition training for health workers on child feeding practices among children aged 6 months to 2 years.</td>
</tr>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Types of</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors searched for</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors found</bold>
</th>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Study designs and Interventions</bold>
</td>
<td align="left" rowspan="1" colspan="1">Randomised trials and cluster-randomised trials of interventions in which health workers received nutrition training targeting caregivers' feeding practices</td>
<td align="left" rowspan="1" colspan="1">10 randomised trials and cluster-randomised trials of interventions in which health workers received nutrition training targeting caregivers' feeding practices</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Participants</bold>
</td>
<td align="left" rowspan="1" colspan="1">Health workers including doctors; nurses and nurse midwives; midlevel providers including assistant medical officers, clinical officers, assistant nurses, or assistant physicians; community health workers including village health workers</td>
<td align="left" rowspan="1" colspan="1">Nutritionists (2 studies); doctors (1 study); health workers (6 studies); community health workers (2 studies); auxiliary nurse midwives (1 study)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Settings</bold>
</td>
<td align="left" rowspan="1" colspan="1">Health facilities</td>
<td align="left" rowspan="1" colspan="1">Health facilities in low- and middle-income countries: India (4 studies), Brazil (1 study), Peru (1 study), Pakistan (1 study), China (1 study), Bangladesh (1 study), Vietnam (1 study)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Outcomes</bold>
</td>
<td align="left" rowspan="1" colspan="1">Feeding frequency measured in the number of times the child was fed in the previous 24 hours; energy intake in kilojoules (kJ) per day; and dietary diversity, defined as the variety of food items that was fed to a child</td>
<td align="left" rowspan="1" colspan="1">Feeding frequency (5 studies); energy intake (6 studies); dietary diversity: consumption of targeted food items (7 studies)</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">October 2012</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<bold>Limitations</bold>
: this is a well-conducted systematic review with only minor limitations.</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<bold>Educational outreach</bold>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<xref rid="b24" ref-type="bibr">O'Brien 2007</xref>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Review objective: to assess the effects of educational outreach on health professional practice and patient outcomes</td>
</tr>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Types of</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors searched for</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors found</bold>
</th>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Study designs and Interventions</bold>
</td>
<td align="left" rowspan="1" colspan="1">Randomised trials of educational outreach to healthcare professionals by trained people that may be from the same organisation, but not from the same practice site. The information given may include feedback about their performance.</td>
<td align="left" rowspan="1" colspan="1">69 trials found</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Participants</bold>
</td>
<td align="left" rowspan="1" colspan="1">Healthcare professionals responsible for patient care</td>
<td align="left" rowspan="1" colspan="1">Primary care physicians or teams practising in community settings (53 studies), physicians in hospital settings (6 studies), nurses and nursing assistants (4 studies), pharmacists/owners and counter attendants (2 studies), dentists (1 study)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Settings</bold>
</td>
<td align="left" rowspan="1" colspan="1">Any practice setting</td>
<td align="left" rowspan="1" colspan="1">Mostly primary and community healthcare settings. The studies were from the USA (23 studies), the UK (22 studies), Europe (14 studies), Australia (8 studies), Indonesia (2 studies) and Thailand (1 study)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Outcomes</bold>
</td>
<td align="left" rowspan="1" colspan="1">Objectively measured professional performance in a healthcare setting or healthcare outcomes. Studies that only measured knowledge or performance in a test situation were excluded.</td>
<td align="left" rowspan="1" colspan="1">Most studies reported multiple effect measures and many did not specify a primary outcome. 28 studies (34 comparisons) contributed to the calculation of the median for the main comparison of professional performance. Educational outreach was compared to another type of intervention, usually audit and feedback, in 8 trials (12 comparisons).</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Date of most recent search: March 2007</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Limitations: this is a well-conducted systematic review with only minor limitations.</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<bold>Educational outreach</bold>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<xref rid="b3" ref-type="bibr">Baskerville 2012</xref>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Review objective: to undertake a quantitative synthesis of the effect of practice facilitation on evidence-based practice behaviour.</td>
</tr>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Types of</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors searched for</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors found</bold>
</th>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Study designs and Interventions</bold>
</td>
<td align="left" rowspan="1" colspan="1">Randomised and non-randomised trials and prospective studies of individual practice facilitation</td>
<td align="left" rowspan="1" colspan="1">23 studies of practice facilitation interventions (17 randomised trials, 3 cluster randomised trials, and 3 non-randomised studies)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Participants</bold>
</td>
<td align="left" rowspan="1" colspan="1">All healthcare providers in primary care practices</td>
<td align="left" rowspan="1" colspan="1">Studies included 1398 practices (697 allocated to facilitation intervention and 701 in the control group)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Settings</bold>
</td>
<td align="left" rowspan="1" colspan="1">Primary care settings</td>
<td align="left" rowspan="1" colspan="1">Primary care practices in the USA (12 studies), the Netherlands (5 studies), Canada (3 studies), the UK (2 studies) and Australia (1 study)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Outcomes</bold>
</td>
<td align="left" rowspan="1" colspan="1">Change in evidence-based practice behaviour</td>
<td align="left" rowspan="1" colspan="1">Studies reported this outcome in varied ways, such as increased screening or management of different conditions and improvements in care provided</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Date of most recent search: December 2010</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Limitations: this is a well-conducted systematic review. However, the literature searches were restricted to English-language studies.</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<bold>Educational outreach</bold>
– Pharmacist-provided services</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<xref rid="b28" ref-type="bibr">Pande 2013</xref>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Review objective: to examine the effectiveness of services provided by pharmacists on patient outcomes and health service utilisation and costs in low- and middle-income countries.</td>
</tr>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Types of</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors searched for</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors found</bold>
</th>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Study designs and Interventions</bold>
</td>
<td align="left" rowspan="1" colspan="1">Any health or drug-related, patient-targeted service delivered by pharmacists (other than drug compounding and dispensing, and excluding other services such as the selling of cosmetics or other non-pharmaceutical products) evaluated in a randomised trial, non-randomised trial, controlled before-after study, or interrupted time series study.</td>
<td align="left" rowspan="1" colspan="1">12 randomised trials in middle-income countries were included. 11 examined pharmacist interventions targeted at patients, and 1 evaluated a pharmacist intervention targeted at healthcare professionals. All the included studies compared pharmacist-provided services with usual care.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Participants</bold>
</td>
<td align="left" rowspan="1" colspan="1">Pharmacists (or pharmacies) delivering services in outpatient settings other than, or in addition to, drug compounding and dispensing</td>
<td align="left" rowspan="1" colspan="1">Practising pharmacists and research pharmacists</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Settings</bold>
</td>
<td align="left" rowspan="1" colspan="1">Outpatient settings</td>
<td align="left" rowspan="1" colspan="1">Sudan (1 study), India (2 studies), Egypt (1 study), Paraguay (1 study), Thailand (2 studies), Chile (2 studies), Bulgaria (2 studies), and South Africa (1 study)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Outcomes</bold>
</td>
<td align="left" rowspan="1" colspan="1">Objective measurement of patient outcomes and process outcomes such as health service utilisation and costs</td>
<td align="left" rowspan="1" colspan="1">Process outcomes (4 studies), rate of hospitalisation (2 studies), number of visits to private clinics or outpatient clinics and emergency rooms in hospitals (1 study), medication costs of patients with chronic obstructive pulmonary disease and asthma (1 study), the number of visits to general practitioners (2 studies), clinical and humanistic outcomes (11 studies), patient outcomes (7 studies), asthma score (1 study)</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Date of most recent search: March 2010</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Limitations: this is a well-conducted systematic review with minor limitations. There were few evaluations of impact that allowed robust conclusions to be drawn, particularly as many of the studies did not take all the costs involved into account.</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<bold>Local opinion leaders</bold>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<xref rid="b8" ref-type="bibr">Flodgren 2011</xref>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Review objective: to assess the effectiveness of local opinion leaders in improving the behaviour of healthcare professionals and patient outcomes</td>
</tr>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Types of</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors searched for</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors found</bold>
</th>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Study designs and Interventions</bold>
</td>
<td align="left" rowspan="1" colspan="1">Randomised trials</td>
<td align="left" rowspan="1" colspan="1">18 randomised trials in which opinion leaders delivered educational initiatives to members of their own healthcare profession</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Participants</bold>
</td>
<td align="left" rowspan="1" colspan="1">Healthcare professionals in charge of patient care</td>
<td align="left" rowspan="1" colspan="1">Physicians (14 studies); nurses (2 studies); physicians, nurses and midwives (2 studies)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Settings</bold>
</td>
<td align="left" rowspan="1" colspan="1">Any healthcare setting</td>
<td align="left" rowspan="1" colspan="1">Hospitals (14 studies), primary care practice (1 study), both primary and secondary care (1 study), and undefined healthcare settings (2 studies); in the USA of America (10 studies), Canada (6 studies), China (1 study), and Argentina and Uruguay (1 study)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Outcomes</bold>
</td>
<td align="left" rowspan="1" colspan="1">Objective measures of professional performance and/or patient outcomes</td>
<td align="left" rowspan="1" colspan="1">General management of a clinical problem (all 18 randomised trials)</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Date of most recent search: May 2009</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Limitations: this is a well-conducted systematic review with only minor limitations.</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<bold>Audit and feedback</bold>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<xref rid="b15" ref-type="bibr">Ivers 2012</xref>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Review objective: to assess the effects of audit and feedback on the practice of healthcare professionals and on patient outcomes.</td>
</tr>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Types of</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors searched for</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors found</bold>
</th>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Study designs and Interventions</bold>
</td>
<td align="left" rowspan="1" colspan="1">Randomised trials assessing the effects of audit and feedback. Interventions were only included if audit and feedback was a core or essential element.</td>
<td align="left" rowspan="1" colspan="1">140 randomised trials were included. The interventions used were highly heterogeneous with respect to their content, format, timing and source.
<break></break>
Targeted behaviours were prescribing (39 trials), managing patients with diabetes or cardiovascular diseases (34 studies), and test ordering (31 studies). The remaining trials varied widely in terms of health conditions and targeted behaviours.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Participants</bold>
</td>
<td align="left" rowspan="1" colspan="1">Healthcare professionals responsible for patient care</td>
<td align="left" rowspan="1" colspan="1">In most of the trials the healthcare professionals were physicians. Other targeted providers included dentists (1 trial), nurses (3 studies), pharmacists (2 studies), and a mix of providers (14 studies).</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Settings</bold>
</td>
<td align="left" rowspan="1" colspan="1">Healthcare settings</td>
<td align="left" rowspan="1" colspan="1">USA (69 trials), Canada (11 studies), UK or Ireland (21 studies), Australia or New Zealand (10 studies), and elsewhere (29 studies). Only 5 studies took place in low- and middle income countries: Sudan (2 studies), Thailand (1 study), Laos (1 study), Argentina and Uruguay (1 study).
<break></break>
94 trials were in outpatient settings, 36 in inpatient settings, and the clinical setting was unclear in 10 trials.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Outcomes</bold>
</td>
<td align="left" rowspan="1" colspan="1">Objectively measured provider performance or healthcare outcomes</td>
<td align="left" rowspan="1" colspan="1">There was large variation in outcome measures, and many trials reported multiple primary outcomes. Most trials measured professional practice, with some also reporting patient outcomes.</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Date of most recent search: December 2010</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Limitations: this is a well-conducted systematic review with only minor limitations.</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<bold>Reminders</bold>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<xref rid="b19" ref-type="bibr">Ko 2011</xref>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Review objective: to assess if the use of safety checklists, compared to not using checklists, improves patient safety in acute hospital settings</td>
</tr>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Types of</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors searched for</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors found</bold>
</th>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Study designs and Interventions</bold>
</td>
<td align="left" rowspan="1" colspan="1">Comparative studies of paper-based checklists, applied to hospitalised patients by medical care teams, compared to controls (care provided without checklists)</td>
<td align="left" rowspan="1" colspan="1">Before-after studies (9 studies) that evaluated a wide variety of checklist designs and training on use of the checklists.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Participants</bold>
</td>
<td align="left" rowspan="1" colspan="1">Medical care teams (a medical clinician or surgeon had to be included)</td>
<td align="left" rowspan="1" colspan="1">Medical teams</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Settings</bold>
</td>
<td align="left" rowspan="1" colspan="1">Acute hospital settings</td>
<td align="left" rowspan="1" colspan="1">Intensive care units (5 studies), emergency departments (2 studies), surgical units (1 study) and multidepartmental acute care settings (1 study)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Outcomes</bold>
</td>
<td align="left" rowspan="1" colspan="1">Any patient-relevant clinical outcome</td>
<td align="left" rowspan="1" colspan="1">Length of stay (3 studies), percentage of ventilator days on which patients received recommended care (1 study), time from admission until prescription of medical deep venous thrombosis prophylaxis (1 study), appropriate indications for use of an indwelling urinary tract catheter (1 study), complications during the postoperative period (1 study), patients receiving antibiotics within 8 hours of a diagnosis of pneumonia (1 study)</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Date of most recent search: September 2009</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Limitations: only articles in English were included and the results of included studies were not described or analysed systematically.</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<bold>Tailored interventions</bold>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<xref rid="b2" ref-type="bibr">Baker 2015</xref>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Review objective: to assess the effectiveness of interventions tailored to address identified barriers to change on professional practice or patient outcomes.</td>
</tr>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Types of</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors searched for</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors found</bold>
</th>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Study designs and Interventions</bold>
</td>
<td align="left" rowspan="1" colspan="1">Randomised trials of interventions tailored to address prospectively identified barriers to change.
<break></break>
Studies had to involve a comparison group that did not receive a tailored intervention or a comparison between an intervention that was targeted at both individual and social or organisational barriers, compared with an intervention targeted at only individual barriers.</td>
<td align="left" rowspan="1" colspan="1">32 randomised trials. Interventions assessed were varied and included (among others): printed materials; educational outreach; clinical guidelines; audit and feedback; interactive workshops; teaching sessions/discussions of patients; facilitation/practice meetings; and individual/group academic detailing.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Participants</bold>
</td>
<td align="left" rowspan="1" colspan="1">Healthcare professionals responsible for patient care</td>
<td align="left" rowspan="1" colspan="1">Primarily physicians (14 studies), mixed professional groups (8 studies), nurses (4 studies); pharmacists (2 studies), geriatric teams (1 study), gynaecology teams (1 study), and physicians (1 study)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Settings</bold>
</td>
<td align="left" rowspan="1" colspan="1">Any setting</td>
<td align="left" rowspan="1" colspan="1">Primary care or community settings (17 studies), hospital settings (7 studies), nursing homes (3 studies), and 1 each in child health clinics, community pharmacies, a regional health system, and a Medicaid programme. The studies took place in the USA of America (USA) (12 studies), the Netherlands (5 studies), the UK (UK) (4 studies), Belgium (2 studies), Indonesia (2 studies), Norway (2 studies), South Africa (2 studies), and Canada (1 study), Ireland (1 study), and Portugal (1 study)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Outcomes</bold>
</td>
<td align="left" rowspan="1" colspan="1">Objectively measured professional performance (excluding self-reporting) or patient outcomes in a healthcare setting or both.</td>
<td align="left" rowspan="1" colspan="1">Change in prescribing behaviour (12 studies), management of a disease (including diagnosis, assessment and treatment) (11 studies), preventive care (6 studies), influenza vaccination (2 studies), reporting adverse drug reactions (1 study)</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Date of most recent search: December 2014</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Limitations: this is a well-conducted systematic review with only minor limitations.</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<bold>Multifaceted interventions</bold>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<xref rid="b30" ref-type="bibr">Perrier 2011</xref>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Review objective: to assess the effectiveness of interventions for seeking, appraising, and applying evidence from systematic reviews in clinical decisions.</td>
</tr>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Types of</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors searched for</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors found</bold>
</th>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Study designs and Interventions</bold>
</td>
<td align="left" rowspan="1" colspan="1">Quantitative studies using any intervention to encourage use of systematic reviews in clinical decision-making</td>
<td align="left" rowspan="1" colspan="1">5 randomised trials that examined strategies ranging from multifaceted to simple interventions</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Participants</bold>
</td>
<td align="left" rowspan="1" colspan="1">Healthcare practitioners of any specialty involved in providing patient care</td>
<td align="left" rowspan="1" colspan="1">Physicians (4 studies) – 1 each in Canada, Thailand, UK, and Uruguay; midwives (3 studies) – 1 each in Thailand, UK, and Uruguay; residents (1 study - Uruguay); interns (1 study - Thailand); students (1 study - Thailand); dentists (1 study - Scotland)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Settings</bold>
</td>
<td align="left" rowspan="1" colspan="1">All settings</td>
<td align="left" rowspan="1" colspan="1">Primary care (1 study), hospitals (3 studies), dental practice (1 study)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Outcomes</bold>
</td>
<td align="left" rowspan="1" colspan="1">Change in professional performance (prescribing patterns, use of diagnostic tests), health outcomes for patients (return visits, adverse events, length of stay, decrease in admissions), and measures of healthcare provider satisfaction, knowledge, or attitude</td>
<td align="left" rowspan="1" colspan="1">All 5 studies provided objective performance measures. Patient health outcome measures and measures of healthcare provider satisfaction were not reported in any study.</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<bold>Date of most recent search</bold>
: July 2009</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<bold>Limitations:</bold>
this is a well-conducted systematic review with only minor limitations.</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<bold>Strategies targeted at healthcareworkers by type of problem</bold>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<bold>Communication with patients</bold>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<xref rid="b6" ref-type="bibr">Dwamena 2012</xref>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Review objective: to assess the effects of interventions for healthcare providers that aim to promote patient-centred care (PCC) approaches in clinical consultations.</td>
</tr>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Types of</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors searched for</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors found</bold>
</th>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Study designs and Interventions</bold>
</td>
<td align="left" rowspan="1" colspan="1">Randomised trials of interventions for healthcare providers that promote PCC in clinical consultations</td>
<td align="left" rowspan="1" colspan="1">43 randomised trials. All studies assessed interventions that included training related to a variety of PCC skills, using diverse teaching techniques and lengths of training. 20 of the 43 studies included additional interventions.
<break></break>
<list list-type="bullet">
<list-item>
<p>Training or general educational material for patients (7 studies)</p>
</list-item>
<list-item>
<p>Health condition-specific training or materials for providers (7 studies)</p>
</list-item>
<list-item>
<p>Condition-specific materials or training for both providers and patients (6 studies).</p>
</list-item>
</list>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Participants</bold>
</td>
<td align="left" rowspan="1" colspan="1">Any types of healthcare providers, including those training to qualify as healthcare providers</td>
<td align="left" rowspan="1" colspan="1">Most of the studies included primary care physicians or nurses practicing in community or hospital outpatient settings.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Settings</bold>
</td>
<td align="left" rowspan="1" colspan="1">Clinical consultations of any type</td>
<td align="left" rowspan="1" colspan="1">Community or outpatient settings in the USA (16 studies), UK (10 studies), Germany (3 studies), Switzerland (2 studies), Netherlands (2 studies), Spain (2 studies), Australia (2 studies), Canada (1 study), France (1 study), Holland (1 study), Norway (1 study), Israel (1 study) and Taiwan (1 study). There were no studies from low- and middle-income countries.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Outcomes</bold>
</td>
<td align="left" rowspan="1" colspan="1">Consultation processes, including the extent to which patient-centred care was judged to be achieved in practice
<break></break>
Patient satisfaction with care
<break></break>
Patient healthcare behaviours, e.g. concordance with care plans and service utilisation
<break></break>
Patient health status and well-being: physiological measures (e.g. blood pressure); clinical assessments (e.g. wound healing); patient self-reports of symptom resolution or quality of life; and patient self-esteem</td>
<td align="left" rowspan="1" colspan="1">Most of the studies assessed the impacts on consultation processes and many also evaluated the impact on patient satisfaction. Patient health behaviours were less frequently assessed and patient health status was evaluated quite frequently.</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Date of most recent search: June 2010</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Limitations: this is a well-conducted systematic review with only minor limitations.</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<bold>Handwashing</bold>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<xref rid="b11" ref-type="bibr">Gould 2010</xref>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Review objective: to assess the effectiveness of strategies to improve hand hygiene compliance in patient care and their subsequent effects on healthcare-associated infections.</td>
</tr>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Types of</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors searched for</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors found</bold>
</th>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Study designs and Interventions</bold>
</td>
<td align="left" rowspan="1" colspan="1">Any single or multifaceted intervention intended to improve compliance with hand hygiene using aqueous solutions or alcohol-based products</td>
<td align="left" rowspan="1" colspan="1">1 randomised clinical trial assessing education about hand hygiene and universal precautions
<break></break>
2 interrupted time series studies of social marketing campaigns, 1 of which also analysed a campaign for substituting types of alcohol-based hand rub either for another type or for soaps
<break></break>
1 controlled before-after study that used a single teaching session</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Participants</bold>
</td>
<td align="left" rowspan="1" colspan="1">Healthcare workers (except operating theatre staff)</td>
<td align="left" rowspan="1" colspan="1">Healthcare workers</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Settings</bold>
</td>
<td align="left" rowspan="1" colspan="1">Any hospital or community setting</td>
<td align="left" rowspan="1" colspan="1">4 studies: UK (general surgical wards), China (hospital), Switzerland (acute hospital) and Australia (3 acute units)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Outcomes</bold>
</td>
<td align="left" rowspan="1" colspan="1">Rates of observed hand hygiene compliance (or proxies for compliance), and reduction in healthcare-associated infection or colonisation rates</td>
<td align="left" rowspan="1" colspan="1">Frequency of hand washes, percentage of nurses washing hands, and use of hand hygiene products</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Date of most recent search: November 2009</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Limitations: this is a well-conducted systematic review.</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<bold>Obstetrics</bold>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<xref rid="b18" ref-type="bibr">Khunpradit 2011</xref>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Review objective: to determine the effectiveness and safety of non-clinical interventions for reducing unnecessary caesarean section rates</td>
</tr>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Types of</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors searched for</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors found</bold>
</th>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Study designs and Interventions</bold>
</td>
<td align="left" rowspan="1" colspan="1">Randomised trials, quasi-experimental studies, non-randomised trials, controlled before-after studies, and interrupted time series studies that evaluated interventions targeting patients, interventions targeting healthcare providers; financial, organisational and regulatory interventions</td>
<td align="left" rowspan="1" colspan="1">16 studies, including cluster-randomised trials (5 studies), patient randomised trials (6 studies), and interrupted time series studies (5 studies) targetting patients (6 studies) and healthcare providers (10 studies), of which 2 were financial interventions and 3 were regulatory interventions.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Participants</bold>
</td>
<td align="left" rowspan="1" colspan="1">Pregnant women and their families, healthcare providers who work with expectant mothers, communities and advocacy groups</td>
<td align="left" rowspan="1" colspan="1">Pregnant women (6 studies), physicians/obstetricians (6 studies), public health nurses (1 study), hospitals or departments (3 studies)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Settings</bold>
</td>
<td align="left" rowspan="1" colspan="1">Healthcare settings in low-, middle- and high-income countries</td>
<td align="left" rowspan="1" colspan="1">North America (6 studies), Latin America (1 study), Taiwan (2 studies), Iran (2 studies), UK (1 study), Netherlands (1 study), Australia (1 study), Finland (2 studies)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Outcomes</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<italic>Primary outcomes</italic>
: the rate of caesarean sections and the rate of unnecessary caesarean sections
<break></break>
<italic>Other outcomes</italic>
: maternal, fetal or neonatal complications, cost and financial benefits, patient and provider satisfaction</td>
<td align="left" rowspan="1" colspan="1">Caesarean section rates (16 studies) and complications (11 studies)</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Date of most recent search: March 2010</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Limitations: this is a well-conducted systematic review with only minor limitations, but the last search for studies took place in 2010.</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<bold>Obstetrics</bold>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<xref rid="b33" ref-type="bibr">Sibley 2012</xref>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Review objective: to assess the effects of initial training or additional training for traditional birth attendants (TBAs) on TBA and maternal behaviours thought to mediate positive pregnancy outcomes, as well as on maternal, perinatal, and newborn mortality and morbidity</td>
</tr>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Types of</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors searched for</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors found</bold>
</th>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Study designs and Interventions</bold>
</td>
<td align="left" rowspan="1" colspan="1">Randomised and quasi-randomised trials (including cluster-randomised trials)</td>
<td align="left" rowspan="1" colspan="1">4 cluster-randomised trials and 2 randomised trials</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Participants</bold>
</td>
<td align="left" rowspan="1" colspan="1">TBAs: a person who assists the mother during childbirth and who initially acquired her skills by delivering babies herself or through an apprenticeship to other TBAs.
<break></break>
Mothers and neonates cared for by trained and untrained TBAs or those who are living in areas where such TBAs attend most births.</td>
<td align="left" rowspan="1" colspan="1">The TBAs were poorly described in the included studies. They were mostly between 40 and 50 years of age, and had low levels of education. Marital and socioeconomic status was generally not reported.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Settings</bold>
</td>
<td align="left" rowspan="1" colspan="1">Rural communities</td>
<td align="left" rowspan="1" colspan="1">Studies from rural communities in Bangladesh (2 studies), Guatemala (1 study), Malawi (1 study), Pakistan (1 study), and Zambia (1 study). 1 study took place in 5 countries (Democratic Republic of Congo, Guatemala, India, Pakistan, and Zambia).</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Outcomes</bold>
</td>
<td align="left" rowspan="1" colspan="1">TBA or maternal behaviours thought to mediate positive pregnancy outcomes; maternal mortality; perinatal and neonatal mortality</td>
<td align="left" rowspan="1" colspan="1">Maternal mortality, maternal morbidity, haemorrhage (antepartum, intrapartum, postpartum combined), puerperal sepsis, frequency of obstructed labour, referral to emergency obstetrical care, neonatal mortality, advice about immediate feeding of colostrum, exclusive breastfeeding</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Date of most recent search: June 2012</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Limitations: this is a well-conducted systematic review with only minor limitations.</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<bold>Obstetrics</bold>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<xref rid="b39" ref-type="bibr">Yakoob 2011</xref>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Review objective: to determine the effect of provision of skilled birth attendance as well as basic and emergency obstetric care on stillbirths</td>
</tr>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Types of</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors searched for</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors found</bold>
</th>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Study designs and Interventions</bold>
</td>
<td align="left" rowspan="1" colspan="1">Randomised and non-randomised trials as well as observational studies evaluating the provision of skilled birth attendance and emergency obstetric care.</td>
<td align="left" rowspan="1" colspan="1">21 studies: 13 for skilled birth attendance (10 before-after or non-randomised studies and 3 observational studies) and 9 historical or ecological studies for emergency obstetric care</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Participants</bold>
</td>
<td align="left" rowspan="1" colspan="1">Pregnant women and newborns</td>
<td align="left" rowspan="1" colspan="1">Most women were from rural areas, but some were also from suburbs and mixed areas.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Settings</bold>
</td>
<td align="left" rowspan="1" colspan="1">Community based settings in any country</td>
<td align="left" rowspan="1" colspan="1">Most skilled birth attendance studies were from low- and middle-income countries (Bangladesh, Bolivia, China, Guatemala, Indonesia, Malawi, Mexico, Mozambique, Nigeria, Papua New Guinea, Sudan, and Tanzania). 3 studies were from high-income countries (Netherlands, Norway, and Sweden).</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Outcomes</bold>
</td>
<td align="left" rowspan="1" colspan="1">Stillbirths and perinatal mortality</td>
<td align="left" rowspan="1" colspan="1">2 (uncontrolled) before-after studies reported stillbirths and 4 reported perinatal mortality and were included in the primary analysis.</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Date of most recent search: March 2010</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Limitations: this is reasonably well-conducted systematic review with only minor limitations such as the incomplete reporting of included studies' characteristics.</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<bold>Obstetrics</bold>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<xref rid="b14" ref-type="bibr">Hundley 2012</xref>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Review objective: to assess the effects of birth kits on newborn and maternal outcomes.</td>
</tr>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Types of</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors searched for</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors found</bold>
</th>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Study designs and Interventions</bold>
</td>
<td align="left" rowspan="1" colspan="1">All available evidence, irrespective of study design. For the purpose of this review, a birth kit was defined as any disposable kit intended for routine use in the intrapartum period, specifically at the delivery of the baby.</td>
<td align="left" rowspan="1" colspan="1">9 included studies reporting effects of intervention packages including births kits: randomised trial (1 study), non-randomised trial (1 study), before-after studies (2 studies) and cross-sectional studies (5 studies)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Participants</bold>
</td>
<td align="left" rowspan="1" colspan="1">Pregnant women in the intrapartum period</td>
<td align="left" rowspan="1" colspan="1">Pregnant women (median delivery at home 87%)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Settings</bold>
</td>
<td align="left" rowspan="1" colspan="1">Home or health facility</td>
<td align="left" rowspan="1" colspan="1">Mostly rural areas from Nepal (2 studies), Egypt (2 studies), Pakistan (1 study), Kenya and Tanzania (1 study), Papua New Guinea (1 study), India (1 study), Tanzania (1 study)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Outcomes</bold>
</td>
<td align="left" rowspan="1" colspan="1">Primary outcomes: newborn outcomes and maternal outcomes
<break></break>
Secondary outcomes: process measures—clean birth practices</td>
<td align="left" rowspan="1" colspan="1">Newborn outcomes (perinatal mortality, neonatal tetanus, neonatal sepsis, and omphalitis) and maternal outcomes (maternal mortality, puerperal sepsis)
<break></break>
Process measures—clean birth practices (clean hands, birth surface, cord cutting, cord tie)</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Date of most recent search: September 2009</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Limitations: this is well-conducted systematic review with only minor limitations.</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<bold>Prescribing antibiotics</bold>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<xref rid="b31" ref-type="bibr">Ranji 2008</xref>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Review objective: to evaluate strategies to reduce unnecessary antibiotic prescribing in outpatient practice and to compare the effect of strategies targeting clinicians, patients and/or healthcare systems</td>
</tr>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Types of</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors searched for</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors found</bold>
</th>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Study designs and Interventions</bold>
</td>
<td align="left" rowspan="1" colspan="1">Randomised trials, controlled before-after studies, and interrupted time series studies that evaluate interventions to reduce unnecessary prescription of antibiotics for acute nonbacterial illnesses using one of the following interventions: clinician and patient education, audit and feedback, clinician reminders and decision support systems, financial and regulatory incentives and provision of delayed prescriptions</td>
<td align="left" rowspan="1" colspan="1">A total of 43 studies were included, reporting 55 trials: Randomised trials (22 studies); quasi-randomised trials (3 studies), controlled before-after studies (19 studies). 24 trials from 23 studies tested an intervention using at least 2 distinct quality improvement (QI) strategies such as clinician education combined with patient education. The remaining trials used a single QI strategy, most commonly clinician education or patient education alone.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Participants</bold>
</td>
<td align="left" rowspan="1" colspan="1">Clinicians, patients, healthcare systems</td>
<td align="left" rowspan="1" colspan="1">Patients were adults and children with acute respiratory infection. Clinicians were mostly from primary care settings.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Settings</bold>
</td>
<td align="left" rowspan="1" colspan="1">Outpatient settings</td>
<td align="left" rowspan="1" colspan="1">USA (17 studies), Canada (2 studies), Europe (12 studies), Australia and New Zealand (4 studies), Israel (1 study). 6 studies took place in low- or middle-income countries (Cuba, Indonesia, Mexico, South Africa, Sri Lanka and Zambia).</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Outcomes</bold>
</td>
<td align="left" rowspan="1" colspan="1">Proportion of patients' visits at which an antibiotic was prescribed</td>
<td align="left" rowspan="1" colspan="1">Most of the studies reported changes in the proportion of visits at which patients were prescribed antibiotics.</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Date of most recent search: March 2007</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Limitations: this is a well-conducted systematic review, although there was no detailed report of risk of bias assessment for the included studies and the search was in 2007</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<bold>Seriously ill newborn care</bold>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<xref rid="b25" ref-type="bibr">Opiyo 2015</xref>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Review objective: to investigate the effectiveness of in-service training of health professionals on their management and care of seriously ill neonates or children in low-income settings</td>
</tr>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Types of</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors searched for</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors found</bold>
</th>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Study designs and Interventions</bold>
</td>
<td align="left" rowspan="1" colspan="1">Randomised trials, cluster-randomised trials, non-randomised trials, controlled before-after studies, and interrupted time series studies of neonatal life support courses, paediatric life support courses, life support elements within the Integrated Management of Pregnancy and Childbirth, and other in-service newborn and child health training courses aimed at the recognition and management of seriously ill children</td>
<td align="left" rowspan="1" colspan="1">2 randomised trials: a 1-day Newborn Resuscitation Training course and a 4-day Essential Newborn Care Training course</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Participants</bold>
</td>
<td align="left" rowspan="1" colspan="1">Qualified healthcare professionals</td>
<td align="left" rowspan="1" colspan="1">Qualified healthcare professionals: doctors, nurses, and midwives</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Settings</bold>
</td>
<td align="left" rowspan="1" colspan="1">Healthcare delivery sites in low-income countries</td>
<td align="left" rowspan="1" colspan="1">Delivery rooms in Kenya and Sri Lanka</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Outcomes</bold>
</td>
<td align="left" rowspan="1" colspan="1">Health professional performance outcomes (e.g. clinical assessment/diagnosis, recognition and management/referral of seriously ill newborn/child, prescribing practices)
<break></break>
Participant outcomes (e.g. mortality, morbidity)
<break></break>
Health resource utilisation (e.g. drug use, laboratory tests)
<break></break>
Health services utilisation (e.g. length of hospital stay)
<break></break>
Other markers of clinical performance (e.g. simulated health worker performance in practice settings)
<break></break>
Training/implementation costs
<break></break>
Impact on equity
<break></break>
Adverse effects</td>
<td align="left" rowspan="1" colspan="1">Proportion of adequate initial resuscitation steps
<break></break>
Inappropriate and potentially harmful practices per resuscitation
<break></break>
Mortality in all resuscitation episodes
<break></break>
Preparedness for resuscitation</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Date of most recent search: February 2015</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Limitations: this is a well-conducted systematic review with only minor limitations.</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<bold>Quality of care for STD and HIV</bold>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<xref rid="b36" ref-type="bibr">Sorsdahl 2009</xref>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Review objective: to evaluate the efficacy of interventions for educating traditional healers in the fundamentals of STDs and HIV medicine</td>
</tr>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Types of</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors searched for</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors found</bold>
</th>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Study designs and Interventions</bold>
</td>
<td align="left" rowspan="1" colspan="1">Randomised trials, non-randomised trials, and controlled before-after studies of interventions aimed at educating traditional healers in STDs and HIV medicine.</td>
<td align="left" rowspan="1" colspan="1">1 controlled before-after study of a 3.5-day training course for traditional healers focusing on HIV, STDs, TB, nutrition, family planning, motivation for risk behaviour reduction
<break></break>
1 non-randomised trial of a 7-day training course for traditional healers focusing on malnutrition, acute respiratory infection, diarrhoea, night blindness and HIV</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Participants</bold>
</td>
<td align="left" rowspan="1" colspan="1">Traditional healers in any setting</td>
<td align="left" rowspan="1" colspan="1">Traditional healers</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Settings</bold>
</td>
<td align="left" rowspan="1" colspan="1">Any setting in which traditional healers are practising</td>
<td align="left" rowspan="1" colspan="1">South Africa (1 study in 2 urban and 2 rural communities in KwaZulu-Natal Province) and Nepal (I study in 10 village development committee areas in a remote, rural region).</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Outcomes</bold>
</td>
<td align="left" rowspan="1" colspan="1">Increase in knowledge about STDs and HIV medicine (HIV transmission, prevention, antiretroviral therapy)
<break></break>
Changes in behaviour (HIV risk practices, referral for testing, condom distribution, safe sex advice and counselling, referral to allopathic medical services)</td>
<td align="left" rowspan="1" colspan="1">Increase in knowledge about STDs and HIV (signs and symptoms, prevention) (2 studies)
<break></break>
Change in behaviour (patient management practices, HIV/AIDS risk behaviours, referral practices) (2 studies)</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Date of most recent search: November 2008</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Limitations: this is a well-conducted systematic review with only minor limitations.</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<bold>Strategies targeted at healthcare recipients</bold>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<bold>Providing information/education</bold>
- mass media campaigns</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<xref rid="b38" ref-type="bibr">Vidanapathirana 2005</xref>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Review objective: to assess the effect of mass media interventions on the uptake of HIV testing</td>
</tr>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Types of</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors searched for</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors found</bold>
</th>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Study designs and Interventions</bold>
</td>
<td align="left" rowspan="1" colspan="1">Randomised trials, non-randomised trials, and interrupted time series studies assessing multimedia interventions or interventions using one type of media</td>
<td align="left" rowspan="1" colspan="1">2 randomised trials, 3 non-randomised trials, and 9 interrupted time series studies. Interventions included multimedia (9 studies), video (1 study), television (1 study), group education (1 study), and leaflets plus discussion with participants (2 studies). No study compared different types of media.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Participants</bold>
</td>
<td align="left" rowspan="1" colspan="1">The public or specific target groups (such as sex workers or drug users), excluding healthcare providers</td>
<td align="left" rowspan="1" colspan="1">The studies targeted the public (8 studies), pregnant women (2 studies), men who have sex with men (1 study), blood transfusion recipients (1 study), and women (2 studies)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Settings</bold>
</td>
<td align="left" rowspan="1" colspan="1">Not specified</td>
<td align="left" rowspan="1" colspan="1">Studies from the UK (7 studies), USA (3 studies), Australia (2 studies), Canada (1 study) and Israel (1 study)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Outcomes</bold>
</td>
<td align="left" rowspan="1" colspan="1">Primary: rate of people tested for HIV
<break></break>
Secondary: improvement in detecting HIV seropositivity</td>
<td align="left" rowspan="1" colspan="1">All studies reported on uptake of HIV testing and 3 reported on HIV seropositivity</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Date of most recent search: April 2004</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Limitations: this is a well-conducted systematic review with only minor limitations.</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<bold>Providing information/education</bold>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<xref rid="b23" ref-type="bibr">Nicolson 2009</xref>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Review objective: to assess the effects of providing written information about prescribed and over-the-counter medicines on patient outcomes</td>
</tr>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Types of</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors searched for</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors found</bold>
</th>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Study designs and Interventions</bold>
</td>
<td align="left" rowspan="1" colspan="1">Randomised trials, non-randomised trials, controlled before-after and interrupted time series studies in which the effects of written information were compared with a control group or alternative intervention</td>
<td align="left" rowspan="1" colspan="1">25 randomised trials</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Participants</bold>
</td>
<td align="left" rowspan="1" colspan="1">Patients of any age receiving written information about a prescribed or over-the-counter medicine in any setting (hospital in- and outpatients and primary care)</td>
<td align="left" rowspan="1" colspan="1">4788 participants were enrolled in the included trials. 19 studies involved patients with chronic conditions (using non-steroidal anti-inflammatory drugs (NSAIDs) or cardiovascular medicines), 5 trials were focused on patients with acute conditions, and 1 on both.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Settings</bold>
</td>
<td align="left" rowspan="1" colspan="1">Any setting</td>
<td align="left" rowspan="1" colspan="1">The trials took place in 9 countries: USA (8 trials), UK (8 studies), Belgium (2 studies), Canada (2 studies), Finland (1 study), France (1 study), Hong Kong (1 study), Switzerland (1 study) and Turkey (1 study).</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Outcomes</bold>
</td>
<td align="left" rowspan="1" colspan="1">Patient knowledge about the medicine, patients' attitudes towards taking the medicine, patients' medicine-taking behaviour, and patients' health outcomes</td>
<td align="left" rowspan="1" colspan="1">Patients' knowledge: recall of information about the medicine, recall of side effects; patients' attitudes towards taking medicines; and patients' medicine-taking behaviour</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Date of most recent search: March 2007</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Limitations: this is a review with important limitations related to the assessment of the risk of bias of individual studies and the analysis of the sources of heterogeneity. Additionally it has not been updated since 2007.</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<bold>Providing information/education</bold>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<xref rid="b4" ref-type="bibr">Berkman 2011</xref>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Review objective: to assess the effects of health literacy interventions on health services utilisation and health outcomes.</td>
</tr>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Types of</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors searched for</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors found</bold>
</th>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Study designs and Interventions</bold>
</td>
<td align="left" rowspan="1" colspan="1">Randomised trials, cluster-randomised trials, quasi-experimental studies, cohort studies, before-after studies, cross-sectional studies
<break></break>
All interventions specifically designed to mitigate the effects of low health literacy by improving the use of healthcare services or health outcomes in low health literacy or low numeracy individuals</td>
<td align="left" rowspan="1" colspan="1">42 intervention studies, including randomised trials (27 studies), cluster-randomised trials (2 studies), quasi-experimental pre-post studies (10 studies), and quasi experimental post only studies (3 studies)
<break></break>
The interventions included: alternative document design (2 studies), alternative numerical presentations (3 studies), additive or alternative pictorial representations (8 studies), alternative media (4 studies), combinations of alternative readability and document design (7 studies), physician notification on patients' literacy status (1 study), intensive self-management (3 studies), educational interventions (1 study), and intensive disease management programmes (2 studies).</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Participants</bold>
</td>
<td align="left" rowspan="1" colspan="1">People of all ages, including different ethnicities and cultural groups</td>
<td align="left" rowspan="1" colspan="1">People of all ages, whites, blacks, Hispanics, different ethnicities and cultural groups</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Settings</bold>
</td>
<td align="left" rowspan="1" colspan="1">All settings</td>
<td align="left" rowspan="1" colspan="1">Inpatient or outpatient settings in healthcare systems and institutions, various community-based settings or homes. Only 1 of the studies took place in a low-income country.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Outcomes</bold>
</td>
<td align="left" rowspan="1" colspan="1">Use of healthcare services such as emergency room visits, office visits, hospitalisations and prevention
<break></break>
Health outcomes such as disease, disease severity, quality of life and death.</td>
<td align="left" rowspan="1" colspan="1">For single strategies (21 studies): physician use of effective communication (1 study), comprehension (14 studies), knowledge (3 studies), accuracy (3 studies), self-efficacy (1 study), intent (1 study), choices (3 studies), adherence (1 study), health outcomes (1 study)
<break></break>
For mixed strategies (21 studies): comprehension (1 study), knowledge (10 studies), self-efficacy (8 studies), adherence (5 studies), use of healthcare (6 studies), and health outcomes (10 studies)</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Date of most recent search: May 2010</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Limitations: this was a well-conducted systematic review with only minor limitations.</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<bold>Adherence</bold>
- medication</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<xref rid="b12" ref-type="bibr">Haynes 2008</xref>
(the updated review Niewlaat 2014 identified 109 additional studies – further details reported in the main text of the overview)</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Review objective: to summarise the effects of interventions to help patients follow prescriptions for medications.</td>
</tr>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Types of</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors searched for</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors found</bold>
</th>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Study designs and Interventions</bold>
</td>
<td align="left" rowspan="1" colspan="1">Randomised trials evaluating interventions to improve adherence with prescribed, self-administered medications</td>
<td align="left" rowspan="1" colspan="1">78 trials evaluating 93 diverse interventions</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Participants</bold>
</td>
<td align="left" rowspan="1" colspan="1">Patients who were prescribed medication for a medical disorder (including psychiatric), but not for addictions</td>
<td align="left" rowspan="1" colspan="1">Patients with several different chronic conditions including hypertension (12 studies), schizophrenia or acute psychosis (10 studies), asthma or chronic obstructive pulmonary disease (COPD) (11 studies), rheumatoid arthritis (2 studies), hyperlipidaemia (3 studies), depression (4 studies) and HIV (12 studies)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Settings</bold>
</td>
<td align="left" rowspan="1" colspan="1">Any setting</td>
<td align="left" rowspan="1" colspan="1">Many different settings and venues were included. Trials took place in the USA (30 studies), UK (14 studies), Spain (5 studies), Canada (8 studies), Australia (3 studies), the Netherlands (3 studies), China (3 studies), France (2 studies), Mexico (1 study), Norway (1 study), Italy (1 study), Sweden (1 study), Ghana (1 study), Denmark (1 study), Republic of Ireland (1 study), United Arab Emirates (1 study), Switzerland (1 study) and Malaysia (1 study).</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Outcomes</bold>
</td>
<td align="left" rowspan="1" colspan="1">Medication adherence and patient outcomes</td>
<td align="left" rowspan="1" colspan="1">9 studies on short-term and 71 on long-term treatments measuring adherence and patient outcomes</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Date of most recent search: February 2007</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Limitations: this is a systematic review with moderate limitations related to how the results were synthesised.</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<bold>Adherence</bold>
– ART for HIV/AIDS</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<xref rid="b34" ref-type="bibr">Simoni 2006</xref>
;
<xref rid="b35" ref-type="bibr">Simoni 2010</xref>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Review objective: to summarise literature on the effects of patient support strategies and education for improving adherence to highly active antiretroviral therapy (HAART) in people living with HIV/AIDS.</td>
</tr>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Types of</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors searched for</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors found</bold>
</th>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Study designs and Interventions</bold>
</td>
<td align="left" rowspan="1" colspan="1">Randomised trials evaluating behavioural interventions to improve adherence to HAART</td>
<td align="left" rowspan="1" colspan="1">19 randomised trials of diverse behavioural interventions: 1-on-1 counselling (10 trials), and group format (3 studies). Components of the intervention were: didactic information on HAART (15 studies); interactive discussions addressing cognitions, motivations, and expectations (15 studies); Behavioural strategies (16 studies), such as cue dosing or cognitive-behaviour therapy; external reminders such as pagers (5 studies). Many interventions included more than one of these components.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Participants</bold>
</td>
<td align="left" rowspan="1" colspan="1">Adults infected with HIV and receiving HAART</td>
<td align="left" rowspan="1" colspan="1">7 studies restricted inclusion to patients exhibiting some marker of risk for non-adherence, such as poor baseline adherence or detectable viral load. Participants in the USA studies were mostly racial/ethnic minorities.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Settings</bold>
</td>
<td align="left" rowspan="1" colspan="1">Any setting</td>
<td align="left" rowspan="1" colspan="1">Most studies (16 studies) studies took place in outpatient HIV primary care clinics in high-income countries: USA (14 studies), Spain (2 studies), France (2 studies) and Switzerland (1 study).</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Outcomes</bold>
</td>
<td align="left" rowspan="1" colspan="1">Any measure of adherence or HIV-1 RNA viral load (a measure of successful HAART)</td>
<td align="left" rowspan="1" colspan="1">Adherence was measured in 18 studies. Data on undetectable viral load were available from 14 studies.</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Date of most recent search: September 2005 in
<xref rid="b34" ref-type="bibr">Simoni 2006</xref>
, updated October 2009 in
<xref rid="b35" ref-type="bibr">Simoni 2010</xref>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Limitations: this is a well-conducted systematic review with only minor limitations.</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<bold>Adherence</bold>
– ART for HIV/AIDS</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<xref rid="b22" ref-type="bibr">Mbuagbaw 2013</xref>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Review objective: to determine whether mobile phone text-messaging is efficacious in enhancing adherence to ART in people with HIV infection.</td>
</tr>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Types of</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors searched for</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors found</bold>
</th>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Study designs and Interventions</bold>
</td>
<td align="left" rowspan="1" colspan="1">Randomised trials in which patients receiving ART or their caregivers (for children) were provided with mobile phone text messages to promote adherence to ART</td>
<td align="left" rowspan="1" colspan="1">3 randomised trials comparing text messaging to a control condition. In 2 studies, weekly text messages reminders were compared to standard care. In the other study, short or long text messages, either daily or weekly, were compared to the provision of a cell phone, but without study-related communication.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Participants</bold>
</td>
<td align="left" rowspan="1" colspan="1">Adults or children receiving ART</td>
<td align="left" rowspan="1" colspan="1">The studies included adults only</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Settings</bold>
</td>
<td align="left" rowspan="1" colspan="1">Any setting</td>
<td align="left" rowspan="1" colspan="1">Kenya (2 studies) and Cameroon (1 study)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Outcomes</bold>
</td>
<td align="left" rowspan="1" colspan="1">The primary outcomes were adherence to ART and viral load suppression. The secondary outcomes were quality of life, mortality, losses to follow-up, transfers and withdrawals</td>
<td align="left" rowspan="1" colspan="1">All studies reported adherence to ART at 48 or 52 weeks and viral load suppression at 52 weeks. 1 study reported mortality, losses to follow-up, transfers and withdrawals. 1 study reported quality of life.</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Date of most recent search: this review included 3 studies, which were the only published studies of which the authors were aware that met their selection criteria up until September 2013.</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Limitations: this is a well-conducted review that analysed individual patient data from 3 randomised trials. However, a systematic search for other relevant studies was not undertaken.</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<bold>Adherence</bold>
- TB</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<xref rid="b21" ref-type="bibr">Lutge 2015</xref>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Review objective: to evaluate the effects of material incentives and enablers given to people undergoing diagnostic testing for TB, or receiving drug therapy to prevent or cure TB</td>
</tr>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Types of</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors searched for</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors found</bold>
</th>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Study designs and Interventions</bold>
</td>
<td align="left" rowspan="1" colspan="1">Randomised trials of any form of material inducement to return for TB test results, or adhere to or complete anti-TB preventive or curative treatment</td>
<td align="left" rowspan="1" colspan="1">12 randomised trials were included, assessing incentives for adherence to different stages of TB management: returning for reading of tuberculin skin test results (2 studies); clinic attendance for initiation of preventive therapy (1 study); clinic attendance for continuation of preventive therapy (2 studies); adherence to preventive treatment (5 studies); adherence to treatment for active TB (2 studies). The incentives used included cash, vouchers that could be redeemed for various products and food.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Participants</bold>
</td>
<td align="left" rowspan="1" colspan="1">Patients receiving curative treatment for TB
<break></break>
Patients receiving preventive therapy for TB
<break></break>
Patients suspected of TB who are undergoing, and collecting results of, diagnostic tests</td>
<td align="left" rowspan="1" colspan="1">Adolescents aged 11-19 years (1 study); injection drug or cocaine users (4 studies); homeless or marginally housed adults (3 studies); prisoners (2 studies); and studies on the general adult population (2 studies)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Settings</bold>
</td>
<td align="left" rowspan="1" colspan="1">No restrictions</td>
<td align="left" rowspan="1" colspan="1">South Africa (1 study), Timor Leste (1 study), USA (10 studies)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Outcomes</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<italic>For treatment of active TB</italic>
: cure and/or completion of treatment and/or successful treatment
<break></break>
<italic>For prophylaxis</italic>
: cases of active TB; completion of prophylactic treatment
<break></break>
<italic>For diagnostics</italic>
: number returning to collect test results
<break></break>
Also adverse events and costs</td>
<td align="left" rowspan="1" colspan="1">Return for tuberculin skin test reading
<break></break>
Completion of TB prophylaxis
<break></break>
Return to clinic for continuation of treatment
<break></break>
Successful TB treatment and / or completion of treatment
<break></break>
Time needed to track participants who missed appointments</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Date of most recent search: June 2015</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Limitations: this is a well-conducted systematic review with only minor limitations.</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<bold>Adherence</bold>
- TB</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<xref rid="b20" ref-type="bibr">Liu 2014</xref>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Review objective: to assess the effects of reminder systems and 'late patient tracers' on the completion of diagnostics, the commencement of treatment in people referred for curative or prophylactic treatment of tuberculosis, the completion of treatment in people starting curative or prophylactic treatment for tuberculosis, and cure rates in people being treated for active tuberculosis.</td>
</tr>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Types of</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors searched for</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors found</bold>
</th>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Study designs and Interventions</bold>
</td>
<td align="left" rowspan="1" colspan="1">Randomised trials, non-randomised trials or controlled before-after studies of any actions taken to remind patients to take their TB medication or attend appointments (pre-appointment reminders) or to contact patients who have missed an appointment (default reminders)</td>
<td align="left" rowspan="1" colspan="1">6 trials of pre-appointment reminders and 3 trials of default reminders</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Participants</bold>
</td>
<td align="left" rowspan="1" colspan="1">Children and adults requiring TB treatment, TB prophylaxis, or referred for TB diagnostics or screening</td>
<td align="left" rowspan="1" colspan="1">People on treatment for active TB (4 studies), prophylaxis for latent TB (1 study), undergoing TB screening using skin tests (3 studies), and undergoing TB diagnosis, chemoprophylaxis, or treatment (1 study)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Settings</bold>
</td>
<td align="left" rowspan="1" colspan="1">Any setting</td>
<td align="left" rowspan="1" colspan="1">Pre-appointment reminders: USA (4 studies), Spain (1 study), and Thailand (1 study); default reminders: India (2 studies) and Iraq (1 study)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Outcomes</bold>
</td>
<td align="left" rowspan="1" colspan="1">Completion of TB diagnostics; completion of screening process; commencement of prophylactic treatment; commencement of curative treatment; completion of prophylactic treatment; completion of curative treatment; cure; incidence of active tuberculosis</td>
<td align="left" rowspan="1" colspan="1">The main outcomes assessed were the number of patients who adhered to a scheduled appointment and cure for pre-appointment reminders (6 studies) and the number of patients who completed treatment for default reminders (3 studies)</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Date of most recent search: August 2014</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Limitations: this is a well-conducted systematic review with only minor limitations</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<bold>Adherence</bold>
- antimalarials</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<xref rid="b26" ref-type="bibr">Orton 2005</xref>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Review objective: to summarise the effects of unit-dose packaged treatment on treatment failure and treatment adherence in people with uncomplicated malaria</td>
</tr>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Types of</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors searched for</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors found</bold>
</th>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Study designs and Interventions</bold>
</td>
<td align="left" rowspan="1" colspan="1">Randomised trials and quasi-randomised trials evaluating programmes that include unit-dose packaging of antimalarial drugs</td>
<td align="left" rowspan="1" colspan="1">1 randomised trial, 1 cluster-randomised trial, and 3 quasi-randomised trials evaluating labelled and boxed blister packs of chloroquine and primaquine tablets and capsules (2 studies) and simple, labelled and sectioned polythene bags of chloroquine tablets (3 studies)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Participants</bold>
</td>
<td align="left" rowspan="1" colspan="1">People diagnosed with uncomplicated malaria infection</td>
<td align="left" rowspan="1" colspan="1">People with uncomplicated malaria confirmed clinically (2 studies), microscopically (2 studies), or using both methods (1 study)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Settings</bold>
</td>
<td align="left" rowspan="1" colspan="1">Any setting</td>
<td align="left" rowspan="1" colspan="1">Outpatient health centres in China (2 studies), Ghana (2 studies) and Papua New Guinea (1 study)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Outcomes</bold>
</td>
<td align="left" rowspan="1" colspan="1">Treatment failure on or by day 28 after initiation of treatment (primary outcome), other clinical measures, treatment adherence and adverse events</td>
<td align="left" rowspan="1" colspan="1">None of the trials reported on treatment failure but all reported on some of the following: parasitaemia, clinical symptoms, wellness of the child, cure according to medical notes and the perception of participants, and the recrudescence of infection. All 5 trials reported on treatment adherence. Adverse events were measured in 2 studies</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Date of most recent search: February 2009</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Limitations: this is a well-conducted systematic review with only minor limitations.</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<bold>Immunisation coverage</bold>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<xref rid="b27" ref-type="bibr">Oyo-Ita 2016</xref>
;
<xref rid="b16" ref-type="bibr">Jacobson Vann 2005</xref>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Review objective: to assess the effectiveness of intervention strategies to improve immunisation coverage in LMICs.</td>
</tr>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Types of</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors searched for</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors found</bold>
</th>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Study designs and Interventions</bold>
</td>
<td align="left" rowspan="1" colspan="1">Randomised trials, non-randomised trials, controlled before-after studies and interrupted time series studies that evaluate patient oriented (health education or incentives), provider oriented (audit and feedback, reminders) or health system oriented (outreach programmes, interventions oriented to improve quality) interventions to increase immunisation coverage</td>
<td align="left" rowspan="1" colspan="1">14 studies were included: 10 cluster randomised trials and 4 individually randomised trials. Interventions included health education (6 studies), monetary incentives (4 studies), health education plus parent reminders (2 studies), provider oriented interventions (1 study), home visits (1 study), integration of immunisation services with intermittent preventive treatment of malaria in infants (1 study), regular immunisation outreach sessions (1 study) and a combination of provider training and quality assurance (1 study). Several studies evaluated more than 1 intervention</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Participants</bold>
</td>
<td align="left" rowspan="1" colspan="1">Healthcare personnel who deliver immunisation. Children under 5 years who receive immunisation or their caregivers</td>
<td align="left" rowspan="1" colspan="1">Children birth to 4 years (10 studies), primary healthcare workers (1 study), general adult population (1 study), and pregnant and postpartum women (2 studies)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Settings</bold>
</td>
<td align="left" rowspan="1" colspan="1">Low- and middle-income countries</td>
<td align="left" rowspan="1" colspan="1">Ambulatory care settings in: Georgia (1 study), Ghana (1 study), Honduras (1 study), India (2 studies), Mali (1 study), Mexico (1 study), Nepal (1 study), Nicaragua (1 study), Pakistan (4 studies) and Zimbabwe (1 study)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Outcomes</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<italic>Primary outcomes</italic>
: proportion of children who received DTP3 by 1 year; proportion of children who received all recommended vaccinations by 2 years of age
<break></break>
<italic>Secondary outcomes</italic>
: occurrence of vaccine preventable diseases, number of under-fives immunised, costs, attitudes of caregivers and clients to vaccination, adverse events</td>
<td align="left" rowspan="1" colspan="1">DTPs coverage (6 studies), proportion of the target population that was fully immunised (11 studies), percentage change in immunisation coverage over time (2 studies). Other outcomes reported were coverage for specific vaccines (3 studies), costs (1 study), received at least one vaccine (1 study), completion of schedule (1 study). None of the studies provided data on the attitudes of caregivers and clients to vaccination</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Date of most recent search: May 2016 for most databases</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Limitations: this is well-conducted systematic review with only minor limitations.</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<bold>Insecticide-treated bednets for malaria</bold>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<xref rid="b1" ref-type="bibr">Augustincic Polec 2015</xref>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Review objective: to assess the evidence on the effectiveness and equity of strategies to increase ownership and proper use of insecticide-treated bednets (ITNs)</td>
</tr>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Types of</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors searched for</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors found</bold>
</th>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Study designs and Interventions</bold>
</td>
<td align="left" rowspan="1" colspan="1">Randomised trials, non-randomised trials, controlled before-after studies and interrupted time series studies evaluating interventions to increase ITN ownership and use</td>
<td align="left" rowspan="1" colspan="1">10 randomised trials: 4 studies used a
<break></break>
combination of strategies focusing on ITN delivery to increase ITN ownership and appropriate ITN use; 2 studies focused on ITN delivery strategies only; and 7 studies examined appropriate use strategies</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Participants</bold>
</td>
<td align="left" rowspan="1" colspan="1">Individuals (children and adults) in
<break></break>
malaria endemic areas</td>
<td align="left" rowspan="1" colspan="1">Adults, children under 5 years, pregnant women, mothers of children under 5 years, rural cotton farmers</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Settings</bold>
</td>
<td align="left" rowspan="1" colspan="1">Not specified</td>
<td align="left" rowspan="1" colspan="1">Rural communities in Africa, India, and Iran</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Outcomes</bold>
</td>
<td align="left" rowspan="1" colspan="1">ITN ownership, ITN use and a range of secondary outcomes including (among others) equity ratio of household ITN ownership and adverse effects</td>
<td align="left" rowspan="1" colspan="1">ITN ownership, ITN use, and malaria morbidity</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Date of most recent search: February 2013</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Limitations: this was a well-conducted systematic review with only minor limitations.</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<bold>Access to healthcare services</bold>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<xref rid="b7" ref-type="bibr">Everett 2011</xref>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Review objective: to assess the effectiveness of interventions aimed at women, to increase the uptake of cervical cancer screening..</td>
</tr>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Types of</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors searched for</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors found</bold>
</th>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Study designs and Interventions</bold>
</td>
<td align="left" rowspan="1" colspan="1">Randomised trials assessing universal, selective or opportunistic cervical cancer screening.</td>
<td align="left" rowspan="1" colspan="1">38 randomised trials, including 6 cluster randomised trials assessed invitations (17 studies), education (6 studies), message framing (1 study), counselling (2 studies), risk factor assessment (2 studies), procedures (1 study), use of a photo comic book (1 study) and intensive recruitment (1 study).</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Participants</bold>
</td>
<td align="left" rowspan="1" colspan="1">Women eligible to participate in cervical cancer screening.</td>
<td align="left" rowspan="1" colspan="1">Women receiving care in community clinics, primary care practices and Health Maintenance Organisations, mostly located in urban areas.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Settings</bold>
</td>
<td align="left" rowspan="1" colspan="1">Community, workplace, health centre and hospital settings.</td>
<td align="left" rowspan="1" colspan="1">USA (16 studies), Australia (9 studies), UK (7 studies), Canada (2 studies), Sweden (2 studies), South Africa (1 study) and Italy (1 study)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Outcomes</bold>
</td>
<td align="left" rowspan="1" colspan="1">Primary outcomes: uptake of cervical screening as recorded by health service records and via self-report
<break></break>
Secondary outcomes: booking of appointments; reported intentions to attend screening; satisfaction with screening service, attitudes and knowledge about screening; costs of the interventions</td>
<td align="left" rowspan="1" colspan="1">All primary outcomes, booking of appointments (1 study), acceptability of the intervention (1 study) and costs of the interventions (5 studies)</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Date of most recent search: March 2009</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Limitations: this is well-conducted systematic review with only minor limitations.</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<bold>Access to healthcare services</bold>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">
<xref rid="b17" ref-type="bibr">Jia 2014</xref>
</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Review objective: to assess the effects of outreach strategies for expanding insurance coverage of vulnerable populations.</td>
</tr>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Types of</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors searched for</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>What the review authors found</bold>
</th>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Study designs and Interventions</bold>
</td>
<td align="left" rowspan="1" colspan="1">Randomised trials, non-randomised trials, controlled before-after studies, and interrupted time series studies</td>
<td align="left" rowspan="1" colspan="1">1 randomised trial and 1 non-randomised trial</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Participants</bold>
</td>
<td align="left" rowspan="1" colspan="1">Children, the elderly, women, low-income individuals, rural population, racial or ethnic minorities, immigrants, informal sector workers, and population with disability or chronic diseases</td>
<td align="left" rowspan="1" colspan="1">674 children aged 18 years or younger recruited from 2 minority communities (1 study) or the emergency departments of 4 inner-city hospitals (1 study)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Settings</bold>
</td>
<td align="left" rowspan="1" colspan="1">Not pre-specified</td>
<td align="left" rowspan="1" colspan="1">USA (2 studies)</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>Outcomes</bold>
</td>
<td align="left" rowspan="1" colspan="1">Primary outcomes: enrolment into health insurance programmes
<break></break>
Secondary outcomes: health service utilisation, health status, satisfaction, costs, adverse effects</td>
<td align="left" rowspan="1" colspan="1">Enrolment of children into health insurance (2 studies), maintaining enrolment of children in insurance schemes (1 study), mean time to obtain insurance (1 study), parental satisfaction with process of enrolment (1 study)</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Date of most recent search: November 2012</td>
</tr>
<tr>
<td align="left" colspan="3" rowspan="1">Limitations: this is a well-conducted systematic review with only minor limitations</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec id="CD011086-sec2-0017">
<title>Appendix 4. Supplementary/related reviews</title>
<p>
<bold>Educational meetings</bold>
</p>
<p>In situ simulation in continuing education for the healthcare professions: a systematic review (
<xref rid="b121" ref-type="bibr">Rosen 2012</xref>
)</p>
<p>
<bold>Reminders</bold>
</p>
<p>The relationship between nursing leadership and patient outcomes: a systematic review (
<xref rid="b135" ref-type="bibr">Wong 2013</xref>
)</p>
<p>
<bold>Multifaceted interventions</bold>
</p>
<p>Systematic review of knowledge translation strategies in the allied health professions (
<xref rid="b127" ref-type="bibr">Scott 2012</xref>
)</p>
<p>What are the effects of interventions to improve the uptake of evidence from health research into policy in low- and middle-income countries? (
<xref rid="b91" ref-type="bibr">Graham 2011</xref>
)</p>
<p>
<bold>Prescribing antibiotics</bold>
</p>
<p>Improving antibiotic selection: a systematic review and quantitative analysis of quality improvement strategies (
<xref rid="b129" ref-type="bibr">Steinman 2006</xref>
)</p>
<p>
<bold>Adherence - medication</bold>
</p>
<p>Financial reinforcers for improving medication adherence: findings from a meta-analysis (
<xref rid="b118" ref-type="bibr">Petry 2012</xref>
)</p>
<p>Reminder packaging for improving adherence to self-administered long-term medications (
<xref rid="b104" ref-type="bibr">Mahtani 2011</xref>
)</p>
<p>Interventions for enhancing medication adherence (
<xref rid="b113" ref-type="bibr">Nieuwlaat 2014</xref>
)</p>
<p>
<bold>Immunisation coverage</bold>
</p>
<p>Too little but not too late: results of a literature review to improve routine immunization programs in developing countries (
<xref rid="b124" ref-type="bibr">Ryman 2008</xref>
)</p>
</sec>
<sec id="CD011086-sec2-0018">
<title>Appendix 5. Reviews awaiting classification</title>
<p>
<bold>Likely included reviews</bold>
</p>
<p>Bowman LR, Donegan S, McCall PJ. Is dengue vector control deficient in effectiveness or evidence?: Systematic review and meta-analysis. PLOS Neglected Tropical Diseases 2016;10(3):e0004551.</p>
<p>Abdel-Aleem H, El-Gibaly OMH, El-Gazzar AFS, Al-Attar GST. Mobile clinics for women's and children's health. Cochrane Database of Systematic Reviews. 2016;8:CD009677.</p>
<p>Akl EA, El-Jardali F, Bou Karroum L, El-Eid J, Brax H, Akik C, et al. Effectiveness of Mechanisms and Models of Coordination between Organizations, Agencies and Bodies Providing or Financing Health Services in Humanitarian Crises: A Systematic Review. PloS one. 2015;10(9):e0137159.</p>
<p>Algie CM, Mahar RK, Wasiak J, Batty L, Gruen RL, Mahar PD. Interventions for reducing wrong-site surgery and invasive clinical procedures. The Cochrane database of systematic reviews. 2015;3(3):CD009404.</p>
<p>Ambia J, Mandala J. A systematic review of interventions to improve prevention of mother-to-child HIV transmission service delivery and promote retention. Journal of the International AIDS Society. 2016;19(1):20309.</p>
<p>Baldwin K, Namdari S, Donegan D, Kamath AF, Mehta S. Early effects of resident work-hour restrictions on patient safety: a systematic review and plea for improved studies. Journal of Bone and Joint Surgery 2011;93:e5.</p>
<p>Barnard S, Kim C, Park MH, Ngo TD. Doctors or mid-level providers for abortion. The Cochrane database of systematic reviews. 2015;7(7):CD011242.</p>
<p>Basu S, Andrews J, Kishore S, Panjabi R, Stuckler D. Comparative performance of private and public healthcare systems in low- and middle-income countries: a systematic review. PLoS medicine. 2012;9(6):e1001244.</p>
<p>Blacklock C, Gonçalves Bradley DC, Mickan S, Willcox M, Roberts N, Bergström A, et al. Impact of Contextual Factors on the Effect of Interventions to Improve Health Worker Performance in Sub-Saharan Africa: Review of Randomised Clinical Trials. PloS one. 2016;11(1):e0145206.</p>
<p>Byrne A, Hodge A, Jimenez-Soto E, Morgan A. What works? Strategies to increase reproductive, maternal and child health in difficult to access mountainous locations: a systematic literature review. PloS one. 2014;9(2):e87683.</p>
<p>Coast E, Jones E, Lattof SR, Portela A. Effectiveness of interventions to provide culturally appropriate maternity care in increasing uptake of skilled maternity care: a systematic review. Health policy and planning. 2016;31(10):1479-91.</p>
<p>Cornish F, Priego-Hernandez J, Campbell C, Mburu G, McLean S. The impact of Community Mobilisation on HIV Prevention in Middle and Low Income Countries: A Systematic Review and Critique. AIDS and behavior. 2014;18(11):2110-34.</p>
<p>Dawson A, Tran NT, Westley E, Mangiaterra V, Festin M. Improving access to emergency contraception pills through strengthening service delivery and demand generation: a systematic review of current evidence in low and middle-income countries. PloS one. 2014;9(10):e109315.</p>
<p>de Jongh TE, Gurol-Urganci I, Allen E, Zhu NJ, Atun R. Integration of antenatal care services with health programmes in low- and middle-income countries: systematic review. Journal of global health. 2016;6(1):010403.</p>
<p>Dyer TA, Brocklehurst P, Glenny AM, Davies L, Tickle M, Issac A, et al. Dental auxiliaries for dental care traditionally provided by dentists. The Cochrane database of systematic reviews. 2014;8(8):CD010076.</p>
<p>Ehiri JE, Gunn JK, Center KE, Li Y, Rouhani M, Ezeanolue EE. Training and deployment of lay refugee/internally displaced persons to provide basic health services in camps: a systematic review. Global health action. 2014;7:23902.</p>
<p>Emdin CA, Chong NJ, Millson PE. Non-physician clinician provided HIV treatment results in equivalent outcomes as physician-provided care: a meta-analysis. Journal of the International AIDS Society. 2013;16(no pagination):18445.</p>
<p>Fernandez Turienzo C, Sandall J, Peacock JL. Models of antenatal care to reduce and prevent preterm birth: a systematic review and meta-analysis. BMJ open. 2016;6(1):e009044.</p>
<p>Feyissa GT, Lockwood C, Munn Z. The effectiveness of home-based HIV counseling and testing in reducing stigma and risky sexual behavior among adults and adolescents: a systematic review and meta-analysis. JBI Database of Systematic Reviews and Implementation Reports. 2015;13(6):318-72.</p>
<p>Fiander M, McGowan J, Grad R, Pluye P, Hannes K, Labrecque M, et al. Interventions to increase the use of electronic health information by healthcare practitioners to improve clinical practice and patient outcomes. The Cochrane database of systematic reviews. 2015;3(3):CD004749.</p>
<p>Flodgren G, Rachas A, Farmer AJ, Inzitari M, Shepperd S. Interactive telemedicine: effects on professional practice and health care outcomes. The Cochrane database of systematic reviews. 2015;9(9):CD002098.</p>
<p>Gaitonde R, Oxman AD, Okebukola PO, Rada G. Interventions to reduce corruption in the health sector. Cochrane Database of Systematic Reviews. 2016;8:CD008856.</p>
<p>George AS, Branchini C, Portela A. Do Interventions that Promote Awareness of Rights Increase Use of Maternity Care Services? A Systematic Review. PloS one. 2015;10(10):e0138116.</p>
<p>Ghada Abou El S, Therese D, Hatem AM. Planned home versus hospital care for preterm prelabour rupture of the membranes (PPROM) prior to 37 weeks' gestation. Cochrane Database of Systematic Reviews. 2014;4(4):CD008053.</p>
<p>Giedion U, Alfonso EA, Diaz Y. The Impact of Universal Coverage Schemes in the Developing World: A Review of the Existing Evidence. Universal Health Coverage (UNICO) studies series; no. 25. Washington D.C.: The Worldbank. 2013.</p>
<p>Handford CD, Tynan AM, Agha A, Rzeznikiewiz D, Glazier RH. Organization of care for persons with HIV-infection: a systematic review. AIDS care. 2016:1-10.</p>
<p>Health Quality Ontario. Interventions to Improve Access to Primary Care for People Who Are Homeless: A Systematic Review. Ontario health technology assessment series. 2016;16(9):1-50.</p>
<p>Hensen B, Taoka S, Lewis JJ, Weiss HA, Hargreaves J. Systematic review of strategies to increase men's HIV-testing in sub-Saharan Africa. AIDS (London, England). 2014;28(14):2133-45.</p>
<p>Hernández AV, Pasupuleti V, Benites-Zapata V, Velásquez-Hurtado E, Loyola-Romaní J, Rodríguez-Calviño Y, et al. [Systematic review of the efectiveness of community-based interventions to decrease neonatal mortality]. Revista peruana de medicina experimental y salud pu' acute;blica. 2015;32(3):532-45.</p>
<p>Hesselink G, Berben S, Beune T, Schoonhoven L. Improving the governance of patient safety in emergency care: a systematic review of interventions. BMJ open. 2016;6(1):e009837.</p>
<p>Hopkins U, Itty AS, Nazario H, Pinon M, Slyer J, Singleton J. The effectiveness of delegation interventions by the registered nurse to the unlicensed assistive personnel and their impact on quality of care, patient satisfaction, and RN staff satisfaction: a systematic review. JBI Library of Systematic Reviews. 2012;10(15):895-934.</p>
<p>Hoyler M, Hagander L, Gillies R, Riviello R, Chu K, Bergström S, et al. Surgical care by non-surgeons in low-income and middle-income countries: a systematic review. Lancet (London, England). 2015;385 Suppl 2:S42.</p>
<p>Joshi R, Alim M, Kengne AP, Jan S, Maulik PK, Peiris D, et al. Task shifting for non-communicable disease management in low and middle income countries--a systematic review. PloS one. 2014;9(8):e103754.</p>
<p>Kien C, Reichenpfader U, Nußbaumer B, Rohleder S, Punz P, Christof C, et al. [Comparative effectiveness and safety of screening and counselling interventions conducted by non-physicians and physicians: A systematic review]. Zeitschrift für Evidenz, Fortbildung und Qualität im Gesundheitswesen. 2015;109(1):18-27.</p>
<p>Kilpatrick K, Kaasalainen S, Donald F, Reid K, Carter N, Bryant-Lukosius D, et al. The effectiveness and cost-effectiveness of clinical nurse specialists in outpatient roles: a systematic review. Journal of evaluation in clinical practice. 2014;20(6):1106-23.</p>
<p>Kim K, Choi JS, Choi E, Nieman CL, Joo JH, Lin FR, et al. Effects of Community-Based Health Worker Interventions to Improve Chronic Disease Management and Care Among Vulnerable Populations: A Systematic Review. American journal of public health. 2016;106(4):e1-e26.</p>
<p>Kredo T, Adeniyi FGB, Bateganya M, Pienaar ED. Task shifting from doctors to non-doctors for initiation and maintenance of antiretroviral therapy. Cochrane Database of Systematic Reviews. 2014;7(7):CD007331.</p>
<p>Lassi ZS, Musavi NB, Maliqi B, Mansoor N, de Francisco A, Toure K, et al. Systematic review on human resources for health interventions to improve maternal health outcomes: evidence from low- and middle-income countries. Human resources for health. 2016;14(1):10.</p>
<p>Lavender T, Richens Y, Milan SJ, Smyth RMD, Dowswell T. Telephone support for women during pregnancy and the first six weeks postpartum. Cochrane Database of Systematic Reviews. 2013;7(7):CD009338.</p>
<p>Lawrence D, Fedorowicz Z, van Zuuren EJ. Day care versus in-patient surgery for age-related cataract. The Cochrane database of systematic reviews. 2015;11(11):CD004242.</p>
<p>Liu G, Jack H, Piette A, Mangezi W, Machando D, Rwafa C, et al. Mental health training for health workers in Africa: a systematic review. The lancet Psychiatry. 2016;3(1):65-76.</p>
<p>MacPherson P, Munthali C, Ferguson J, Armstrong A, Kranzer K, Ferrand RA, et al. Service delivery interventions to improve adolescents' linkage, retention and adherence to antiretroviral therapy and HIV care. Tropical medicine & international health : TM & IH. 2015;20(8):1015-32.</p>
<p>Mauger Rothenberg B, Marbella A, Pines E, Chopra R, Black ER, Aronson N. Prevention of healthcare-associated infections. Closing the quality gap: revisiting the state of the science. Rockville, MD, USA: Agency for Healthcare Research and Quality. Evidence Report/Technology Assessment; 208. 2012.</p>
<p>Mbuagbaw L, Medley N, Darzi AJ, Richardson M, Habiba Garga K, Ongolo-Zogo P. Health system and community level interventions for improving antenatal care coverage and health outcomes. The Cochrane database of systematic reviews. 2015;12(12):CD010994.</p>
<p>Mdege ND, Chindove S. Bringing antiretroviral therapy (ART) closer to the end-user through mobile clinics and home-based ART: systematic review shows more evidence on the effectiveness and cost effectiveness is needed. The International journal of health planning and management. 2013;29(1):e31-47.</p>
<p>Moraros J, Lemstra M, Nwankwo C. Lean interventions in healthcare: do they actually work? A systematic literature review. International journal for quality in health care : journal of the International Society for Quality in Health Care / ISQua. 2016;28(2):150-65.</p>
<p>Mundell WC, Kennedy CS, Szostek JH, Cook DA. Simulation technology for resuscitation training: a systematic review and meta-analysis. Resuscitation 2013;84:1174-83.</p>
<p>Nunan M, Duke T. Effectiveness of pharmacy interventions in improving availability of essential medicines at the primary healthcare level. Tropical medicine & international health : TM & IH. 2011;16(5):647-58.</p>
<p>Oluoch T, Santas X, Kwaro D, Were M, Biondich P, Bailey C, et al. The effect of electronic medical record-based clinical decision support on HIV care in resource-constrained settings: a systematic review. International journal of medical informatics. 2012;81(10):e83-92.</p>
<p>Palmer KS, Agoritsas T, Martin D, Scott T, Mulla SM, Miller AP, et al. Activity-based funding of hospitals and its impact on mortality, readmission, discharge destination, severity of illness, and volume of care: a systematic review and meta-analysis. PloS one. 2014;9(10):e109975.</p>
<p>Pega F, Liu SY, Walter S, Lhachimi SK. Unconditional cash transfers for assistance in humanitarian disasters: effect on use of health services and health outcomes in low- and middle-income countries. The Cochrane database of systematic reviews. 2015;9(9):CD011247.</p>
<p>Penazzato M, Davies MA, Apollo T, Negussie E, Ford N. Task shifting for the delivery of pediatric antiretroviral treatment: a systematic review. Journal of acquired immune deficiency syndromes (1999). 2014;65(4):414-22.</p>
<p>Pollaris G, Sabbe M. Reverse triage: more than just another method. European journal of emergency medicine : official journal of the European Society for Emergency Medicine. 2015;23(4):240-7.</p>
<p>Polus S, Lewin S, Glenton C, Lerberg PM, Rehfuess E, Gülmezoglu AM. Optimizing the delivery of contraceptives in low- and middle-income countries through task shifting: a systematic review of effectiveness and safety. Reproductive health. 2015;12(1):27.</p>
<p>Rashidian A, Omidvari AH, Vali Y, Sturm H, Oxman AD. Pharmaceutical policies: effects of financial incentives for prescribers. The Cochrane database of systematic reviews. 2015;8(8):CD006731.</p>
<p>Reichow B, Servili C, Yasamy MT, Barbui C, Saxena S. Non-specialist psychosocial interventions for children and adolescents with intellectual disability or lower-functioning autism spectrum disorders: a systematic review. PLoS medicine. 2013;10(12):e1001572.</p>
<p>Reisman J, Arlington L, Jensen L, Louis H, Suarez-Rebling D, Nelson BD. Newborn Resuscitation Training in Resource-Limited Settings: A Systematic Literature Review. Pediatrics. 2016;138(2):1-16.</p>
<p>Robyn PJ, Sauerborn R, Bärnighausen T. Provider payment in community-based health insurance schemes in developing countries: a systematic review. Health policy and planning. 2013;28(2):111-22.</p>
<p>Rolfe A, Cash-Gibson L, Car J, Sheikh A, McKinstry B. Interventions for improving patients' trust in doctors and groups of doctors. Cochrane Database of Systematic Reviews 2014, Issue 3. Art. No.: CD004134. DOI: 10.1002/14651858.CD004134.pub3.</p>
<p>Salam RA, Das JK, Lassi ZS, Bhutta ZA. Impact of community-based interventions for the prevention and control of malaria on intervention coverage and health outcomes for the prevention and control of malaria. Infectious diseases of poverty. 2014;3(1):25.</p>
<p>Schmidt E, Goldhaber-Fiebert SN, Ho LA, McDonald KM. Simulation exercises as a patient safety strategy: a systematic review. Annals of internal medicine. 2013;158(5 Pt 2):426-32.</p>
<p>Sharon RL, Amanda N, Andrew FS, Phil A. Physician anaesthetists versus non-physician providers of anaesthesia for surgical patients. Cochrane Database of Systematic Reviews. 2014;7(7):CD010357.</p>
<p>Sondaal SF, Browne JL, Amoakoh-Coleman M, Borgstein A, Miltenburg AS, Verwijs M, et al. Assessing the Effect of mHealth Interventions in Improving Maternal and Neonatal Care in Low- and Middle-Income Countries: A Systematic Review. PloS one. 2016;11(5):e0154664.</p>
<p>Spaan E, Mathijssen J, Tromp N, McBain F, ten Have A, Baltussen R. The impact of health insurance in Africa and Asia: a systematic review. Bulletin of the World Health Organization. 2012;90(9):685-92.</p>
<p>Sunguya BF, Poudel KC, Mlunde LB, Urassa DP, Yasuoka J, Jimba M. Nutrition training improves health workers' nutrition knowledge and competence to manage child undernutrition: a systematic review. Frontiers in public health. 2013;1:37.</p>
<p>Susan FM, Benjamin MH, Ramila B, Tim E, Debra B. Demand-side financing measures to increase maternal health service utilisation and improve health outcomes: a systematic review of evidence from low- and middle-income countries. JBI Library of Systematic Reviews. 2012;10(58):4165-567.</p>
<p>Tannenbaum SI, Cerasoli CP. Do team and individual debriefs enhance performance? a meta-analysis. Human Factors 2013;55(1):231-45.</p>
<p>Thomas SM, Jeyaraman M, Hodge WG, Hutnik C, Costella J, Malvankar-Mehta MS. The effectiveness of teleglaucoma versus in-patient examination for glaucoma screening: a systematic review and meta-analysis. PloS one. 2014;9(12):e113779.</p>
<p>Tibingana-Ahimbisibwe B, Katabira C, Mpalampa L, Harrison RA. The effectiveness of adolescent-specific prenatal interventions on improving attendance and reducing harm during and after birth: a systematic review. International journal of adolescent medicine and health. 2016.</p>
<p>Till SR, Everetts D, Haas DM. Incentives for increasing prenatal care use by women in order to improve maternal and neonatal outcomes. Cochrane Database of Systematic Reviews. 2015;12(12):CD009916.</p>
<p>Watterson JL, Walsh J, Madeka I. Using mHealth to Improve Usage of Antenatal Care, Postnatal Care, and Immunization: A Systematic Review of the Literature. BioMed research international. 2015;2015(no pagination):153402.</p>
<p>Weeks G, George J, Maclure K, Stewart D. Non-medical prescribing versus medical prescribing for acute and chronic disease management in primary and secondary care. The Cochrane database of systematic reviews. 2016;11:CD011227.</p>
<p>Wiysonge CS, Abdullahi LH, Ndze VN, Hussey GD. Public stewardship of private for-profit healthcare providers in low- and middle-income countries. Cochrane Database of Systematic Reviews. 2016;8(8):CD009855.</p>
<p>Wong WC, Luk CW, Kidd MR. Is there a role for primary care clinicians in providing shared care in HIV treatment? A systematic literature review. Sexually transmitted infections. 2012;88(2):125-31.</p>
<p>
<bold>Likely excluded reviews</bold>
</p>
<p>Bassili A, Fitzpatrick C, Qadeer E, Fatima R, Floyd K, Jaramillo E. A systematic review of the effectiveness of hospital- and ambulatory-based management of multidrug-resistant tuberculosis. The American journal of tropical medicine and hygiene. 2013;89(2):271-80.</p>
<p>Bhageerathy R, Nair S, Bhaskaran U. A systematic review of community-based health insurance programs in South Asia. The International journal of health planning and management. 2016.</p>
<p>Blaya JA, Fraser HS, Holt B. E-health technologies show promise in developing countries. Health affairs (Project Hope). 2010;29(2):244-51.</p>
<p>Callese TE, Richards CT, Shaw P, Schuetz SJ, Paladino L, Issa N, et al. Trauma system development in low- and middle-income countries: a review. The Journal of surgical research. 2015;193(1):300-7.</p>
<p>Davy C, Bleasel J, Liu H, Tchan M, Ponniah S, Brown A. Effectiveness of chronic care models: opportunities for improving healthcare practice and health outcomes: a systematic review. BMC health services research. 2015;15(1):194.</p>
<p>Dawson AZ, Walker RJ, Campbell JA, Egede LE. Effective Strategies for Global Health Training Programs A Systematic Review of Training Outcomes in Low and Middle Income Countries. Global journal of health science. 2016;8(11):56719.</p>
<p>Higgs ES, Goldberg AB, Labrique AB, Cook SH, Schmid C, Cole CF, et al. Understanding the role of mHealth and other media interventions for behavior change to enhance child survival and development in low- and middle-income countries: an evidence review. Journal of health communication. 2014;19 Suppl 1:164-89.</p>
<p>Hubert GJ, Müller-Barna P, Audebert HJ. Recent advances in TeleStroke: a systematic review on applications in prehospital management and Stroke Unit treatment or TeleStroke networking in developing countries. International journal of stroke : official journal of the International Stroke Society. 2014;9(8):968-73.</p>
<p>Margaret Elizabeth K, Denis P, Peter CR, Wim Van L. The contribution of primary care to health and health systems in low- and middle-income countries: A critical review of major primary care initiatives. 2010.</p>
<p>Pannick S, Davis R, Ashrafian H, Byrne BE, Beveridge I, Athanasiou T, et al. Effects of Interdisciplinary Team Care Interventions on General Medical Wards: A Systematic Review. JAMA internal medicine. 2015;175(8):1288-98.</p>
<p>Schiavo R, May Leung M, Brown M. Communicating risk and promoting disease mitigation measures in epidemics and emerging disease settings. Pathogens and global health. 2014;108(2):76-94.</p>
<p>Zulfiqar AB, Zohra SL, Nadia M. Systematic review on human resources for health interventions to improve maternal health outcomes: Evidence from developing countries. 2010.</p>
<p>
<bold>Uncertain reviews</bold>
</p>
<p>Acheampong F, Anto BP, Koffuor GA. Medication safety strategies in hospitals--a systematic review. The International journal of risk & safety in medicine. 2014;26(3):117-31.</p>
<p>Alkhenizan A, Shaw C. Impact of accreditation on the quality of healthcare services: a systematic review of the literature. Annals of Saudi medicine. 2011;31(4):407-16.</p>
<p>Al-Mallah MH, Farah I, Al-Madani W, Bdeir B, Al Habib S, Bigelow ML, et al. The Impact of Nurse-Led Clinics on the Mortality and Morbidity of Patients with Cardiovascular Diseases: A Systematic Review and Meta-analysis. The Journal of cardiovascular nursing. 2015;31(1):89-95.</p>
<p>Bakitas MA, Elk R, Astin M, Ceronsky L, Clifford KN, Dionne-Odom JN, et al. Systematic Review of Palliative Care in the Rural Setting. Cancer control : journal of the Moffitt Cancer Center. 2015;22(4):450-64.</p>
<p>Balfour J, Abdulcadir J, Say L, Hindin MJ. Interventions for healthcare providers to improve treatment and prevention of female genital mutilation: a systematic review. BMC health services research. 2016;16(1):409.</p>
<p>Bannan DF, Tully MP. Bundle interventions used to reduce prescribing and administration errors in hospitalized children: a systematic review. Journal of clinical pharmacy and therapeutics. 2016;41(3):246-55.</p>
<p>Bashshur RL, Howell JD, Krupinski EA, Harms KM, Bashshur N, Doarn CR. The Empirical Foundations of Telemedicine Interventions in Primary Care. Telemedicine journal and e-health : the official journal of the American Telemedicine Association. 2016;22(5):342-75.</p>
<p>Boccia D, Hargreaves J, Lönnroth K, Jaramillo E, Weiss J, Uplekar M, et al. Cash transfer and microfinance interventions for tuberculosis control: review of the impact evidence and policy implications. The international journal of tuberculosis and lung disease : the official journal of the International Union against Tuberculosis and Lung Disease. 2011;15 Suppl 2:S37-49.</p>
<p>Booth A, Cantrell A, Preston L, Chambers D, Goyder E. What is the evidence for the effectiveness, appropriateness and feasibility of group clinics for patients with chronic conditions? A systematic review2015 2015/12/None.</p>
<p>Brocklehurst P, Mertz B, Jerković-Ćosić K, Littlewood A, Tickle M. Direct access to midlevel dental providers: an evidence synthesis. Journal of public health dentistry. 2014;74(4):326-35.</p>
<p>Candy B, France R, Low J, Sampson L. Does involving volunteers in the provision of palliative care make a difference to patient and family wellbeing? A systematic review of quantitative and qualitative evidence. International journal of nursing studies. 2014;52(3):756-68.</p>
<p>Chapman SM, Wray J, Oulton K, Peters MJ. Systematic review of paediatric track and trigger systems for hospitalised children. Resuscitation. 2016;109:87-109.</p>
<p>Coxeter P, Del Mar CB, McGregor L, Beller EM, Hoffmann TC. Interventions to facilitate shared decision making to address antibiotic use for acute respiratory infections in primary care. The Cochrane database of systematic reviews. 2015;11(11):CD010907.</p>
<p>Damiani G, Pinnarelli L, Sommella L, Vena V, Magrini P, Ricciardi W. The Short Stay Unit as a new option for hospitals: a review of the scientific literature. Medical science monitor : international medical journal of experimental and clinical research. 2011;17(6):SR15-9.</p>
<p>Gentry S, van Velthoven MHMMT, Tudor Car L, Car J. Telephone delivered interventions for reducing morbidity and mortality in people with HIV infection. Cochrane Database of Systematic Reviews. 2013;5(5):CD009189.</p>
<p>Harding R, Albertyn R, Sherr L, Gwyther L. Pediatric palliative care in sub-saharan Africa: a systematic review of the evidence for care models, interventions, and outcomes. Journal of pain and symptom management. 2014;47(3):642-51.</p>
<p>Hastings SE, Armitage GD, Mallinson S, Jackson K, Suter E. Exploring the relationship between governance mechanisms in healthcare and health workforce outcomes: a systematic review. BMC health services research. 2014;14(1):479.</p>
<p>Hines S, Munday J, Kynoch K. Effectiveness of nurse-led preoperative assessment services for elective surgery: a systematic review update. JBI database of systematic reviews and implementation reports. 2015;13(6):279-317.</p>
<p>Hotchkiss DR, Diana ML, Foreit KG. How can routine health information systems improve health systems functioning in low- and middle-income countries? Assessing the evidence base. Advances in health care management. 2012;12:25-58.</p>
<p>Housden L, Wong ST, Dawes M. Effectiveness of group medical visits for improving diabetes care: a systematic review and meta-analysis. CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne. 2013;185(13):E635-44.</p>
<p>Ireland S, Kent B. Telephone pre-operative assessment for adults: a comprehensive systematic review. JBI Library of Systematic Reviews. 2012;10(25):1452-503.</p>
<p>Kågesten A, Parekh J, Tunçalp O, Turke S, Blum RW. Comprehensive adolescent health programs that include sexual and reproductive health services: a systematic review. American journal of public health. 2014;104(12):e1-e14.</p>
<p>Lazarus JV, Safreed-Harmon K, Nicholson J, Jaffar S. Health service delivery models for the provision of antiretroviral therapy in sub-Saharan Africa: a systematic review. Tropical medicine & international health : TM & IH. 2014;19(10):1198-215.</p>
<p>Leidy Johanna Rueda D, Diná Lopes Monteiro da C. The efficacy of telephone use to assist and improve the wellbeing of family caregivers of persons with chronic diseases: a systematic review. JBI Library of Systematic Reviews. 2015;12(12):106-40.</p>
<p>McCormack L, Sheridan S, Lewis M, Boudewyns V, Melvin CL, Kistler C, et al. Communication and dissemination strategies to facilitate the use of health-related evidence. Evidence report/technology assessment. 2013(213):1-520.</p>
<p>Meid AD, Lampert A, Burnett A, Seidling HM, Haefeli WE. The impact of pharmaceutical care interventions for medication underuse in older people: a systematic review and meta-analysis. British journal of clinical pharmacology. 2015;80(4):768-76.</p>
<p>Mengistu TA, Tafere TE. Effect of antenatal care on institutional delivery in developing countries: a systematic review. JBI Library of Systematic Reviews. 2011;9(35):1447-70.</p>
<p>Mitchell GK, Burridge L, Zhang J, Donald M, Scott IA, Dart J, et al. Systematic review of integrated models of health care delivered at the primary?secondary interface: how effective is it and what determines effectiveness? Australian journal of primary health. 2015;21(4):391-408.</p>
<p>Palmas W, March D, Darakjy S, Findley SE, Teresi J, Carrasquillo O, et al. Community Health Worker Interventions to Improve Glycemic Control in People with Diabetes: A Systematic Review and Meta-Analysis. Journal of General Internal Medicine. 2015;30:1004-12.</p>
<p>Pérez-Escamilla R, Martinez JL, Segura-Pérez S. Impact of the Baby-friendly Hospital Initiative on breastfeeding and child health outcomes: a systematic review. Maternal & child nutrition. 2016;12(3):402-17.</p>
<p>Rinke ML, Bundy DG, Velasquez CA, Rao S, Zerhouni Y, Lobner K, et al. Interventions to Reduce Pediatric Medication Errors: A Systematic Review. Pediatrics. 2014;134(2):338-60.</p>
<p>Rudge MV, Lima SA, El Dib RP, Marini G, Magalhães C, Calderon Ide M. Effect of ambulatory versus hospital treatment for gestational diabetes or hyperglycemia on infant mortality rates: a systematic review. São Paulo medical journal = Revista paulista de medicina. 2013;131(5):331-7.</p>
<p>Sabater-Hernández D, Sabater-Galindo M, Fernandez-Llimos F, Rotta I, Hossain LN, Durks D, et al. A Systematic Review of Evidence-Based Community Pharmacy Services Aimed at the Prevention of Cardiovascular Disease. Journal of managed care & specialty pharmacy. 2016;22(6):699-713.</p>
<p>Salmoiraghi A, Hussain S. A Systematic Review of the Use of Telepsychiatry in Acute Settings. Journal of psychiatric practice. 2015;21(5):389-93.</p>
<p>Santos MT, Moura SC, Gomes LM, Lima AH, Moreira RS, Silva CD, et al. Telehealth application on the rehabilitation of children and adolescents. Revista paulista de pediatria : orgão oficial da Sociedade de Pediatria de São Paulo. 2014;32(1):136-43.</p>
<p>Saxon RL, Gray MA, Oprescu FI. Extended roles for allied health professionals: an updated systematic review of the evidence. Journal of multidisciplinary healthcare. 2014;7((Saxon R.L.,
<email>robyn.saxon@health.qld.gov.au</email>
; Gray M.A.; Ioprescu F.) School of Health and Sports Sciences, University of the Sunshine Coast, Sippy Downs, Australia):479-88.</p>
<p>Stokes J, Panagioti M, Alam R, Checkland K, Cheraghi-Sohi S, Bower P. Effectiveness of Case Management for 'At Risk' Patients in Primary Care: A Systematic Review and Meta-Analysis. PloS one. 2015;10(7):e0132340.</p>
<p>Suksomboon N, Poolsup N, Nge YL. Impact of phone call intervention on glycemic control in diabetes patients: a systematic review and meta-analysis of randomized, controlled trials. PloS one. 2014;9(2):e89207.</p>
<p>Tao D, Xie L, Wang T, Wang T. A meta-analysis of the use of electronic reminders for patient adherence to medication in chronic disease care. Journal of Telemedicine and Telecare. 2015;21(1).</p>
<p>Tricco AC, Antony J, Ivers NM, Ashoor HM, Khan PA, Blondal E, et al. Effectiveness of quality improvement strategies for coordination of care to reduce use of health care services: a systematic review and meta-analysis. CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne. 2014;186(15):E568-78.</p>
<p>Pitt V, Lowe D, Hill S, Prictor M, Hetrick SE, Ryan R, et al. Consumer-providers of care for adult clients of statutory mental health services. Cochrane Database of Systematic Reviews. 2013;3(3):CD004807.</p>
<p>Weaver MS, Lönnroth K, Howard SC, Roter DL, Lam CG. Interventions to improve adherence to treatment for paediatric tuberculosis in low- and middle-income countries: a systematic review and meta-analysis. Bulletin of the World Health Organization. 2015;93(10):700-11B.</p>
<p>Wekesah FM, Mbada CE, Muula AS, Kabiru CW, Muthuri SK, Izugbara CO. Effective non-drug interventions for improving outcomes and quality of maternal health care in sub-Saharan Africa: a systematic review. Systematic reviews. 2016;5(1):137.</p>
<p>Willey B, Smith Paintain L, Mangham-Jefferies L, Car J, Armstrong Schellenberg J. Effectiveness of interventions to strengthen national health service delivery on coverage, access, quality and equity in the use of health services in low and lower middle income countries. 2013 2013.</p>
<p>World Health Organization, University of California SF. Task shifting - physicians (doctors) versus non-physicians (nurses or clinical officers) for initiation and maintenance of antiretroviral therapy. World Health Organization. 2013.</p>
<p>Yasmin F, Banu B, Zakir SM, Sauerborn R, Ali L, Souares A. Positive influence of short message service and voice call interventions on adherence and health outcomes in case of chronic disease care: a systematic review. BMC medical informatics and decision making. 2016;16:46.</p>
<p>Zhai YK, Zhu WJ, Hou HL, Sun DX, Zhao J. Efficacy of telemedicine for thrombolytic therapy in acute ischemic stroke: a meta-analysis. Journal of telemedicine and telecare. 2015;21(3):123-30.</p>
<p>Zhou K, Fitzpatrick T, Walsh N, Kim JY, Chou R, Lackey M, et al. Interventions to optimise the care continuum for chronic viral hepatitis: a systematic review and meta-analyses. The Lancet Infectious diseases. 2016.</p>
<p>Zwanikken PA, Dieleman M, Samaranayake D, Akwataghibe N, Scherpbier A. A systematic review of outcome and impact of master's in health and health care. BMC medical education. 2013;13:18.</p>
<p>
<bold>Likely supplemental reviews</bold>
</p>
<p>Abdulwahid MA, Booth A, Kuczawski M, Mason SM. The impact of senior doctor assessment at triage on emergency department performance measures: systematic review and meta-analysis of comparative studies. Emergency medicine journal : EMJ. 2015;33(7):504-13.</p>
<p>Adebayo EF, Uthman OA, Wiysonge CS, Stern EA, Lamont KT, Ataguba JE. A systematic review of factors that affect uptake of community-based health insurance in low-income and middle-income countries. BMC health services research. 2015;15(1):543.</p>
<p>Alghamdi M, Gashgari H, Househ M. A Systematic Review of Mobile Health Technology Use in Developing Countries. Studies in health technology and informatics. 2015;213:223-6.</p>
<p>Alkhaled L, Kahale L, Nass H, Brax H, Fadlallah R, Badr K, et al. Legislative, educational, policy and other interventions targeting physicians' interaction with pharmaceutical companies: a systematic review. BMJ open. 2014;4(7):e004880.</p>
<p>Altowaijri A, Phillips CJ, Fitzsimmons D. A systematic review of the clinical and economic effectiveness of clinical pharmacist intervention in secondary prevention of cardiovascular disease. Journal of managed care pharmacy : JMCP. 2013;19(5):408-16.</p>
<p>Amouzou A, Morris S, Moulton LH, Mukanga D. Assessing the impact of integrated community case management (iCCM) programs on child mortality: Review of early results and lessons learned in sub-Saharan Africa. Journal of global health. 2014;4(2):020411.</p>
<p>Aziz H, Hatah E, Makmor Bakry M, Islahudin F. How payment scheme affects patients' adherence to medications? A systematic review. Patient preference and adherence. 2016;10:837-50.</p>
<p>Bailey C, Blake C, Schriver M, Cubaka VK, Thomas T, Martin Hilber A. A systematic review of supportive supervision as a strategy to improve primary healthcare services in Sub-Saharan Africa. International journal of gynaecology and obstetrics: the official organ of the International Federation of Gynaecology and Obstetrics. 2015;132(1):117-25.</p>
<p>Baxter PE, Hewko SJ, Pfaff KA, Cleghorn L, Cunningham BJ, Elston D, et al. Leaders' experiences and perceptions implementing activity-based funding and pay-for-performance hospital funding models: A systematic review. Health policy (Amsterdam, Netherlands). 2015;119(8):1096-110.</p>
<p>Bbosa GS, Wong G, Kyegombe DB, Ogwal-Okeng J. Effects of intervention measures on irrational antibiotics/antibacterial drug use in developing countries: A systematic review. Health. 2014;6.</p>
<p>Bellows B, Bulaya C, Inambwae S, Lissner CL, Ali M, Bajracharya A. Family Planning Vouchers in Low and Middle Income Countries: A Systematic Review. Studies in family planning. 2016;47(4):357-70.</p>
<p>Bellows BW, Conlon CM, Higgs ES, Townsend JW, Nahed MG, Cavanaugh K, et al. A taxonomy and results from a comprehensive review of 28 maternal health voucher programmes. Journal of health, population, and nutrition. 2013;31(4 Suppl 2):106-28.</p>
<p>Benishek LA, Dugosh KL, Kirby KC, Matejkowski J, Clements NT, Seymour BL, et al. Prize-based contingency management for the treatment of substance abusers: a meta-analysis. Addiction (Abingdon, England). 2014;109(9):1426-36.</p>
<p>Beratarrechea A, Lee AG, Willner JM, Jahangir E, Ciapponi A, Rubinstein A. The impact of mobile health interventions on chronic disease outcomes in developing countries: a systematic review. Telemedicine journal and e-health : the official journal of the American Telemedicine Association. 2014;20(1):75-82.</p>
<p>Blank L, Baxter S, Woods HB, Goyder E, Lee A, Payne N, et al. What is the evidence on interventions to manage referral from primary to specialist non-emergency care? A systematic review and logic model synthesis. Health services and delivery research. 2015.</p>
<p>Bloomfield GS, Vedanthan R, Vasudevan L, Kithei A, Were M, Velazquez EJ. Mobile health for non-communicable diseases in Sub-Saharan Africa: a systematic review of the literature and strategic framework for research. Globalization and health. 2014;10(1):49.</p>
<p>Boksmati N, Butler-Henderson K, Anderson K, Sahama T. The Effectiveness of SMS Reminders on Appointment Attendance: a Meta-Analysis. Journal of medical systems. 2016;40(4):90.</p>
<p>Borchard A, Schwappach DL, Barbir A, Bezzola P. A systematic review of the effectiveness, compliance, and critical factors for implementation of safety checklists in surgery. Annals of surgery. 2012;256(6):925-33.</p>
<p>Braet A, Weltens C, Sermeus W. Effectiveness of discharge interventions from hospital to home on hospital readmissions: a systematic review. JBI database of systematic reviews and implementation reports. 2016;14(2):106-73.</p>
<p>Brata C, Gudka S, Schneider CR, Clifford RM. A review of the provision of appropriate advice by pharmacy staff for self-medication in developing countries. Research in social & administrative pharmacy: RSAP. 2014;11(2):136-53.</p>
<p>Byrne A, Morgan A. How the integration of traditional birth attendants with formal health systems can increase skilled birth attendance. International journal of gynaecology and obstetrics: the official organ of the International Federation of Gynaecology and Obstetrics. 2011;115(2):127-34.</p>
<p>Campanella P, Vukovic V, Parente P, Sulejmani A, Ricciardi W, Specchia ML. The impact of Public Reporting on clinical outcomes: a systematic review and meta-analysis. BMC health services research. 2016;16(1):296.</p>
<p>Carter EB, Temming LA, Akin J, Fowler S, Macones GA, Colditz GA, et al. Group Prenatal Care Compared With Traditional Prenatal Care: A Systematic Review and Meta-analysis. Obstetrics and gynecology. 2016;128(3):551-61.</p>
<p>Chhina HK, Bhole VM, Goldsmith C, Hall W, Kaczorowski J, Lacaille D. Effectiveness of academic detailing to optimize medication prescribing behaviour of family physicians. Journal of pharmacy & pharmaceutical sciences : a publication of the Canadian Society for Pharmaceutical Sciences, Société canadienne des sciences pharmaceutiques. 2013;16(4):511-29.</p>
<p>Chin WY, Lam CL, Lo SV. Quality of care of nurse-led and allied health personnel-led primary care clinics. Hong Kong medical journal = Xianggang yi xue za zhi / Hong Kong Academy of Medicine. 2011;17(3):217-30.</p>
<p>Chishinga N, Godfrey-Faussett P, Fielding K, Ayles H. Effect of home-based interventions on virologic outcomes in adults receiving antiretroviral therapy in Africa: a meta-analysis. BMC public health. 2014;14(1):239.</p>
<p>Clark CE, Smith LF, Taylor RS, Campbell JL. Nurse led interventions to improve control of blood pressure in people with hypertension: systematic review and meta-analysis. BMJ (Clinical research ed). 2010;341(7771):c3995.</p>
<p>Cobos Muñoz D, Merino Amador P, Monzon Llamas L, Martinez Hernandez D, Santos Sancho JM. Decentralization of health systems in low and middle income countries: a systematic review. International journal of public health. 2016.</p>
<p>Conn VS, Ruppar TM, Enriquez M, Cooper PS, Chan KC. Healthcare provider targeted interventions to improve medication adherence: systematic review and meta-analysis. International journal of clinical practice. 2015;69(8):889-99.</p>
<p>Davis R, Parand A, Pinto A, Buetow S. Systematic review of the effectiveness of strategies to encourage patients to remind healthcare professionals about their hand hygiene. The Journal of hospital infection. 2014;89(3):141-62.</p>
<p>Davy C, Bleasel J, Liu H, Tchan M, Ponniah S, Brown A. Factors influencing the implementation of chronic care models: A systematic literature review. BMC family practice. 2015;16:102.</p>
<p>Decroo T, Rasschaert F, Telfer B, Remartinez D, Laga M, Ford N. Community-based antiretroviral therapy programs can overcome barriers to retention of patients and decongest health services in sub-Saharan Africa: a systematic review. International health. 2013;5(3):169-79.</p>
<p>Dempsey E, Pammi M, Ryan AC, Barrington KJ. Standardised formal resuscitation training programmes for reducing mortality and morbidity in newborn infants. The Cochrane database of systematic reviews. 2015;9(9):CD009106.</p>
<p>Devi BR, Syed-Abdul S, Kumar A, Iqbal U, Nguyen PA, Li YC, et al. mHealth: An updated systematic review with a focus on HIV/AIDS and tuberculosis long term management using mobile phones. Computer methods and programs in biomedicine. 2015;122(2):257-65.</p>
<p>do Amaral JJF, Victora CG. The effect of training in Integrated Management of Childhood Illness (IMCI) on the performance and healthcare quality of pediatric healthcare workers: a systematic review. Revista Brasileira de Saúde Materno Infantil. 2008;8(2):151-62.</p>
<p>Druetz T, Siekmans K, Goossens S, Ridde V, Haddad S. The community case management of pneumonia in Africa: a review of the evidence. Health policy and planning. 2013;30(2):253-66.</p>
<p>Dzakpasu S, Powell-Jackson T, Campbell OM. Impact of user fees on maternal health service utilization and related health outcomes: a systematic review. Health policy and planning. 2014;29(2):137-50.</p>
<p>Eichler R, Agarwal K, Askew I, Iriarte E, Morgan L, Watson J. Performance-based incentives to improve health status of mothers and newborns: what does the evidence show? Journal of health, population, and nutrition. 2013;31(4 Suppl 2):36-47.</p>
<p>Elder E, Johnston AN, Crilly J. Review article: Systematic review of three key strategies designed to improve patient flow through the emergency department. Emergency medicine Australasia : EMA. 2015;27(5):394-404.</p>
<p>Evans BA, Porter A, Gammon B, Mayes RH, Poulden M, Rees N, et al. A systematic review of rapid access models of care and their effects on delays in emergency departments. Emergency medicine journal : EMJ. 2015;32(6):e15-6.</p>
<p>Free C, Phillips G, Galli L, Watson L, Felix L, Edwards P, et al. The effectiveness of mobile-health technology-based health behaviour change or disease management interventions for health care consumers: a systematic review. PLoS medicine. 2013;10(1):e1001362.</p>
<p>Gielen SC, Dekker J, Francke AL, Mistiaen P, Kroezen M. The effects of nurse prescribing: A systematic review. International journal of nursing studies. 2013;51(7):1048-61.</p>
<p>Gillespie BM, Chaboyer W, Thalib L, John M, Fairweather N, Slater K. Effect of Using a Safety Checklist on Patient Complications after Surgery: A Systematic Review and Meta-analysis. Anesthesiology. 2014;120(6):1380-9.</p>
<p>Gilmore B, McAuliffe E. Effectiveness of community health workers delivering preventive interventions for maternal and child health in low- and middle-income countries: a systematic review. BMC public health. 2013;13(1):847.</p>
<p>Gogia S, Sachdev HP. Home-based neonatal care by community health workers for preventing mortality in neonates in low- and middle-income countries: a systematic review. Journal of perinatology : official journal of the California Perinatal Association. 2016;36 Suppl 1(S1):S55-73.</p>
<p>Gogia S, Sachdev HS. Home visits by community health workers to prevent neonatal deaths in developing countries: a systematic review. Bulletin of the World Health Organization. 2010;88(9):658-66B.</p>
<p>Govindasamy D, Meghij J, Kebede Negussi E, Clare Baggaley R, Ford N, Kranzer K. Interventions to improve or facilitate linkage to or retention in pre-ART (HIV) care and initiation of ART in low- and middle-income settings - a systematic review. Journal of the International AIDS Society. 2014;17(1):19032.</p>
<p>Hamine S, Gerth-Guyette E, Faulx D, Green BB, Ginsburg AS. Impact of mHealth Chronic Disease Management on Treatment Adherence and Patient Outcomes: A Systematic Review. Journal of medical Internet research. 2015;17(2):e52.</p>
<p>Hecht L, Buhse S, Meyer G. Effectiveness of training in evidence-based medicine skills for healthcare professionals: a systematic review. BMC medical education. 2016;16(1):103.</p>
<p>Hurt K, Walker RJ, Campbell JA, Egede LE. mHealth Interventions in Low and Middle-Income Countries: A Systematic Review. Global journal of health science. 2016;8(9):54429.</p>
<p>Jia L, Meng Q, Yuan B, Fang L. Effects of drug cost sharing policy on the drug use, financial risks and moral hazard for the health insurance beneficiaries. Value in Health. 2014;17(7):A795.</p>
<p>Kamarudin G, Penm J, Chaar B, Moles R. Educational interventions to improve prescribing competency: a systematic review. BMJ open. 2013;3(8):e003291.</p>
<p>Kanters S, Park JJ, Chan K, Socias ME, Ford N, Forrest JI, et al. Interventions to improve adherence to antiretroviral therapy: a systematic review and network meta-analysis. The lancet HIV. 2016.</p>
<p>Ke KM, Blazeby JM, Strong S, Carroll FE, Ness AR, Hollingworth W. Are multidisciplinary teams in secondary care cost-effective? A systematic review of the literature. Cost effectiveness and resource allocation : C/E. 2013;11(1):7.</p>
<p>Khanal S, Burgon J, Leonard S, Griffiths M, Eddowes LA. Recommendations for the Improved Effectiveness and Reporting of Telemedicine Programs in Developing Countries: Results of a Systematic Literature Review. Telemedicine journal and e-health : the official journal of the American Telemedicine Association. 2015;21(11):903-15.</p>
<p>Kok MC, Dieleman M, Taegtmeyer M, Broerse JE, Kane SS, Ormel H, et al. Which intervention design factors influence performance of community health workers in low- and middle-income countries? A systematic review. Health policy and planning. 2014;30(9):1207-27.</p>
<p>Kondo KK, Damberg CL, Mendelson A, Motu'apuaka M, Freeman M, O'Neil M, et al. Implementation Processes and Pay for Performance in Healthcare: A Systematic Review. Journal of general internal medicine. 2016;31 Suppl 1:61-9.</p>
<p>Korachais C, Macouillard E, Meessen B. How User Fees Influence Contraception in Low and Middle Income Countries: A Systematic Review. Studies in family planning. 2016;47(4):341-56.</p>
<p>Körner M, Bütof S, Müller C, Zimmermann L, Becker S, Bengel J. Interprofessional teamwork and team interventions in chronic care: A systematic review. Journal of interprofessional care. 2015;30(1):1-14.</p>
<p>Kurtzman ET, Greene J. Effective presentation of health care performance information for consumer decision making: A systematic review. Patient education and counseling. 2015;99(1):36-43.</p>
<p>Lee IH, Bloor K, Hewitt C, Maynard A. International experience in controlling pharmaceutical expenditure: influencing patients and providers and regulating industry - a systematic review. Journal of health services research & policy. 2014;20(1):52-9.</p>
<p>Lee SH, Nurmatov UB, Nwaru BI, Mukherjee M, Grant L, Pagliari C. Effectiveness of mHealth interventions for maternal, newborn and child health in low- and middle-income countries: Systematic review and meta-analysis. Journal of global health. 2016;6(1):010401.</p>
<p>Lehnbom EC, Stewart MJ, Manias E, Westbrook JI. Impact of medication reconciliation and review on clinical outcomes. The Annals of pharmacotherapy. 2014;48(10):1298-312.</p>
<p>L'Engle KL, Mangone ER, Parcesepe AM, Agarwal S, Ippoliti NB. Mobile Phone Interventions for Adolescent Sexual and Reproductive Health: A Systematic Review. Pediatrics. 2016;138(3):1-16.</p>
<p>Lin Y, Yin S, Huang J, Du L. Impact of Pay for performance on Behavior of Primary Care Physicians and Patient Outcomes. Journal of evidence-based medicine. 2015;9(1):8-23.</p>
<p>Liu X, Dou L, Zhang H, Sun Y, Yuan B. Analysis of context factors in compulsory and incentive strategies for improving attraction and retention of health workers in rural and remote areas: a systematic review. Human resources for health. 2015;13:61.</p>
<p>Liu X, Hotchkiss DR, Bose S. The effectiveness of contracting-out primary health care services in developing countries: A review of the evidence. Health Policy and Planning. 2007; 23(1): 1-13.</p>
<p>Luangasanatip N, Hongsuwan M, Limmathurotsakul D, Lubell Y, Lee AS, Harbarth S, et al. Comparative efficacy of interventions to promote hand hygiene in hospital: systematic review and network meta-analysis. BMJ (Clinical research ed). 2015;351:h3728.</p>
<p>Mann BS, Barnieh L, Tang K, Campbell DJ, Clement F, Hemmelgarn B, et al. Association between drug insurance cost sharing strategies and outcomes in patients with chronic diseases: a systematic review. PloS one. 2014;9(3):e89168.</p>
<p>Martínez-González NA, Djalali S, Tandjung R, Huber-Geismann F, Markun S, Wensing M, et al. Substitution of physicians by nurses in primary care: a systematic review and meta-analysis. BMC health services research. 2014;14:214.</p>
<p>Martínez-González NA, Rosemann T, Tandjung R, Djalali S. The effect of physician-nurse substitution in primary care in chronic diseases: a systematic review. Swiss medical weekly. 2015;145(no pagination):w14031.</p>
<p>Martínez-González NA, Tandjung R, Djalali S, Rosemann T. The impact of physician-nurse task shifting in primary care on the course of disease: a systematic review. Human resources for health. 2015;13:55.</p>
<p>Mbuagbaw L, Sivaramalingam B, Navarro T, Hobson N, Keepanasseril A, Wilczynski NJ, et al. Interventions for Enhancing Adherence to Antiretroviral Therapy (ART): A Systematic Review of High Quality Studies. AIDS patient care and STDs. 2015;29(5):248-66.</p>
<p>McCollum R, Gomez W, Theobald S, Taegtmeyer M. How equitable are community health worker programmes and which programme features influence equity of community health worker services? A systematic review. BMC public health. 2016;16(1):419.</p>
<p>McCulloch P, Rathbone J, Catchpole K. Interventions to improve teamwork and communications among healthcare staff. The British journal of surgery. 2011;98(4):469-79.</p>
<p>McGrady ME, Ryan JL, Gutiérrez-Colina AM, Fredericks EM, Towner EK, Pai AL. The impact of effective paediatric adherence promotion interventions: systematic review and meta-analysis. Child: care, health and development. 2015;41(6):789-802.</p>
<p>McMillan SS, Kendall E, Sav A, King MA, Whitty JA, Kelly F, et al. Patient-centered approaches to health care: a systematic review of randomized controlled trials. Medical care research and review : MCRR. 2013;70(6):567-96.</p>
<p>Mijovic H, McKnight J, English M. What does the literature tell us about health workers' experiences of task-shifting projects in sub-Saharan Africa? A systematic, qualitative review. Journal of clinical nursing. 2016;25(15-16):2083-100.</p>
<p>Montagu D, Goodman C, Berman P, Penn A, Visconti A. Recent trends in working with the private sector to improve basic healthcare: a review of evidence and interventions. Health policy and planning. 2016;31(8):1117-32.</p>
<p>Musa BM, Iliyasu Z, Yusuf SM, Uloko AE. Systematic review and metanalysis on community based interventions in tuberculosis care in developing countries. Nigerian journal of medicine: journal of the National Association of Resident Doctors of Nigeria. 2014;23(2):103-17.</p>
<p>Mwai GW, Mburu G, Torpey K, Frost P, Ford N, Seeley J. Role and outcomes of community health workers in HIV care in sub-Saharan Africa: a systematic review. Journal of the International AIDS Society. 2013;16(1):18586.</p>
<p>Nazar H, Nazar Z, Portlock J, Todd A, Slight SP. A systematic review of the role of community pharmacies in improving the transition from secondary to primary care. British journal of clinical pharmacology. 2015;80(5):936-48.</p>
<p>Nguyen DT, Leung KK, McIntyre L, Ghali WA, Sauve R. Does integrated management of childhood illness (IMCI) training improve the skills of health workers? A systematic review and meta-analysis. PloS one. 2013;8(6):e66030.</p>
<p>Nijmeijer KJ, Fabbricotti IN, Huijsman R. Is franchising in health care valuable? A systematic review. Health policy and planning. 2014;29(2):164-76.</p>
<p>Nilsson C, Lundgren I, Smith V, Vehvilainen-Julkunen K, Nicoletti J, Devane D, et al. Women-centred interventions to increase vaginal birth after caesarean section (VBAC): A systematic review. Midwifery. 2015;31(7):657-63.</p>
<p>Ofek Shlomai N, Rao S, Patole S. Efficacy of interventions to improve hand hygiene compliance in neonatal units: a systematic review and meta-analysis. European journal of clinical microbiology & infectious diseases : official publication of the European Society of Clinical Microbiology. 2015;34:887-97.</p>
<p>Ogbechie OA, Hsu J. Systematic review of benefit designs with differential cost sharing for prescription drugs. The American journal of managed care. 2015;21(5):e338-48.</p>
<p>Olisemeke B, Chen YF, Hemming K, Girling A. The Effectiveness of Service Delivery Initiatives at Improving Patients' Waiting Times in Clinical Radiology Departments: A Systematic Review. Journal of digital imaging. 2014;27(6):751-78.</p>
<p>Owusu-Addo E, Cross R. The impact of conditional cash transfers on child health in low- and middle-income countries: a systematic review. International journal of public health. 2014;59(4):609-18.</p>
<p>Pallas SW, Minhas D, Pérez-Escamilla R, Taylor L, Curry L, Bradley EH. Community Health Workers in Low- and Middle-Income Countries: What Do We Know About Scaling Up and Sustainability? American journal of public health. 2013;103(7):e74-82.</p>
<p>Patel J, Ahmed K, Guru KA, Khan F, Marsh H, Shamim Khan M, et al. An overview of the use and implementation of checklists in surgical specialities - a systematic review. International journal of surgery (London, England). 2014;12(12):1317-23.</p>
<p>Rashidian A, Omidvari AH, Vali Y, Mortaz S, Yousefi-Nooraie R, Jafari M, et al. The effectiveness of regionalization of perinatal care services--a systematic review. Public health. 2014;128(10):872-85.</p>
<p>Robinson DJ. An integrative review: triage protocols and the effect on ED length of stay. Journal of emergency nursing: JEN : official publication of the Emergency Department Nurses Association. 2013;39(4):398-408.</p>
<p>Roque MD, Herdeiro MT, Soares SI, Teixeira Rodrigues A, Granadeiro LA, Gusman AF. Educational interventions to improve prescription and dispensing of antibiotics: a systematic review. BMC public health. 2014;14(1):1276.</p>
<p>Ruizendaal E, Dierickx S, Peeters Grietens K, Schallig HD, Pagnoni F, Mens PF. Success or failure of critical steps in community case management of malaria with rapid diagnostic tests: a systematic review. Malaria journal. 2014;13(1):229.</p>
<p>Russ S, Rout S, Sevdalis N, Moorthy K, Darzi A, Vincent C. Do safety checklists improve teamwork and communication in the operating room? A systematic review. Annals of surgery. 2013;258(6):856-71.</p>
<p>Ruth Lv, Francke AL, Mistiaen P. Effects of nurse prescribing of medication: a systematic review. The Internet Journal of Healthcare Administration. 2008;5(2).</p>
<p>Sacks GD, Shannon EM, Dawes AJ, Rollo JC, Nguyen DK, Russell MM, et al. Teamwork, communication and safety climate: a systematic review of interventions to improve surgical culture. BMJ quality & safety. 2015;24(7):458-67.</p>
<p>Santschi V, Chiolero A, Colosimo AL, Platt RW, Taffé P, Burnier M, et al. Improving blood pressure control through pharmacist interventions: a meta-analysis of randomized controlled trials. Journal of the American Heart Association. 2014;3(2):e000718.</p>
<p>Schepman S, Hansen J, de Putter ID, Batenburg RS, de Bakker DH. The common characteristics and outcomes of multidisciplinary collaboration in primary health care: a systematic literature review. International journal of integrated care. 2015;15:e027.</p>
<p>Schmutz J, Manser T. Do team processes really have an effect on clinical performance? A systematic literature review. British journal of anaesthesia. 2013;110(4):529-44.</p>
<p>Schweizer ML, Reisinger HS, Ohl M, Formanek MB, Blevins A, Ward MA, et al. Searching for an optimal hand hygiene bundle: a meta-analysis. Clinical infectious diseases : an official publication of the Infectious Diseases Society of America. 2014;58(2):248-59.</p>
<p>Suwannakeeree W, Picheansathian W. Strategies to Promote Adherence to Treatment by Pulmonary Tuberculosis Patients: A systematic review. JBI Database of Systematic Reviews and Implementation Reports. 2012;10(11):615.</p>
<p>Sweeney S, Obure CD, Maier CB, Greener R, Dehne K, Vassall A. Costs and efficiency of integrating HIV/AIDS services with other health services: a systematic review of evidence and experience. Sexually transmitted infections. 2012;88(2):85-99.</p>
<p>Thakkar J, Kurup R, Laba TL, Santo K, Thiagalingam A, Rodgers A, et al. Mobile Telephone Text Messaging for Medication Adherence in Chronic Disease: A Meta-analysis. JAMA internal medicine. 2016;176(3):340-9.</p>
<p>Trehan A, Maruthappu M, Barnett-Vanes A, Carty M, McCulloch P. Does feedback of surgical outcome data improve surgical performance? A systematic review. Journal of the American College of Surgeons. 2014;219(4):e148.</p>
<p>Tripathi A, Kabra SK, Sachdev HP, Lodha R. Home visits by community health workers to improve identification of serious illness and care seeking in newborns and young infants from low- and middle-income countries. Journal of perinatology : official journal of the California Perinatal Association. 2016;36 Suppl 1(S1):S74-82.</p>
<p>Tshiananga JK, Kocher S, Weber C, Erny-Albrecht K, Berndt K, Neeser K. The effect of nurse-led diabetes self-management education on glycosylated hemoglobin and cardiovascular risk factors: a meta-analysis. The Diabetes educator. 2011;38(1):108-23.</p>
<p>Tsiachristas A, Wallenburg I, Bond CM, Elliot RF, Busse R, van Exel J, et al. Costs and effects of new professional roles: Evidence from a literature review. Health policy (Amsterdam, Netherlands). 2015;119(9):1176-87.</p>
<p>Turcotte-Tremblay AM, Spagnolo J, De Allegri M, Ridde V. Does performance-based financing increase value for money in low- and middle- income countries? A systematic review. Health economics review. 2015;6(1):30.</p>
<p>Uyei J, Coetzee D, Macinko J, Guttmacher S. Integrated delivery of HIV and tuberculosis services in Sub-Saharan Africa: A systematic review. International Initiative for Impact Evaluation (3ie). 2011.</p>
<p>Van Camp YP, Van Rompaey B, Elseviers MM. Nurse-led interventions to enhance adherence to chronic medication: systematic review and meta-analysis of randomised controlled trials. European journal of clinical pharmacology. 2013;69(4):761-70.</p>
<p>van Velthoven MHMMT, Tudor Car L, Gentry S, Car J. Telephone delivered interventions for preventing HIV infection in HIV-negative persons. Cochrane Database of Systematic Reviews. 2013;5(5):CD009190.</p>
<p>Wagner B, Filice GA, Drekonja D, Greer N, MacDonald R, Rutks I, et al. Antimicrobial stewardship programs in inpatient hospital settings: a systematic review. Infection control and hospital epidemiology : the official journal of the Society of Hospital Epidemiologists of America. 2014;35(10):1209-28.</p>
<p>Wald DS, Butt S, Bestwick JP. One-way versus two-way text messaging on improving medication adherence: meta-analysis of randomized trials. The American journal of medicine. 2015;128(10):1139.e1-5.</p>
<p>Wallace AS, Ryman TK, Dietz V. Experiences integrating delivery of maternal and child health services with childhood immunization programs: systematic review update. The Journal of infectious diseases. 2012;205 Suppl 1:S6-19.</p>
<p>Wallace J, Byrne C, Clarke M. Improving the uptake of systematic reviews: a systematic review of intervention effectiveness and relevance. BMJ open. 2014;4(10):e005834.</p>
<p>Watson SJ, Aldus CF, Bond C, Bhattacharya D. Systematic review of the health and societal effects of medication organisation devices. BMC health services research. 2016;16(1):202.</p>
<p>Wilcher R, Hoke T, Adamchak SE, Cates W. Integration of family planning into HIV services: a synthesis of recent evidence. AIDS (London, England). 2013;27 Suppl 1:S65-75.</p>
<p>World Health Organization, University of California SF. Electronic reminders for promoting adherence to ART among people living with HIV. World Health Organization. 2013.</p>
<p>World Health Organziation, University of California SF. Integration of HIV and TB services. World Health Organization. 2013.</p>
<p>Yamada J, Shorkey A, Barwick M, Widger K, Stevens BJ. The effectiveness of toolkits as knowledge translation strategies for integrating evidence into clinical care: a systematic review. BMJ open. 2015;5(4):e006808.</p>
<p>Zulu JM, Kinsman J, Michelo C, Hurtig AK. Integrating national community-based health worker programmes into health systems: a systematic review identifying lessons learned from low-and middle-income countries. BMC public health. 2014;14(1):987.</p>
</sec>
<sec id="CD011086-sec2-0019">
<title>Appendix 6. Summary of findings for interventions targeted at healthcare workers by type of intervention
<sup>a</sup>
</title>
<table-wrap id="d35e17724" position="float">
<table frame="border" rules="groups">
<tbody>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Intervention</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>Definition</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>Effect on practice</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>Costs</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>Pros</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>Cons</bold>
</th>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Printed educational materials (PEMs) (
<xref rid="b10" ref-type="bibr">Giguère 2012</xref>
)</td>
<td align="left" rowspan="1" colspan="1">Distribution of printed recommendations for clinical care, including clinical practice guidelines. The materials can be delivered personally or through mass mailings</td>
<td align="left" rowspan="1" colspan="1">Printed educational materials may slightly improve practice.
<break></break>
Absolute risk difference across various outcomes: 0.02 higher (range from −0.06 to 0.29). (ARD = 0.02 indicates an absolute improvement in adherence to the targeted behaviours of 2%)
<break></break>
Standardised mean difference across various outcomes: 0.13 higher (range from −0.16 to 1.96).</td>
<td align="left" rowspan="1" colspan="1">The costs of producing and distributing PEMs is likely to be highly variable and should be estimated in the context in which these interventions are being considered.</td>
<td align="left" rowspan="1" colspan="1">Printed educational materials provide familiar, accessible and convenient strategy to distribute evidence and recommendations for clinical care.</td>
<td align="left" rowspan="1" colspan="1">In low-income countries (LICs) where health systems are weaker it may be difficult to obtain resources to produce up-to-date PEMs, and ensure that PEMs reach the appropriate providers in a timely way.
<break></break>
"Printed educational materials frequently lead to small or no improvement in professional practice."</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Internet-based learning or computerised educational materials (
<xref rid="b5" ref-type="bibr">Cook 2008</xref>
)</td>
<td align="left" rowspan="1" colspan="1">Distribution of electronic recommendations for clinical care, including clinical practice guidelines. The materials are usually delivered through mass mailings and/or published on web pages</td>
<td align="left" rowspan="1" colspan="1">Internet-based learning compared to no intervention may improve health worker knowledge, skills and behaviours.
<break></break>
Knowledge (SMD 1.00, 95% CI 0.90 to 1.10);
<break></break>
Skills (SMD 0.85, 95% CI 0.49 to 1.20);
<break></break>
Behaviour (SMD 0.82, 95% CI 0.63 to 1.02).
<break></break>
Internet-based learning compared to alternative instructional media, including face-to-face teaching and learning may slightly improve knowledge, but has little or no effect on satisfaction, skills and behaviour.
<break></break>
Satisfaction (SMD 0.10, 95% CI −0.12 to 0.32);
<break></break>
Knowledge (SMD 0.12, 95% CI 0.003 to 0.24);
<break></break>
Behaviour and effects on patient care (SMD 0.51, 95% CI −0.24 to 1.25)</td>
<td align="left" rowspan="1" colspan="1">The costs of Internet-based learning (e.g. reliable information technology infrastructure) may be high, limiting scale-up and sustainability in low-income countries.</td>
<td align="left" rowspan="1" colspan="1">Internet-based learning permits learners to participate at a time and place convenient to them, facilitates innovation in instructional methods, and potentially allows instruction to be tailored to the individual's needs.
<break></break>
Internet learning might reduce inequities when face-to-face learning is not an option for disadvantaged health professions and they have access to Internet-based learning resources.</td>
<td align="left" rowspan="1" colspan="1">Internet learning requires advanced information technology and knowledge which may be lacking in low-income settings.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Educational meetings (
<xref rid="b9" ref-type="bibr">Forsetlund 2009</xref>
)</td>
<td align="left" rowspan="1" colspan="1">Lectures, workshops and courses</td>
<td align="left" rowspan="1" colspan="1">Educational meetings probably improve professional practice (median absolute improvement 6%, IQR 1.8% to 15.9%).</td>
<td align="left" rowspan="1" colspan="1">The cost of educational meetings is likely to be highly variable and must be estimated based on specific local conditions.</td>
<td align="left" rowspan="1" colspan="1">Integration of educational meetings in other quality improvement interventions (e.g. audit and feedback, educational outreach) may improve efficiency in resource use, cost savings and patient care.
<break></break>
A mix of interactive small group work and didactic presentations may be more effective (compared to either alone).</td>
<td align="left" rowspan="1" colspan="1">Resources needed for educational meetings may be less available in disadvantaged settings. Thus, additional resources may be needed to deliver effective educational meetings in disadvantaged settings to reduce inequities.
<break></break>
Educational meetings may be less effective with lower attendance.
<break></break>
Educational meetings may not be effective for complex behaviours.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Educational outreach (
<xref rid="b24" ref-type="bibr">O'Brien 2007</xref>
)</td>
<td align="left" rowspan="1" colspan="1">Personal visits by a trained person to healthcare workers in their own setting in order to provide information with the intent of improving practice. The information provided may include feedback about health worker performance.</td>
<td align="left" rowspan="1" colspan="1">Educational outreach improves appropriate prescribing and probably improves other types of practice.
<break></break>
Appropriate prescribing: median improvement 4.8% (IQR 3.0% to 6.5%);
<break></break>
Non-prescribing practices: median improvement 6.0%
<break></break>
(IQR 3.6% to 16.0%).</td>
<td align="left" rowspan="1" colspan="1">The cost of educational outreach visits may limit scale-up, although at least 1 study in a low-resource setting in South Africa found that educational outreach visits for improving the quality of asthma care would be worthwhile and affordable.</td>
<td align="left" rowspan="1" colspan="1">It might be possible to reach professionals who would not attend educational meetings.</td>
<td align="left" rowspan="1" colspan="1">Educational outreach might be more challenging to organise than educational meetings.
<break></break>
Educational outreach visits may require additional resources to provide clinical and managerial support.
<break></break>
Some co-interventions such as feedback about healthcare professionals' performance or reminders might require information systems that are not available in low-resource settings.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Educational outreach - practice facilitation (
<xref rid="b3" ref-type="bibr">Baskerville 2012</xref>
)</td>
<td align="left" rowspan="1" colspan="1">Personal visits by a trained person to healthcare workers in their own setting in order to provide information with the intent of improving practice. The information provided may include feedback about health worker performance.</td>
<td align="left" rowspan="1" colspan="1">Practice facilitation probably improves the adoption of evidence-based guidelines.
<break></break>
<bold>Moderate adherence
<sup>b</sup>
</bold>
: Difference: 21 more patients receiving recommended practice per 100 patient encounters (Margin of error: 17 to 24 more).
<break></break>
<bold>Low adherence
<sup>c</sup>
</bold>
:
<break></break>
Difference: 21 more patients receiving recommended practice per 100 patient encounters (Margin of error: 15 to 26 more)</td>
<td align="left" rowspan="1" colspan="1">The cost of practice facilitation is likely to be highly variable and must be estimated based on specific local conditions.</td>
<td align="left" rowspan="1" colspan="1">Poor adherence to evidence-based guidelines often impacts more on disadvantaged populations. Practice facilitation as a strategy to improve evidence-based guideline adoption could help these populations achieve the benefits of better quality service.</td>
<td align="left" rowspan="1" colspan="1">Practice facilitation might be difficult to implement in low-resource settings, particularly the audit and feedback component, and it might be more difficult to make necessary organisational changes such as implementation of quality improvement tools.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Educational outreach - Pharmacist provided services (
<xref rid="b28" ref-type="bibr">Pande 2013</xref>
)</td>
<td align="left" rowspan="1" colspan="1">Personal visits by a trained person to healthcare workers in their own setting in order to provide information with the intent of improving practice. The information provided may include feedback about health worker performance.</td>
<td align="left" rowspan="1" colspan="1">Provision of additional services by pharmacists and targeted at health professionals (such as educational outreach visits) can probably improve patient outcomes
<break></break>
Effects on healthcare cost were uncertain (no studies were found)</td>
<td align="left" rowspan="1" colspan="1">Pharmacist-provided outreach services are likely to be expensive (e.g. high cost of training pharmacists)</td>
<td align="left" rowspan="1" colspan="1">Expanding the role of pharmacists could reduce inequalities if, for example, help from pharmacists is available when access to other healthcare professionals is limited</td>
<td align="left" rowspan="1" colspan="1">Expanding the role of pharmacists is dependent on having a workforce able to supply sufficient numbers of competent pharmacists, pharmacy technicians or assistants
<break></break>
Regulatory frameworks are needed to allow pharmacists to extend their activities beyond their traditional professional responsibilities
<break></break>
There may be too few pharmacists in low-income countries and who may lack sufficient training or support to assume additional roles and responsibilities</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Local opinion leaders (
<xref rid="b8" ref-type="bibr">Flodgren 2011</xref>
)</td>
<td align="left" rowspan="1" colspan="1">The identification and use of local opinion leaders to promote implementation of guidelines.</td>
<td align="left" rowspan="1" colspan="1">Local opinion leaders probably improve healthcare workers compliance with desired practice (median improvement 12%, IQR 6% to 14.5%).</td>
<td align="left" rowspan="1" colspan="1">Effective implementation of opinion leaders may be expensive due to high costs associated with supplementary interventions required for implementation (e.g. reminders, audit and feedback).</td>
<td align="left" rowspan="1" colspan="1">Use of opinion leaders may improve implementation of clinical guidelines as they are perceived by their peers as credible and trustworthy.</td>
<td align="left" rowspan="1" colspan="1">In most included studies opinion leaders were supplemented by other interventions such as reminders, faxed evidence summaries, and audit and feedback which rely on technologies that may not always be available in low-income settings.
<break></break>
Implementation of opinion leader interventions in low-income settings, utilising such inaccessible technologies, may exacerbate health inequities or fail to address them adequately.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Audit and feedback (
<xref rid="b15" ref-type="bibr">Ivers 2012</xref>
)</td>
<td align="left" rowspan="1" colspan="1">A summary of healthcare workers' performance over a specified period of time given to them in written, electronic or verbal format.</td>
<td align="left" rowspan="1" colspan="1">Audit and feedback probably improves slightly professional practice:
<break></break>
Median absolute increase in desired practice (dichotomous outcomes): 4.3% (IQR 0.5% to 16.0%)
<break></break>
Median percentage increase in desired practice (continuous outcomes): 1.3% (IQR 1.3% to 28.9%)</td>
<td align="left" rowspan="1" colspan="1">The cost of audit and feedback is likely to be highly variable and must be estimated based on specific local conditions, including the availability of reliable routinely collected data and personnel costs.</td>
<td align="left" rowspan="1" colspan="1">Audit and feedback may be more effective when baseline performance is low, when the source is a supervisor or senior colleague, when it is provided more than once, when it is provided both verbally and written, and when it includes both measurable targets and an action plan.</td>
<td align="left" rowspan="1" colspan="1">The feasibility of using audit and feedback may be limited by the scarcity of health professionals, availability of reliable data, the costs of collecting data, or low staff morale and a lack of motivation among health professionals.
<break></break>
Resources needed for audit and feedback may be less easily available in disadvantaged populations.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Reminders (
<xref rid="b19" ref-type="bibr">Ko 2011</xref>
)</td>
<td align="left" rowspan="1" colspan="1">Manual or computerised interventions that prompt healthcare workers to perform some action.</td>
<td align="left" rowspan="1" colspan="1">Surgical safety checklists may reduce death rates and major complications within 30 days after surgery.
<break></break>
It was uncertain whether safety checklists improve adherence to guidelines or patient safety in intensive care units, emergency departments or acute care settings</td>
<td align="left" rowspan="1" colspan="1">There may be some additional costs involved in training and educating staff on how to use checklists, as well as the time taken to use checklists.</td>
<td align="left" rowspan="1" colspan="1">The benefit/cost ratio of checklists may be high where health provider compliance is adequate.</td>
<td align="left" rowspan="1" colspan="1">It is possible that resource levels, staff workloads, staff training and other factors could influence the effectiveness of patient safety checklists, and that they might be less effective in disadvantaged settings.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Tailored interventions (
<xref rid="b2" ref-type="bibr">Baker 2015</xref>
)</td>
<td align="left" rowspan="1" colspan="1">Interventions to change practice that are selected based on an assessment of barriers to change.</td>
<td align="left" rowspan="1" colspan="1">Tailored interventions probably improve adherence to guideline recommendations
<sup>d</sup>
</td>
<td align="left" rowspan="1" colspan="1">Low-cost methods can be used to tailor interventions, but some interventions to address identified barriers may be costly, limiting their use in low-income countries</td>
<td align="left" rowspan="1" colspan="1">It is logical to tailor interventions to address barriers to change.</td>
<td align="left" rowspan="1" colspan="1">Little is known about how best to identify barriers to improving practice and how to tailor interventions to address these barriers.</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn>
<p>
<bold>ARD</bold>
: absolute risk difference;
<bold>CI</bold>
: confidence interval;
<bold>IQR</bold>
: interquartile range;
<bold>LIC</bold>
: low-income country;
<bold>LMIC</bold>
: low- and middle-income countries;
<bold>RR</bold>
: risk ratio;
<bold>SMD</bold>
: standardised mean difference.</p>
</fn>
<fn>
<p>
<sup>a</sup>
The effects of implementation strategies on patient outcomes are smaller than the effects on professional practice. This is because both implementation strategies and clinical interventions typically have moderate effects (improvements in practice), and the effect of implementation strategies on patient outcomes is the product of the effect on practice × the effect of that practice on patient outcomes. For example, consider an implementation strategy that improved practice by 10% (i.e. 10 more health professionals per 100 delivered an effective clinical intervention). That effect is larger than the median effect for most implementation strategies. Now assume that the clinical intervention improved patient outcomes by 10% (i.e. for every 10 patients treated, 1 additional patient benefited; a number needed to treat of 10). That is more effective than many, if not most, clinical interventions at which implementation strategies are targeted. The effect of the implementation strategy on patient outcomes then would be 10% x 10%, or 1 more patient per 100 in the intervention group having a desirable outcome compared to patients in the control group. Because of this, we have focused in this table on effects on practice rather than effects on patient outcomes. Improvements in practice are surrogates for improvements in patient outcomes. However, provided the certainty of the evidence for a clinical intervention being implemented is high, it is reasonable to assume that appropriate implementation of a recommendation to use that intervention will result in improved patient outcomes, albeit the improvements in patient outcomes will be smaller than the improvements in practice.</p>
</fn>
<fn>
<p>
<sup>b</sup>
Moderate adherence was assumed at 60% of desired practice.</p>
</fn>
<fn>
<p>
<sup>c</sup>
Low adherence was assumed at 20% of desired practice.</p>
</fn>
<fn>
<p>
<sup>d</sup>
The odds ratio ranged from 1.08 to 12.25. The combined (average) odds ratio for 12 of the studies was 1.54 (95% CI 1.16 to 2.01), in favour of tailored interventions. In a situation where adherence with recommended practice was initially 60% this would correspond to an improvement to 70%. In a situation where adherence was initially 20% this would correspond to an improvement to 28%.</p>
</fn>
</table-wrap-foot>
</table-wrap>
</sec>
<sec id="CD011086-sec2-0020">
<title>Appendix 7. Summary of findings for interventions targeted at healthcare workers by type of problem
<sup>a</sup>
</title>
<table-wrap id="d35e18029" position="float">
<table frame="border" rules="groups">
<tbody>
<tr>
<th align="left" rowspan="1" colspan="1">
<bold>Intervention</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>Definition</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>Effect on practice</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>Costs</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>Pros</bold>
</th>
<th align="left" rowspan="1" colspan="1">
<bold>Cons</bold>
</th>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Communication with patients</td>
<td align="left" rowspan="1" colspan="1">Interventions that aim to promote patient-centred care (PCC) in clinical consultations (
<xref rid="b6" ref-type="bibr">Dwamena 2012</xref>
)</td>
<td align="left" rowspan="1" colspan="1">Patient-centred training probably improves the patient-provider consultation process (provider consultation skills and behaviour): SMD 0.7, 95% CI 0.57 to 0.82.</td>
<td align="left" rowspan="1" colspan="1">The cost of promoting patient-centred care is likely to be highly variable and must be estimated based on specific local conditions outside of research settings.</td>
<td align="left" rowspan="1" colspan="1">If interventions to promote patient centred care result in improved healthcare behaviours and outcomes, such as improved adherence to treatment, then these programmes may result in cost savings.</td>
<td align="left" rowspan="1" colspan="1">Human resource constraints in some health systems and low motivation to deliver patient-centred care, may limit the feasibility and potential of this approach for improving professional practice and health outcomes.
<break></break>
The additional resources needed to provide patient-centred training and materials for providers and patients may be less easily available in disadvantaged settings, particularly where absolute access to providers is poor. Low literacy levels in some settings may also limit the applicability of written materials for patients.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Handwashing</td>
<td align="left" rowspan="1" colspan="1">Single or multifaceted intervention intended to improve compliance with hand hygiene (
<xref rid="b11" ref-type="bibr">Gould 2010</xref>
)</td>
<td align="left" rowspan="1" colspan="1">Educational interventions may increase hand hygiene compliance: 65% (25% to 120%) increase in hand hygiene compliance before patient contact, and 29% (6% to 56%) increase after patient contact.
<break></break>
Multifaceted marketing campaigns may increase the use of hand hygiene products (range of increase 48% to 56%).</td>
<td align="left" rowspan="1" colspan="1">The costs of most interventions are likely to be low except in instances in which washing facilities do not exist and need to be provided.
<break></break>
The provision of hand hygiene facilities may not be expensive if locally sustainable solutions (such as the use of rainwater) are implemented.</td>
<td align="left" rowspan="1" colspan="1">Healthcare units can create their own low-cost interventions using the formula for alcohol-based products.</td>
<td align="left" rowspan="1" colspan="1">Variable availability of functioning washing facilities or alcohol-based products for health-care workers could limit the applicability of the results in LICs.</td>
</tr>
<tr>
<td align="left" rowspan="4" colspan="1">Obstetric care</td>
<td align="left" rowspan="1" colspan="1">Non-clinical interventions to reduce unnecessary cesarean section rates (nurse led relaxation, birth preparation classes for mothers, implementation of guidelines with mandatory second opinion and with support from local opinion leaders, and audit and feedback given to individual care providers) (
<xref rid="b18" ref-type="bibr">Khunpradit 2011</xref>
)</td>
<td align="left" rowspan="1" colspan="1">Non-clinical interventions may decrease caesarean section rates.
<break></break>
The effect of prenatal education and support programmes, computer patient decision aids, decision-aid booklets and intensive group therapy on caesarean section rates is uncertain.</td>
<td align="left" rowspan="1" colspan="1">Given that some interventions will involve changes in the guidelines such as having mandatory secondary opinion, training healthcare professionals this might result into considerable cost implications. Hence costs and potentials benefits need to be considered before adapting the intervention.</td>
<td align="left" rowspan="1" colspan="1">Interventions such as nurse led relaxation and birth preparation classes for mothers can be integrated in the existing mother to child health clinics.</td>
<td align="left" rowspan="1" colspan="1">Scarcity of health professionals may limit the feasibility and potential of interventions to reduce unnecessary caesarean sections in LICs (e.g. mandatory second opinion, birth preparation classes for mothers).</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Training traditional birth attendants (TBAs) (
<xref rid="b33" ref-type="bibr">Sibley 2012</xref>
)</td>
<td align="left" rowspan="1" colspan="1">Training of TBAs may increase referral of pregnant women with obstetric complication (RR 1.45 (1.17 to 1.19).</td>
<td align="left" rowspan="1" colspan="1">In general, TBA training may be associated with high costs (e.g. requirement for suitably trained facilitators and locally adapted training materials).</td>
<td align="left" rowspan="1" colspan="1">TBAs are found widely in low- and middle-income countries, and it is estimated that they may assist at up to 25% of all births in these settings.
<break></break>
TBA training may have potential to reduce inequalities in health experienced by disadvantaged populations through facilitating timely referral of pregnant women where improved health services are available. However, further evidence on these impacts is required.</td>
<td align="left" rowspan="1" colspan="1">TBA training may limit promotion of health facility deliveries.
<break></break>
Implementation of TBA training requires an existing network of TBAs that can be targeted for further training and provided with support and acceptance of non-professional providers within the formal health system.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Skilled birth attendance and emergency obstetric care (
<xref rid="b39" ref-type="bibr">Yakoob 2011</xref>
)</td>
<td align="left" rowspan="1" colspan="1">Professional practice outcomes not reported.
<break></break>
Skilled birth attendance may reduce stillbirths (by 23%, 95% CI 15 to 31) and perinatal mortality (by 12%, 95% CI 5 to 18).</td>
<td align="left" rowspan="1" colspan="1">Scaling up skilled birth attendance and access to emergency obstetric care will require considerable resources, particularly in more rural settings. However, the benefits of this may be substantial.</td>
<td align="left" rowspan="1" colspan="1">The beneficial effects of interventions are expected to be larger for underserved populations, therefore reducing inequalities.</td>
<td align="left" rowspan="1" colspan="1">Good access to these services are needed to optimise their benefits.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Are birth kits a good idea? A systematic review of the evidence (
<xref rid="b14" ref-type="bibr">Hundley 2012</xref>
)</td>
<td align="left" rowspan="1" colspan="1">Professional practice outcomes not reported.
<break></break>
The use of birth kits (alongside with education or topical antimicrobial) compared with no intervention: reduces neonatal tetanus related mortality, neonatal tetanus related mortality; probably reduces neonatal mortality rate, maternal mortality, haemorrhage; and may reduce neonatal sepsis.</td>
<td align="left" rowspan="1" colspan="1">Scaling up birth kits introduction will require resources that should to be considered. The cost of items purchased separately, could be higher than as a kit. Re-use of items could reduce costs</td>
<td align="left" rowspan="1" colspan="1">Birth kits may decrease inequity; however, resources needed for birth kits introduction may be less available in even more disadvantaged settings.</td>
<td align="left" rowspan="1" colspan="1">The availability acceptability and costs of the birth kits could limit feasibility among disadvantaged populations.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Prescribing antibiotics (
<xref rid="b31" ref-type="bibr">Ranji 2008</xref>
)</td>
<td align="left" rowspan="1" colspan="1">Interventions to improve antibiotic prescribing in ambulatory settings – clinician education (e.g. educational meetings, audit and feedback)</td>
<td align="left" rowspan="1" colspan="1">Clinician education may reduce the number of patient visits at which an antibiotic is prescribed (by 9%, 95% CI 8.2 to 13).
<break></break>
It is uncertain if clinician educational interventions improve the percentage of patients treated with adequate antibiotics.</td>
<td align="left" rowspan="1" colspan="1">The costs of some interventions to promote appropriate antibiotic prescribing may be high, limiting feasibility in low-income countries (e.g. educational meetings, audit and feedback).</td>
<td align="left" rowspan="1" colspan="1">These interventions could save costs arising from unnecessary medication and treatment of drug resistant strains of bacteria.</td>
<td align="left" rowspan="1" colspan="1">Scarcity of resources (health workers, educational materials) may limit feasibility of interventions to improve appropriate antibiotic prescribing.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Seriously ill newborn care (
<xref rid="b25" ref-type="bibr">Opiyo 2015</xref>
)</td>
<td align="left" rowspan="1" colspan="1">In-service training of health professionals</td>
<td align="left" rowspan="1" colspan="1">In-service neonatal emergency care training probably improves professional practices:
<break></break>
Proportion of adequate initial resuscitation: difference 39 more adequate steps per 100 initial resuscitation steps (95% CI 21 to 66 more)
<break></break>
Inappropriate and potentially harmful practices per resuscitation: mean difference 0.4 (95% CI 0.13 to 0.66)
<break></break>
Preparedness for resuscitation: mean percentage improvement 8.83% (95% CI 6.41 to 11.25)</td>
<td align="left" rowspan="1" colspan="1">In general, in-service training is associated with considerable financial costs and may potentially disrupt the standard functioning of healthcare services.</td>
<td align="left" rowspan="1" colspan="1">In-service training may result in improvements in quality of care and may be worthwhile if provided at a low cost.</td>
<td align="left" rowspan="1" colspan="1">It is possible that courses are offered predominantly to staff in large, central healthcare facilities. These facilities tend to be relatively better equipped and often benefit the better-off disproportionately. This could therefore negatively affect the poor who often live in rural areas or are unable to access such healthcare facilities due to prohibitive fees.
<break></break>
Feasibility of in-service training in low-income settings may be limited by the need to have adequately skilled instructors and appropriate, locally adapted training materials.</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Quality of care for sexually transmitted diseases (STDs) and HIV (
<xref rid="b36" ref-type="bibr">Sorsdahl 2009</xref>
)</td>
<td align="left" rowspan="1" colspan="1">Educating traditional healers about STDs and HIV</td>
<td align="left" rowspan="1" colspan="1">Training of traditional healers may increase patient management practices, knowledge of STDs and HIV (signs and symptoms, prevention) and referral practice.
<break></break>
Training may lead to little or no difference in the incidence of HIV/AIDS risk behaviour and traditional healers' self-reported referral practices.</td>
<td align="left" rowspan="1" colspan="1">Training is generally expensive (remuneration for trainers and facilitators, per diems, training materials).</td>
<td align="left" rowspan="1" colspan="1">Traditional healers are most common in traditional societies which tend to be rural and poor, and usually have poor access to other forms of healthcare. Improving the skills of traditional healers might therefore benefit these otherwise marginalised populations.</td>
<td align="left" rowspan="1" colspan="1">The nature of the practices employed by traditional healers and the degree to which healers are integrated into healthcare systems differs widely between societies.</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn>
<p>
<bold>CI</bold>
: confidence interval;
<bold>LIC</bold>
: low-income country;
<bold>RR</bold>
: risk ratio;
<bold>SMD</bold>
: standardised mean difference;
<bold>TBA</bold>
: traditional birth attendant.</p>
</fn>
<fn>
<p>
<sup>a</sup>
The effects of implementation strategies on patient outcomes are smaller than the effects on professional practice. This is because both implementation strategies and clinical interventions typically have moderate effects (improvements in practice) and the effect of implementation strategies on patient outcomes is the product of the effect on practice × the effect of that practice on patient outcomes. For example, consider an implementation strategy that improved practice by 10% (i.e. 10 more health professionals per 100 delivered an effective clinical intervention). That effect is larger than the median effect for most implementation strategies. Now assume that the clinical intervention improved patient outcomes by 10% (i.e. for every 10 patients treated 1 additional patient benefited; a number needed to treat of 10). That is more effective than many, if not most, clinical interventions at which implementation strategies are targeted. The effect of the implementation strategy on patient outcomes then would be 10% x 10%, or 1 more patient per 100 in the intervention group having a desirable outcome compared to patients in the control group. Because of this, we have focused in this table on effects on practice rather than effects on patient outcomes. Improvements in practice are surrogates for improvements in patient outcomes. However, provided the certainty of the evidence for a clinical intervention being implemented is high, it is reasonable to assume that appropriate implementation of a recommendation to use that intervention will result in improved patient outcomes, albeit the improvements in patient outcomes will be smaller than the improvements in practice.</p>
</fn>
</table-wrap-foot>
</table-wrap>
</sec>
</sec>
<sec>
<title>Contributions of authors</title>
<p>All of the authors contributed to drafting and revising the overview. All of the authors contributed important intellectual input to the overview.</p>
</sec>
<sec>
<title>Declarations of interest</title>
<p>Tomas Pantoja, Newton Opiyo, Simon Lewin, Elizabeth Paulsen, Cristian A Herrera, Gabriel Rada, and Andrew D Oxman are editors of the Cochrane Effective Practice and Organisation of Care (EPOC) Group. Newton Opiyo, Simon Lewin, Andrew D Oxman, and Charles S Wiysonge are authors on some of the included reviews. Agustín Ciapponi, Blanca Peñaloza, Lilian Dudley, Marie-Pierre Gagnon, and Sebastian Garcia Marti have no relevant conflicts to declare.</p>
</sec>
<sec>
<title>Sources of support</title>
<sec>
<title>Internal sources</title>
<p>
<list list-type="bullet">
<list-item>
<p>Department of Family Medicine, School of Medicine, Pontificia Universidad Católica de Chile, Santiago, Chile.</p>
</list-item>
<list-item>
<p>Institute for Clinical Effectiveness and Health Policy, Buenos Aires, Argentina.</p>
</list-item>
<list-item>
<p>Norwegian Knowledge Centre for the Health Services, Oslo, Norway.</p>
</list-item>
<list-item>
<p>University of Cape Town, Cape Town, South Africa.</p>
</list-item>
<list-item>
<p>South African Medical Research Council, South Africa.</p>
</list-item>
</list>
</p>
</sec>
<sec>
<title>External sources</title>
<p>
<list list-type="bullet">
<list-item>
<p>Norwegian Agency for Development Cooperation (Norad), Oslo, Norway.</p>
</list-item>
<list-item>
<p>The Effective Health Care Research Consortium which is funded by UK aid from the UK Government for the benefit of developing countries, UK.</p>
</list-item>
</list>
</p>
</sec>
</sec>
</back>
</pmc>
</record>

Pour manipuler ce document sous Unix (Dilib)

EXPLOR_STEP=$WICRI_ROOT/Wicri/Sante/explor/SidaSubSaharaV1/Data/Pmc/Corpus
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 002E13 | SxmlIndent | more

Ou

HfdSelect -h $EXPLOR_AREA/Data/Pmc/Corpus/biblio.hfd -nk 002E13 | SxmlIndent | more

Pour mettre un lien sur cette page dans le réseau Wicri

{{Explor lien
   |wiki=    Wicri/Sante
   |area=    SidaSubSaharaV1
   |flux=    Pmc
   |étape=   Corpus
   |type=    RBID
   |clé=     PMC:5621088
   |texte=   Implementation strategies for health systems in low-income countries: an overview of systematic reviews
}}

Pour générer des pages wiki

HfdIndexSelect -h $EXPLOR_AREA/Data/Pmc/Corpus/RBID.i   -Sk "pubmed:28895659" \
       | HfdSelect -Kh $EXPLOR_AREA/Data/Pmc/Corpus/biblio.hfd   \
       | NlmPubMed2Wicri -a SidaSubSaharaV1 

Wicri

This area was generated with Dilib version V0.6.32.
Data generation: Mon Nov 13 19:31:10 2017. Site generation: Wed Mar 6 19:14:32 2024