Links to Exploration step
Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">Guidelines of the International Federation of Red Cross and Red Crescent Societies: an overview and quality appraisal using AGREE II</title>
<author><name sortKey="Vande Veegaete, Axel" sort="Vande Veegaete, Axel" uniqKey="Vande Veegaete A" first="Axel" last="Vande Veegaete">Axel Vande Veegaete</name>
<affiliation><nlm:aff id="af1"><institution>Center for Evidence-Based Practice (CEBaP), Belgian Red Cross</institution>
,<addr-line>Mechelen</addr-line>
,<country>Belgium</country>
</nlm:aff>
</affiliation>
</author>
<author><name sortKey="Borra, Vere" sort="Borra, Vere" uniqKey="Borra V" first="Vere" last="Borra">Vere Borra</name>
<affiliation><nlm:aff id="af1"><institution>Center for Evidence-Based Practice (CEBaP), Belgian Red Cross</institution>
,<addr-line>Mechelen</addr-line>
,<country>Belgium</country>
</nlm:aff>
</affiliation>
</author>
<author><name sortKey="De Buck, Emmy" sort="De Buck, Emmy" uniqKey="De Buck E" first="Emmy" last="De Buck">Emmy De Buck</name>
<affiliation><nlm:aff id="af1"><institution>Center for Evidence-Based Practice (CEBaP), Belgian Red Cross</institution>
,<addr-line>Mechelen</addr-line>
,<country>Belgium</country>
</nlm:aff>
</affiliation>
<affiliation><nlm:aff id="af2"><addr-line>Faculty of Medicine, Department of Public Health and Primary Care</addr-line>
,<institution>KU Leuven</institution>
,<addr-line>Leuven</addr-line>
,<country>Belgium</country>
</nlm:aff>
</affiliation>
</author>
<author><name sortKey="Vandekerckhove, Philippe" sort="Vandekerckhove, Philippe" uniqKey="Vandekerckhove P" first="Philippe" last="Vandekerckhove">Philippe Vandekerckhove</name>
<affiliation><nlm:aff id="af2"><addr-line>Faculty of Medicine, Department of Public Health and Primary Care</addr-line>
,<institution>KU Leuven</institution>
,<addr-line>Leuven</addr-line>
,<country>Belgium</country>
</nlm:aff>
</affiliation>
<affiliation><nlm:aff id="af3"><addr-line>Belgian Red Cross-Flanders, Mechelen, Belgium</addr-line>
</nlm:aff>
</affiliation>
<affiliation><nlm:aff id="af4"><addr-line>Faculty of Medicine</addr-line>
,<institution>University of Ghent</institution>
,<addr-line>Ghent</addr-line>
,<country>Belgium</country>
</nlm:aff>
</affiliation>
</author>
</titleStmt>
<publicationStmt><idno type="wicri:source">PMC</idno>
<idno type="pmid">27678534</idno>
<idno type="pmc">5051453</idno>
<idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC5051453</idno>
<idno type="RBID">PMC:5051453</idno>
<idno type="doi">10.1136/bmjopen-2016-011744</idno>
<date when="2016">2016</date>
<idno type="wicri:Area/Pmc/Corpus">000326</idno>
</publicationStmt>
<sourceDesc><biblStruct><analytic><title xml:lang="en" level="a" type="main">Guidelines of the International Federation of Red Cross and Red Crescent Societies: an overview and quality appraisal using AGREE II</title>
<author><name sortKey="Vande Veegaete, Axel" sort="Vande Veegaete, Axel" uniqKey="Vande Veegaete A" first="Axel" last="Vande Veegaete">Axel Vande Veegaete</name>
<affiliation><nlm:aff id="af1"><institution>Center for Evidence-Based Practice (CEBaP), Belgian Red Cross</institution>
,<addr-line>Mechelen</addr-line>
,<country>Belgium</country>
</nlm:aff>
</affiliation>
</author>
<author><name sortKey="Borra, Vere" sort="Borra, Vere" uniqKey="Borra V" first="Vere" last="Borra">Vere Borra</name>
<affiliation><nlm:aff id="af1"><institution>Center for Evidence-Based Practice (CEBaP), Belgian Red Cross</institution>
,<addr-line>Mechelen</addr-line>
,<country>Belgium</country>
</nlm:aff>
</affiliation>
</author>
<author><name sortKey="De Buck, Emmy" sort="De Buck, Emmy" uniqKey="De Buck E" first="Emmy" last="De Buck">Emmy De Buck</name>
<affiliation><nlm:aff id="af1"><institution>Center for Evidence-Based Practice (CEBaP), Belgian Red Cross</institution>
,<addr-line>Mechelen</addr-line>
,<country>Belgium</country>
</nlm:aff>
</affiliation>
<affiliation><nlm:aff id="af2"><addr-line>Faculty of Medicine, Department of Public Health and Primary Care</addr-line>
,<institution>KU Leuven</institution>
,<addr-line>Leuven</addr-line>
,<country>Belgium</country>
</nlm:aff>
</affiliation>
</author>
<author><name sortKey="Vandekerckhove, Philippe" sort="Vandekerckhove, Philippe" uniqKey="Vandekerckhove P" first="Philippe" last="Vandekerckhove">Philippe Vandekerckhove</name>
<affiliation><nlm:aff id="af2"><addr-line>Faculty of Medicine, Department of Public Health and Primary Care</addr-line>
,<institution>KU Leuven</institution>
,<addr-line>Leuven</addr-line>
,<country>Belgium</country>
</nlm:aff>
</affiliation>
<affiliation><nlm:aff id="af3"><addr-line>Belgian Red Cross-Flanders, Mechelen, Belgium</addr-line>
</nlm:aff>
</affiliation>
<affiliation><nlm:aff id="af4"><addr-line>Faculty of Medicine</addr-line>
,<institution>University of Ghent</institution>
,<addr-line>Ghent</addr-line>
,<country>Belgium</country>
</nlm:aff>
</affiliation>
</author>
</analytic>
<series><title level="j">BMJ Open</title>
<idno type="eISSN">2044-6055</idno>
<imprint><date when="2016">2016</date>
</imprint>
</series>
</biblStruct>
</sourceDesc>
</fileDesc>
<profileDesc><textClass></textClass>
</profileDesc>
</teiHeader>
<front><div type="abstract" xml:lang="en"><sec><title>Objectives</title>
<p>To appraise the quality of guidelines developed by the International Federation of Red Cross and Red Crescent Societies (IFRC) between 2001 and 2015.</p>
</sec>
<sec><title>Study design</title>
<p>Cross-sectional.</p>
</sec>
<sec><title>Methods</title>
<p>2 authors independently assessed the quality of IFRC guidelines using the Appraisal of Guidelines for Research and Evaluation (AGREE II) instrument. Average domain scores were calculated and overall quality scores and recommendation for use were determined.</p>
</sec>
<sec><title>Results</title>
<p>Out of 77 identified guidelines, 27 met the inclusion criteria and were assessed. The domains with the highest average scores across guidelines were ‘scope and purpose’, ‘clarity of presentation’ and ‘applicability’. The lowest scoring domains were ‘rigour of development’ and ‘editorial independence’. No guideline can be ‘recommended for immediate use’, 23 guidelines are ‘recommended with modifications’ and 4 guidelines are ‘not recommended’.</p>
</sec>
<sec><title>Conclusions</title>
<p>The IFRC produces guidelines that should be adhered to by millions of staff and volunteers in 190 countries. These guidelines should therefore be of high quality. Up until now, the IFRC had no uniform guideline development process. The results of the AGREE II appraisal indicate that the quality of the guidelines needs to be improved.</p>
</sec>
</div>
</front>
<back><div1 type="bibliography"><listBibl><biblStruct></biblStruct>
<biblStruct><analytic><author><name sortKey="Oxman, Ad" uniqKey="Oxman A">AD Oxman</name>
</author>
<author><name sortKey="Lavis, Jn" uniqKey="Lavis J">JN Lavis</name>
</author>
<author><name sortKey="Fretheim, A" uniqKey="Fretheim A">A Fretheim</name>
</author>
</analytic>
</biblStruct>
<biblStruct></biblStruct>
<biblStruct><analytic><author><name sortKey="Vandekerckhove, P" uniqKey="Vandekerckhove P">P Vandekerckhove</name>
</author>
<author><name sortKey="Clarke, Mj" uniqKey="Clarke M">MJ Clarke</name>
</author>
<author><name sortKey="De Buck, E" uniqKey="De Buck E">E De Buck</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Burda, Bu" uniqKey="Burda B">BU Burda</name>
</author>
<author><name sortKey="Chambers, Ar" uniqKey="Chambers A">AR Chambers</name>
</author>
<author><name sortKey="Johnson, Jc" uniqKey="Johnson J">JC Johnson</name>
</author>
</analytic>
</biblStruct>
<biblStruct></biblStruct>
<biblStruct><analytic><author><name sortKey="Brouwers, Mc" uniqKey="Brouwers M">MC Brouwers</name>
</author>
<author><name sortKey="Kho, Me" uniqKey="Kho M">ME Kho</name>
</author>
<author><name sortKey="Browman, Gp" uniqKey="Browman G">GP Browman</name>
</author>
</analytic>
</biblStruct>
<biblStruct></biblStruct>
<biblStruct><analytic><author><name sortKey="Siering, U" uniqKey="Siering U">U Siering</name>
</author>
<author><name sortKey="Eikermann, M" uniqKey="Eikermann M">M Eikermann</name>
</author>
<author><name sortKey="Hausner, E" uniqKey="Hausner E">E Hausner</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Altman, Dg" uniqKey="Altman D">DG Altman</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Ou, Y" uniqKey="Ou Y">Y Ou</name>
</author>
<author><name sortKey="Goldberg, I" uniqKey="Goldberg I">I Goldberg</name>
</author>
<author><name sortKey="Migdal, C" uniqKey="Migdal C">C Migdal</name>
</author>
</analytic>
</biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct><analytic><author><name sortKey="Miller, J" uniqKey="Miller J">J Miller</name>
</author>
<author><name sortKey="Petrie, J" uniqKey="Petrie J">J Petrie</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Cruse, H" uniqKey="Cruse H">H Cruse</name>
</author>
<author><name sortKey="Winiarek, M" uniqKey="Winiarek M">M Winiarek</name>
</author>
<author><name sortKey="Marshburn, J" uniqKey="Marshburn J">J Marshburn</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Bradt, Da" uniqKey="Bradt D">DA Bradt</name>
</author>
<author><name sortKey="Aitken, P" uniqKey="Aitken P">P Aitken</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="De Buck, E" uniqKey="De Buck E">E De Buck</name>
</author>
<author><name sortKey="Pauwels, Ns" uniqKey="Pauwels N">NS Pauwels</name>
</author>
<author><name sortKey="Dieltjens, T" uniqKey="Dieltjens T">T Dieltjens</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Eccles, Mp" uniqKey="Eccles M">MP Eccles</name>
</author>
<author><name sortKey="Grimshaw, Jm" uniqKey="Grimshaw J">JM Grimshaw</name>
</author>
<author><name sortKey="Shekelle, P" uniqKey="Shekelle P">P Shekelle</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Shekelle, P" uniqKey="Shekelle P">P Shekelle</name>
</author>
<author><name sortKey="Woolf, S" uniqKey="Woolf S">S Woolf</name>
</author>
<author><name sortKey="Grimshaw, Jm" uniqKey="Grimshaw J">JM Grimshaw</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="James, D" uniqKey="James D">D James</name>
</author>
<author><name sortKey="Warren Forward, H" uniqKey="Warren Forward H">H Warren-Forward</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Bisson, Ji" uniqKey="Bisson J">JI Bisson</name>
</author>
<author><name sortKey="Tavakoly, B" uniqKey="Tavakoly B">B Tavakoly</name>
</author>
<author><name sortKey="Witteveen, Ab" uniqKey="Witteveen A">AB Witteveen</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Ansari, S" uniqKey="Ansari S">S Ansari</name>
</author>
<author><name sortKey="Rashidian, A" uniqKey="Rashidian A">A Rashidian</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Lo, B" uniqKey="Lo B">B Lo</name>
</author>
<author><name sortKey="Field, Mj" uniqKey="Field M">MJ Field</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Akl, Ea" uniqKey="Akl E">EA Akl</name>
</author>
<author><name sortKey="El Hachem, P" uniqKey="El Hachem P">P El-Hachem</name>
</author>
<author><name sortKey="Abou Haidar, H" uniqKey="Abou Haidar H">H Abou-Haidar</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Gale, Eam" uniqKey="Gale E">EAM Gale</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Neumann, I" uniqKey="Neumann I">I Neumann</name>
</author>
<author><name sortKey="Karl, R" uniqKey="Karl R">R Karl</name>
</author>
<author><name sortKey="Rajpal, A" uniqKey="Rajpal A">A Rajpal</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Gagliardi, Ar" uniqKey="Gagliardi A">AR Gagliardi</name>
</author>
<author><name sortKey="Marshall, C" uniqKey="Marshall C">C Marshall</name>
</author>
<author><name sortKey="Huckson, S" uniqKey="Huckson S">S Huckson</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Gagliardi, Ar" uniqKey="Gagliardi A">AR Gagliardi</name>
</author>
<author><name sortKey="Alhabib, S" uniqKey="Alhabib S">S Alhabib</name>
</author>
</analytic>
</biblStruct>
</listBibl>
</div1>
</back>
</TEI>
<pmc article-type="research-article"><pmc-dir>properties open_access</pmc-dir>
<front><journal-meta><journal-id journal-id-type="nlm-ta">BMJ Open</journal-id>
<journal-id journal-id-type="iso-abbrev">BMJ Open</journal-id>
<journal-id journal-id-type="hwp">bmjopen</journal-id>
<journal-id journal-id-type="publisher-id">bmjopen</journal-id>
<journal-title-group><journal-title>BMJ Open</journal-title>
</journal-title-group>
<issn pub-type="epub">2044-6055</issn>
<publisher><publisher-name>BMJ Publishing Group</publisher-name>
<publisher-loc>BMA House, Tavistock Square, London, WC1H 9JR</publisher-loc>
</publisher>
</journal-meta>
<article-meta><article-id pub-id-type="pmid">27678534</article-id>
<article-id pub-id-type="pmc">5051453</article-id>
<article-id pub-id-type="publisher-id">bmjopen-2016-011744</article-id>
<article-id pub-id-type="doi">10.1136/bmjopen-2016-011744</article-id>
<article-categories><subj-group subj-group-type="heading"><subject>Public Health</subject>
<subj-group><subject>Research</subject>
</subj-group>
</subj-group>
<subj-group subj-group-type="hwp-journal-coll"><subject>1506</subject>
<subject>1724</subject>
<subject>1694</subject>
</subj-group>
</article-categories>
<title-group><article-title>Guidelines of the International Federation of Red Cross and Red Crescent Societies: an overview and quality appraisal using AGREE II</article-title>
</title-group>
<contrib-group><contrib contrib-type="author"><name><surname>Vande veegaete</surname>
<given-names>Axel</given-names>
</name>
<xref ref-type="aff" rid="af1">1</xref>
</contrib>
<contrib contrib-type="author"><name><surname>Borra</surname>
<given-names>Vere</given-names>
</name>
<xref ref-type="aff" rid="af1">1</xref>
</contrib>
<contrib contrib-type="author"><name><surname>De Buck</surname>
<given-names>Emmy</given-names>
</name>
<xref ref-type="aff" rid="af1">1</xref>
<xref ref-type="aff" rid="af2">2</xref>
</contrib>
<contrib contrib-type="author"><name><surname>Vandekerckhove</surname>
<given-names>Philippe</given-names>
</name>
<xref ref-type="aff" rid="af2">2</xref>
<xref ref-type="aff" rid="af3">3</xref>
<xref ref-type="aff" rid="af4">4</xref>
</contrib>
</contrib-group>
<aff id="af1"><label>1</label>
<institution>Center for Evidence-Based Practice (CEBaP), Belgian Red Cross</institution>
,<addr-line>Mechelen</addr-line>
,<country>Belgium</country>
</aff>
<aff id="af2"><label>2</label>
<addr-line>Faculty of Medicine, Department of Public Health and Primary Care</addr-line>
,<institution>KU Leuven</institution>
,<addr-line>Leuven</addr-line>
,<country>Belgium</country>
</aff>
<aff id="af3"><label>3</label>
<addr-line>Belgian Red Cross-Flanders, Mechelen, Belgium</addr-line>
</aff>
<aff id="af4"><label>4</label>
<addr-line>Faculty of Medicine</addr-line>
,<institution>University of Ghent</institution>
,<addr-line>Ghent</addr-line>
,<country>Belgium</country>
</aff>
<author-notes><corresp><label>Correspondence to</label>
Axel Vande veegaete; <email>axel.vandeveegaete@rodekruis.be</email>
</corresp>
</author-notes>
<pub-date pub-type="collection"><year>2016</year>
</pub-date>
<pub-date pub-type="epub"><day>27</day>
<month>9</month>
<year>2016</year>
</pub-date>
<volume>6</volume>
<issue>9</issue>
<elocation-id>e011744</elocation-id>
<history><date date-type="received"><day>1</day>
<month>3</month>
<year>2016</year>
</date>
<date date-type="rev-recd"><day>8</day>
<month>8</month>
<year>2016</year>
</date>
<date date-type="accepted"><day>2</day>
<month>9</month>
<year>2016</year>
</date>
</history>
<permissions><copyright-statement>Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/</copyright-statement>
<copyright-year>2016</copyright-year>
<license license-type="open-access"><license-p>This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: <ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/licenses/by-nc/4.0/">http://creativecommons.org/licenses/by-nc/4.0/</ext-link>
</license-p>
</license>
</permissions>
<self-uri xlink:title="pdf" xlink:href="bmjopen-2016-011744.pdf"></self-uri>
<abstract><sec><title>Objectives</title>
<p>To appraise the quality of guidelines developed by the International Federation of Red Cross and Red Crescent Societies (IFRC) between 2001 and 2015.</p>
</sec>
<sec><title>Study design</title>
<p>Cross-sectional.</p>
</sec>
<sec><title>Methods</title>
<p>2 authors independently assessed the quality of IFRC guidelines using the Appraisal of Guidelines for Research and Evaluation (AGREE II) instrument. Average domain scores were calculated and overall quality scores and recommendation for use were determined.</p>
</sec>
<sec><title>Results</title>
<p>Out of 77 identified guidelines, 27 met the inclusion criteria and were assessed. The domains with the highest average scores across guidelines were ‘scope and purpose’, ‘clarity of presentation’ and ‘applicability’. The lowest scoring domains were ‘rigour of development’ and ‘editorial independence’. No guideline can be ‘recommended for immediate use’, 23 guidelines are ‘recommended with modifications’ and 4 guidelines are ‘not recommended’.</p>
</sec>
<sec><title>Conclusions</title>
<p>The IFRC produces guidelines that should be adhered to by millions of staff and volunteers in 190 countries. These guidelines should therefore be of high quality. Up until now, the IFRC had no uniform guideline development process. The results of the AGREE II appraisal indicate that the quality of the guidelines needs to be improved.</p>
</sec>
</abstract>
<kwd-group><kwd>Quality assessment</kwd>
<kwd>AGREE II</kwd>
</kwd-group>
</article-meta>
</front>
<body><boxed-text position="float" orientation="portrait"><caption><title>Strengths and limitations of this study</title>
</caption>
<list list-type="bullet"><list-item><p>This study is the first to assess the quality of the guidelines of the International Federation of Red Cross and Red Crescent Societies (IFRC) using a widely used instrument for guideline appraisal.</p>
</list-item>
<list-item><p>The quality assessment was performed by two assessors. More assessors could in theory increase the reliability of the assessment. However, since the inter-rater reliability between both assessors was good to very good, the view of an extra assessor is unlikely to influence the overall scores.</p>
</list-item>
<list-item><p>Appraisal of Guidelines for Research and Evaluation (AGREE II) is designed for clinical practice guidelines, and most of the guidelines developed by the IFRC are not intended for clinical practice. Some items were therefore not applicable; since it only concerns 2 out of 23 items, this has not influenced the overall score.</p>
</list-item>
</list>
</boxed-text>
<sec sec-type="intro" id="s1"><title>Introduction</title>
<p>The International Federation of Red Cross and Red Crescent Societies (IFRC) is the world's largest humanitarian organisation, providing assistance without discrimination as to nationality, race, religious beliefs, class or political opinions. Founded in 1919, the IFRC comprises 190 member Red Cross and Red Crescent National Societies, a secretariat in Geneva and more than 60 delegations around the world. It is an organisation with more than 17 million active volunteers and 427 000 paid staff, serving 182 million people annually.<xref rid="R1" ref-type="bibr">1</xref>
</p>
<p>The IFRC carries out relief operations to assist victims of disasters, and combines this with development work to strengthen the capacities of its member National Societies. The role of the secretariat in Geneva is to coordinate and mobilise relief assistance for international emergencies, to promote cooperation between National Societies and to represent these National Societies in the international field. Over the years, the IFRC has published dozens of guidelines, guidance series, etc, to assist and guide the millions of volunteers and staff in their work.</p>
<p>In the past, guidelines developed by humanitarian and development agencies did not usually adhere to rigorous quality assessment standards.<xref rid="R2" ref-type="bibr">2–4</xref>
In recent times, however, international organisations such as the WHO and some non-governmental organisations such as Médecins Sans Frontières have adopted a more rigorous and well-structured guideline development process, whereby the guidelines are based on the latest available scientific evidence.<xref rid="R5" ref-type="bibr">5</xref>
<xref rid="R6" ref-type="bibr">6</xref>
</p>
<p>Given the importance of guidelines in an organisation such as the IFRC, the objective of this study is to appraise the quality of the guidelines developed by the IFRC. The present study has been initiated and performed by the Belgian Red Cross. The Belgian Red Cross is one of the 190 members of the IFRC. Having established the ‘Centre for Evidence-Based Practice’ about 10 years ago (and which later became a reference centre of the IFRC), specialising in guideline development according to the ‘Evidence-Based Practice’ principles, the Belgian Red Cross took the initiative to make this analysis.</p>
</sec>
<sec sec-type="methods" id="s2"><title>Methods</title>
<sec id="s2a"><title>Guideline identification</title>
<p>A list of the IFRC publications is available in the IFRC online library catalogue (<ext-link ext-link-type="uri" xlink:href="http://weblis.ifrc.org/Libcat/index.html">http://weblis.ifrc.org/Libcat/index.html</ext-link>
). The authors identified guidelines from this database using the following search strategy (‘advanced search’ function): keyword from title: guideline*; keyword from record: guideline*. Tick-off box: IFRC publication. The search was performed on 27 November 2015.</p>
<p>The objective was to analyse all guidelines aimed at guiding the work of staff and volunteers of all National Red Cross and Red Crescent Societies in the field of emergency relief, development cooperation and organisational development.</p>
<p>Therefore, (internal) administrative guidelines for the staff of the IFRC (eg, ‘human resource or finance guidelines’ or ‘social media guidelines for IFRC staff’) were excluded, as well as managerial guidelines (eg, ‘strategic planning guidelines for African National Societies’ or ‘guidelines for National Societies to organise local youth actions and celebrate the international year of the youth’). We only included IFRC guidelines and guidelines published jointly with the International Committee of the Red Cross (ICRC). One guideline developed with another (non-Red Cross) organisation (‘guidelines for drug donations’ developed with the WHO) was excluded.</p>
<p>Only guidelines in English were included. Guidelines in other Federation languages such as Arabic or Spanish were excluded, given that all IFRC guidelines are also available in English.</p>
<p>We included guidelines published between 1 January 2001 and 27 November 2015. Since there is no established process within the IFRC to review the guidelines after a certain number of years, or to abrogate guidelines, we decided to perform the analysis on the guidelines of the past 15 years.</p>
</sec>
<sec id="s2b"><title>Quality appraisal</title>
<p>The quality of each guideline was assessed using the Appraisal of Guidelines for Research and Evaluation (AGREE II) instrument.<xref rid="R7" ref-type="bibr">7</xref>
AGREE II is an international instrument for assessing the quality of guidelines in any disease area targeting any step in the healthcare continuum, including those for health promotion, public health, screening, diagnosis, treatment or interventions. AGREE II is one of only a few tools, specifically developed for quality assessment of guidelines, that uses a numeric rating scale to quantify guideline quality. It contains 23 items grouped into six quality domains. Furthermore, two global rating items are used to assess the overall quality of the guideline (<xref ref-type="boxed-text" rid="bx1">box 1</xref>
).<xref rid="R8" ref-type="bibr">8</xref>
AGREE II was chosen since it is the most comprehensively validated appraisal tool.<xref rid="R9" ref-type="bibr">9</xref>
AGREE II was also used for the appraisal of the WHO guidelines.<xref rid="R5" ref-type="bibr">5</xref>
<boxed-text id="bx1" position="float" orientation="portrait"><label>Box 1</label>
<caption><title>Appraisal of Guidelines for Research and Evaluation II domains and items</title>
</caption>
<p>Domain 1: scope and purpose</p>
<list list-type="order"><list-item><p>The overall objective(s) of the guideline is (are) specifically described.</p>
</list-item>
<list-item><p>The health question(s) covered by the guideline is (are) specifically described.</p>
</list-item>
<list-item><p>The population (patients, public, etc) to whom the guideline is meant to apply is specifically described.</p>
</list-item>
</list>
<p>Domain 2: stakeholder involvement</p>
<list list-type="bullet"><list-item><p>The guideline development group includes individuals from all relevant professional groups.</p>
</list-item>
<list-item><p>The views and preferences of the target population (patients, public, etc) have been sought.</p>
</list-item>
<list-item><p>The target users of the guideline are clearly defined.</p>
</list-item>
</list>
<p>Domain 3: rigour of development</p>
<list list-type="bullet"><list-item><p>Systematic methods were used to search for evidence.</p>
</list-item>
<list-item><p>The criteria for selecting the evidence are clearly described.</p>
</list-item>
<list-item><p>The strengths and limitations of the body of evidence are clearly described.</p>
</list-item>
<list-item><p>The methods for formulating the recommendations are clearly described.</p>
</list-item>
<list-item><p>The health benefits, side effects and risks have been considered in formulating the recommendations.</p>
</list-item>
<list-item><p>There is an explicit link between the recommendations and the supporting evidence.</p>
</list-item>
<list-item><p>The guideline has been externally reviewed by experts prior to this publication.</p>
</list-item>
<list-item><p>A procedure for updating the guideline is provided.</p>
</list-item>
</list>
<p>Domain 4: clarity of presentation</p>
<list list-type="bullet"><list-item><p>The recommendations are specific and unambiguous.</p>
</list-item>
<list-item><p>The different options for management of the condition or health issues are clearly presented.</p>
</list-item>
<list-item><p>Key recommendations are easily identifiable.</p>
</list-item>
</list>
<p>Domain 5: applicability</p>
<list list-type="bullet"><list-item><p>The guideline describes facilitators and barriers to its application.</p>
</list-item>
<list-item><p>The guideline provides advice and/or tools on how the recommendations can be put into practice.</p>
</list-item>
<list-item><p>The potential resource implications of applying the recommendations have been considered.</p>
</list-item>
<list-item><p>The guideline presents monitoring and/or auditing criteria.</p>
</list-item>
</list>
<p>Domain 6: editorial independence</p>
<list list-type="bullet"><list-item><p>The views of the funding body have not influenced the content of the guideline.</p>
</list-item>
<list-item><p>Competing interests of guideline development group members have been recorded and addressed.</p>
</list-item>
</list>
<p>Overall assessment</p>
<p>Judgement as to the quality of the guideline, taking into account the criteria considered in the assessment process.</p>
<p>Provide a recommendation for use of the guideline.</p>
</boxed-text>
</p>
<p>The 23 items are rated on a seven-point Likert scale that measures the extent to which the specific criterion is fulfilled, ranging from 1 (strongly disagree) to 7 (strongly agree). The overall quality of the guideline is also rated with a seven-point Likert scale with 1 as the lowest possible quality and 7 the highest possible quality. Furthermore, a recommendation is made for the use of this guideline (yes; yes, with modifications; no).</p>
<p>Two authors (AVV and VB) independently assessed the quality of each guideline. The two assessors had complementary profiles; the first assessor (VB) is a methodologist with a PhD working full time on the development of systematic reviews and evidence-based guidelines; the second (AVV) has a 35-year career in international disaster and development assistance. The two assessors were not involved in the drafting of any of the guidelines assessed.</p>
<p>Both assessors worked according to the online tutorial (<ext-link ext-link-type="uri" xlink:href="http://agree2.machealth.ca/players/open/index.html">http://agree2.machealth.ca/players/open/index.html</ext-link>
) and used the AGREE II user's manual instructions.<xref rid="R8" ref-type="bibr">8</xref>
</p>
<p>In accordance with the AGREE II guidelines, it was decided in advance how to rate items that are not applicable (eg, items 2 (health question) and 11 (health benefits) for governance guidelines). The assessors decided not to skip the item, as this would entail modifications in calculating the domain scores (which is discouraged by AGREE II<xref rid="R7" ref-type="bibr">7</xref>
), but to give these items an average score of 3. Furthermore, it was important to be as consistent as possible throughout the exercise in providing similar rates when the level of information is comparable. For example, for guidelines providing detailed descriptions about the contributors, such as name, occupation, affiliation, role, etc (compared with limited information such as ‘nutrition experts’ or no information at all), a similar higher score (5–7) should be given. In an effort to ensure that consistency, the assessors drafted a table detailing per AGREE II item ‘how to rate’ in three categories (1–2; 3–4; 5–7) with details about the level of information per category. This table was drafted after the first discussion of discrepancies and was used by both assessors for further evaluation of the guidelines.</p>
<p>Major scoring discrepancies between the two assessors (difference of more than two points on the Likert scale) were discussed and scores were changed in case of misinterpretation. No attempt was made to reach a consensus. A first comparison of scores was made after scoring five guidelines to clarify discrepancies. A second discussion round was held when all guidelines were scored.</p>
</sec>
<sec id="s2c"><title>Data analysis</title>
<p>The scores were entered into a Microsoft Excel (2013) spreadsheet. A domain score was calculated for each domain by scaling the sum of the scores of the individual items in a domain as a percentage of the maximum possible score for that domain, according to the AGREE II manual:<xref rid="R8" ref-type="bibr">8</xref>
<disp-formula><graphic xlink:href="bmjopen2016011744ueq1.jpg" position="float" orientation="portrait"></graphic>
</disp-formula>
</p>
<p>The intraclass correlation coefficient (ICC) was calculated, before and after discussion, as an indicator of agreement between both assessors, using StatsDirect V.2.8.0 (StatsDirect statistical software. 2013. England, StatsDirect). For the classification of the degree of agreement, the scale proposed by Altman was used: ICC<0.20: poor; ICC 0.21–0.40: fair; ICC 0.41–0.60: moderate; ICC 0.61–0.80: good, ICC 0.81–1.00: very good.<xref rid="R10" ref-type="bibr">10</xref>
</p>
<p>As in the AGREE II checklist no clear cut-off was provided on the relationship between the ICC value and the overall recommendation for use in practice, the authors decided to take the average of the scores for each item to rate the overall quality, and to base the overall recommendation on the ranking described in a previous study.<xref rid="R11" ref-type="bibr">11</xref>
This ranking states that if more than half of the domains have an overall domain score of more than 60%, the guideline is ‘recommended for immediate use’. If most domain scores are higher than 30%, the guideline is ‘recommended with modifications’, and if most domain scores are below 30%, the guideline is ‘not recommended for use’.</p>
</sec>
</sec>
<sec sec-type="results" id="s3"><title>Results</title>
<sec id="s3a"><title>Guideline identification and characterisation</title>
<p>Seventy-seven records were identified with the aforementioned search strategy. Of these, 49 records were excluded based on the inclusion and exclusion criteria (<xref ref-type="fig" rid="BMJOPEN2016011744F1">figure 1</xref>
): 13 records were duplicates, 18 were in a different language than English (eg, Arabic or Russian), 7 guidelines were excluded because they concerned internal managerial guidelines and 11 records were excluded for being internal administrative guidelines. One guideline was excluded because the full text of this guideline could not be obtained (<xref ref-type="fig" rid="BMJOPEN2016011744F1">figure 1</xref>
).</p>
<fig id="BMJOPEN2016011744F1" orientation="portrait" position="float"><label>Figure 1</label>
<caption><p>Flow chart of guideline selection.</p>
</caption>
<graphic xlink:href="bmjopen2016011744f01"></graphic>
</fig>
<p>Of the 27 guidelines that met the inclusion criteria, 13 are designed for a humanitarian aid context, dealing with a variety of subjects such as disaster preparedness, reconstruction, disaster law, food security or how to deal with a nuclear emergency.<xref rid="R12" ref-type="bibr">12–24</xref>
Only eight guidelines are related to a health issue (of which two in an emergency context), dealing with first aid, HIV/AIDS, nutrition, tuberculosis (TBC) or drug abuse.<xref rid="R25" ref-type="bibr">25–32</xref>
Six guidelines dealt with other topics such as cash transfer programming, humanitarian diplomacy, income-generating projects or strategic planning.<xref rid="R33" ref-type="bibr">33–38</xref>
Four guidelines were produced together with the ICRC (‘guideline for cash transfer programming’,<xref rid="R34" ref-type="bibr">34</xref>
‘rapid assessment for markets—guidelines for an initial emergency market assessment’,<xref rid="R22" ref-type="bibr">22</xref>
‘guidelines for assessment in emergencies’<xref rid="R15" ref-type="bibr">15</xref>
and ‘guidelines on first aid and HIV/AIDS’<xref rid="R26" ref-type="bibr">26</xref>
). Half of the guidelines analysed (15 out of 27) were published before 2011, which allows us to conclude that a lot of IFRC guidelines are outdated.</p>
</sec>
<sec id="s3b"><title>Guideline appraisal</title>
<sec id="s3b1"><title>AGREE II</title>
<p>The AGREE II domain scores across the guidelines are shown in <xref ref-type="fig" rid="BMJOPEN2016011744F2">figure 2</xref>
and <xref ref-type="table" rid="BMJOPEN2016011744TB1">table 1</xref>
. The error bars represent the range of scores within each domain. The top and bottom of the boxes are the 75th and 25th centiles, respectively; the middle line of the boxes represents the median. The diamond shows the mean domain score.</p>
<table-wrap id="BMJOPEN2016011744TB1" orientation="portrait" position="float"><label>Table 1</label>
<caption><p>Overview of guidelines with a mean overall score for each domain and recommendations for use in practice</p>
</caption>
<table frame="hsides" rules="groups"><colgroup span="1"><col align="left" span="1"></col>
<col align="left" span="1"></col>
<col align="left" span="1"></col>
<col align="char" char="." span="1"></col>
<col align="left" span="1"></col>
<col align="left" span="1"></col>
<col align="char" char="." span="1"></col>
<col align="left" span="1"></col>
<col align="left" span="1"></col>
</colgroup>
<thead valign="bottom"><tr><th align="left" rowspan="1" colspan="1">Guideline, year</th>
<th align="left" rowspan="1" colspan="1">Scope and purpose (%)</th>
<th align="left" rowspan="1" colspan="1">Stakeholder involvement (%)</th>
<th align="left" rowspan="1" colspan="1">Rigour of development (%)</th>
<th align="left" rowspan="1" colspan="1">Clarity of presentation (%)</th>
<th align="left" rowspan="1" colspan="1">Applicability (%)</th>
<th align="left" rowspan="1" colspan="1">Editorial independence (%)</th>
<th align="left" rowspan="1" colspan="1">Overall quality score</th>
<th align="left" rowspan="1" colspan="1">Recommend?</th>
</tr>
</thead>
<tbody><tr><td colspan="9" rowspan="1">Guidelines for humanitarian aid context</td>
</tr>
<tr><td rowspan="1" colspan="1"> Children in disasters—games and guidelines to engage youth in risk reduction, 2010<xref rid="R12" ref-type="bibr">12</xref>
</td>
<td rowspan="1" colspan="1">41.7</td>
<td rowspan="1" colspan="1">13.9</td>
<td rowspan="1" colspan="1">0.0</td>
<td rowspan="1" colspan="1">27.8</td>
<td rowspan="1" colspan="1">25.0</td>
<td rowspan="1" colspan="1">4.2</td>
<td rowspan="1" colspan="1">2</td>
<td rowspan="1" colspan="1">No</td>
</tr>
<tr><td rowspan="1" colspan="1"> Earthquakes: guidelines on preparing, responding and recovering, 2012<xref rid="R13" ref-type="bibr">13</xref>
</td>
<td rowspan="1" colspan="1">50.0</td>
<td rowspan="1" colspan="1">47.2</td>
<td rowspan="1" colspan="1">8.3</td>
<td rowspan="1" colspan="1">52.8</td>
<td rowspan="1" colspan="1">35.4</td>
<td rowspan="1" colspan="1">0.0</td>
<td rowspan="1" colspan="1">3</td>
<td rowspan="1" colspan="1">Yes, with modifications</td>
</tr>
<tr><td rowspan="1" colspan="1"> Global food security assessment guidelines: a step-by-step guide for National Societies, 2007<xref rid="R14" ref-type="bibr">14</xref>
</td>
<td rowspan="1" colspan="1">30.6</td>
<td rowspan="1" colspan="1">19.4</td>
<td rowspan="1" colspan="1">7.3</td>
<td rowspan="1" colspan="1">22.2</td>
<td rowspan="1" colspan="1">27.1</td>
<td rowspan="1" colspan="1">0.0</td>
<td rowspan="1" colspan="1">2</td>
<td rowspan="1" colspan="1">No</td>
</tr>
<tr><td rowspan="1" colspan="1"> Guidelines for assessment in emergencies, 2008<xref rid="R15" ref-type="bibr">15</xref>
</td>
<td rowspan="1" colspan="1">30.6</td>
<td rowspan="1" colspan="1">25.0</td>
<td rowspan="1" colspan="1">5.2</td>
<td rowspan="1" colspan="1">47.2</td>
<td rowspan="1" colspan="1">27.1</td>
<td rowspan="1" colspan="1">0.0</td>
<td rowspan="1" colspan="1">2</td>
<td rowspan="1" colspan="1">Yes, with modifications</td>
</tr>
<tr><td rowspan="1" colspan="1"> IFRC guidelines for livelihoods programming, 2010<xref rid="R16" ref-type="bibr">16</xref>
</td>
<td rowspan="1" colspan="1">36.1</td>
<td rowspan="1" colspan="1">44.4</td>
<td rowspan="1" colspan="1">17.7</td>
<td rowspan="1" colspan="1">19.4</td>
<td rowspan="1" colspan="1">35.4</td>
<td rowspan="1" colspan="1">0.0</td>
<td rowspan="1" colspan="1">3</td>
<td rowspan="1" colspan="1">Yes, with modifications</td>
</tr>
<tr><td rowspan="1" colspan="1"> Introduction to the guidelines for the domestic facilitation and regulation of international disaster relief and initial recovery assistance, 2011<xref rid="R17" ref-type="bibr">17</xref>
</td>
<td rowspan="1" colspan="1">52.8</td>
<td rowspan="1" colspan="1">72.2</td>
<td rowspan="1" colspan="1">41.7</td>
<td rowspan="1" colspan="1">63.9</td>
<td rowspan="1" colspan="1">47.9</td>
<td rowspan="1" colspan="1">20.8</td>
<td rowspan="1" colspan="1">4</td>
<td rowspan="1" colspan="1">Yes, with modifications</td>
</tr>
<tr><td rowspan="1" colspan="1"> Nuclear and radiological emergency guidelines: preparedness, response and recovery, 2015<xref rid="R18" ref-type="bibr">18</xref>
</td>
<td rowspan="1" colspan="1">41.7</td>
<td rowspan="1" colspan="1">33.3</td>
<td rowspan="1" colspan="1">12.5</td>
<td rowspan="1" colspan="1">30.6</td>
<td rowspan="1" colspan="1">27.1</td>
<td rowspan="1" colspan="1">16.7</td>
<td rowspan="1" colspan="1">3</td>
<td rowspan="1" colspan="1">Yes, with modifications</td>
</tr>
<tr><td rowspan="1" colspan="1"> Owner-driven housing reconstruction guidelines, 2010<xref rid="R19" ref-type="bibr">19</xref>
</td>
<td rowspan="1" colspan="1">50.0</td>
<td rowspan="1" colspan="1">58.3</td>
<td rowspan="1" colspan="1">10.4</td>
<td rowspan="1" colspan="1">33.3</td>
<td rowspan="1" colspan="1">56.3</td>
<td rowspan="1" colspan="1">12.5</td>
<td rowspan="1" colspan="1">3</td>
<td rowspan="1" colspan="1">Yes, with modifications</td>
</tr>
<tr><td rowspan="1" colspan="1"> Postdisaster community infrastructure rehabilitation and (re)construction guidelines, 2012<xref rid="R20" ref-type="bibr">20</xref>
</td>
<td rowspan="1" colspan="1">44.4</td>
<td rowspan="1" colspan="1">33.3</td>
<td rowspan="1" colspan="1">7.3</td>
<td rowspan="1" colspan="1">47.2</td>
<td rowspan="1" colspan="1">41.7</td>
<td rowspan="1" colspan="1">20.8</td>
<td rowspan="1" colspan="1">3</td>
<td rowspan="1" colspan="1">Yes, with modifications</td>
</tr>
<tr><td rowspan="1" colspan="1"> Postdisaster settlement planning guidelines, 2012<xref rid="R21" ref-type="bibr">21</xref>
</td>
<td rowspan="1" colspan="1">44.4</td>
<td rowspan="1" colspan="1">33.3</td>
<td rowspan="1" colspan="1">6.3</td>
<td rowspan="1" colspan="1">47.2</td>
<td rowspan="1" colspan="1">41.7</td>
<td rowspan="1" colspan="1">20.8</td>
<td rowspan="1" colspan="1">3</td>
<td rowspan="1" colspan="1">Yes, with modifications</td>
</tr>
<tr><td rowspan="1" colspan="1"> Rapid assessment for markets—guidelines for an initial emergency market assessment, 2014<xref rid="R22" ref-type="bibr">22</xref>
</td>
<td rowspan="1" colspan="1">50.0</td>
<td rowspan="1" colspan="1">27.8</td>
<td rowspan="1" colspan="1">6.3</td>
<td rowspan="1" colspan="1">58.3</td>
<td rowspan="1" colspan="1">52.1</td>
<td rowspan="1" colspan="1">0.0</td>
<td rowspan="1" colspan="1">3</td>
<td rowspan="1" colspan="1">Yes, with modifications</td>
</tr>
<tr><td rowspan="1" colspan="1"> Setting up a national disaster preparedness and response mechanism: guidelines for National Societies, 2010<xref rid="R23" ref-type="bibr">23</xref>
</td>
<td rowspan="1" colspan="1">50.0</td>
<td rowspan="1" colspan="1">44.4</td>
<td rowspan="1" colspan="1">18.8</td>
<td rowspan="1" colspan="1">25.0</td>
<td rowspan="1" colspan="1">33.3</td>
<td rowspan="1" colspan="1">0.0</td>
<td rowspan="1" colspan="1">3</td>
<td rowspan="1" colspan="1">Yes, with modifications</td>
</tr>
<tr><td rowspan="1" colspan="1"> Volunteering in emergencies: practical guidelines for Red Cross and Red Crescent Societies managing volunteers in emergency situations, 2012<xref rid="R24" ref-type="bibr">24</xref>
</td>
<td rowspan="1" colspan="1">55.6</td>
<td rowspan="1" colspan="1">22.2</td>
<td rowspan="1" colspan="1">5.2</td>
<td rowspan="1" colspan="1">41.7</td>
<td rowspan="1" colspan="1">31.3</td>
<td rowspan="1" colspan="1">0.0</td>
<td rowspan="1" colspan="1">3</td>
<td rowspan="1" colspan="1">Yes, with modifications</td>
</tr>
<tr><td colspan="9" rowspan="1">Guidelines related to health issues</td>
</tr>
<tr><td rowspan="1" colspan="1"> Guidelines for the implementation of a psychological support programme in emergencies, 2001<xref rid="R25" ref-type="bibr">25</xref>
</td>
<td rowspan="1" colspan="1">22.2</td>
<td rowspan="1" colspan="1">22.2</td>
<td rowspan="1" colspan="1">5.2</td>
<td rowspan="1" colspan="1">13.9</td>
<td rowspan="1" colspan="1">18.8</td>
<td rowspan="1" colspan="1">0.0</td>
<td rowspan="1" colspan="1">2</td>
<td rowspan="1" colspan="1">No</td>
</tr>
<tr><td rowspan="1" colspan="1"> Guidelines on first aid and HIV/AIDS, 2001<xref rid="R26" ref-type="bibr">26</xref>
</td>
<td rowspan="1" colspan="1">38.9</td>
<td rowspan="1" colspan="1">25.0</td>
<td rowspan="1" colspan="1">5.2</td>
<td rowspan="1" colspan="1">61.1</td>
<td rowspan="1" colspan="1">22.9</td>
<td rowspan="1" colspan="1">0.0</td>
<td rowspan="1" colspan="1">3</td>
<td rowspan="1" colspan="1">Yes, with modifications</td>
</tr>
<tr><td rowspan="1" colspan="1"> HIV prevention: principles and guidelines for programming, 2009<xref rid="R27" ref-type="bibr">27</xref>
</td>
<td rowspan="1" colspan="1">50.0</td>
<td rowspan="1" colspan="1">30.6</td>
<td rowspan="1" colspan="1">13.5</td>
<td rowspan="1" colspan="1">55.6</td>
<td rowspan="1" colspan="1">37.5</td>
<td rowspan="1" colspan="1">0.0</td>
<td rowspan="1" colspan="1">3</td>
<td rowspan="1" colspan="1">Yes, with modifications</td>
</tr>
<tr><td rowspan="1" colspan="1"> International first aid and resuscitation guidelines 2011 for National Society first aid programme managers, scientific advisory groups, first aid instructors and first responders, 2011<xref rid="R28" ref-type="bibr">28</xref>
</td>
<td rowspan="1" colspan="1">52.8</td>
<td rowspan="1" colspan="1">66.7</td>
<td rowspan="1" colspan="1">16.7</td>
<td rowspan="1" colspan="1">80.6</td>
<td rowspan="1" colspan="1">52.1</td>
<td rowspan="1" colspan="1">0.0</td>
<td rowspan="1" colspan="1">4</td>
<td rowspan="1" colspan="1">Yes, with modifications</td>
</tr>
<tr><td rowspan="1" colspan="1"> Nutrition guidelines, 2014<xref rid="R29" ref-type="bibr">29</xref>
</td>
<td rowspan="1" colspan="1">63.9</td>
<td rowspan="1" colspan="1">13.9</td>
<td rowspan="1" colspan="1">1.0</td>
<td rowspan="1" colspan="1">61.1</td>
<td rowspan="1" colspan="1">29.2</td>
<td rowspan="1" colspan="1">0.0</td>
<td rowspan="1" colspan="1">3</td>
<td rowspan="1" colspan="1">Yes, with modifications</td>
</tr>
<tr><td rowspan="1" colspan="1"> Operational guidelines for involvement in tuberculosis control: Red Cross and Red Crescent for a TB-free world, 2007<xref rid="R30" ref-type="bibr">30</xref>
</td>
<td rowspan="1" colspan="1">36.1</td>
<td rowspan="1" colspan="1">19.4</td>
<td rowspan="1" colspan="1">3.1</td>
<td rowspan="1" colspan="1">11.1</td>
<td rowspan="1" colspan="1">39.6</td>
<td rowspan="1" colspan="1">0.0</td>
<td rowspan="1" colspan="1">2</td>
<td rowspan="1" colspan="1">Yes, with modifications</td>
</tr>
<tr><td rowspan="1" colspan="1"> Orphans and other children made vulnerable by HIV/AIDS: principles and operational guidelines for programming, 2002<xref rid="R31" ref-type="bibr">31</xref>
</td>
<td rowspan="1" colspan="1">44.4</td>
<td rowspan="1" colspan="1">25.0</td>
<td rowspan="1" colspan="1">2.1</td>
<td rowspan="1" colspan="1">69.4</td>
<td rowspan="1" colspan="1">37.5</td>
<td rowspan="1" colspan="1">0.0</td>
<td rowspan="1" colspan="1">3</td>
<td rowspan="1" colspan="1">Yes, with modifications</td>
</tr>
<tr><td rowspan="1" colspan="1"> Spreading the light of science: guidelines on harm reduction related to injecting drug use, 2003<xref rid="R32" ref-type="bibr">32</xref>
</td>
<td rowspan="1" colspan="1">47.2</td>
<td rowspan="1" colspan="1">16.7</td>
<td rowspan="1" colspan="1">7.3</td>
<td rowspan="1" colspan="1">19.4</td>
<td rowspan="1" colspan="1">22.9</td>
<td rowspan="1" colspan="1">0.0</td>
<td rowspan="1" colspan="1">2</td>
<td rowspan="1" colspan="1">No</td>
</tr>
<tr><td colspan="9" rowspan="1">Other guidelines</td>
</tr>
<tr><td rowspan="1" colspan="1"> Governance: National Society—guidelines, 2003<xref rid="R33" ref-type="bibr">33</xref>
</td>
<td rowspan="1" colspan="1">33.3</td>
<td rowspan="1" colspan="1">11.1</td>
<td rowspan="1" colspan="1">5.2</td>
<td rowspan="1" colspan="1">50.0</td>
<td rowspan="1" colspan="1">33.3</td>
<td rowspan="1" colspan="1">0.0</td>
<td rowspan="1" colspan="1">2</td>
<td rowspan="1" colspan="1">Yes, with modifications</td>
</tr>
<tr><td rowspan="1" colspan="1"> Guideline for cash transfer programming, 2007<xref rid="R34" ref-type="bibr">34</xref>
</td>
<td rowspan="1" colspan="1">58.3</td>
<td rowspan="1" colspan="1">30.6</td>
<td rowspan="1" colspan="1">7.3</td>
<td rowspan="1" colspan="1">66.7</td>
<td rowspan="1" colspan="1">77.1</td>
<td rowspan="1" colspan="1">16.7</td>
<td rowspan="1" colspan="1">4</td>
<td rowspan="1" colspan="1">Yes, with modifications</td>
</tr>
<tr><td rowspan="1" colspan="1"> Income generating projects—guidelines: how to get started, 2001<xref rid="R35" ref-type="bibr">35</xref>
</td>
<td rowspan="1" colspan="1">58.3</td>
<td rowspan="1" colspan="1">25.0</td>
<td rowspan="1" colspan="1">4.2</td>
<td rowspan="1" colspan="1">33.3</td>
<td rowspan="1" colspan="1">41.7</td>
<td rowspan="1" colspan="1">0.0</td>
<td rowspan="1" colspan="1">3</td>
<td rowspan="1" colspan="1">Yes, with modifications</td>
</tr>
<tr><td rowspan="1" colspan="1"> Practising humanitarian diplomacy: an introduction. Humanitarian Diplomacy Guidance, 2012<xref rid="R36" ref-type="bibr">36</xref>
</td>
<td rowspan="1" colspan="1">47.2</td>
<td rowspan="1" colspan="1">44.4</td>
<td rowspan="1" colspan="1">14.6</td>
<td rowspan="1" colspan="1">30.6</td>
<td rowspan="1" colspan="1">45.8</td>
<td rowspan="1" colspan="1">0.0</td>
<td rowspan="1" colspan="1">3</td>
<td rowspan="1" colspan="1">Yes, with modifications</td>
</tr>
<tr><td rowspan="1" colspan="1"> Strategic planning guidelines for National Societies: developing and implementing a strategic plan in a National Society, 2012<xref rid="R37" ref-type="bibr">37</xref>
</td>
<td rowspan="1" colspan="1">44.4</td>
<td rowspan="1" colspan="1">13.9</td>
<td rowspan="1" colspan="1">4.2</td>
<td rowspan="1" colspan="1">33.3</td>
<td rowspan="1" colspan="1">58.3</td>
<td rowspan="1" colspan="1">0.0</td>
<td rowspan="1" colspan="1">3</td>
<td rowspan="1" colspan="1">Yes, with modifications</td>
</tr>
<tr><td rowspan="1" colspan="1"> Youth as agents of behavioural change: guidelines for peer educators working in community engagement, 2012<xref rid="R38" ref-type="bibr">38</xref>
</td>
<td rowspan="1" colspan="1">41.7</td>
<td rowspan="1" colspan="1">41.7</td>
<td rowspan="1" colspan="1">4.2</td>
<td rowspan="1" colspan="1">44.4</td>
<td rowspan="1" colspan="1">45.8</td>
<td rowspan="1" colspan="1">29.2</td>
<td rowspan="1" colspan="1">3</td>
<td rowspan="1" colspan="1">Yes, with modifications</td>
</tr>
<tr><td rowspan="1" colspan="1"> Summary, mean (range)</td>
<td rowspan="1" colspan="1">45.1 (22.2–63.9)</td>
<td rowspan="1" colspan="1">31.9 (11.1–72.2)</td>
<td rowspan="1" colspan="1">8.9 (0.0–41.7)</td>
<td rowspan="1" colspan="1">42.5 (11.1–80.6)</td>
<td rowspan="1" colspan="1">38.7 (18.8–77.1)</td>
<td rowspan="1" colspan="1">5.2 (0.0–29.2)</td>
<td rowspan="1" colspan="1">3 (2–4)</td>
<td rowspan="1" colspan="1">Y: 0%<break></break>
YWM: 85%<break></break>
N: 15%</td>
</tr>
</tbody>
</table>
<table-wrap-foot><fn><p>IFRC, International Federation of Red Cross and Red Crescent Societies; N, no; TB, tuberculosis; Y, yes; YWM, yes, with modifications.</p>
</fn>
</table-wrap-foot>
</table-wrap>
<fig id="BMJOPEN2016011744F2" orientation="portrait" position="float"><label>Figure 2</label>
<caption><p>AGREE II domain scores across the guidelines.</p>
</caption>
<graphic xlink:href="bmjopen2016011744f02"></graphic>
</fig>
<p>The domain ‘scope and purpose’ had the highest average score (mean score 45.1; median 44.4; range 22.2–63.9). All guidelines described the overall objectives and most described the target population, although not always very specifically. For most guidelines, the health question was not applicable and this item was therefore rated with an average score (score of 3). ‘Clarity of presentation’ also had a higher average domain score (mean score 42.5; median 44.4; range 11.1–80.6). Most guidelines provided relatively specific recommendations which varied in presentation (bullet points or generally phrased descriptions). The different options for management of the condition or health issue was also not applicable for most guidelines, but where applicable, different options were mentioned. In the domain ‘applicability’ (mean score 38.7; median 37.5; range 18.8–77.1), 40% of the guidelines regularly mentioned facilitators and barriers to its application and almost all guidelines presented some advice and/or tools on how the recommendations could be put into practice.</p>
<p>‘Stakeholder involvement’ (mean score 31.9; median 27.8; range 11.1–72.2) was highly variable. Half of the guidelines did not mention the contributors of the guideline development group, and in more than half it was not clear whether the views and preferences of the target population were sought. However, all the guidelines gave some description of the target users.</p>
<p>The domains with the lowest scores were ‘rigour of development’ (mean score 8.9; median 6.3; range 0.0–41.7) and ‘editorial independence’ (mean score 5.2; median 0.0; range 0.0–29.2). There was only one guideline<xref rid="R17" ref-type="bibr">17</xref>
that had an average to fairly good score on most items within the rigour of development domain. All other guidelines scored low to very low on all items of this domain. As for ‘editorial independence’, none of the guidelines provided a disclosure of interests and only seven guidelines reported the funding body, although they did not state their role in the development process.</p>
<p>The initial level of agreement between assessors was good (ICC 0.79, 95% CI (−1.870971 to 2.083532)). After discussion, some scores were adjusted and the level of agreement increased to very good (ICC 0.90, 95% CI (−1.240409 to 1.443307)).</p>
</sec>
<sec id="s3b2"><title>Overall quality and recommendation</title>
<p>The overall quality of the guidelines is moderate to low and quite variable; the mean overall quality score is 3 (median 3; range 2–4). No guideline can be ‘recommended for immediate use’, 23 guidelines are ‘recommended with modifications’ (mean score 3; median 3; range 2–4) and 4 guidelines are ‘not recommended’ (mean score 2; median 2; range 2–2; <xref ref-type="table" rid="BMJOPEN2016011744TB1">table 1</xref>
). This means that all guidelines fail to meet several aspects of good guideline development, which can have serious consequences for practice. For example, guidelines with a low score in the domains ‘stakeholder involvement’, ‘rigour of development’ and ‘editorial independence’ may contain recommendations that are ineffective or even harmful, which is a waste of time and effort. Guidelines with a low score in the domains ‘scope and purpose’, ‘clarity of presentation’ and ‘applicability’ may be guidelines that are not implementable and thus have no impact on practice. When we compare the scores of the individual domains, there is no consistent difference between the guidelines that are ‘recommended with modifications’ and guidelines that are ‘not recommended’, except that the latter guidelines all have the lowest applicability score. It can only be concluded that more effort needs to be made to revise guidelines with a lower score. Concrete recommendations concerning the revision of these guidelines are given in the Discussion section.</p>
</sec>
</sec>
</sec>
<sec id="s4"><title>Discussion and conclusions</title>
<p>The IFRC regularly drafts guidelines for the different fields of activities of the Red Cross & Red Crescent (RC&RC). These guidelines can be commissioned by a variety of Federation structures, from governing bodies to thematic RC&RC working groups, but there is no formal process for ‘officially’ initiating, drafting and approving a guideline. IFRC guidelines are written and published by the department responsible for the subject matter (eg, the Health Department wrote and published the nutrition guideline). Our study is the first to evaluate guidelines of the IFRC for quality, and the assessment was performed independently of the IFRC.</p>
<p>The quality assessment with AGREE II of the guidelines developed by the IFRC showed that there is a great variability in the quality of the guidelines developed. There is great overall variety between different guidelines, as well as a large variability within each domain of AGREE II (within guidelines; <xref ref-type="fig" rid="BMJOPEN2016011744F2">figure 2</xref>
). The domains that score best were scope and purpose, clarity of presentation and applicability. The lowest scoring domains were rigour of development and editorial independence. The very low score on the rigour of development domain for all guidelines but one (all guidelines scored an average of <2, except the ‘guidelines for the domestic facilitation and regulation of international disaster relief and initial recovery assistance’<xref rid="R17" ref-type="bibr">17</xref>
) indicates that the recommendations are usually not linked to supporting evidence, systematically collected from scientific literature searches. Furthermore, the low average score for taking into account target group experiences and expectations (1.98) indicates that in most cases the process relies heavily on expert opinion. Qualitative guidelines should be developed according to the method of ‘Evidence-Based Practice’. This means that the best available evidence is collected through systematic literature searches, which are important since guidelines that are mainly based on expert knowledge may be biased due to undeclared conflicts of interest, and a lack of or outdated knowledge.<xref rid="R39" ref-type="bibr">39</xref>
Evidence-based guidelines are generally considered to produce more valid recommendations.<xref rid="R40" ref-type="bibr">40</xref>
However, it is not always possible to support guidelines with evidence, since evidence is often lacking. For example, in an emergency setting, the priority is to help people in need, and it is usually perceived as unethical to perform research and test the effectiveness of interventions in such circumstances.<xref rid="R41" ref-type="bibr">41</xref>
However, the strength of the Evidence-Based Practice methodology is that, in addition to collecting the best available evidence, expert opinion and practice experience are also taken into account, as well as the preferences of the target group.<xref rid="R42" ref-type="bibr">42–44</xref>
Guideline recommendations are based on finding a balance between the quality of the evidence, benefits and harms, costs and preferences, and this applies to each of the three guideline categories that we defined for the purpose of this project (humanitarian aid, health issues, other). For guideline subjects for which existing evidence is scarce, as in the case of disaster aid, for example, more weight will be given to the aspect of collecting ‘expert opinion and practice experience’ and of formulating good practice points. It is important to do this in as unbiased a way as possible. It might therefore be interesting for those developing guidelines with a limited evidence base to use formal consensus methods, such as the Delphi method, nominal group technique and the consensus development conference.<xref rid="R45" ref-type="bibr">45</xref>
These methods provide an objective way to come to a decision, and are being used by other guideline development groups as well, for example, in the development of postdisaster psychosocial care guidelines, where a Delphi method was used to collect expert consensus from 106 experts.<xref rid="R46" ref-type="bibr">46</xref>
In an overview paper of guideline development methods, it was reported that ‘making group decisions and reaching consensus’ is mentioned in 17 different guideline methodology handbooks, and 13 handbooks provide a clear explanation about it.<xref rid="R47" ref-type="bibr">47</xref>
</p>
<p>The low score on the editorial independence domain does not necessarily mean that the majority of the guidelines could not guarantee editorial independence, but rather that no information on this subject was transparently reported. Nevertheless, it is well known that conflicts of interest can negatively influence the quality of guidelines and could result in disadvantages for the target group.<xref rid="R48" ref-type="bibr">48–50</xref>
Therefore, it is recommended to include enough methodologists (who are often unbiased about the content of a specific guideline), in addition to content experts (whose content expertise is needed, but who may have subjective opinions on certain topics). Content experts should be prevented from making decisions on recommendations where there is a conflict of interest.<xref rid="R51" ref-type="bibr">51</xref>
An additional approach to having an independent review by external experts is publication in an open-access peer-reviewed journal. This study, however, has some limitations. First, the quality assessment was performed by two assessors, as minimally recommended by AGREE II.<xref rid="R7" ref-type="bibr">7</xref>
More assessors could in theory increase the reliability of the assessment. However, since the inter-rater reliability between both assessors was good to very good (meaning there was a high agreement between both assessors), the view of an extra assessor is unlikely to influence the overall scores. Second, some challenges were encountered during the process. AGREE II is designed for guidelines in any disease area targeting any step in the healthcare continuum,<xref rid="R7" ref-type="bibr">7</xref>
and most of the guidelines developed by the IFRC are guidelines outside healthcare. AGREE II was used since this is the only tool specifically developed for quality assessment of guidelines, with use of a numeric scale to quantify guideline quality. We acknowledge that AGREE II is not developed for guidelines outside healthcare; however, while appraising the included guidelines for this project, we did not identify any problems in using this checklist for non-healthcare guidelines. Only 2 of the 23 items (items 2 and 11, <xref ref-type="boxed-text" rid="bx1">box 1</xref>
) dealt specifically with ‘health questions’ or ‘health benefits’, and the guidelines assessors agreed on a procedure to deal with this). By giving a score of 3 for those items (instead of excluding the item, which is discouraged by AGREE II<xref rid="R8" ref-type="bibr">8</xref>
), the overall score of the guideline will not be affected.</p>
<p>The IFRC produces guidelines that should be adhered to by millions of staff and volunteers in 190 countries. These guidelines therefore should be of high quality. Since none of the guidelines included in our analysis can be recommended for practice, all guidelines should ideally be revised (meaning that a ‘de novo guideline’ is developed), so that they comply with set quality standards before they are published and promoted, and they are developed following an agreed on guideline development process covering all stages from initiation, through development, to approval. Once this is the case, the guidelines should be updated regularly (ie, every 5 years) in order to take into account the changes in the operational environment, the role and mandates of the different humanitarian actors and the newly available scientific evidence. When setting priorities for guideline revision, several aspects can be taken into account: first, the four guidelines that are ‘not recommended’ for practice date from 2001, 2003, 2007 and 2010, and therefore their further use is probably not recommended. Second, based on the reach and impact of the guidelines, it could be decided which guidelines should be revised first.</p>
<p>A similar evaluation was performed for the WHO guidelines. In 2003, the WHO performed an in-house analysis, using the AGREE checklist. This analysis was followed by interviews conducted with Department Directors at the WHO headquarters, leading to the conclusion that evidence was rarely used in the development of guideline recommendations.<xref rid="R5" ref-type="bibr">5</xref>
As a consequence of these analyses, a Guideline Review Committee (GRC) was established in 2007 and a WHO Handbook of Guideline Development was published. Following this improvement in guideline development, a second quality appraisal analysis of a set of guidelines was made in 2013, making use of AGREE II. The latter analysis included 124 guidelines intended for a global audience, all concerning health interventions on a wide variety of topics (34% of all guidelines addressed HIV/AIDS and/or tuberculosis). It was concluded that the quality of the WHO guidelines is better, but further improvement is still necessary.<xref rid="R5" ref-type="bibr">5</xref>
From this experience, we know that documenting the quality of the WHO guidelines resulted in fewer, albeit higher quality, guidelines being developed.</p>
<p>In addition to guideline quality, guideline implementation is at least as important, since there may be barriers that hinder implementation of guidelines among a certain target group. Implementation strategies include strategies to promote guideline use.<xref rid="R52" ref-type="bibr">52</xref>
The AGREE II tool already takes into account some aspects that should facilitate implementation (eg, clarity of presentation, applicability). In addition, it is considered relevant to identify implementation barriers and facilitators, so that implementation strategies can take these into account in order to maximise impact.<xref rid="R53" ref-type="bibr">53</xref>
Various efforts have been made to facilitate guideline implementation, such as the development of a checklist for guideline implementation planning.<xref rid="R52" ref-type="bibr">52</xref>
</p>
<p>Considering that the IFRC has no uniform guideline development process and that the results of AGREE II indicate that the quality of the guidelines needs to be improved, the IFRC could improve its guidelines by:
<list list-type="bullet"><list-item><p>Setting up a formal procedure for guideline development and/or a revision process;</p>
</list-item>
<list-item><p>Setting up a GRC to ensure that IFRC guidelines are of high quality and are developed according to a transparent, evidence-based decision-making process;</p>
</list-item>
<list-item><p>Drafting a handbook to provide guidance on the development of guidelines and other documents detailing the procedures to be followed when submitting a guideline or document with recommendations to the GRC;</p>
</list-item>
<list-item><p>Setting up a formal procedure to monitor the implementation of the guidelines by the membership.</p>
</list-item>
</list>
</p>
<p>Some RC&RC National Societies already make efforts to produce evidence-based guidelines. In addition to the American Red Cross, which takes the initiative to follow the principles of Evidence-Based Practice, the Belgian Red Cross with its Centre for Evidence-Based Practice also works according to a methodological charter for the development of evidence-based guidelines and systematic reviews.<xref rid="R42" ref-type="bibr">42</xref>
</p>
<p>This paper thus forms a baseline measurement with regard to IFRC guidelines, which will help to monitor progress in the future, and can also be a first step in motivating all other components of the RC&RC Movement to develop evidence-based guidelines.</p>
</sec>
</body>
<back><fn-group><fn><p><bold>Contributors:</bold>
AVV contributed to the study design, literature search, data collection, data analysis, data interpretation and writing of the manuscript. VB contributed to the data collection, data analysis, data interpretation and writing of the manuscript. EDB and PV contributed to the study design and writing of the manuscript. All authors are employees at the Belgian Red Cross-Flanders and were involved in the development of this manuscript. They gave final approval of the version to be submitted.</p>
</fn>
<fn><p><bold>Funding:</bold>
This work was made possible through funding from the Foundation for Scientific Research of the Belgian Red Cross-Flanders.</p>
</fn>
<fn><p><bold>Competing interests:</bold>
The Belgian Red Cross is a member of the National Society of the International Federation of Red Cross and Red Crescent Societies (IFRC).</p>
</fn>
<fn><p><bold>Provenance and peer review:</bold>
Not commissioned; externally peer reviewed.</p>
</fn>
<fn><p><bold>Data sharing statement:</bold>
The scoring details of the guideline appraisal of each assessor are available on request from the corresponding author at axel.vandeveegaete@rodekruis.be.</p>
</fn>
</fn-group>
<ref-list><title>References</title>
<ref id="R1"><label>1</label>
<mixed-citation publication-type="book"><collab>International Federation of Red Cross and Red Crescent Societies (IFRC)</collab>
. <source>Everyone counts: key data from 189 National Red Cross and Red Crescent Societies—a baseline</source>
. <publisher-loc>Geneva</publisher-loc>
: <publisher-name>IFRC</publisher-name>
, <year>2014</year>
.</mixed-citation>
</ref>
<ref id="R2"><label>2</label>
<mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Oxman</surname>
<given-names>AD</given-names>
</name>
, <name><surname>Lavis</surname>
<given-names>JN</given-names>
</name>
, <name><surname>Fretheim</surname>
<given-names>A</given-names>
</name>
</person-group>
<article-title>Use of evidence in WHO recommendations</article-title>
. <source>Lancet</source>
<year>2007</year>
;<volume>369</volume>
:<fpage>1883</fpage>
–<lpage>9</lpage>
. <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1016/S0140-6736(07)60675-8">doi:10.1016/S0140-6736(07)60675-8</ext-link>
<pub-id pub-id-type="pmid">17493676</pub-id>
</mixed-citation>
</ref>
<ref id="R3"><label>3</label>
<mixed-citation publication-type="book"><collab>The Sphere Project</collab>
. <source>Humanitarian charter and minimum standards in disaster</source>
. <publisher-loc>UK</publisher-loc>
: <publisher-name>Practical Action Publishing</publisher-name>
, <year>2011</year>
.</mixed-citation>
</ref>
<ref id="R4"><label>4</label>
<mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Vandekerckhove</surname>
<given-names>P</given-names>
</name>
, <name><surname>Clarke</surname>
<given-names>MJ</given-names>
</name>
, <name><surname>De Buck</surname>
<given-names>E</given-names>
</name>
<etal>et al</etal>
</person-group>
<article-title>Second Evidence Aid Conference: prioritizing evidence in disaster aid</article-title>
. <source>Disaster Med Public Health Prep</source>
<year>2013</year>
;<volume>7</volume>
:<fpage>593</fpage>
–<lpage>6</lpage>
. <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1017/dmp.2013.109">doi:10.1017/dmp.2013.109</ext-link>
<pub-id pub-id-type="pmid">24444132</pub-id>
</mixed-citation>
</ref>
<ref id="R5"><label>5</label>
<mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Burda</surname>
<given-names>BU</given-names>
</name>
, <name><surname>Chambers</surname>
<given-names>AR</given-names>
</name>
, <name><surname>Johnson</surname>
<given-names>JC</given-names>
</name>
</person-group>
<article-title>Appraisal of guidelines developed by the World Health Organization</article-title>
. <source>Public Health</source>
<year>2014</year>
;<volume>128</volume>
:<fpage>444</fpage>
–<lpage>74</lpage>
. <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1016/j.puhe.2014.01.002">doi:10.1016/j.puhe.2014.01.002</ext-link>
<pub-id pub-id-type="pmid">24856197</pub-id>
</mixed-citation>
</ref>
<ref id="R6"><label>6</label>
<mixed-citation publication-type="other"><collab>Operational Research—Definition, Purpose and Framework (a Policy Framework)</collab>
. <year>2013</year>
<comment>Médecins Sans Frontières</comment>
.</mixed-citation>
</ref>
<ref id="R7"><label>7</label>
<mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Brouwers</surname>
<given-names>MC</given-names>
</name>
, <name><surname>Kho</surname>
<given-names>ME</given-names>
</name>
, <name><surname>Browman</surname>
<given-names>GP</given-names>
</name>
<etal>et al</etal>
</person-group>
<article-title>AGREE II: advancing guideline development, reporting and evaluation in health care</article-title>
. <source>CMAJ</source>
<year>2010</year>
;<volume>182</volume>
:<fpage>E839</fpage>
–<lpage>42</lpage>
. <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1503/cmaj.090449">doi:10.1503/cmaj.090449</ext-link>
<pub-id pub-id-type="pmid">20603348</pub-id>
</mixed-citation>
</ref>
<ref id="R8"><label>8</label>
<mixed-citation publication-type="other"><collab>AGREE Next Steps Consortium (2009)</collab>
. <comment>The AGREE II Instrument. 2013. <ext-link ext-link-type="uri" xlink:href="http://www.agreetrust.org/wp-content/uploads/2013/10/AGREE-II-Users-Manual-and-23-item-Instrument_2009_UPDATE_2013.pdf">http://www.agreetrust.org/wp-content/uploads/2013/10/AGREE-II-Users-Manual-and-23-item-Instrument_2009_UPDATE_2013.pdf</ext-link>
</comment>
.</mixed-citation>
</ref>
<ref id="R9"><label>9</label>
<mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Siering</surname>
<given-names>U</given-names>
</name>
, <name><surname>Eikermann</surname>
<given-names>M</given-names>
</name>
, <name><surname>Hausner</surname>
<given-names>E</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Appraisal tools for clinical practice guidelines: a systematic review</article-title>
. <source>PLoS ONE</source>
<year>2013</year>
;<volume>8</volume>
:<fpage>e82915</fpage>
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1371/journal.pone.0082915">doi:10.1371/journal.pone.0082915</ext-link>
<pub-id pub-id-type="pmid">24349397</pub-id>
</mixed-citation>
</ref>
<ref id="R10"><label>10</label>
<mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Altman</surname>
<given-names>DG</given-names>
</name>
</person-group>
<source>Practical statistics for medical research</source>
. <publisher-loc>London</publisher-loc>
: <publisher-name>Chapman and Hall</publisher-name>
, <year>1991</year>
.</mixed-citation>
</ref>
<ref id="R11"><label>11</label>
<mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ou</surname>
<given-names>Y</given-names>
</name>
, <name><surname>Goldberg</surname>
<given-names>I</given-names>
</name>
, <name><surname>Migdal</surname>
<given-names>C</given-names>
</name>
<etal>et al</etal>
</person-group>
<article-title>A critical appraisal and comparison of the quality and recommendations of glaucoma clinical practice guidelines</article-title>
. <source>Ophthalmology</source>
<year>2011</year>
;<volume>118</volume>
:<fpage>1017</fpage>
–<lpage>23</lpage>
. <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1016/j.ophtha.2011.03.038">doi:10.1016/j.ophtha.2011.03.038</ext-link>
<pub-id pub-id-type="pmid">21507487</pub-id>
</mixed-citation>
</ref>
<ref id="R12"><label>12</label>
<mixed-citation publication-type="book"><collab>International Federation of Red Cross and Red Crescent Societies (IFRC)</collab>
. <source>Children in disasters—games and guidelines to engage youth in risk reduction</source>
. <publisher-loc>Bangkok</publisher-loc>
: <publisher-name>IFRC, South East Asia Regional Office</publisher-name>
, <year>2010</year>
.</mixed-citation>
</ref>
<ref id="R13"><label>13</label>
<mixed-citation publication-type="book"><collab>International Federation of Red Cross and Red Crescent Societies (IFRC)</collab>
. <source>Earthquakes: guidelines on preparing, responding and recovering</source>
. <publisher-loc>Geneva</publisher-loc>
: <publisher-name>IFRC</publisher-name>
, <year>2012</year>
.</mixed-citation>
</ref>
<ref id="R14"><label>14</label>
<mixed-citation publication-type="book"><collab>International Federation of Red Cross and Red Crescent Societies (IFRC)</collab>
. <source>Global food security assessment guidelines: a step-by-step guide for National Societies</source>
. <publisher-loc>Geneva</publisher-loc>
: <publisher-name>IFRC</publisher-name>
, <year>2007</year>
.</mixed-citation>
</ref>
<ref id="R15"><label>15</label>
<mixed-citation publication-type="book"><collab>International Committee of the Red Cross (ICRC), International Federation of Red Cross and Red Crescent Societies (IFRC)</collab>
. <source>Guidelines for assessment in emergencies</source>
. <publisher-loc>Geneva</publisher-loc>
: <publisher-name>International Federation of Red Cross and Red Crescent Societies; International Committee of the Red Cross</publisher-name>
, <year>2008</year>
.</mixed-citation>
</ref>
<ref id="R16"><label>16</label>
<mixed-citation publication-type="book"><collab>International Federation of Red Cross and Red Crescent Societies (IFRC)</collab>
. <source>IFRC guidelines for livelihoods programming</source>
. <publisher-loc>Geneva</publisher-loc>
, <publisher-name>International Federation of Red Cross and Red Crescent Scocieties</publisher-name>
, <year>2010</year>
.</mixed-citation>
</ref>
<ref id="R17"><label>17</label>
<mixed-citation publication-type="book"><collab>International Federation of Red Cross and Red Crescent Societies (IFRC)</collab>
. <source>Introduction to the guidelines for the domestic facilitation and regulation of international disaster relief and initial recovery assistance</source>
. <publisher-loc>Geneva</publisher-loc>
, <publisher-name>International Federation of Red Cross and Red Crescent Societies</publisher-name>
, <year>2011</year>
.</mixed-citation>
</ref>
<ref id="R18"><label>18</label>
<mixed-citation publication-type="book"><collab>International Federation of Red Cross and Red Crescent Societies (IFRC)</collab>
. <source>Nuclear and radiological emergency guidelines: preparedness, response and recovery</source>
. <publisher-loc>Geneva</publisher-loc>
: <publisher-name>IFRC</publisher-name>
, <year>2015</year>
.</mixed-citation>
</ref>
<ref id="R19"><label>19</label>
<mixed-citation publication-type="book"><collab>International Federation of Red Cross and Red Crescent Societies (IFRC)</collab>
. <source>Owner-driven housing reconstruction guidelines</source>
. <publisher-loc>Geneva</publisher-loc>
: <publisher-name>International Federation of Red Cross and Red Crescent Societies</publisher-name>
, <year>2010</year>
.</mixed-citation>
</ref>
<ref id="R20"><label>20</label>
<mixed-citation publication-type="book"><collab>International Federation of Red Cross and Red Crescent Societies (IFRC)</collab>
. <source>Post-disaster community infrastructure rehabilitation and (re) construction guidelines</source>
. <publisher-loc>Geneva</publisher-loc>
, <publisher-name>IFRC</publisher-name>
, <year>2012</year>
.</mixed-citation>
</ref>
<ref id="R21"><label>21</label>
<mixed-citation publication-type="book"><collab>International Federation of Red Cross and Red Crescent Societies (IFRC)</collab>
. <source>Post-disaster settlement planning guidelines</source>
. <publisher-loc>Geneva</publisher-loc>
, <publisher-name>IFRC</publisher-name>
, <year>2012</year>
.</mixed-citation>
</ref>
<ref id="R22"><label>22</label>
<mixed-citation publication-type="book"><collab>International Federation of Red Cross and Red Crescent Societies (IFRC), International Committee of the Red Cross (ICRC)</collab>
. <source>Rapid assessment for markets: guidelines for an initial emergency market assessment</source>
. <publisher-loc>Geneva</publisher-loc>
, <publisher-name>ICRC</publisher-name>
, <year>2014</year>
.</mixed-citation>
</ref>
<ref id="R23"><label>23</label>
<mixed-citation publication-type="book"><collab>International Federation of Red Cross and Red Crescent Societies (IFRC)</collab>
. <source>Setting up a national disaster preparedness and response mechanism: guidelines for National Societies</source>
. <publisher-loc>Geneva</publisher-loc>
: <publisher-name>International Federation of Red Cross and Red Crescent Societies</publisher-name>
, <year>2010</year>
.</mixed-citation>
</ref>
<ref id="R24"><label>24</label>
<mixed-citation publication-type="book"><collab>International Federation of Red Cross and Red Crescent Societies (IFRC)</collab>
. <source>Volunteering in emergencies: practical guidelines for Red Cross and Red Crescent Societies managing volunteers in emergency situations</source>
. <publisher-loc>Geneva</publisher-loc>
: <publisher-name>International Federation of Red Cross and Red Crescent Societies</publisher-name>
, <year>2012</year>
.</mixed-citation>
</ref>
<ref id="R25"><label>25</label>
<mixed-citation publication-type="book"><collab>International Federation of Red Cross and Red Crescent Societies (IFRC)</collab>
. <source>Guidelines for the implementation of a psychological support programme in emergencies</source>
. <publisher-loc>Geneva</publisher-loc>
: <publisher-name>IFRC</publisher-name>
, <year>2001</year>
.</mixed-citation>
</ref>
<ref id="R26"><label>26</label>
<mixed-citation publication-type="book"><collab>International Federation of Red Cross and Red Crescent Societies (IFRC), International Committee of the Red Cross (ICRC)</collab>
. <source>Guidelines on first aid and HIV/AIDS</source>
. <publisher-loc>Geneva</publisher-loc>
: <publisher-name>International Federation of Red Cross and Red Crescent Societies</publisher-name>
, <year>2001</year>
.</mixed-citation>
</ref>
<ref id="R27"><label>27</label>
<mixed-citation publication-type="book"><collab>International Federation of Red Cross and Red Crescent Societies (IFRC)</collab>
. <source>HIV prevention: principles and guidelines for programming</source>
. <publisher-loc>Geneva</publisher-loc>
: <publisher-name>International Federation of Red Cross and Red Crescent Societies</publisher-name>
, <year>2009</year>
.</mixed-citation>
</ref>
<ref id="R28"><label>28</label>
<mixed-citation publication-type="book"><collab>International Federation of Red Cross and Red Crescent Societies (IFRC)</collab>
. <source>International first aid and resuscitation, guidelines 2011 for National Society first aid programme managers, scientific advisory groups, first aid instructors and first responders</source>
. <publisher-loc>Geneva</publisher-loc>
: <publisher-name>International Federation of Red Cross and Red Crescent Societies</publisher-name>
, <year>2011</year>
.</mixed-citation>
</ref>
<ref id="R29"><label>29</label>
<mixed-citation publication-type="book"><collab>International Federation of Red Cross and Red Crescent Societies (IFRC)</collab>
. <source>Nutrition guidelines</source>
. <publisher-loc>Geneva</publisher-loc>
: <publisher-name>IFRC</publisher-name>
, <year>2014</year>
.</mixed-citation>
</ref>
<ref id="R30"><label>30</label>
<mixed-citation publication-type="book"><collab>International Federation of Red Cross and Red Crescent Societies (IFRC)</collab>
. <source>Operational guidelines for involvement in tuberculosis control: Red Cross Red Crescent for a TB free world</source>
. <publisher-loc>Geneva</publisher-loc>
: <publisher-name>International Federation of Red Cross and Red Crescent Societies</publisher-name>
, <year>2007</year>
.</mixed-citation>
</ref>
<ref id="R31"><label>31</label>
<mixed-citation publication-type="book"><collab>International Federation of Red Cross and Red Crescent Societies (IFRC)</collab>
. <source>Orphans and other children made vulnerable by HIV/AIDS: principles and operational guidelines for programming</source>
. <publisher-loc>Geneva</publisher-loc>
: <publisher-name>International Federation of Red Cross and Red Crescent Societies</publisher-name>
, <year>2002</year>
.</mixed-citation>
</ref>
<ref id="R32"><label>32</label>
<mixed-citation publication-type="book"><collab>International Federation of Red Cross and Red Crescent Societies (IFRC)</collab>
. <source>Spreading the light of science: guidelines on harm reduction related to injecting drug use</source>
. <publisher-loc>Geneva</publisher-loc>
: <publisher-name>IFRC</publisher-name>
, <year>2003</year>
.</mixed-citation>
</ref>
<ref id="R33"><label>33</label>
<mixed-citation publication-type="book"><collab>International Federation of Red Cross and Red Crescent Societies (IFRC)</collab>
. <source>Governance: National Society—guidelines</source>
. <publisher-loc>Geneva</publisher-loc>
: <publisher-name>IFRC</publisher-name>
, <year>2003</year>
.</mixed-citation>
</ref>
<ref id="R34"><label>34</label>
<mixed-citation publication-type="book"><collab>International Committee of the Red Cross (ICRC), International Federation of Red Cross and Red Crescent Societies (IFRC)</collab>
. <source>Guidelines for cash transfer programming</source>
. <publisher-loc>Geneva</publisher-loc>
: <publisher-name>International Federation of Red Cross and Red Crescent Societies</publisher-name>
, <year>2007</year>
.</mixed-citation>
</ref>
<ref id="R35"><label>35</label>
<mixed-citation publication-type="book"><collab>International Federation of Red Cross and Red Crescent Societies</collab>
. <source>Income generating projects—guidelines: how to get started</source>
. <publisher-loc>Geneva</publisher-loc>
: <publisher-name>International Federation of Red Cross and Red Crescent Societies</publisher-name>
, <year>2001</year>
.</mixed-citation>
</ref>
<ref id="R36"><label>36</label>
<mixed-citation publication-type="book"><collab>International Federation of Red Cross and Red Crescent Societies (IFRC)</collab>
. <source>Practicing humanitarian diplomacy: an introduction. Humanitarian diplomacy guidance</source>
. <publisher-loc>Geneva</publisher-loc>
: <publisher-name>International Federation of Red Cross and Red Crescent Societies</publisher-name>
, <year>2012</year>
.</mixed-citation>
</ref>
<ref id="R37"><label>37</label>
<mixed-citation publication-type="book"><collab>International Federation of Red Cross and Red Crescent Societies (IFRC)</collab>
. <source>Strategic planning guidelines for National Societies: developing and implementing a Strategic Plan in a National Society</source>
. <publisher-loc>Geneva</publisher-loc>
: <publisher-name>IFRC</publisher-name>
, <year>2012</year>
.</mixed-citation>
</ref>
<ref id="R38"><label>38</label>
<mixed-citation publication-type="book"><collab>International Federation of Red Cross and Red Crescent Societies (IFRC)</collab>
. <source>Youth as agents of behavioural change: guidelines for peer educators working in community engagement</source>
. <publisher-loc>Tunis</publisher-loc>
: <publisher-name>IFRC, North Africa Regional Office</publisher-name>
, <year>2012</year>
.</mixed-citation>
</ref>
<ref id="R39"><label>39</label>
<mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Miller</surname>
<given-names>J</given-names>
</name>
, <name><surname>Petrie</surname>
<given-names>J</given-names>
</name>
</person-group>
<article-title>Development of practice guidelines</article-title>
. <source>Lancet</source>
<year>2000</year>
;<volume>355</volume>
:<fpage>82</fpage>
–<lpage>3</lpage>
. <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1016/S0140-6736(99)90326-4">doi:10.1016/S0140-6736(99)90326-4</ext-link>
<pub-id pub-id-type="pmid">10675160</pub-id>
</mixed-citation>
</ref>
<ref id="R40"><label>40</label>
<mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Cruse</surname>
<given-names>H</given-names>
</name>
, <name><surname>Winiarek</surname>
<given-names>M</given-names>
</name>
, <name><surname>Marshburn</surname>
<given-names>J</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Quality and methods of developing practice guidelines</article-title>
. <source>BMC Health Serv Res</source>
<year>2002</year>
;<volume>2</volume>
:<fpage>1</fpage>
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1186/1472-6963-2-1">doi:10.1186/1472-6963-2-1</ext-link>
<pub-id pub-id-type="pmid">11825346</pub-id>
</mixed-citation>
</ref>
<ref id="R41"><label>41</label>
<mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bradt</surname>
<given-names>DA</given-names>
</name>
, <name><surname>Aitken</surname>
<given-names>P</given-names>
</name>
</person-group>
<article-title>Disaster medicine reporting: the need for new guidelines and the CONFIDE statement</article-title>
. <source>Emerg Med Australas</source>
<year>2010</year>
;<volume>22</volume>
:<fpage>483</fpage>
–<lpage>7</lpage>
. <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1111/j.1742-6723.2010.01342.x">doi:10.1111/j.1742-6723.2010.01342.x</ext-link>
<pub-id pub-id-type="pmid">21143395</pub-id>
</mixed-citation>
</ref>
<ref id="R42"><label>42</label>
<mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>De Buck</surname>
<given-names>E</given-names>
</name>
, <name><surname>Pauwels</surname>
<given-names>NS</given-names>
</name>
, <name><surname>Dieltjens</surname>
<given-names>T</given-names>
</name>
<etal>et al</etal>
</person-group>
<article-title>Use of evidence-based practice in an aid organisation: a proposal to deal with the variety in terminology and methodology</article-title>
. <source>Int J Evid Based Healthc</source>
<year>2014</year>
;<volume>12</volume>
:<fpage>39</fpage>
–<lpage>49</lpage>
. <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1097/01.XEB.0000444637.88465.a3">doi:10.1097/01.XEB.0000444637.88465.a3</ext-link>
<pub-id pub-id-type="pmid">24685899</pub-id>
</mixed-citation>
</ref>
<ref id="R43"><label>43</label>
<mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Eccles</surname>
<given-names>MP</given-names>
</name>
, <name><surname>Grimshaw</surname>
<given-names>JM</given-names>
</name>
, <name><surname>Shekelle</surname>
<given-names>P</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Developing clinical practice guidelines: target audiences, identifying topics for guidelines, guideline group composition and functioning and conflicts of interest</article-title>
. <source>Implement Sci</source>
<year>2012</year>
;<volume>7</volume>
:<fpage>60</fpage>
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1186/1748-5908-7-60">doi:10.1186/1748-5908-7-60</ext-link>
<pub-id pub-id-type="pmid">22762776</pub-id>
</mixed-citation>
</ref>
<ref id="R44"><label>44</label>
<mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Shekelle</surname>
<given-names>P</given-names>
</name>
, <name><surname>Woolf</surname>
<given-names>S</given-names>
</name>
, <name><surname>Grimshaw</surname>
<given-names>JM</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Developing clinical practice guidelines: reviewing, reporting, and publishing guidelines; updating guidelines; and the emerging issues of enhancing guideline implementability and accounting for comorbid conditions in guideline development</article-title>
. <source>Implement Sci</source>
<year>2012</year>
;<volume>7</volume>
:<fpage>62</fpage>
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1186/1748-5908-7-62">doi:10.1186/1748-5908-7-62</ext-link>
<pub-id pub-id-type="pmid">22762242</pub-id>
</mixed-citation>
</ref>
<ref id="R45"><label>45</label>
<mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>James</surname>
<given-names>D</given-names>
</name>
, <name><surname>Warren-Forward</surname>
<given-names>H</given-names>
</name>
</person-group>
<article-title>Research methods for formal consensus development</article-title>
. <source>Nurse Res</source>
<year>2015</year>
;<volume>22</volume>
:<fpage>35</fpage>
–<lpage>40</lpage>
. <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.7748/nr.22.3.35.e1297">doi:10.7748/nr.22.3.35.e1297</ext-link>
<pub-id pub-id-type="pmid">25587865</pub-id>
</mixed-citation>
</ref>
<ref id="R46"><label>46</label>
<mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bisson</surname>
<given-names>JI</given-names>
</name>
, <name><surname>Tavakoly</surname>
<given-names>B</given-names>
</name>
, <name><surname>Witteveen</surname>
<given-names>AB</given-names>
</name>
<etal>et al</etal>
</person-group>
<article-title>TENTS guidelines: development of post-disaster psychosocial care guidelines through a Delphi process</article-title>
. <source>Br J Psychiatry</source>
<year>2010</year>
;<volume>196</volume>
:<fpage>69</fpage>
–<lpage>74</lpage>
. <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1192/bjp.bp.109.066266">doi:10.1192/bjp.bp.109.066266</ext-link>
<pub-id pub-id-type="pmid">20044665</pub-id>
</mixed-citation>
</ref>
<ref id="R47"><label>47</label>
<mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ansari</surname>
<given-names>S</given-names>
</name>
, <name><surname>Rashidian</surname>
<given-names>A</given-names>
</name>
</person-group>
<article-title>Guidelines for guidelines: are they up to the task? A comparative assessment of clinical practice guideline development handbooks</article-title>
. <source>PLoS ONE</source>
<year>2012</year>
;<volume>7</volume>
:<fpage>e49864</fpage>
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1371/journal.pone.0049864">doi:10.1371/journal.pone.0049864</ext-link>
<pub-id pub-id-type="pmid">23189167</pub-id>
</mixed-citation>
</ref>
<ref id="R48"><label>48</label>
<mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Lo</surname>
<given-names>B</given-names>
</name>
, <name><surname>Field</surname>
<given-names>MJ</given-names>
</name>
</person-group>
<source>Conflict of Interest in Medical Research, Education, and Practice</source>
. <publisher-loc>Washington DC</publisher-loc>
: <publisher-name>National Academies Press (US)</publisher-name>
, <year>2009</year>
.</mixed-citation>
</ref>
<ref id="R49"><label>49</label>
<mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Akl</surname>
<given-names>EA</given-names>
</name>
, <name><surname>El-Hachem</surname>
<given-names>P</given-names>
</name>
, <name><surname>Abou-Haidar</surname>
<given-names>H</given-names>
</name>
<etal>et al</etal>
</person-group>
<article-title>Considering intellectual, in addition to financial, conflicts of interest proved important in a clinical practice guideline: a descriptive study</article-title>
. <source>J Clin Epidemiol</source>
<year>2014</year>
;<volume>67</volume>
:<fpage>1222</fpage>
–<lpage>8</lpage>
. <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1016/j.jclinepi.2014.05.006">doi:10.1016/j.jclinepi.2014.05.006</ext-link>
<pub-id pub-id-type="pmid">24970099</pub-id>
</mixed-citation>
</ref>
<ref id="R50"><label>50</label>
<mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gale</surname>
<given-names>EAM</given-names>
</name>
</person-group>
<article-title>Conflicts of interest in guideline panel members</article-title>
. <source>BMJ</source>
<year>2011</year>
;<volume>343</volume>
:<fpage>d5728</fpage>
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1136/bmj.d5728">doi:10.1136/bmj.d5728</ext-link>
<pub-id pub-id-type="pmid">21990258</pub-id>
</mixed-citation>
</ref>
<ref id="R51"><label>51</label>
<mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Neumann</surname>
<given-names>I</given-names>
</name>
, <name><surname>Karl</surname>
<given-names>R</given-names>
</name>
, <name><surname>Rajpal</surname>
<given-names>A</given-names>
</name>
<etal>et al</etal>
</person-group>
<article-title>Experiences with a novel policy for managing conflicts of interest of guideline developers: a descriptive qualitative study</article-title>
. <source>Chest</source>
<year>2013</year>
;<volume>144</volume>
:<fpage>398</fpage>
–<lpage>404</lpage>
. <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1378/chest.12-2390">doi:10.1378/chest.12-2390</ext-link>
<pub-id pub-id-type="pmid">23412682</pub-id>
</mixed-citation>
</ref>
<ref id="R52"><label>52</label>
<mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gagliardi</surname>
<given-names>AR</given-names>
</name>
, <name><surname>Marshall</surname>
<given-names>C</given-names>
</name>
, <name><surname>Huckson</surname>
<given-names>S</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Developing a checklist for guideline implementation planning: review and synthesis of guideline development and implementation advice</article-title>
. <source>Implement Sci</source>
<year>2015</year>
;<volume>10</volume>
:<fpage>19</fpage>
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1186/s13012-015-0205-5">doi:10.1186/s13012-015-0205-5</ext-link>
<pub-id pub-id-type="pmid">25884601</pub-id>
</mixed-citation>
</ref>
<ref id="R53"><label>53</label>
<mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gagliardi</surname>
<given-names>AR</given-names>
</name>
, <name><surname>Alhabib</surname>
<given-names>S</given-names>
</name>
</person-group>
; <collab>members of Guidelines International Network Implementation Working Group</collab>
. <article-title>Trends in guideline implementation: a scoping systematic review</article-title>
. <source>Implement Sci</source>
<year>2015</year>
;<volume>10</volume>
:<fpage>54</fpage>
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1186/s13012-015-0247-8">doi:10.1186/s13012-015-0247-8</ext-link>
<pub-id pub-id-type="pmid">25895908</pub-id>
</mixed-citation>
</ref>
</ref-list>
</back>
</pmc>
</record>
Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Wicri/Belgique/explor/OpenAccessBelV2/Data/Pmc/Corpus
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000326 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Pmc/Corpus/biblio.hfd -nk 000326 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien |wiki= Wicri/Belgique |area= OpenAccessBelV2 |flux= Pmc |étape= Corpus |type= RBID |clé= |texte= }}
![]() | This area was generated with Dilib version V0.6.25. | ![]() |