Contribution of Systematic Reviews to Management Decisions
Identifieur interne : 000355 ( Pmc/Corpus ); précédent : 000354; suivant : 000356Contribution of Systematic Reviews to Management Decisions
Auteurs : Carly N. Cook ; Hugh P. Possingham ; Richard A. FullerSource :
- Conservation Biology [ 0888-8892 ] ; 2013.
Abstract
Systematic reviews comprehensively summarize evidence about the effectiveness of conservation interventions. We investigated the contribution to management decisions made by this growing body of literature. We identified 43 systematic reviews of conservation evidence, 23 of which drew some concrete conclusions relevant to management. Most reviews addressed conservation interventions relevant to policy decisions; only 35% considered practical on-the-ground management interventions. The majority of reviews covered only a small fraction of the geographic and taxonomic breadth they aimed to address (median = 13% of relevant countries and 16% of relevant taxa). The likelihood that reviews contained at least some implications for management tended to increase as geographic coverage increased and to decline as taxonomic breadth increased. These results suggest the breadth of a systematic review requires careful consideration. Reviews identified a mean of 312 relevant primary studies but excluded 88% of these because of deficiencies in design or a failure to meet other inclusion criteria. Reviews summarized on average 284 data sets and 112 years of research activity, yet the likelihood that their results had at least some implications for management did not increase as the amount of primary research summarized increased. In some cases, conclusions were elusive despite the inclusion of hundreds of data sets and years of cumulative research activity. Systematic reviews are an important part of the conservation decision making tool kit, although we believe the benefits of systematic reviews could be significantly enhanced by increasing the number of reviews focused on questions of direct relevance to on-the-ground managers; defining a more focused geographic and taxonomic breadth that better reflects available data; including a broader range of evidence types; and appraising the cost-effectiveness of interventions.
Contribuciones de las Revisiones Sistemáticas a las Decisiones de Manejo
Las revisiones sistemáticas resumen integralmente la evidencia sobre la efectividad de las intervenciones de conservación. Investigamos la contribución de las decisiones de manejo hechas por este creciente cuerpo de literatura. Identificamos 43 revisiones sistemáticas de evidencia de conservación, 23 de las cuales hicieron algunas conclusiones concretas relevantes al manejo. La mayoría de las revisiones se dirigían a intervenciones de conservación relevantes a las decisiones políticas; sólo el 35% consideraba intervenciones de manejo sobre-la-causa prácticas. La mayoría de las revisiones cubrieron solo una pequeña fracción de la amplitud geográfica y taxonómica a la que buscaban dirigirse (mediana = 13% de los países relevantes y 16% de los taxones relevantes). La probabilidad de que las revisiones tuvieran por lo menos algunas implicaciones para el manejo tendió a incrementar conforme la cobertura geográfica incrementaba y a declinar conforme aumentaba la amplitud taxonómica. Estos resultados sugieren que la amplitud de una revisión taxonómica requiere de una consideración cuidadosa. Las revisiones identificaron una media de 312 estudios primarios relevantes pero excluyeron 88% de estos por deficiencias en el diseño o fallas para coincidir con otros criterios de inclusión. Las revisiones resumieron en promedio 248 juegos de datos y 112 años de actividad de investigación, pero la probabilidad de que sus resultados tuvieran por lo menos algunas implicaciones para el manejo no incrementaron mientras la cantidad de investigación primaria resumida aumentaba. En algunos casos, las conclusiones fueron elusivas a pesar de la inclusión de cientos de conjuntos de datos y años de actividad de investigación acumulada. Las revisiones sistemáticas son una parte importante del juego de herramientas en la toma de decisiones de conservación, aunque consideramos que los beneficios de las revisiones sistemáticas podrían ser mejorados significativamente al incrementar el número de revisiones centradas en preguntas con relevancia directa a administradores sobre-la-causa; definiendo una amplitud geográfica y taxonómica más enfocada que reflejo los datos disponibles; incluyendo un rango más amplio de tipos de evidencia; y evaluando la efectividad de costo de las intervenciones.
Url:
DOI: 10.1111/cobi.12114
PubMed: 24001025
PubMed Central: 4232040
Links to Exploration step
PMC:4232040Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">Contribution of Systematic Reviews to Management Decisions</title><author><name sortKey="Cook, Carly N" sort="Cook, Carly N" uniqKey="Cook C" first="Carly N" last="Cook">Carly N. Cook</name><affiliation><nlm:aff>NONE</nlm:aff></affiliation><affiliation><nlm:aff>NONE</nlm:aff></affiliation></author><author><name sortKey="Possingham, Hugh P" sort="Possingham, Hugh P" uniqKey="Possingham H" first="Hugh P" last="Possingham">Hugh P. Possingham</name><affiliation><nlm:aff>NONE</nlm:aff></affiliation></author><author><name sortKey="Fuller, Richard A" sort="Fuller, Richard A" uniqKey="Fuller R" first="Richard A" last="Fuller">Richard A. Fuller</name><affiliation><nlm:aff>NONE</nlm:aff></affiliation></author></titleStmt><publicationStmt><idno type="wicri:source">PMC</idno><idno type="pmid">24001025</idno><idno type="pmc">4232040</idno><idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4232040</idno><idno type="RBID">PMC:4232040</idno><idno type="doi">10.1111/cobi.12114</idno><date when="2013">2013</date><idno type="wicri:Area/Pmc/Corpus">000355</idno></publicationStmt><sourceDesc><biblStruct><analytic><title xml:lang="en" level="a" type="main">Contribution of Systematic Reviews to Management Decisions</title><author><name sortKey="Cook, Carly N" sort="Cook, Carly N" uniqKey="Cook C" first="Carly N" last="Cook">Carly N. Cook</name><affiliation><nlm:aff>NONE</nlm:aff></affiliation><affiliation><nlm:aff>NONE</nlm:aff></affiliation></author><author><name sortKey="Possingham, Hugh P" sort="Possingham, Hugh P" uniqKey="Possingham H" first="Hugh P" last="Possingham">Hugh P. Possingham</name><affiliation><nlm:aff>NONE</nlm:aff></affiliation></author><author><name sortKey="Fuller, Richard A" sort="Fuller, Richard A" uniqKey="Fuller R" first="Richard A" last="Fuller">Richard A. Fuller</name><affiliation><nlm:aff>NONE</nlm:aff></affiliation></author></analytic><series><title level="j">Conservation Biology</title><idno type="ISSN">0888-8892</idno><idno type="eISSN">1523-1739</idno><imprint><date when="2013">2013</date></imprint></series></biblStruct></sourceDesc></fileDesc><profileDesc><textClass></textClass></profileDesc></teiHeader><front><div type="abstract" xml:lang="en"><p>Systematic reviews comprehensively summarize evidence about the effectiveness of conservation interventions. We investigated the contribution to management decisions made by this growing body of literature. We identified 43 systematic reviews of conservation evidence, 23 of which drew some concrete conclusions relevant to management. Most reviews addressed conservation interventions relevant to policy decisions; only 35% considered practical on-the-ground management interventions. The majority of reviews covered only a small fraction of the geographic and taxonomic breadth they aimed to address (median = 13% of relevant countries and 16% of relevant taxa). The likelihood that reviews contained at least some implications for management tended to increase as geographic coverage increased and to decline as taxonomic breadth increased. These results suggest the breadth of a systematic review requires careful consideration. Reviews identified a mean of 312 relevant primary studies but excluded 88% of these because of deficiencies in design or a failure to meet other inclusion criteria. Reviews summarized on average 284 data sets and 112 years of research activity, yet the likelihood that their results had at least some implications for management did not increase as the amount of primary research summarized increased. In some cases, conclusions were elusive despite the inclusion of hundreds of data sets and years of cumulative research activity. Systematic reviews are an important part of the conservation decision making tool kit, although we believe the benefits of systematic reviews could be significantly enhanced by increasing the number of reviews focused on questions of direct relevance to on-the-ground managers; defining a more focused geographic and taxonomic breadth that better reflects available data; including a broader range of evidence types; and appraising the cost-effectiveness of interventions.</p><p>Contribuciones de las Revisiones Sistemáticas a las Decisiones de Manejo</p><sec><title>Resumen</title><p>Las revisiones sistemáticas resumen integralmente la evidencia sobre la efectividad de las intervenciones de conservación. Investigamos la contribución de las decisiones de manejo hechas por este creciente cuerpo de literatura. Identificamos 43 revisiones sistemáticas de evidencia de conservación, 23 de las cuales hicieron algunas conclusiones concretas relevantes al manejo. La mayoría de las revisiones se dirigían a intervenciones de conservación relevantes a las decisiones políticas; sólo el 35% consideraba intervenciones de manejo sobre-la-causa prácticas. La mayoría de las revisiones cubrieron solo una pequeña fracción de la amplitud geográfica y taxonómica a la que buscaban dirigirse (mediana = 13% de los países relevantes y 16% de los taxones relevantes). La probabilidad de que las revisiones tuvieran por lo menos algunas implicaciones para el manejo tendió a incrementar conforme la cobertura geográfica incrementaba y a declinar conforme aumentaba la amplitud taxonómica. Estos resultados sugieren que la amplitud de una revisión taxonómica requiere de una consideración cuidadosa. Las revisiones identificaron una media de 312 estudios primarios relevantes pero excluyeron 88% de estos por deficiencias en el diseño o fallas para coincidir con otros criterios de inclusión. Las revisiones resumieron en promedio 248 juegos de datos y 112 años de actividad de investigación, pero la probabilidad de que sus resultados tuvieran por lo menos algunas implicaciones para el manejo no incrementaron mientras la cantidad de investigación primaria resumida aumentaba. En algunos casos, las conclusiones fueron elusivas a pesar de la inclusión de cientos de conjuntos de datos y años de actividad de investigación acumulada. Las revisiones sistemáticas son una parte importante del juego de herramientas en la toma de decisiones de conservación, aunque consideramos que los beneficios de las revisiones sistemáticas podrían ser mejorados significativamente al incrementar el número de revisiones centradas en preguntas con relevancia directa a administradores sobre-la-causa; definiendo una amplitud geográfica y taxonómica más enfocada que reflejo los datos disponibles; incluyendo un rango más amplio de tipos de evidencia; y evaluando la efectividad de costo de las intervenciones.</p></sec></div></front><back><div1 type="bibliography"><listBibl><biblStruct><analytic><author><name sortKey="Abella, Sr" uniqKey="Abella S">SR Abella</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Baxter, Pwj" uniqKey="Baxter P">PWJ Baxter</name></author><author><name sortKey="Mccarthy, Ma" uniqKey="Mccarthy M">MA McCarthy</name></author><author><name sortKey="Possingham, Hp" uniqKey="Possingham H">HP Possingham</name></author><author><name sortKey="Menkhorst, Pw" uniqKey="Menkhorst P">PW Menkhorst</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Bayard, Ts" uniqKey="Bayard T">TS Bayard</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Benitez L Pez, A" uniqKey="Benitez L Pez A">A Benítez-López</name></author><author><name sortKey="Alkemade, R" uniqKey="Alkemade R">R Alkemade</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Bowler, De" uniqKey="Bowler D">DE Bowler</name></author><author><name sortKey="Buyung Ali, Lm" uniqKey="Buyung Ali L">LM Buyung-Ali</name></author><author><name sortKey="Healey, Jr" uniqKey="Healey J">JR Healey</name></author><author><name sortKey="Jones, Jpg" uniqKey="Jones J">JPG Jones</name></author><author><name sortKey="Knight, Tm" uniqKey="Knight T">TM Knight</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Braunisch, V" uniqKey="Braunisch V">V Braunisch</name></author><author><name sortKey="Home, R" uniqKey="Home R">R Home</name></author><author><name sortKey="Pellet, J" uniqKey="Pellet J">J Pellet</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Brooks, Js" uniqKey="Brooks J">JS Brooks</name></author><author><name sortKey="Franzen, Ma" uniqKey="Franzen M">MA Franzen</name></author><author><name sortKey="Holmes, Cm" uniqKey="Holmes C">CM Holmes</name></author><author><name sortKey="Grote, Mn" uniqKey="Grote M">MN Grote</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Bussell, J" uniqKey="Bussell J">J Bussell</name></author><author><name sortKey="Jones, Dl" uniqKey="Jones D">DL Jones</name></author><author><name sortKey="Healey, Jr" uniqKey="Healey J">JR Healey</name></author></analytic></biblStruct><biblStruct></biblStruct><biblStruct><analytic><author><name sortKey="Chalmers, I" uniqKey="Chalmers I">I Chalmers</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Cochrane, Al" uniqKey="Cochrane A">AL Cochrane</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Cook, Cn" uniqKey="Cook C">CN Cook</name></author><author><name sortKey="Carter, Rw" uniqKey="Carter R">RW Carter</name></author><author><name sortKey="Fuller, Ra" uniqKey="Fuller R">RA Fuller</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Cook, Cn" uniqKey="Cook C">CN Cook</name></author><author><name sortKey="Hockings, M" uniqKey="Hockings M">M Hockings</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Cook, Cn" uniqKey="Cook C">CN Cook</name></author><author><name sortKey="Mascia, Mb" uniqKey="Mascia M">MB Mascia</name></author><author><name sortKey="Schwartz, Mw" uniqKey="Schwartz M">MW Schwartz</name></author><author><name sortKey="Possingham, Hp" uniqKey="Possingham H">HP Possingham</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Dalrymple, Se" uniqKey="Dalrymple S">SE Dalrymple</name></author><author><name sortKey="Stewart, Gb" uniqKey="Stewart G">GB Stewart</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Davies, Zg" uniqKey="Davies Z">ZG Davies</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Davies, Zg" uniqKey="Davies Z">ZG Davies</name></author><author><name sortKey="Tyler, C" uniqKey="Tyler C">C Tyler</name></author><author><name sortKey="Stewart, Gb" uniqKey="Stewart G">GB Stewart</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Doerr, Vaj" uniqKey="Doerr V">VAJ Doerr</name></author><author><name sortKey="Doerr, Ed" uniqKey="Doerr E">ED Doerr</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Eycott, A" uniqKey="Eycott A">A Eycott</name></author><author><name sortKey="Watts, K" uniqKey="Watts K">K Watts</name></author><author><name sortKey="Brandt, G" uniqKey="Brandt G">G Brandt</name></author><author><name sortKey="Buyung Ali, L" uniqKey="Buyung Ali L">L Buyung-Ali</name></author><author><name sortKey="Bowler, D" uniqKey="Bowler D">D Bowler</name></author><author><name sortKey="Stewart, Gb" uniqKey="Stewart G">GB Stewart</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Eycott, Ae" uniqKey="Eycott A">AE Eycott</name></author><author><name sortKey="Stewart, Gb" uniqKey="Stewart G">GB Stewart</name></author><author><name sortKey="Buyung Ali, Lm" uniqKey="Buyung Ali L">LM Buyung-Ali</name></author><author><name sortKey="Bowler, De" uniqKey="Bowler D">DE Bowler</name></author><author><name sortKey="Watts, K" uniqKey="Watts K">K Watts</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Fazey, I" uniqKey="Fazey I">I Fazey</name></author><author><name sortKey="Fischer, J" uniqKey="Fischer J">J Fischer</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Fazey, I" uniqKey="Fazey I">I Fazey</name></author><author><name sortKey="Salisbury, Jg" uniqKey="Salisbury J">JG Salisbury</name></author><author><name sortKey="Lindenmayer, Db" uniqKey="Lindenmayer D">DB Lindenmayer</name></author><author><name sortKey="Maindonald, J" uniqKey="Maindonald J">J Maindonald</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Ferraro, Pj" uniqKey="Ferraro P">PJ Ferraro</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Forsyth, G" uniqKey="Forsyth G">G Forsyth</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Frampton, Gk" uniqKey="Frampton G">GK Frampton</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Gibbons, P" uniqKey="Gibbons P">P Gibbons</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Greet, J" uniqKey="Greet J">J Greet</name></author><author><name sortKey="Webb, Ja" uniqKey="Webb J">JA Webb</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Gusset, M" uniqKey="Gusset M">M Gusset</name></author><author><name sortKey="Stewart, Gb" uniqKey="Stewart G">GB Stewart</name></author><author><name sortKey="Bowler, De" uniqKey="Bowler D">DE Bowler</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Hansen, Hf" uniqKey="Hansen H">HF Hansen</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Hawkins, Ba" uniqKey="Hawkins B">BA Hawkins</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Higgins, Jpt" uniqKey="Higgins J">JPT Higgins</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Holt, Ar" uniqKey="Holt A">AR Holt</name></author><author><name sortKey="Davies, Zg" uniqKey="Davies Z">ZG Davies</name></author><author><name sortKey="Tyler, C" uniqKey="Tyler C">C Tyler</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Isasi Catala, E" uniqKey="Isasi Catala E">E Isasi-Catalá</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Kabat, Tj" uniqKey="Kabat T">TJ Kabat</name></author><author><name sortKey="Stewart, Gb" uniqKey="Stewart G">GB Stewart</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Kalies, El" uniqKey="Kalies E">EL Kalies</name></author><author><name sortKey="Chambers, Cl" uniqKey="Chambers C">CL Chambers</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Kareiva, P" uniqKey="Kareiva P">P Kareiva</name></author><author><name sortKey="Marvier, M" uniqKey="Marvier M">M Marvier</name></author><author><name sortKey="West, S" uniqKey="West S">S West</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Kettenring, Km" uniqKey="Kettenring K">KM Kettenring</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Linklater, Wl" uniqKey="Linklater W">WL Linklater</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Magurran, Ae" uniqKey="Magurran A">AE Magurran</name></author><author><name sortKey="Baillie, Sr" uniqKey="Baillie S">SR Baillie</name></author><author><name sortKey="Buckland, St" uniqKey="Buckland S">ST Buckland</name></author><author><name sortKey="Dick, Jmcp" uniqKey="Dick J">JMcP Dick</name></author><author><name sortKey="Elston, Da" uniqKey="Elston D">DA Elston</name></author><author><name sortKey="Scott, Em" uniqKey="Scott E">EM Scott</name></author><author><name sortKey="Smith, Ri" uniqKey="Smith R">RI Smith</name></author><author><name sortKey="Somerfield, Pj" uniqKey="Somerfield P">PJ Somerfield</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Mant, R" uniqKey="Mant R">R Mant</name></author><author><name sortKey="Jones, D" uniqKey="Jones D">D Jones</name></author><author><name sortKey="Reynolds, B" uniqKey="Reynolds B">B Reynolds</name></author><author><name sortKey="Ormerod, S" uniqKey="Ormerod S">S Ormerod</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Martinez Abrain, A" uniqKey="Martinez Abrain A">A Martinez-Abrain</name></author><author><name sortKey="Oro, D" uniqKey="Oro D">D Oro</name></author><author><name sortKey="Jimenez, J" uniqKey="Jimenez J">J Jimenez</name></author><author><name sortKey="Stewart, G" uniqKey="Stewart G">G Stewart</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Maynard, A" uniqKey="Maynard A">A Maynard</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Mcleod, Lj" uniqKey="Mcleod L">LJ McLeod</name></author><author><name sortKey="Saunders, Gr" uniqKey="Saunders G">GR Saunders</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Meffe, Gk" uniqKey="Meffe G">GK Meffe</name></author><author><name sortKey="Ehrenfeld, D" uniqKey="Ehrenfeld D">D Ehrenfeld</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Mulrow, Cd" uniqKey="Mulrow C">CD Mulrow</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Newton, Ac" uniqKey="Newton A">AC Newton</name></author><author><name sortKey="Stewart, Gb" uniqKey="Stewart G">GB Stewart</name></author><author><name sortKey="Diaz, A" uniqKey="Diaz A">A Diaz</name></author><author><name sortKey="Golicher, D" uniqKey="Golicher D">D Golicher</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Newton, Ac" uniqKey="Newton A">AC Newton</name></author><author><name sortKey="Stewart, Gb" uniqKey="Stewart G">GB Stewart</name></author><author><name sortKey="Myers, G" uniqKey="Myers G">G Myers</name></author><author><name sortKey="Diaz, A" uniqKey="Diaz A">A Diaz</name></author><author><name sortKey="Lake, S" uniqKey="Lake S">S Lake</name></author><author><name sortKey="Bullock, Jm" uniqKey="Bullock J">JM Bullock</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Norris, Rh" uniqKey="Norris R">RH Norris</name></author><author><name sortKey="Webb, Ja" uniqKey="Webb J">JA Webb</name></author><author><name sortKey="Nichols, Sj" uniqKey="Nichols S">SJ Nichols</name></author><author><name sortKey="Stewartson, Mj" uniqKey="Stewartson M">MJ Stewartson</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Oro, D" uniqKey="Oro D">D Oro</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Peppin, D" uniqKey="Peppin D">D Peppin</name></author><author><name sortKey="Fule, Pz" uniqKey="Fule P">PZ Fule</name></author><author><name sortKey="Sieg, Ch" uniqKey="Sieg C">CH Sieg</name></author><author><name sortKey="Beyers, Jl" uniqKey="Beyers J">JL Beyers</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Petticrew, M" uniqKey="Petticrew M">M Petticrew</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Pfeffer, J" uniqKey="Pfeffer J">J Pfeffer</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Pullin, As" uniqKey="Pullin A">AS Pullin</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Pullin, As" uniqKey="Pullin A">AS Pullin</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Pullin, As" uniqKey="Pullin A">AS Pullin</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Pullin, As" uniqKey="Pullin A">AS Pullin</name></author><author><name sortKey="Knight, Tm" uniqKey="Knight T">TM Knight</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Pullin, As" uniqKey="Pullin A">AS Pullin</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Radwan, J" uniqKey="Radwan J">J Radwan</name></author><author><name sortKey="Biedrzycka, A" uniqKey="Biedrzycka A">A Biedrzycka</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Roberts, Pd" uniqKey="Roberts P">PD Roberts</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Roberts, Pd" uniqKey="Roberts P">PD Roberts</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Roberts, Pd" uniqKey="Roberts P">PD Roberts</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Roberts, Pd" uniqKey="Roberts P">PD Roberts</name></author><author><name sortKey="Stewart, Gb" uniqKey="Stewart G">GB Stewart</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Segan, Db" uniqKey="Segan D">DB Segan</name></author><author><name sortKey="Bottrill, Mc" uniqKey="Bottrill M">MC Bottrill</name></author><author><name sortKey="Baxter, Pwj" uniqKey="Baxter P">PWJ Baxter</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Showler, Da" uniqKey="Showler D">DA Showler</name></author><author><name sortKey="Stewart, Gb" uniqKey="Stewart G">GB Stewart</name></author><author><name sortKey="Sutherland, Wj" uniqKey="Sutherland W">WJ Sutherland</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Smith, Rk" uniqKey="Smith R">RK Smith</name></author><author><name sortKey="Pullin, As" uniqKey="Pullin A">AS Pullin</name></author><author><name sortKey="Stewart, Gb" uniqKey="Stewart G">GB Stewart</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Smith, Rk" uniqKey="Smith R">RK Smith</name></author><author><name sortKey="Pullin, As" uniqKey="Pullin A">AS Pullin</name></author><author><name sortKey="Stewart, Gb" uniqKey="Stewart G">GB Stewart</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Stacey, Cj" uniqKey="Stacey C">CJ Stacey</name></author><author><name sortKey="Springer, Ae" uniqKey="Springer A">AE Springer</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Stevens, A" uniqKey="Stevens A">A Stevens</name></author><author><name sortKey="Milne, R" uniqKey="Milne R">R Milne</name></author><author><name sortKey="Scally, G" uniqKey="Scally G">G Scally</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Stewart, Gb" uniqKey="Stewart G">GB Stewart</name></author><author><name sortKey="Coles, Cf" uniqKey="Coles C">CF Coles</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Stewart, Gb" uniqKey="Stewart G">GB Stewart</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Stewart, Gb" uniqKey="Stewart G">GB Stewart</name></author><author><name sortKey="Pullin, As" uniqKey="Pullin A">AS Pullin</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Stewart, Gb" uniqKey="Stewart G">GB Stewart</name></author><author><name sortKey="Pullin, As" uniqKey="Pullin A">AS Pullin</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Stewart, Gb" uniqKey="Stewart G">GB Stewart</name></author><author><name sortKey="Bayliss, Hr" uniqKey="Bayliss H">HR Bayliss</name></author><author><name sortKey="Showler, Da" uniqKey="Showler D">DA Showler</name></author><author><name sortKey="Sutherland, Wj" uniqKey="Sutherland W">WJ Sutherland</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Stewart, Gb" uniqKey="Stewart G">GB Stewart</name></author><author><name sortKey="Bayliss, Hr" uniqKey="Bayliss H">HR Bayliss</name></author><author><name sortKey="Showler, Da" uniqKey="Showler D">DA Showler</name></author><author><name sortKey="Sutherland, Wj" uniqKey="Sutherland W">WJ Sutherland</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Stewart, Gb" uniqKey="Stewart G">GB Stewart</name></author><author><name sortKey="Kaiser, Mj" uniqKey="Kaiser M">MJ Kaiser</name></author><author><name sortKey="Cote, Im" uniqKey="Cote I">IM Cote</name></author><author><name sortKey="Halpern, Bs" uniqKey="Halpern B">BS Halpern</name></author><author><name sortKey="Lester, Se" uniqKey="Lester S">SE Lester</name></author><author><name sortKey="Bayliss, Hr" uniqKey="Bayliss H">HR Bayliss</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Sutherland, Wj" uniqKey="Sutherland W">WJ Sutherland</name></author><author><name sortKey="Pullin, As" uniqKey="Pullin A">AS Pullin</name></author><author><name sortKey="Dolman, Pm" uniqKey="Dolman P">PM Dolman</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Timonen, J" uniqKey="Timonen J">J Timonen</name></author><author><name sortKey="Gustafsson, L" uniqKey="Gustafsson L">L Gustafsson</name></author><author><name sortKey="Kotiaho, Js" uniqKey="Kotiaho J">JS Kotiaho</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Tyler, C" uniqKey="Tyler C">C Tyler</name></author><author><name sortKey="Clark, E" uniqKey="Clark E">E Clark</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Tyler, C" uniqKey="Tyler C">C Tyler</name></author><author><name sortKey="Pullin, As" uniqKey="Pullin A">AS Pullin</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Waylen, Ka" uniqKey="Waylen K">KA Waylen</name></author><author><name sortKey="Fischer, A" uniqKey="Fischer A">A Fischer</name></author><author><name sortKey="Mcgowan, Pjk" uniqKey="Mcgowan P">PJK McGowan</name></author><author><name sortKey="Thirgood, Sj" uniqKey="Thirgood S">SJ Thirgood</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Webb, Ja" uniqKey="Webb J">JA Webb</name></author><author><name sortKey="Wealands, Sr" uniqKey="Wealands S">SR Wealands</name></author><author><name sortKey="Lea, P" uniqKey="Lea P">P Lea</name></author><author><name sortKey="Nichols, Sj" uniqKey="Nichols S">SJ Nichols</name></author><author><name sortKey="De Little, Sc" uniqKey="De Little S">SC de Little</name></author><author><name sortKey="Stewartson, Mj" uniqKey="Stewartson M">MJ Stewartson</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Whitlock, Ep" uniqKey="Whitlock E">EP Whitlock</name></author><author><name sortKey="Lin, Js" uniqKey="Lin J">JS Lin</name></author><author><name sortKey="Chou, R" uniqKey="Chou R">R Chou</name></author><author><name sortKey="Shekelle, P" uniqKey="Shekelle P">P Shekelle</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Whitten, T" uniqKey="Whitten T">T Whitten</name></author><author><name sortKey="Holmes, D" uniqKey="Holmes D">D Holmes</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Young, Kd" uniqKey="Young K">KD Young</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Zavaleta, E" uniqKey="Zavaleta E">E Zavaleta</name></author><author><name sortKey="Miller, Dc" uniqKey="Miller D">DC Miller</name></author><author><name sortKey="Salafsky, N" uniqKey="Salafsky N">N Salafsky</name></author><author><name sortKey="Fleishman, E" uniqKey="Fleishman E">E Fleishman</name></author><author><name sortKey="Webster, M" uniqKey="Webster M">M Webster</name></author><author><name sortKey="Gold, B" uniqKey="Gold B">B Gold</name></author><author><name sortKey="Hulse, D" uniqKey="Hulse D">D Hulse</name></author><author><name sortKey="Rowen, M" uniqKey="Rowen M">M Rowen</name></author><author><name sortKey="Tabor, G" uniqKey="Tabor G">G Tabor</name></author></analytic></biblStruct></listBibl></div1></back></TEI><pmc article-type="research-article"><pmc-dir>properties open_access</pmc-dir>
<front><journal-meta><journal-id journal-id-type="nlm-ta">Conserv Biol</journal-id><journal-id journal-id-type="iso-abbrev">Conserv. Biol</journal-id><journal-id journal-id-type="publisher-id">cobi</journal-id><journal-title-group><journal-title>Conservation Biology</journal-title></journal-title-group><issn pub-type="ppub">0888-8892</issn><issn pub-type="epub">1523-1739</issn><publisher><publisher-name>BlackWell Publishing Ltd</publisher-name><publisher-loc>Oxford, UK</publisher-loc></publisher></journal-meta><article-meta><article-id pub-id-type="pmid">24001025</article-id><article-id pub-id-type="pmc">4232040</article-id><article-id pub-id-type="doi">10.1111/cobi.12114</article-id><article-categories><subj-group subj-group-type="heading"><subject>Reviews</subject></subj-group></article-categories><title-group><article-title>Contribution of Systematic Reviews to Management Decisions</article-title></title-group><contrib-group><contrib contrib-type="author"><name><surname>COOK</surname><given-names>CARLY N</given-names></name><xref ref-type="aff" rid="au1"></xref><xref ref-type="aff" rid="au2"></xref></contrib><contrib contrib-type="author"><name><surname>POSSINGHAM</surname><given-names>HUGH P</given-names></name><xref ref-type="aff" rid="au2"></xref></contrib><contrib contrib-type="author"><name><surname>FULLER</surname><given-names>RICHARD A</given-names></name><xref ref-type="aff" rid="au2"></xref></contrib><aff id="au1"><label>*</label><institution>Quantitative and Applied Ecology Group, The School of Botany, University of Melbourne</institution><addr-line>Parkville, Victoria, 3010, Australia</addr-line></aff><aff id="au2"><label>†</label><institution>School of Biological Sciences, University of Queensland</institution><addr-line>Brisbane, Queensland, 4072, Australia</addr-line></aff></contrib-group><pub-date pub-type="ppub"><month>1</month><year>2014</year></pub-date><pub-date pub-type="epub"><day>1</day><month>1</month><year>2013</year></pub-date><volume>27</volume><issue>5</issue><fpage>902</fpage><lpage>915</lpage><history><date date-type="received"><day>19</day><month>11</month><year>2012</year></date><date date-type="accepted"><day>24</day><month>3</month><year>2013</year></date></history><permissions><copyright-statement>© 2013 The Authors. <italic>Conservation Biology</italic> published by Wiley Periodicals, Inc., on behalf of the Society for Conservation Biology.</copyright-statement><copyright-year>2013</copyright-year><license license-type="open-access" xlink:href="http://creativecommons.org/licenses/by-nc/3.0/"><license-p>This is an open access article under the terms of the Creative Commons Attribution-NonCommercial License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited and is not used for commercial purposes.</license-p></license></permissions><abstract><p>Systematic reviews comprehensively summarize evidence about the effectiveness of conservation interventions. We investigated the contribution to management decisions made by this growing body of literature. We identified 43 systematic reviews of conservation evidence, 23 of which drew some concrete conclusions relevant to management. Most reviews addressed conservation interventions relevant to policy decisions; only 35% considered practical on-the-ground management interventions. The majority of reviews covered only a small fraction of the geographic and taxonomic breadth they aimed to address (median = 13% of relevant countries and 16% of relevant taxa). The likelihood that reviews contained at least some implications for management tended to increase as geographic coverage increased and to decline as taxonomic breadth increased. These results suggest the breadth of a systematic review requires careful consideration. Reviews identified a mean of 312 relevant primary studies but excluded 88% of these because of deficiencies in design or a failure to meet other inclusion criteria. Reviews summarized on average 284 data sets and 112 years of research activity, yet the likelihood that their results had at least some implications for management did not increase as the amount of primary research summarized increased. In some cases, conclusions were elusive despite the inclusion of hundreds of data sets and years of cumulative research activity. Systematic reviews are an important part of the conservation decision making tool kit, although we believe the benefits of systematic reviews could be significantly enhanced by increasing the number of reviews focused on questions of direct relevance to on-the-ground managers; defining a more focused geographic and taxonomic breadth that better reflects available data; including a broader range of evidence types; and appraising the cost-effectiveness of interventions.</p><p>Contribuciones de las Revisiones Sistemáticas a las Decisiones de Manejo</p><sec><title>Resumen</title><p>Las revisiones sistemáticas resumen integralmente la evidencia sobre la efectividad de las intervenciones de conservación. Investigamos la contribución de las decisiones de manejo hechas por este creciente cuerpo de literatura. Identificamos 43 revisiones sistemáticas de evidencia de conservación, 23 de las cuales hicieron algunas conclusiones concretas relevantes al manejo. La mayoría de las revisiones se dirigían a intervenciones de conservación relevantes a las decisiones políticas; sólo el 35% consideraba intervenciones de manejo sobre-la-causa prácticas. La mayoría de las revisiones cubrieron solo una pequeña fracción de la amplitud geográfica y taxonómica a la que buscaban dirigirse (mediana = 13% de los países relevantes y 16% de los taxones relevantes). La probabilidad de que las revisiones tuvieran por lo menos algunas implicaciones para el manejo tendió a incrementar conforme la cobertura geográfica incrementaba y a declinar conforme aumentaba la amplitud taxonómica. Estos resultados sugieren que la amplitud de una revisión taxonómica requiere de una consideración cuidadosa. Las revisiones identificaron una media de 312 estudios primarios relevantes pero excluyeron 88% de estos por deficiencias en el diseño o fallas para coincidir con otros criterios de inclusión. Las revisiones resumieron en promedio 248 juegos de datos y 112 años de actividad de investigación, pero la probabilidad de que sus resultados tuvieran por lo menos algunas implicaciones para el manejo no incrementaron mientras la cantidad de investigación primaria resumida aumentaba. En algunos casos, las conclusiones fueron elusivas a pesar de la inclusión de cientos de conjuntos de datos y años de actividad de investigación acumulada. Las revisiones sistemáticas son una parte importante del juego de herramientas en la toma de decisiones de conservación, aunque consideramos que los beneficios de las revisiones sistemáticas podrían ser mejorados significativamente al incrementar el número de revisiones centradas en preguntas con relevancia directa a administradores sobre-la-causa; definiendo una amplitud geográfica y taxonómica más enfocada que reflejo los datos disponibles; incluyendo un rango más amplio de tipos de evidencia; y evaluando la efectividad de costo de las intervenciones.</p></sec></abstract><kwd-group><kwd>conservation management</kwd><kwd>conservation policy</kwd><kwd>decision making</kwd><kwd>environmental evidence</kwd><kwd>evidence-based conservation</kwd><kwd>implementation gap</kwd><kwd>brecha de implementación</kwd><kwd>conservación basada en evidencias</kwd><kwd>evidencia ambiental</kwd><kwd>manejo de conservación</kwd><kwd>política de conservación</kwd><kwd>toma de decisiones</kwd></kwd-group></article-meta></front><body><sec sec-type="intro"><title>Introduction</title><p>Despite the aim of conservation science being to inform and guide management (Meffe et al. <xref rid="b44" ref-type="bibr">2006</xref>), decision makers report that it can be difficult and time-consuming to access available science (Fazey et al. <xref rid="b22" ref-type="bibr">2004</xref>; Zavaleta et al. <xref rid="b84" ref-type="bibr">2008</xref>) and that research findings can be challenging to interpret (Pullin & Knight <xref rid="b54" ref-type="bibr">2005</xref>). Debate in the literature and conflicting research findings can also cause managers to mistrust scientific information (Young & Van Aarde <xref rid="b83" ref-type="bibr">2011</xref>). Compounding these challenges, the peer-reviewed literature often does not address questions of direct relevance to conservation managers (Whitten et al. <xref rid="b82" ref-type="bibr">2001</xref>; Fazey et al. <xref rid="b21" ref-type="bibr">2005</xref>) or deliver information when needed (Kareiva et al. <xref rid="b36" ref-type="bibr">2002</xref>; Linklater <xref rid="b38" ref-type="bibr">2003</xref>). These impediments to using science to guide practice have contributed to the poor use of empirical evidence to inform management decisions (Sutherland et al. <xref rid="b75" ref-type="bibr">2004</xref>; Cook et al. <xref rid="b13" ref-type="bibr">2010</xref>).</p><p>The challenge of translating science into practice is not unique to conservation but is common to many applied disciplines (Pfeffer & Sutton <xref rid="b52" ref-type="bibr">1999</xref>; Pullin & Knight <xref rid="b53" ref-type="bibr">2001</xref>). Concern about the lack of evidence in medical practice (Forsyth <xref rid="b24" ref-type="bibr">1963</xref>; Cochrane <xref rid="b11" ref-type="bibr">1972</xref>; Maynard & Chalmers <xref rid="b42" ref-type="bibr">1997</xref>) stimulated an evidence revolution (Pullin & Knight <xref rid="b53" ref-type="bibr">2001</xref>) that promoted randomized, controlled trials as the standard for credible evidence (Stevens & Milne <xref rid="b68" ref-type="bibr">1997</xref>). To help practitioners manage the rapid increase in available evidence (Chalmers <xref rid="b10" ref-type="bibr">1993</xref>), systematic reviews were developed as a tool to collate (systematically search the available literature), filter (identify credible sources of evidence), synthesize (analyze the body of evidence to determine the overall effect of an intervention), and disseminate the evidence for the effectiveness of potential and currently used treatment options on a topic for practitioners (Higgins & Green <xref rid="b31" ref-type="bibr">2011</xref>). The rigorous methodological and statistical protocol associated with systematic reviews minimizes bias and improves their transparency and repeatability (Pullin & Stewart <xref rid="b57" ref-type="bibr">2006</xref>; Newton et al. <xref rid="b46" ref-type="bibr">2007</xref>). These factors make systematic reviews more comprehensive and less open to potential bias than other review formats that summarize the literature in an unstructured way (e.g., narrative reviews) (Roberts et al. <xref rid="b62" ref-type="bibr">2006</xref>). A distinct focus on making recommendations for management and a systematic search of both the peer-reviewed and gray literatures generally distinguish systematic reviews from traditional meta-analytical studies. The practice of systematic reviews has been widely adopted in medicine, health sciences, education, criminology, and several other disciplines (Hansen & Rieper <xref rid="b29" ref-type="bibr">2009</xref>).</p><p>The benefits of an evidence-based approach to medical practice have led several authors to promote systematic reviews as a tool for integrating science into conservation practice (e.g., Pullin & Knight <xref rid="b53" ref-type="bibr">2001</xref>; Fazey et al. <xref rid="b22" ref-type="bibr">2004</xref>; Sutherland et al. <xref rid="b75" ref-type="bibr">2004</xref>). Systematic reviews facilitate evidence-based conservation practice by providing managers with an overview of relevant, trustworthy empirical evidence pertinent to a decision (Pullin & Stewart <xref rid="b57" ref-type="bibr">2006</xref>). The evidence movement has been instrumental in highlighting the importance of evaluating the effectiveness of management interventions (Ferraro & Pattanayak <xref rid="b23" ref-type="bibr">2006</xref>) so that decision makers do not waste time and money on ineffective or potentially harmful management interventions (Pullin & Knight <xref rid="b53" ref-type="bibr">2001</xref>). By combining the replicates from multiple studies, systematic review can also maximize the value of primary research, generating greater explanatory power, which may reveal effects not detected by the original individual studies (Mulrow <xref rid="b45" ref-type="bibr">1994</xref>).</p><p>To facilitate systematic reviews and make them freely available to managers, the Collaboration for Environmental Evidence (CEE) (<ext-link ext-link-type="uri" xlink:href="www.environmentalevidence.org">www.environmentalevidence.org</ext-link>) was developed (Pullin & Knight <xref rid="b55" ref-type="bibr">2009</xref>). The collaboration was modeled on the Cochrane Collaboration for medical practice and the Campbell Collaboration for social programs. The CEE has developed detailed guidelines (Pullin & Stewart <xref rid="b57" ref-type="bibr">2006</xref>; CEBC <xref rid="b9" ref-type="bibr">2010</xref>) to assist authors wishing to conduct systematic reviews of conservation interventions.</p><p>With evidence-based conservation being embraced by the conservation community as a desirable approach to decision making, it is timely to review the benefits to conservation practice arising from systematic reviews. We examined how the method of systematic review has been applied to evidence about the effectiveness of conservation interventions and the benefits they have provided to conservation practice. We measured the level of guidance systematic reviews offer conservation managers and quantified the types of conservation questions being addressed; geographic and taxonomic breadth of reviewed topics; and the quantity of primary research available in a format suitable for systematic review. We considered the benefits to environmental management arising from systematic reviews and how systematic reviews might be improved.</p></sec><sec sec-type="methods"><title>Methods</title><sec><title>Criteria and Method for Selection of Systematic Reviews</title><p>We based selection of systematic reviews on the criteria outlined in the guidelines for systematic reviews of conservation evidence published by Pullin and Roberts (<xref rid="b59" ref-type="bibr">2006</xref>). Accordingly, we ensured that reviewers had clearly defined a question focused on evaluating the effectiveness of a conservation intervention with implications for management or policy; used a systematic and objective approach to search the literature without limiting the publication period; established clear and transparent criteria for the inclusion of studies in the review; synthesized available data through a meta-analysis or scoring system; and discussed the findings in relation to the implications for management or policy.</p><p>Pullin and Roberts (<xref rid="b59" ref-type="bibr">2006</xref>) recommend that authors formulate the review question in consultation with managers and stakeholders, assess the methodological quality of relevant studies, evaluate the sources of heterogeneity in the data sets and document the data extracted from studies included in the review. Published reviews often do not document such steps, although this did not disqualify them from our sample because lack of documentation does not mean these steps were not conducted. Formal quantitative analyses within systematic reviews ideally involve a meta-analysis that includes summary effect sizes for each data set weighted according to some measure of its importance (Pullin & Stewart <xref rid="b57" ref-type="bibr">2006</xref>). However, we included systematic reviews that used any quantitative approach to meta-analysis or used a scoring approach, where the results of each study were tallied according to whether the intervention yielded positive, negative, or equivocal results.</p><p>To identify relevant studies, we used electronic searches of ISI Web of Knowledge (i.e., ISI Web of Science: Science Citation Index Expanded 1945–present and ISI Proceedings: Science and Technology Proceedings 1990–present) and Google Scholar and searched for the terms “<italic>systematic review</italic>” and “<italic>conservation</italic>.” We refined each of these searches by excluding results from unrelated disciplines, such as medicine, chemistry, or physics, to limit the number of irrelevant articles returned. We also searched the online CEE library for systematic reviews listed as completed. We extracted several pieces of information from each review that met our selection criteria (summarized later and detailed in Supporting Information).</p></sec><sec><title>Types and Breadth of Reviews</title><p>We determined whether the key audience for the review findings was policy makers or on-the-ground managers (Supporting Information).</p><p>We were interested in whether there is a trade-off between the geographic and taxonomic breadth of a review and whether it had direct implications for management. We used the selection criteria described in the review to establish the intended breadth of the review (the pool of research from which data could be drawn—e.g., all birds). We then used the data captured within the meta-analysis to determine the realized coverage of the review (e.g., number of bird species with data included in the meta-analysis). We measured geographic scope by the number of countries relevant to the review topic and realized geographic coverage by the proportion of the geographic scope for which data were represented in the meta-analysis. Taxonomic scope was the number of species relevant to the review topic, and taxonomic coverage was the proportion of the taxonomic scope with data included in the meta-analysis. We estimated taxonomic scope when the definition was ecological rather than strictly taxonomic (e.g., ground- and cliff-nesting birds). If reliable estimates could not be found, we omitted the review from the analysis of scope. In many cases, such as when estimates could be obtained for only some taxonomic groups, only the minimum number of taxa could be estimated. For the purpose of analyses, we normalized the geographic and taxonomic coverage variables by log<sub>10</sub> transformation.</p></sec><sec><title>Evidence Captured by Reviews</title><p>To estimate the level of evidence available for each systematic review, we recorded the number of studies the review authors reported as relevant to the review topic after evaluating the title and abstract. Although we assumed abstracts accurately reflected the contents of the paper, if this was not always the case, our results will overestimate the number of relevant studies. Although the majority of authors reported the number of relevant studies, in some cases it was necessary to contact the corresponding author to request these data. We also recorded the number of studies that met the criteria for inclusion in each review. This figure captures the studies included in the meta-analysis and, if relevant, those studies included only in sections of the review that provide a qualitative synthesis of the relevant literature.</p><p>To capture the research effort underpinning a meta-analysis, we recorded the number of independent statistical units included in each meta-analysis. We also calculated the total number of years of data collection embodied in the primary studies being reviewed. Although both these measures of research effort are imperfect, they are indicative of the effort involved in generating the primary literature underpinning a topic. Where the number of years of research effort was not reported in a systematic review, we examined the original primary studies to extract the number of years of data collection reported therein. When this figure could not be obtained, we generated an estimate from the available data. Five systematic reviews had 65–129 primary studies in the meta-analysis, and owing to the time-consuming nature of examining each primary study, we used a random sample of one-third of studies to generate the number of years of data collection. For analyses the number of independent data sets and number of years of data collection were normalized by log<sub>10</sub> transformation.</p></sec><sec><title>Findings from Reviews</title><p>The goal of systematic review is to provide a dispassionate synthesis of the best available evidence, not to be prescriptive about how a practitioner should act. Practitioners must still interpret this information according to the relevant socioeconomic and ecological circumstances (Chalmers <xref rid="b10" ref-type="bibr">1993</xref>). Therefore, we evaluated the findings arising from the data synthesis, given the limitations of each review, and classified them according to their implications for management practice (<xref ref-type="table" rid="tbl1">Table 1</xref>) and conservation science. Where possible, we recorded the overall effect size emerging from meta-analyses. We then investigated whether attributes of the reviews contributed to the degree to which they could unambiguously inform management decisions.</p><table-wrap id="tbl1" position="float"><label>Table 1</label><caption><p>Description of the categories used to identify whether systematic reviews of conservation evidence have implications for management</p></caption><table frame="hsides" rules="groups"><thead><tr><th align="left" rowspan="1" colspan="1"><italic>Implications for management</italic></th><th align="left" rowspan="1" colspan="1"><italic>Description</italic></th><th align="left" rowspan="1" colspan="1"><italic>Example</italic></th></tr></thead><tbody><tr><td align="left" rowspan="1" colspan="1">Yes</td><td align="left" rowspan="1" colspan="1">The review presents unequivocal evidence across the full scope of the review with direct implications for the conduct of management.</td><td align="left" rowspan="1" colspan="1">Culling is not an effective method of reducing the abundance of yellow-legged gulls (<italic>Larus michahellis</italic>) to protect threatened waterbirds (Oro & Martínez-Abraín <xref rid="b49" ref-type="bibr">2007</xref>).</td></tr><tr><td align="left" rowspan="1" colspan="1">Some direct implications</td><td align="left" rowspan="1" colspan="1">Findings partially address the scope of the review, providing guidance relevant to some management contexts. This includes reviews that lack data on some of the relevant management alternatives and those where findings vary according to the environments and taxonomic groups being considered.</td><td align="left" rowspan="1" colspan="1">Two of 4 herbicides significantly reduce <italic>Rhododendron ponticum</italic>, but the best concentration and method of application cannot be determined. Results for the other herbicides were inconclusive (Tyler et al. <xref rid="b78" ref-type="bibr">2006</xref>).Some mammal and bird populations are displaced by road infrastructure, but the effect varies with the habitat type and species considered (Benítez-López et al. <xref rid="b4" ref-type="bibr">2009</xref>).</td></tr><tr><td align="left" rowspan="1" colspan="1">No</td><td align="left" rowspan="1" colspan="1">No conclusions can be drawn from the review due to insufficient data, equivocal evidence for the effectiveness of an intervention, or confounding variables in the original studies.</td><td align="left" rowspan="1" colspan="1">All studies had poor design and no conclusions could be drawn (Isasi-Catalá <xref rid="b33" ref-type="bibr">2010</xref>).Herbicides used close to conservation areas appear to decrease invertebrates but most studies did not control for the use of fertilizers or were greenhouse trials (Frampton & Dorne <xref rid="b25" ref-type="bibr">2007</xref>).</td></tr></tbody></table></table-wrap></sec></sec><sec sec-type="results"><title>Results</title><sec><title>Number of Systematic Reviews</title><p>We conducted literature searches in March 2012 and located 3375 articles (ISI Web of Knowledge, <italic>n</italic> = 42; Google Scholar, <italic>n</italic> = 3290; CEE, <italic>n</italic> = 43). The majority of articles was irrelevant because they were duplicate records; discussed rather than conducted a systematic review; did not address a conservation intervention; were systematic reviews of taxonomy; or were related to medical interventions. After reviewing these articles, 43 met our criteria for systematic reviews of conservation evidence (Supporting Information). Supporting Information provides a list of studies that met some of our criteria and the reasons they were ultimately excluded.</p></sec><sec><title>Findings from Reviews</title><p>Two of the 43 reviews provided guidance across the full geographic and taxonomic breadth of the review. However, 21 reviews had direct implications for only some interventions of interest or some management contexts (<xref ref-type="fig" rid="fig01">Fig.1</xref>). Conclusions about the effect of the intervention could not be drawn from the remaining 20 reviews due to small sample sizes, confounding variables, or conflicting results across the primary studies (<xref ref-type="fig" rid="fig01">Fig.1</xref>).</p><fig id="fig01" position="float"><label>Figure 1</label><caption><p>Number of systematic reviews (n = 43) within each recommendation category (<xref ref-type="table" rid="tbl1">Table 1</xref>) sorted by review topic.</p></caption><graphic xlink:href="cobi0027-0902-f1"></graphic></fig><p>Although most reviews provided only some guidance for management practice, almost all (93%) identified existing knowledge gaps and made recommendations for the direction of future research effort. A large proportion (79%) also highlighted common flaws in existing research methods and recommended changes to experimental design to improve the value of future primary research.</p></sec><sec><title>Types of Review Questions</title><p>Reviews tended to address questions of conservation policy (65%) (Supporting Information) relevant to the efficacy of high-level conservation tools, such as habitat corridors (Davies & Pullin <xref rid="b16" ref-type="bibr">2007</xref>; Doerr et al. <xref rid="b18" ref-type="bibr">2010</xref>; Eycott et al. <xref rid="b19" ref-type="bibr">2010</xref>) and marine protected areas (Stewart et al. <xref rid="b73" ref-type="bibr">2009a</xref>), or emerging conservation issues, such as the effect of wind farms on birds (Stewart et al. <xref rid="b71" ref-type="bibr">2007a</xref>). A minority of reviews (35%) addressed issues directly relevant to on-the-ground managers (Supporting Information), such as the effectiveness of options to control individual weed species (e.g., Kabat et al. <xref rid="b34" ref-type="bibr">2006</xref>; Roberts & Pullin <xref rid="b59" ref-type="bibr">2006</xref>; Roberts & Pullin <xref rid="b60" ref-type="bibr">2007a</xref>; Stewart et al. <xref rid="b72" ref-type="bibr">2007b</xref>).</p><p>Although the topic of reviews did not affect the type of findings arising from the reviews (<xref ref-type="fig" rid="fig01">Fig.1</xref>), larger overall effect sizes were detected in reviews that addressed topics relevant to on-the-ground managers (mean effect size = 2.95) than reviews that addressed questions of conservation policy (mean effect size = 1.60; <italic>t</italic> = 2.62; df = 26; <italic>p</italic> = 0.03).</p></sec><sec><title>Breadth of Reviews</title><p>In many cases, the geographic and taxonomic scope of reviews was not clearly defined or no obvious restrictions on scope were mentioned. Thirty percent of reviews restricted the geographic scope to a small number of countries (≤10), but most reviews had a much broader geographic scope (median = 141 countries [SE 14], range = 1–196 countries) (Supporting Information). However, the realized coverage of reviews from data actually included in the meta-analysis tended to be much lower (median = 13% of countries [SE 6]) (<xref ref-type="table" rid="tbl2">Table 2</xref> & <xref ref-type="fig" rid="fig02">Fig.2</xref>). We also found a distinct geographic bias toward western countries, particularly those in western Europe and North America. Reviews that provided some management guidance showed a non significant tendency to include data from a greater proportion of the countries relevant to the scope of the review than those that were unable to provide guidance (<italic>t</italic> = –2.02; df = 37; <italic>p</italic> = 0.33) (<xref ref-type="fig" rid="fig02">Fig 2</xref>). Likewise, many of the reviews had a very wide taxonomic scope (range = 1–936, 244 species) but realized a much narrower taxonomic coverage (median = 16% of species [SE 8]) (<xref ref-type="table" rid="tbl2">Table 2</xref>). Reviews overrepresented primary studies featuring vertebrates, particularly birds, relative to global species richness and underrepresented more diverse taxonomic groups, such as invertebrates and plants. There was no clear difference between the proportion of species represented between reviews that could or could not provide guidance to managers (<italic>t</italic> = 0.49; df = 23; <italic>p</italic> = 0.62). However, the only reviews to fully address the stated scope were restricted to a single species or small functional groups of species (<xref ref-type="fig" rid="fig03">Fig.3</xref>).</p><table-wrap id="tbl2" position="float"><label>Table 2</label><caption><p>The geographic and taxonomic coverage of systematic reviews of conservation evidence</p></caption><table frame="hsides" rules="groups"><thead><tr><th rowspan="1" colspan="1"></th><th rowspan="1" colspan="1"></th><th rowspan="1" colspan="1"></th><th align="center" rowspan="1" colspan="1"><italic>Geographic</italic></th><th align="center" rowspan="1" colspan="1"><italic>Taxa of</italic></th><th align="center" rowspan="1" colspan="1"><italic>Taxonomic</italic></th></tr><tr><th align="left" rowspan="1" colspan="1"><italic>Reference</italic></th><th align="center" rowspan="1" colspan="1"><italic>Review topic</italic></th><th align="center" rowspan="1" colspan="1"><italic>Places of interest</italic></th><th align="center" rowspan="1" colspan="1"><italic>coverage</italic><xref ref-type="table-fn" rid="tf2-1">a</xref><italic>(%</italic>)</th><th align="center" rowspan="1" colspan="1"><italic>interest</italic></th><th align="center" rowspan="1" colspan="1"><italic>coverage</italic><xref ref-type="table-fn" rid="tf2-2">b</xref><italic>(%</italic>)</th></tr></thead><tbody><tr><td align="left" rowspan="1" colspan="1">Abella <xref rid="b1" ref-type="bibr">2009</xref></td><td align="left" rowspan="1" colspan="1">effects of fire on vegetation in the Mohave and Sonoran Deserts</td><td align="left" rowspan="1" colspan="1">U.S.A.</td><td align="center" rowspan="1" colspan="1">1</td><td align="left" rowspan="1" colspan="1">plants</td><td align="center" rowspan="1" colspan="1">CBC<xref ref-type="table-fn" rid="tf2-3">c</xref></td></tr><tr><td align="left" rowspan="1" colspan="1">Bayard & Elphick <xref rid="b3" ref-type="bibr">2010</xref></td><td align="left" rowspan="1" colspan="1">effects of fragmentation on birds</td><td align="left" rowspan="1" colspan="1">global</td><td align="center" rowspan="1" colspan="1">CBC<xref ref-type="table-fn" rid="tf2-3">c</xref></td><td align="left" rowspan="1" colspan="1">birds</td><td align="center" rowspan="1" colspan="1">10</td></tr><tr><td align="left" rowspan="1" colspan="1">Benitez-Lopez et al. <xref rid="b4" ref-type="bibr">2009</xref></td><td align="left" rowspan="1" colspan="1">effects of roads and other infrastructure on mammal and bird populations</td><td align="left" rowspan="1" colspan="1">global</td><td align="center" rowspan="1" colspan="1">9</td><td align="left" rowspan="1" colspan="1">mammals and birds</td><td align="center" rowspan="1" colspan="1">1</td></tr><tr><td align="left" rowspan="1" colspan="1">Bowler et al. <xref rid="b5" ref-type="bibr">2012</xref></td><td align="left" rowspan="1" colspan="1">effects of community forest management on global environmental benefits and local welfare</td><td align="left" rowspan="1" colspan="1">global</td><td align="center" rowspan="1" colspan="1">5</td><td align="left" rowspan="1" colspan="1">CBC<xref ref-type="table-fn" rid="tf2-3">c</xref></td><td align="center" rowspan="1" colspan="1">CBC<xref ref-type="table-fn" rid="tf2-3">c</xref></td></tr><tr><td align="left" rowspan="1" colspan="1">Brooks et al. <xref rid="b7" ref-type="bibr">2006</xref></td><td align="left" rowspan="1" colspan="1">effects of development on ecological, economic, attitudinal, and behavioral outcomes</td><td align="left" rowspan="1" colspan="1">global</td><td align="center" rowspan="1" colspan="1">7</td><td align="left" rowspan="1" colspan="1">NA<xref ref-type="table-fn" rid="tf2-4">d</xref></td><td align="center" rowspan="1" colspan="1">NA<xref ref-type="table-fn" rid="tf2-4">d</xref></td></tr><tr><td align="left" rowspan="1" colspan="1">Bussell et al. <xref rid="b8" ref-type="bibr">2010</xref></td><td align="left" rowspan="1" colspan="1">effects of draining and re-wetting peatland soils on carbon stores and greenhouse gas fluxes</td><td align="left" rowspan="1" colspan="1">global</td><td align="center" rowspan="1" colspan="1">6</td><td align="left" rowspan="1" colspan="1">bogs, fens and mires</td><td align="center" rowspan="1" colspan="1">47</td></tr><tr><td align="left" rowspan="1" colspan="1">Dalrymple et al. <xref rid="b15" ref-type="bibr">2011</xref></td><td align="left" rowspan="1" colspan="1">effects of reintroductions on plant extinctions</td><td align="left" rowspan="1" colspan="1">global</td><td align="center" rowspan="1" colspan="1">7</td><td align="left" rowspan="1" colspan="1">plants</td><td align="center" rowspan="1" colspan="1"><1</td></tr><tr><td align="left" rowspan="1" colspan="1">Davies & Pullin <xref rid="b16" ref-type="bibr">2007</xref></td><td align="left" rowspan="1" colspan="1">effects of hedgerows on movement between fragments of woodland habitat</td><td align="left" rowspan="1" colspan="1">North America, Europe</td><td align="center" rowspan="1" colspan="1">19</td><td align="left" rowspan="1" colspan="1">woodland species</td><td align="center" rowspan="1" colspan="1">CBC<xref ref-type="table-fn" rid="tf2-3">c</xref></td></tr><tr><td align="left" rowspan="1" colspan="1">Davies et al. <xref rid="b17" ref-type="bibr">2008</xref></td><td align="left" rowspan="1" colspan="1">effects of current management recommendations on saproxylic invertebrates</td><td align="left" rowspan="1" colspan="1">global</td><td align="center" rowspan="1" colspan="1">4</td><td align="left" rowspan="1" colspan="1">saproxylic invertebrates</td><td align="center" rowspan="1" colspan="1">CBC<xref ref-type="table-fn" rid="tf2-3">c</xref></td></tr><tr><td align="left" rowspan="1" colspan="1">Doerr et al. <xref rid="b18" ref-type="bibr">2010</xref></td><td align="left" rowspan="1" colspan="1">effects of structural connectivity on the dispersal of native species in Australia’s fragmented landscapes</td><td align="left" rowspan="1" colspan="1">Australia</td><td align="center" rowspan="1" colspan="1">100</td><td align="left" rowspan="1" colspan="1">Australian flora and fauna</td><td align="center" rowspan="1" colspan="1">1</td></tr><tr><td align="left" rowspan="1" colspan="1">Eycott et al. <xref rid="b20" ref-type="bibr">2012</xref></td><td align="left" rowspan="1" colspan="1">effects of landscape matric features on species movement</td><td align="left" rowspan="1" colspan="1">global</td><td align="center" rowspan="1" colspan="1">10</td><td align="left" rowspan="1" colspan="1">fauna</td><td align="center" rowspan="1" colspan="1"><1</td></tr><tr><td align="left" rowspan="1" colspan="1">Frampton & Dorne <xref rid="b25" ref-type="bibr">2007</xref></td><td align="left" rowspan="1" colspan="1">effects on invertebrates of pesticide usage at crop edges</td><td align="left" rowspan="1" colspan="1">global</td><td align="center" rowspan="1" colspan="1"><1</td><td align="left" rowspan="1" colspan="1">terrestrial invertebrates</td><td align="center" rowspan="1" colspan="1"><1</td></tr><tr><td align="left" rowspan="1" colspan="1">Gusset et al. <xref rid="b28" ref-type="bibr">2010</xref></td><td align="left" rowspan="1" colspan="1">effects of wild dog (<italic>Lycaon pictus</italic>) reintroductions in South Africa</td><td align="left" rowspan="1" colspan="1">South Africa</td><td align="center" rowspan="1" colspan="1">100</td><td align="left" rowspan="1" colspan="1">wild dogs (<italic>L. pictus</italic>)</td><td align="center" rowspan="1" colspan="1">100</td></tr><tr><td align="left" rowspan="1" colspan="1">Holt et al. <xref rid="b32" ref-type="bibr">2008</xref></td><td align="left" rowspan="1" colspan="1">effects of predation on prey abundance in the United Kingdom</td><td align="left" rowspan="1" colspan="1">U.K.</td><td align="center" rowspan="1" colspan="1">50</td><td align="left" rowspan="1" colspan="1">vertebrates</td><td align="center" rowspan="1" colspan="1">3</td></tr><tr><td align="left" rowspan="1" colspan="1">Isasi-Catalá <xref rid="b33" ref-type="bibr">2010</xref></td><td align="left" rowspan="1" colspan="1">effects of translocating problematic jaguars (<italic>Panthera onca</italic>) on human-predator conflicts</td><td align="left" rowspan="1" colspan="1">South and Central America</td><td align="center" rowspan="1" colspan="1">18</td><td align="left" rowspan="1" colspan="1">jaguar (<italic>P. onca</italic>)</td><td align="center" rowspan="1" colspan="1">100</td></tr><tr><td align="left" rowspan="1" colspan="1">Kabat et al. <xref rid="b34" ref-type="bibr">2006</xref></td><td align="left" rowspan="1" colspan="1">effects of control and eradication interventions on Japanese knotweed (<italic>Fallopia japonica</italic>)</td><td align="left" rowspan="1" colspan="1">Australia, Europe, North America, New Zealand</td><td align="center" rowspan="1" colspan="1">15</td><td align="left" rowspan="1" colspan="1">Japanese knotweed (<italic>F. japonica</italic>)</td><td align="center" rowspan="1" colspan="1">100</td></tr><tr><td align="left" rowspan="1" colspan="1">Kalies et al. <xref rid="b35" ref-type="bibr">2010</xref></td><td align="left" rowspan="1" colspan="1">effects of thinning and burning in southwestern conifer forests on wildlife density and populations in the United States</td><td align="left" rowspan="1" colspan="1">U.S.A.</td><td align="center" rowspan="1" colspan="1">100</td><td align="left" rowspan="1" colspan="1">birds, mammals, reptiles, amphibians in southwestern conifer forests, U.S.A.</td><td align="center" rowspan="1" colspan="1">16</td></tr><tr><td align="left" rowspan="1" colspan="1">Kettenring & Adams <xref rid="b37" ref-type="bibr">2011</xref></td><td align="left" rowspan="1" colspan="1">effects of control on invasive plant species</td><td align="left" rowspan="1" colspan="1">global</td><td align="center" rowspan="1" colspan="1">13</td><td align="left" rowspan="1" colspan="1">Plants</td><td align="center" rowspan="1" colspan="1">4</td></tr><tr><td align="left" rowspan="1" colspan="1">Mant et al. <xref rid="b40" ref-type="bibr">2011</xref></td><td align="left" rowspan="1" colspan="1">effects of liming streams and rivers on fish and invertebrates</td><td align="left" rowspan="1" colspan="1">Europe, North America</td><td align="center" rowspan="1" colspan="1">9</td><td align="left" rowspan="1" colspan="1">fish and invertebrates</td><td align="center" rowspan="1" colspan="1">CBC<xref ref-type="table-fn" rid="tf2-3">c</xref></td></tr><tr><td align="left" rowspan="1" colspan="1">Martinez-Abrain et al. <xref rid="b41" ref-type="bibr">2010</xref></td><td align="left" rowspan="1" colspan="1">effects of recreational activities on nesting birds of prey</td><td align="left" rowspan="1" colspan="1">global</td><td align="center" rowspan="1" colspan="1">6</td><td align="left" rowspan="1" colspan="1">birds of prey</td><td align="center" rowspan="1" colspan="1">4</td></tr><tr><td align="left" rowspan="1" colspan="1">McLeod et al. <xref rid="b43" ref-type="bibr">2008</xref></td><td align="left" rowspan="1" colspan="1">effects of controlling European red foxes (<italic>Vulpes vulpes</italic>) biological diversity and agricultural production in Australia</td><td align="left" rowspan="1" colspan="1">Australia</td><td align="center" rowspan="1" colspan="1">100</td><td align="left" rowspan="1" colspan="1">Australian birds, mammals, reptiles, amphibians, livestock, invertebrates, poultry</td><td align="center" rowspan="1" colspan="1">18</td></tr><tr><td align="left" rowspan="1" colspan="1">Newton et al. <xref rid="b47" ref-type="bibr">2009</xref></td><td align="left" rowspan="1" colspan="1">effects of grazing on lowland heathland in northwest Europe</td><td align="left" rowspan="1" colspan="1">Europe</td><td align="center" rowspan="1" colspan="1">12</td><td align="left" rowspan="1" colspan="1">lowland heathland</td><td align="center" rowspan="1" colspan="1">CBC<xref ref-type="table-fn" rid="tf2-3">c</xref></td></tr><tr><td align="left" rowspan="1" colspan="1">Oro & Martínez-Abraín <xref rid="b49" ref-type="bibr">2007</xref></td><td align="left" rowspan="1" colspan="1">effects of large gulls on sympatric threatened waterbirds</td><td align="left" rowspan="1" colspan="1">Europe, Africa</td><td align="center" rowspan="1" colspan="1">11</td><td align="left" rowspan="1" colspan="1">threatened waterbirds</td><td align="center" rowspan="1" colspan="1">100</td></tr><tr><td align="left" rowspan="1" colspan="1">Peppin et al. <xref rid="b50" ref-type="bibr">2010</xref></td><td align="left" rowspan="1" colspan="1">effects of postwildfire seeding in forests of the western United States</td><td align="left" rowspan="1" colspan="1">U.S.A.</td><td align="center" rowspan="1" colspan="1">100</td><td align="left" rowspan="1" colspan="1">forest species</td><td align="center" rowspan="1" colspan="1">CBC<xref ref-type="table-fn" rid="tf2-3">c</xref></td></tr><tr><td align="left" rowspan="1" colspan="1">Radwan et al. <xref rid="b58" ref-type="bibr">2010</xref></td><td align="left" rowspan="1" colspan="1">effects of reduced major histocompatibility complex diversity on vertebrate populations</td><td align="left" rowspan="1" colspan="1">global</td><td align="center" rowspan="1" colspan="1">10</td><td align="left" rowspan="1" colspan="1">vertebrates</td><td align="center" rowspan="1" colspan="1"><1</td></tr><tr><td align="left" rowspan="1" colspan="1">Roberts & Pullin <xref rid="b59" ref-type="bibr">2006</xref></td><td align="left" rowspan="1" colspan="1">effects of different management on <italic>Spartina</italic> species</td><td align="left" rowspan="1" colspan="1">global</td><td align="center" rowspan="1" colspan="1">3</td><td align="left" rowspan="1" colspan="1"><italic>Spartina alternifolia</italic>, <italic>S. anglica</italic>, <italic>S. densiflora</italic>, <italic>S. patens</italic>, <italic>S</italic>. x <italic>townsendii</italic></td><td align="center" rowspan="1" colspan="1">40</td></tr><tr><td align="left" rowspan="1" colspan="1">Roberts & Pullin <xref rid="b60" ref-type="bibr">2007a</xref></td><td align="left" rowspan="1" colspan="1">effects of management interventions on ragwort species</td><td align="left" rowspan="1" colspan="1">U.K., Ireland, North America, Australia, New Zealand, South Africa, Argentina</td><td align="center" rowspan="1" colspan="1">83</td><td align="left" rowspan="1" colspan="1">ragwort (<italic>Senecio jacobaea</italic> and <italic>S. aquaticus</italic>)</td><td align="center" rowspan="1" colspan="1">100</td></tr><tr><td align="left" rowspan="1" colspan="1">Roberts & Pullin <xref rid="b61" ref-type="bibr">2007b</xref></td><td align="left" rowspan="1" colspan="1">effects of land-based schemes (incl. agri-environment) on farmland bird densities in the United Kingdom</td><td align="left" rowspan="1" colspan="1">U.K.</td><td align="center" rowspan="1" colspan="1">100</td><td align="left" rowspan="1" colspan="1">farmland birds in the United Kingdom</td><td align="center" rowspan="1" colspan="1">31</td></tr><tr><td align="left" rowspan="1" colspan="1">Showler et al. <xref rid="b64" ref-type="bibr">2010</xref></td><td align="left" rowspan="1" colspan="1">effects of public access on ground-nesting and cliff-nesting birds</td><td align="left" rowspan="1" colspan="1">global</td><td align="center" rowspan="1" colspan="1">6</td><td align="left" rowspan="1" colspan="1">ground-nesting and cliff-nesting birds</td><td align="center" rowspan="1" colspan="1">CBC<xref ref-type="table-fn" rid="tf2-3"></xref></td></tr><tr><td align="left" rowspan="1" colspan="1">Smith et al. <xref rid="b65" ref-type="bibr">2010</xref></td><td align="left" rowspan="1" colspan="1">effects of predator removal on bird populations</td><td align="left" rowspan="1" colspan="1">global</td><td align="center" rowspan="1" colspan="1">6</td><td align="left" rowspan="1" colspan="1">birds</td><td align="center" rowspan="1" colspan="1">1</td></tr><tr><td align="left" rowspan="1" colspan="1">Smith et al. <xref rid="b66" ref-type="bibr">2011</xref></td><td align="left" rowspan="1" colspan="1">effects of nest predator exclusion on bird populations</td><td align="left" rowspan="1" colspan="1">global</td><td align="center" rowspan="1" colspan="1">2</td><td align="left" rowspan="1" colspan="1">birds</td><td align="center" rowspan="1" colspan="1"><1</td></tr><tr><td align="left" rowspan="1" colspan="1">Stacey et al. <xref rid="b67" ref-type="bibr">2011</xref></td><td align="left" rowspan="1" colspan="1">effects of arid land springs restoration on hydrology, geomorphology, and invertebrate and plant species composition</td><td align="left" rowspan="1" colspan="1">Europe, North and South America, Australasia</td><td align="center" rowspan="1" colspan="1">6</td><td align="left" rowspan="1" colspan="1">invertebrate and plant species associated with land springs</td><td align="center" rowspan="1" colspan="1">CBC<xref ref-type="table-fn" rid="tf2-3">c</xref></td></tr><tr><td align="left" rowspan="1" colspan="1">Stewart & Pullin <xref rid="b70" ref-type="bibr">2008</xref></td><td align="left" rowspan="1" colspan="1">effects of grazing stock type and intensity on the conservation of mesotrophic old- meadow pasture</td><td align="left" rowspan="1" colspan="1">U.K.</td><td align="center" rowspan="1" colspan="1">20</td><td align="left" rowspan="1" colspan="1">mesotrophic “old meadow” pasture community</td><td align="center" rowspan="1" colspan="1">100</td></tr><tr><td align="left" rowspan="1" colspan="1">Stewart et al. <xref rid="b69" ref-type="bibr">2005</xref></td><td align="left" rowspan="1" colspan="1">effects of moorland burning in heath and bogs on biological diversity and effects of burning on blanket bog</td><td align="left" rowspan="1" colspan="1">U.K., Ireland</td><td align="center" rowspan="1" colspan="1">60</td><td align="left" rowspan="1" colspan="1">bogs, heaths, and montane communities</td><td align="center" rowspan="1" colspan="1">37</td></tr><tr><td align="left" rowspan="1" colspan="1">Stewart et al. <xref rid="b71" ref-type="bibr">2007a</xref></td><td align="left" rowspan="1" colspan="1">effects of wind farms on birds</td><td align="left" rowspan="1" colspan="1">global</td><td align="center" rowspan="1" colspan="1">4</td><td align="left" rowspan="1" colspan="1">Birds</td><td align="center" rowspan="1" colspan="1">23</td></tr><tr><td align="left" rowspan="1" colspan="1">Stewart et al. <xref rid="b72" ref-type="bibr">2007b</xref></td><td align="left" rowspan="1" colspan="1">effectiveness of Asulam for bracken (<italic>Pteridium aquilinum</italic>) control in the United Kingdom</td><td align="left" rowspan="1" colspan="1">U.K.</td><td align="center" rowspan="1" colspan="1">75</td><td align="left" rowspan="1" colspan="1">bracken (<italic>P. aquilinum</italic>)</td><td align="center" rowspan="1" colspan="1">100</td></tr><tr><td align="left" rowspan="1" colspan="1">Stewart et al. <xref rid="b85" ref-type="bibr">2007c</xref></td><td align="left" rowspan="1" colspan="1">effects of salmonid stocking in lakes on native fish populations and other fauna and flora</td><td align="left" rowspan="1" colspan="1">global</td><td align="center" rowspan="1" colspan="1">2</td><td align="left" rowspan="1" colspan="1">freshwater fishes, reptiles, amphibians, invertebrates, and flora</td><td align="center" rowspan="1" colspan="1"><1</td></tr><tr><td align="left" rowspan="1" colspan="1">Stewart et al. <xref rid="b73" ref-type="bibr">2009a</xref></td><td align="left" rowspan="1" colspan="1">global ecological effects of temperate marine reserves</td><td align="left" rowspan="1" colspan="1">global</td><td align="center" rowspan="1" colspan="1">4</td><td align="left" rowspan="1" colspan="1">marine fishes, algae, and invertebrates</td><td align="center" rowspan="1" colspan="1">2</td></tr><tr><td align="left" rowspan="1" colspan="1">Stewart et al. <xref rid="b74" ref-type="bibr">2009b</xref></td><td align="left" rowspan="1" colspan="1">effects of engineered in-stream structure on salmonid abundance</td><td align="left" rowspan="1" colspan="1">global</td><td align="center" rowspan="1" colspan="1">4</td><td align="left" rowspan="1" colspan="1">salmon species, trout species and <italic>Cottus gobio</italic></td><td align="center" rowspan="1" colspan="1">12</td></tr><tr><td align="left" rowspan="1" colspan="1">Timonen et al. <xref rid="b76" ref-type="bibr">2011</xref></td><td align="left" rowspan="1" colspan="1">woodland key habitats as biological diversity hotspots in boreal forests</td><td align="left" rowspan="1" colspan="1">Sweden, Finland, Norway, Denmark, Latvia, Lithuania, Estonia, Russia</td><td align="center" rowspan="1" colspan="1">38</td><td align="left" rowspan="1" colspan="1">boreal forest species</td><td align="center" rowspan="1" colspan="1">CBC<xref ref-type="table-fn" rid="tf2-3">c</xref></td></tr><tr><td align="left" rowspan="1" colspan="1">Tyler et al. <xref rid="b77" ref-type="bibr">2005</xref></td><td align="left" rowspan="1" colspan="1">effects of management interventions on American mink (<italic>Mustela vison</italic>) populations</td><td align="left" rowspan="1" colspan="1">Europe, North America</td><td align="center" rowspan="1" colspan="1">21</td><td align="left" rowspan="1" colspan="1">American mink (<italic>M. vison</italic>)</td><td align="center" rowspan="1" colspan="1">100</td></tr><tr><td align="left" rowspan="1" colspan="1">Tyler et al. <xref rid="b78" ref-type="bibr">2006</xref></td><td align="left" rowspan="1" colspan="1">effects of management interventions on <italic>Rhododendron ponticum</italic></td><td align="left" rowspan="1" colspan="1">U. K., Ireland, Austria, Belgium, France, Netherlands, New Zealand</td><td align="center" rowspan="1" colspan="1">40</td><td align="left" rowspan="1" colspan="1"><italic>R. ponticum</italic></td><td align="center" rowspan="1" colspan="1">100</td></tr><tr><td align="left" rowspan="1" colspan="1">Waylen et al. <xref rid="b79" ref-type="bibr">2010</xref></td><td align="left" rowspan="1" colspan="1">effects of local cultural context on community-based conservation interventions</td><td align="left" rowspan="1" colspan="1">global</td><td align="center" rowspan="1" colspan="1">16</td><td align="left" rowspan="1" colspan="1">NA<italic><sup>d</sup></italic></td><td align="center" rowspan="1" colspan="1">NA<xref ref-type="table-fn" rid="tf2-4">d</xref></td></tr></tbody></table><table-wrap-foot><fn id="tf2-1"><label>a</label><p><italic>Percentage of relevant countries represented in the meta-analysis</italic>.</p></fn><fn id="tf2-2"><label>b</label><p><italic>Percentage of relevant species represented in the meta-analysis</italic>.</p></fn><fn id="tf2-3"><label>c</label><p><italic>Could not be calculated</italic>.</p></fn><fn id="tf2-4"><label>d</label><p><italic>Not applicable</italic>.</p></fn></table-wrap-foot></table-wrap><fig id="fig02" position="float"><label>Figure 2</label><caption><p><italic>Proportion of relevant countries with data included in the meta-analysis (geographic coverage) of the systematic review on the basis of type of implications for management practice</italic> (n = 41) (<italic>error bars indicate SE</italic>).</p></caption><graphic xlink:href="cobi0027-0902-f2"></graphic></fig><fig id="fig03" position="float"><label>Figure 3</label><caption><p><italic>Taxonomic scope of the systematic review according to the type of implications for management practice</italic> (n =<italic>40</italic>).</p></caption><graphic xlink:href="cobi0027-0902-f3"></graphic></fig></sec><sec><title>Evidence Captured by Reviews</title><p>The reviews we evaluated commonly reported large numbers of relevant studies (μ = 315 [SE 85]) (<xref ref-type="fig" rid="fig04">Fig.4</xref>); however, the strict inclusion criteria for reviews and the limited quality of much of the available primary literature led to a median of only 12% of relevant studies being included in the meta-analysis. The reasons for this high attrition of relevant studies included: a different measure of outcome (e.g., measuring the effect of an intervention on fecundity instead of mortality); no measure of variance reported for the data set; research methods that failed to meet quality standards (e.g., no data collected prior to the intervention and lack of experimental controls); and use of multiple management interventions that masked the effect of the intervention of interest.</p><fig id="fig04" position="float"><label>Figure 4</label><caption><p><italic>Number of relevant studies found and those included in systematic review grouped by the type of implications for conservation practice (</italic>n =<italic>40</italic>).</p></caption><graphic xlink:href="cobi0027-0902-f4"></graphic></fig><p>Despite 88% of the available research being excluded from systematic reviews, the meta-analyses still captured a large research effort. On average, the primary studies included in each meta-analysis represented 284 independent data sets (SE 109) and a combined total of 112 years (SE 24) of data collection. However, we found no statistically significant difference between reviews that could or could not provide guidance to managers for either the number of data sets (<italic>t</italic> = –1.43; df = 37; <italic>p</italic> = 0.82) or the number of years of data collection (<italic>t</italic> = 1.60; df = 39; <italic>p</italic> = 0.11) embodied in the meta-analysis.</p></sec></sec><sec sec-type="discussion"><title>Discussion</title><p>We located 43 systematic reviews on the effectiveness of conservation interventions published from January 2001 through March 2012. Just over half had direct implications for conservation practice, but almost as many could not directly inform management (Fig.<xref ref-type="fig" rid="fig01">1</xref>). Although direct comparisons among disciplines can be problematic and the small sample size of available reviews undoubtedly limits inference, this result is consistent with reviews within the fields of medicine, social welfare, education, and criminology, where 54% of systematic reviews could not draw conclusions about the effectiveness of interventions (Hansen & Rieper <xref rid="b29" ref-type="bibr">2009</xref>). Considerable time and money are required to produce a review (up to $US300,000) (CEBC <xref rid="b9" ref-type="bibr">2010</xref>), so the frequency with which reviews fail to provide implications for management may discourage authors from conducting systematic reviews.</p><p>It has been suggested that systematic reviews of conservation interventions are not well suited to addressing broad policy issues (Fazey et al. <xref rid="b22" ref-type="bibr">2004</xref>). Ecological phenomena vary enormously among species and environments (Hawkins et al. <xref rid="b30" ref-type="bibr">2003</xref>; Magurran et al. <xref rid="b39" ref-type="bibr">2010</xref>), and reviews with a policy focus tended to encompass a broad geographic and taxonomic scope, reflecting this variation. Reviews with a broader geographic scope highlighted geographic variation in the effectiveness of interventions (Fig.<xref ref-type="fig" rid="fig02">2</xref>), and reviews addressing more than one functional group could provide guidance only for a narrow set of management contexts within their overall breadth (Fig.<xref ref-type="fig" rid="fig03">3</xref>). Reviews focusing on big-picture conservation interventions tend to provide little guidance for individual conservation managers because there is often substantial heterogeneity in results across different spatiotemporal scales and for different focal species (e.g., Stewart et al. <xref rid="b73" ref-type="bibr">2009a</xref>). We echo cautions raised in the medical literature that broad review questions increase the heterogeneity in the circumstances under which interventions are made, making findings harder to interpret (Higgins & Green <xref rid="b31" ref-type="bibr">2011</xref>).</p><p>Taking an evidence-based approach to developing conservation policy is clearly desirable (Pullin et al. <xref rid="b56" ref-type="bibr">2009</xref>). However, we found that the available data rarely justify conducting reviews with a broad geographic and taxonomic scope because only a fraction of this scope (13–16%) is actually realized. Despite attempting to address diverse taxonomic and geographic regions, the individual reviews were generally highly taxonomically and geographically biased due to limitations in the available data. Research from North America and Europe was overrepresented as was research on particular taxonomic groups, such as birds and mammals. Despite the rigor of the systematic review method, it could thus be argued that many reviews provide little information to managers that cannot be provided through traditional narrative reviews or research synopses (<ext-link ext-link-type="uri" xlink:href="www.conservationevidence.com/synopses.php">www.conservationevidence.com/synopses.php</ext-link>), which summarize the primary literature on a topic in a more informal manner. Moreover, the poor quality of much of the available literature and the restrictive criteria imposed by quantitative meta-analysis methods mean that much potentially relevant science might be excluded from a systematic review. Given the expense, time, and expertise required to conduct a systematic review, careful consideration is needed to determine which conservation questions warrant a systematic review versus a narrative review or other form of information synthesis.</p><p>The breadth of many of the reviews may explain why there were often hundreds of relevant studies reported during the literature search phase of the reviews (Fig.<xref ref-type="fig" rid="fig04">4</xref>) and a significant research effort (μ = 284 data sets; μ = 112 years) captured by the analyses. Research effort was unrelated to the strength of the meta-analysis, such that a review with little data was as likely to yield clear findings as one representing hundreds of data sets or years of data collection. Therefore, contrary to other disciplines that attribute high failure rates of reviews to a lack of available primary data (Hansen & Rieper <xref rid="b29" ref-type="bibr">2009</xref>), it is possible that this is not a primary concern in conservation science.</p><p>One aspect of systematic reviews that we could not address is whether reviews change management practices. The types of evidence valued by managers is an understudied area (but see Pullin & Knight <xref rid="b54" ref-type="bibr">2005</xref>; Cook et al. <xref rid="b12" ref-type="bibr">2012</xref>), and managers’ perspectives on the value of systematic reviews and other types of information syntheses could provide valuable insight into the types of questions best suited to each approach and which research questions should be given priority (Braunisch et al. <xref rid="b6" ref-type="bibr">2012</xref>). We observed a tendency for systematic reviews to address big-picture conservation issues, sometimes at the expense of relevance for on-the-ground managers. Bilateral communication between scientists and managers throughout the review process is likely to improve the relevance of systematic reviews (Cook et al. <xref rid="b14" ref-type="bibr">2013</xref>).</p><sec><title>Benefits of Systematic Reviews</title><p>We found that systematic reviews are effective at exposing important knowledge gaps. For example, studies of the effectiveness of invasive species control rarely quantify the benefits for biological diversity (Kettenring & Adams <xref rid="b37" ref-type="bibr">2011</xref>). Practitioners are an important resource for identifying key knowledge gaps in conservation science (Braunisch et al. <xref rid="b6" ref-type="bibr">2012</xref>). However, the well-documented mismatch between conservation science and information priorities for on-the-ground managers (e.g., Whitten et al. <xref rid="b82" ref-type="bibr">2001</xref>; Fazey et al. <xref rid="b21" ref-type="bibr">2005</xref>) highlights the important role systematic reviews can play in articulating key research priorities to scientists.</p><p>The research quality standards imposed by systematic reviews frequently highlight methodological problems with published research, and most reviews make recommendations for how methods should be strengthened to provide greater value for management decisions. For example, research on the effectiveness of invasive species control methods often use greenhouse studies that do not reflect management conditions (Roberts & Pullin <xref rid="b60" ref-type="bibr">2007a</xref>). Likewise, when research findings are obstructed by confounding variables, reviews can highlight necessary improvements to experimental protocols (e.g., Frampton & Dorne <xref rid="b25" ref-type="bibr">2007</xref>). Therefore, even when reviews fail to provide guidance for on-the-ground managers, they can yield many useful recommendations about how to improve the quality of management-relevant conservation science.</p></sec><sec><title>Opportunities to Improve Systematic Reviews of Conservation Evidence</title><p>We suggest there are several opportunities to improve the application of the systematic methodology to yield greater benefits for conservation management: encourage more reviews, select the appropriate topic and breadth, make better use of available data, and evaluate cost-effectiveness.</p><p>The small number of systematic reviews conducted leaves many critical conservation management issues without a comprehensive synthesis of existing evidence. The imperative for academics to publish in high-impact journals (Gibbons et al. <xref rid="b26" ref-type="bibr">2008</xref>) and the considerable time and money required to conduct systematic reviews (CEBC <xref rid="b9" ref-type="bibr">2010</xref>) mean they are currently relatively unattractive. Additional avenues for funding and publishing reviews are required and more open-access scientific platforms for distilling relevant information, such as Environmental Evidence, would benefit conservation managers. To streamline the review process, software now exists to capture, store, and synthesize primary data for reviews (e.g., Eco Evidence—Webb et al. <xref rid="b80" ref-type="bibr">2011</xref>). Making evidence summaries available to other users through a communal database allows existing reviews to be easily updated or modified so that information can be used in new reviews. This practice reduces duplication of effort and could provide a valuable resource for decision makers searching for reliable evidence pertaining to a specific topic.</p><p>Incentives for academics to publish may explain why we observed a mismatch between the narrow review questions likely to be more valuable to decision makers and the prevalence of high-level conservation questions likely to be interesting to a broad scientific audience. Knowledge maps highlight where gaps in the available literature warrant the review topic being refined to provide the greatest value for decision makers (CEBC <xref rid="b9" ref-type="bibr">2010</xref>). Encouraging authors to conduct reviews with a narrower scope focused on informing on-the-ground management decisions would help streamline the review process and simplify the interpretation of findings (Higgins & Green <xref rid="b31" ref-type="bibr">2011</xref>). Narrow review topics may not elucidate the sources of heterogeneity in the effectiveness of an intervention that are helpful for conservation policy; overview reviews developed for evidence-based medicine (Whitlock et al. <xref rid="b81" ref-type="bibr">2008</xref>) can achieve this by drawing together the results of several narrowly focused reviews. However, the cost-effectiveness of overview reviews has not been examined.</p><p>Not all of the 88% of relevant studies excluded from reviews provide meaningful evidence. However, the stringent requirements for data inclusion in a meta-analysis undoubtedly result in potentially useful information being excluded (Pullin & Stewart <xref rid="b57" ref-type="bibr">2006</xref>). To reflect a broader evidence base without compromising on the quality of science, formalized scoring approaches, such as causal criteria analyses (Norris et al. <xref rid="b48" ref-type="bibr">2012</xref>) and Bayesian approaches that capture expert knowledge (Newton et al. <xref rid="b46" ref-type="bibr">2007</xref>) can be used. These less-stringent methods capture up to 30% more data than meta-analysis and can test a broader range of hypotheses (Greet et al. <xref rid="b27" ref-type="bibr">2011</xref>). Other disciplines have also broadened their definitions of credible evidence to suit the questions being addressed (Hansen & Rieper <xref rid="b29" ref-type="bibr">2009</xref>) and are using evidence typologies to define the appropriate types of evidence according to the nature of the research question (Petticrew & Roberts <xref rid="b51" ref-type="bibr">2003</xref>). Similarly, methods are being developed to identify rigorous qualitative research (Higgins & Green <xref rid="b31" ref-type="bibr">2011</xref>) that can complement, enhance, extend, and supplement the quantitative analysis in systematic reviews (Petticrew & Roberts <xref rid="b51" ref-type="bibr">2003</xref>; Higgins & Green <xref rid="b31" ref-type="bibr">2011</xref>).</p><p>The cost of an action can materially alter conclusions about the best interventions for a given context (Baxter et al. <xref rid="b2" ref-type="bibr">2006</xref>). We believe that to be of greatest valuable to managers, systematic reviews should include an explicit cost-effectiveness analysis (Segan et al. <xref rid="b63" ref-type="bibr">2011</xref>). Some review authors have recognized the importance of including costs (e.g., Doerr et al. <xref rid="b18" ref-type="bibr">2010</xref>; Kettenring & Adams <xref rid="b37" ref-type="bibr">2011</xref>) but have been prevented from analyzing the cost-effectiveness of different interventions by poor reporting of management costs within primary studies. A further impediment is the lack of guidelines for capturing cost-effectiveness in systematic reviews of conservation interventions (Pullin & Stewart <xref rid="b57" ref-type="bibr">2006</xref>).</p></sec><sec><title>Value of Systematic Reviews</title><p>The need for effective management highlights the value of tools to synthesize and distribute credible evidence to decision makers. Systematic reviews can be an important part of the conservation decision making tool kit; however, the current application of this method generally fails to harness their full potential, and at present systematic review is most useful for summarizing the current state of knowledge, identifying knowledge gaps, and highlighting where the quality of existing research needs to be improved. We believe that the benefits of systematic reviews could be enhanced by increasing the number of reviews focused on questions of direct relevance to on-the-ground managers, a more focused geographic and taxonomic scope that better reflects the available data, greater use of existing knowledge that includes a broader range of evidence types, and inclusion of an appraisal of the cost-effectiveness of interventions.</p></sec></sec></body><back><ack><p>This research was conducted with the support of funding from the Australian Research Council Centre of Excellence in Environmental Decisions and the Environmental Decisions Hub of the National Environmental Research Program. We thank A. Pullin and W. Sutherland for valuable discussions and feedback during the development of this manuscript.</p></ack><ref-list><title>Literature Cited</title><ref id="b1"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Abella</surname><given-names>SR</given-names></name></person-group><article-title>Post-fire plant recovery in the Mojave and Sonoran Deserts of western North America</article-title><source>Journal of Arid Environments</source><year>2009</year><volume>73</volume><fpage>699</fpage><lpage>707</lpage></element-citation></ref><ref id="b2"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Baxter</surname><given-names>PWJ</given-names></name><name><surname>McCarthy</surname><given-names>MA</given-names></name><name><surname>Possingham</surname><given-names>HP</given-names></name><name><surname>Menkhorst</surname><given-names>PW</given-names></name></person-group><person-group person-group-type="author"><name><surname>McLean</surname><given-names>N</given-names></name></person-group><article-title>Accounting for management costs in sensitivity analyses of matrix population models</article-title><source>Conservation Biology</source><year>2006</year><volume>20</volume><fpage>893</fpage><lpage>905</lpage><pub-id pub-id-type="pmid">16909581</pub-id></element-citation></ref><ref id="b3"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bayard</surname><given-names>TS</given-names></name></person-group><person-group person-group-type="author"><name><surname>Elphick</surname><given-names>CS</given-names></name></person-group><article-title>How area sensitivity in birds is studied</article-title><source>Conservation Biology</source><year>2010</year><volume>24</volume><fpage>938</fpage><lpage>947</lpage><pub-id pub-id-type="pmid">20337682</pub-id></element-citation></ref><ref id="b4"><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Benítez-López</surname><given-names>A</given-names></name><name><surname>Alkemade</surname><given-names>R</given-names></name></person-group><person-group person-group-type="author"><name><surname>Verweij</surname><given-names>PA</given-names></name></person-group><source>Are mammal and bird populations declining in the proximity of roads and other infrastructure? Systematic review 68</source><year>2009</year><publisher-loc>Bilthoven, The Netherlands</publisher-loc><publisher-name>Collaboration for Environmental Evidence</publisher-name></element-citation></ref><ref id="b5"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bowler</surname><given-names>DE</given-names></name><name><surname>Buyung-Ali</surname><given-names>LM</given-names></name><name><surname>Healey</surname><given-names>JR</given-names></name><name><surname>Jones</surname><given-names>JPG</given-names></name><name><surname>Knight</surname><given-names>TM</given-names></name></person-group><person-group person-group-type="author"><name><surname>Pullin</surname><given-names>AS</given-names></name></person-group><article-title>Does community forest management provide global environmental benefits and improve local welfare?</article-title><source>Frontiers in Ecology and the Environment</source><year>2012</year><volume>10</volume><fpage>29</fpage><lpage>36</lpage></element-citation></ref><ref id="b6"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Braunisch</surname><given-names>V</given-names></name><name><surname>Home</surname><given-names>R</given-names></name><name><surname>Pellet</surname><given-names>J</given-names></name></person-group><person-group person-group-type="author"><name><surname>Arlettaz</surname><given-names>R</given-names></name></person-group><article-title>Conservation science relevant to action: a research agenda identified and prioritized by practitioners</article-title><source>Biological Conservation</source><year>2012</year><volume>153</volume><fpage>201</fpage><lpage>210</lpage></element-citation></ref><ref id="b7"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Brooks</surname><given-names>JS</given-names></name><name><surname>Franzen</surname><given-names>MA</given-names></name><name><surname>Holmes</surname><given-names>CM</given-names></name><name><surname>Grote</surname><given-names>MN</given-names></name></person-group><person-group person-group-type="author"><name><surname>Mulder</surname><given-names>MB</given-names></name></person-group><article-title>Testing hypotheses for the success of different conservation strategies</article-title><source>Conservation Biology</source><year>2006</year><volume>20</volume><fpage>1528</fpage><lpage>1538</lpage><pub-id pub-id-type="pmid">17002770</pub-id></element-citation></ref><ref id="b8"><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Bussell</surname><given-names>J</given-names></name><name><surname>Jones</surname><given-names>DL</given-names></name><name><surname>Healey</surname><given-names>JR</given-names></name></person-group><person-group person-group-type="author"><name><surname>Pullin</surname><given-names>AS</given-names></name></person-group><source>How do draining and re-wetting affect carbon stores and greenhouse gas fluxes in peatland soils? Systematic review 49</source><year>2010</year><publisher-loc>Bangor, United Kingdom</publisher-loc><publisher-name>Collaboration for Environmental Evidence</publisher-name></element-citation></ref><ref id="b9"><element-citation publication-type="other"><comment>Centre for Evidence-Based Conservation (CEBC) Guidelines for systematic review in environmental management. Version 4.0. Environmental evidence 2010. CEBC, Bangor University, Bangor, United Kingdom. Available from <ext-link ext-link-type="uri" xlink:href="www.environmentalevidence.org/Authors.htm">www.environmentalevidence.org/Authors.htm</ext-link> (accessed September 2012)</comment></element-citation></ref><ref id="b10"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Chalmers</surname><given-names>I</given-names></name></person-group><article-title>The Cochrane collaboration: preparing, maintaining and disseminating systematic reviews of the effects of health care</article-title><source>Annals of the New York Academy of Sciences</source><year>1993</year><volume>703</volume><fpage>156</fpage><lpage>165</lpage><pub-id pub-id-type="pmid">8192293</pub-id></element-citation></ref><ref id="b11"><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Cochrane</surname><given-names>AL</given-names></name></person-group><source>Effectiveness and efficiency: random reflections on health services</source><year>1972</year><publisher-loc>London</publisher-loc><publisher-name>The Nuffield Provincial Hospitals Trust</publisher-name></element-citation></ref><ref id="b12"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Cook</surname><given-names>CN</given-names></name><name><surname>Carter</surname><given-names>RW</given-names></name><name><surname>Fuller</surname><given-names>RA</given-names></name></person-group><person-group person-group-type="author"><name><surname>Hockings</surname><given-names>M</given-names></name></person-group><article-title>Managers consider multiple lines of evidence important for biodiversity management decisions</article-title><source>Journal of Environmental Management</source><year>2012</year><volume>113</volume><fpage>341</fpage><lpage>346</lpage><pub-id pub-id-type="pmid">23062270</pub-id></element-citation></ref><ref id="b13"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Cook</surname><given-names>CN</given-names></name><name><surname>Hockings</surname><given-names>M</given-names></name></person-group><person-group person-group-type="author"><name><surname>Carter</surname><given-names>RW</given-names></name></person-group><article-title>Conservation in the dark? the information used to support management decisions</article-title><source>Frontiers in Ecology and the Environment</source><year>2010</year><volume>8</volume><fpage>181</fpage><lpage>186</lpage></element-citation></ref><ref id="b14"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Cook</surname><given-names>CN</given-names></name><name><surname>Mascia</surname><given-names>MB</given-names></name><name><surname>Schwartz</surname><given-names>MW</given-names></name><name><surname>Possingham</surname><given-names>HP</given-names></name></person-group><person-group person-group-type="author"><name><surname>Fuller</surname><given-names>RA</given-names></name></person-group><article-title>Achieving conservation science that bridges the knowledge-action boundary</article-title><source>Conservation Biology</source><year>2013</year><volume>27</volume><comment>DOI: 10.1111/cobi.12050</comment></element-citation></ref><ref id="b15"><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Dalrymple</surname><given-names>SE</given-names></name><name><surname>Stewart</surname><given-names>GB</given-names></name></person-group><person-group person-group-type="author"><name><surname>Pullin</surname><given-names>AS</given-names></name></person-group><source>Are reintroductions an effective way of mitigating against plant extinctions? Systematic review 32</source><year>2011</year><publisher-loc>Aberdeen, United Kingdom</publisher-loc><publisher-name>Collaboration for Environmental Evidence</publisher-name></element-citation></ref><ref id="b16"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Davies</surname><given-names>ZG</given-names></name></person-group><person-group person-group-type="author"><name><surname>Pullin</surname><given-names>AS</given-names></name></person-group><article-title>Are hedgerows effective corridors between fragments of woodland habitat? An evidence-based approach</article-title><source>Landscape Ecology</source><year>2007</year><volume>22</volume><fpage>333</fpage><lpage>351</lpage></element-citation></ref><ref id="b17"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Davies</surname><given-names>ZG</given-names></name><name><surname>Tyler</surname><given-names>C</given-names></name><name><surname>Stewart</surname><given-names>GB</given-names></name></person-group><person-group person-group-type="author"><name><surname>Pullin</surname><given-names>AS</given-names></name></person-group><article-title>Are current management recommendations for saproxylic invertebrates effective? a systematic review</article-title><source>Biodiversity and Conservation</source><year>2008</year><volume>17</volume><fpage>209</fpage><lpage>234</lpage></element-citation></ref><ref id="b18"><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Doerr</surname><given-names>VAJ</given-names></name><name><surname>Doerr</surname><given-names>ED</given-names></name></person-group><person-group person-group-type="author"><name><surname>Davies</surname><given-names>MJ</given-names></name></person-group><source>Does structural connectivity facilitate dispersal of native species in Australia’s fragmented terrestrial landscapes? Systematic review 44</source><year>2010</year><publisher-loc>Canberra, Australia</publisher-loc><publisher-name>Collaboration for Environmental Evidence</publisher-name></element-citation></ref><ref id="b19"><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Eycott</surname><given-names>A</given-names></name><name><surname>Watts</surname><given-names>K</given-names></name><name><surname>Brandt</surname><given-names>G</given-names></name><name><surname>Buyung-Ali</surname><given-names>L</given-names></name><name><surname>Bowler</surname><given-names>D</given-names></name><name><surname>Stewart</surname><given-names>GB</given-names></name></person-group><person-group person-group-type="author"><name><surname>Pullin</surname><given-names>AS</given-names></name></person-group><source>Do landscape matric features affect species movement? Systematic review 43</source><year>2010</year><publisher-loc>United Kingdom</publisher-loc><publisher-name>Collaboration for Environmental Evidence, Farnham</publisher-name></element-citation></ref><ref id="b20"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Eycott</surname><given-names>AE</given-names></name><name><surname>Stewart</surname><given-names>GB</given-names></name><name><surname>Buyung-Ali</surname><given-names>LM</given-names></name><name><surname>Bowler</surname><given-names>DE</given-names></name><name><surname>Watts</surname><given-names>K</given-names></name></person-group><person-group person-group-type="author"><name><surname>Pullin</surname><given-names>AS</given-names></name></person-group><article-title>A meta-analysis on the impact of different matrix structures on species movement rates</article-title><source>Landscape Ecology</source><year>2012</year><volume>27</volume><fpage>1263</fpage><lpage>1278</lpage></element-citation></ref><ref id="b21"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Fazey</surname><given-names>I</given-names></name><name><surname>Fischer</surname><given-names>J</given-names></name></person-group><person-group person-group-type="author"><name><surname>Lindenmayer</surname><given-names>DB</given-names></name></person-group><article-title>What do conservation biologists publish?</article-title><source>Biological Conservation</source><year>2005</year><volume>124</volume><fpage>63</fpage><lpage>73</lpage></element-citation></ref><ref id="b22"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Fazey</surname><given-names>I</given-names></name><name><surname>Salisbury</surname><given-names>JG</given-names></name><name><surname>Lindenmayer</surname><given-names>DB</given-names></name><name><surname>Maindonald</surname><given-names>J</given-names></name></person-group><person-group person-group-type="author"><name><surname>Douglas</surname><given-names>R</given-names></name></person-group><article-title>Can methods applied in medicine be used to summarize and disseminate conservation research?</article-title><source>Environmental Conservation</source><year>2004</year><volume>31</volume><fpage>190</fpage><lpage>198</lpage></element-citation></ref><ref id="b23"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ferraro</surname><given-names>PJ</given-names></name></person-group><person-group person-group-type="author"><name><surname>Pattanayak</surname><given-names>SK</given-names></name></person-group><article-title>Money for nothing? A call for empirical evaluation of biodiversity conservation investments</article-title><source>PLoS Biology</source><year>2006</year><volume>4</volume><fpage>482</fpage><lpage>488</lpage></element-citation></ref><ref id="b24"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Forsyth</surname><given-names>G</given-names></name></person-group><article-title>An enquiry into drug bill</article-title><source>Medical Care</source><year>1963</year><volume>1</volume><fpage>10</fpage><lpage>16</lpage></element-citation></ref><ref id="b25"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Frampton</surname><given-names>GK</given-names></name></person-group><person-group person-group-type="author"><name><surname>Dorne</surname><given-names>JCM</given-names></name></person-group><article-title>The effects on terrestrial invertebrates of reducing pesticide inputs in arable crop edges: a meta-analysis</article-title><source>Journal of Applied Ecology</source><year>2007</year><volume>44</volume><fpage>362</fpage><lpage>373</lpage></element-citation></ref><ref id="b26"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gibbons</surname><given-names>P</given-names></name><etal></etal></person-group><article-title>Some practical suggestions for improving engagement between researchers and policy-makers in natural resource management</article-title><source>Ecological Management & Restoration</source><year>2008</year><volume>9</volume><fpage>182</fpage><lpage>186</lpage></element-citation></ref><ref id="b27"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Greet</surname><given-names>J</given-names></name><name><surname>Webb</surname><given-names>JA</given-names></name></person-group><person-group person-group-type="author"><name><surname>Cousens</surname><given-names>RD</given-names></name></person-group><article-title>The importance of seasonal flow timing for riparian vegetation dynamics: a systematic review using causal criteria analysis</article-title><source>Freshwater Biology</source><year>2011</year><volume>56</volume><fpage>1231</fpage><lpage>1247</lpage></element-citation></ref><ref id="b28"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gusset</surname><given-names>M</given-names></name><name><surname>Stewart</surname><given-names>GB</given-names></name><name><surname>Bowler</surname><given-names>DE</given-names></name></person-group><person-group person-group-type="author"><name><surname>Pullin</surname><given-names>AS</given-names></name></person-group><article-title>Wild dog reintroductions in South Africa: a systematic review and cross-validation of an endangered species recovery programme</article-title><source>Journal for Nature Conservation</source><year>2010</year><volume>18</volume><fpage>230</fpage><lpage>234</lpage></element-citation></ref><ref id="b29"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Hansen</surname><given-names>HF</given-names></name></person-group><person-group person-group-type="author"><name><surname>Rieper</surname><given-names>O</given-names></name></person-group><article-title>The evidence movement: the development and consequences of methodologies in review practices</article-title><source>Evaluation</source><year>2009</year><volume>15</volume><fpage>141</fpage><lpage>163</lpage></element-citation></ref><ref id="b30"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Hawkins</surname><given-names>BA</given-names></name><etal></etal></person-group><article-title>Energy, water, and broad-scale geographic patterns of species richness</article-title><source>Ecology</source><year>2003</year><volume>84</volume><fpage>3105</fpage><lpage>3117</lpage></element-citation></ref><ref id="b31"><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Higgins</surname><given-names>JPT</given-names></name></person-group><person-group person-group-type="author"><name><surname>Green</surname><given-names>S</given-names></name></person-group><source>Cochrane handbook for systematic reviews of interventions</source><year>2011</year><publisher-loc>London</publisher-loc><publisher-name>The Cochrane Collaboration</publisher-name></element-citation></ref><ref id="b32"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Holt</surname><given-names>AR</given-names></name><name><surname>Davies</surname><given-names>ZG</given-names></name><name><surname>Tyler</surname><given-names>C</given-names></name></person-group><person-group person-group-type="author"><name><surname>Staddon</surname><given-names>S</given-names></name></person-group><article-title>Meta-analysis of the effects of predation on animal prey abundance: evidence from UK vertebrates</article-title><source>PLoS ONE</source><year>2008</year><volume>3</volume><fpage>e2400</fpage><pub-id pub-id-type="pmid">18545690</pub-id></element-citation></ref><ref id="b33"><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Isasi-Catalá</surname><given-names>E</given-names></name></person-group><article-title>Is translocation of problematic jaguars</article-title><source>(Panthera onca)</source><year>2010</year><publisher-loc>Caracas, Venezuela</publisher-loc><publisher-name>Collaboration for Environmental Evidence</publisher-name><comment>an effective strategy to resolve human-predator conflicts? Systematic Review No. 55.</comment></element-citation></ref><ref id="b34"><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Kabat</surname><given-names>TJ</given-names></name><name><surname>Stewart</surname><given-names>GB</given-names></name></person-group><person-group person-group-type="author"><name><surname>Pullin</surname><given-names>AS</given-names></name></person-group><article-title>Are Japanese knotweed</article-title><source>(Fallopia japonica)</source><year>2006</year><publisher-loc>Birmingham, United Kingdom</publisher-loc><publisher-name>Collaboration for Environmental Evidence</publisher-name><comment>control and eradication interventions effective? Systematic review 21.</comment></element-citation></ref><ref id="b35"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kalies</surname><given-names>EL</given-names></name><name><surname>Chambers</surname><given-names>CL</given-names></name></person-group><person-group person-group-type="author"><name><surname>Covington</surname><given-names>WW</given-names></name></person-group><article-title>Wildlife responses to thinning and burning treatments in southwestern conifer forests: a meta-analysis</article-title><source>Forest Ecology and Management</source><year>2010</year><volume>259</volume><fpage>333</fpage><lpage>342</lpage></element-citation></ref><ref id="b36"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kareiva</surname><given-names>P</given-names></name><name><surname>Marvier</surname><given-names>M</given-names></name><name><surname>West</surname><given-names>S</given-names></name></person-group><person-group person-group-type="author"><name><surname>Hornisher</surname><given-names>J</given-names></name></person-group><article-title>Slow-moving journals hinder conservation efforts</article-title><source>Nature</source><year>2002</year><volume>420</volume><fpage>15</fpage><pub-id pub-id-type="pmid">12422182</pub-id></element-citation></ref><ref id="b37"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kettenring</surname><given-names>KM</given-names></name></person-group><person-group person-group-type="author"><name><surname>Adams</surname><given-names>CR</given-names></name></person-group><article-title>Lessons learned from invasive plant control experiments: a systematic review and meta-analysis</article-title><source>Journal of Applied Ecology</source><year>2011</year><volume>48</volume><fpage>970</fpage><lpage>979</lpage></element-citation></ref><ref id="b38"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Linklater</surname><given-names>WL</given-names></name></person-group><article-title>Science and management in a conservation crisis: a case study with rhinoceros</article-title><source>Conservation Biology</source><year>2003</year><volume>17</volume><fpage>968</fpage><lpage>975</lpage></element-citation></ref><ref id="b39"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Magurran</surname><given-names>AE</given-names></name><name><surname>Baillie</surname><given-names>SR</given-names></name><name><surname>Buckland</surname><given-names>ST</given-names></name><name><surname>Dick</surname><given-names>JMcP</given-names></name><name><surname>Elston</surname><given-names>DA</given-names></name><name><surname>Scott</surname><given-names>EM</given-names></name><name><surname>Smith</surname><given-names>RI</given-names></name><name><surname>Somerfield</surname><given-names>PJ</given-names></name></person-group><person-group person-group-type="author"><name><surname>Watt</surname><given-names>AD</given-names></name></person-group><article-title>Long-term datasets in biodiversity research and monitoring: assessing change in ecological communities through time</article-title><source>Trends in Ecology & Evolution</source><year>2010</year><volume>25</volume><fpage>574</fpage><lpage>582</lpage><pub-id pub-id-type="pmid">20656371</pub-id></element-citation></ref><ref id="b40"><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Mant</surname><given-names>R</given-names></name><name><surname>Jones</surname><given-names>D</given-names></name><name><surname>Reynolds</surname><given-names>B</given-names></name><name><surname>Ormerod</surname><given-names>S</given-names></name></person-group><person-group person-group-type="author"><name><surname>Pullin</surname><given-names>AS</given-names></name></person-group><source>What is the impact of “liming” of streams and rivers on the abundance and diversity of fish and invertebrate populations?</source><year>2011</year><publisher-loc>Bangor, United Kingdom</publisher-loc><publisher-name>Collaboration for Environmental Evidence</publisher-name><comment>Systematic review 21.</comment></element-citation></ref><ref id="b41"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Martinez-Abrain</surname><given-names>A</given-names></name><name><surname>Oro</surname><given-names>D</given-names></name><name><surname>Jimenez</surname><given-names>J</given-names></name><name><surname>Stewart</surname><given-names>G</given-names></name></person-group><person-group person-group-type="author"><name><surname>Pullin</surname><given-names>A</given-names></name></person-group><article-title>A systematic review of the effects of recreational activities on nesting birds of prey</article-title><source>Basic and Applied Ecology</source><year>2010</year><volume>11</volume><fpage>312</fpage><lpage>319</lpage></element-citation></ref><ref id="b42"><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Maynard</surname><given-names>A</given-names></name></person-group><person-group person-group-type="author"><name><surname>Chalmers</surname><given-names>I</given-names></name></person-group><source>Non-random reflections on health services research: on the 25th anniversary of Archie Cochrane’s effectiveness and efficiency</source><year>1997</year><publisher-loc>London</publisher-loc><publisher-name>BMJ Publishing Group</publisher-name></element-citation></ref><ref id="b43"><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>McLeod</surname><given-names>LJ</given-names></name><name><surname>Saunders</surname><given-names>GR</given-names></name></person-group><person-group person-group-type="author"><name><surname>Kabat</surname><given-names>TJ</given-names></name></person-group><source>Do control interventions effectively reduce the impact of European Red Foxes on conservation values and agricultural production in Australia?</source><year>2008</year><publisher-loc>Orange, New South Wales</publisher-loc><publisher-name>Collaboration for Environmental Evidence</publisher-name><comment>Systematic review 24.</comment></element-citation></ref><ref id="b44"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Meffe</surname><given-names>GK</given-names></name><name><surname>Ehrenfeld</surname><given-names>D</given-names></name></person-group><person-group person-group-type="author"><name><surname>Noss</surname><given-names>RF</given-names></name></person-group><article-title>Conservation biology at twenty</article-title><source>Conservation Biology</source><year>2006</year><volume>20</volume><fpage>595</fpage><lpage>596</lpage><pub-id pub-id-type="pmid">16909538</pub-id></element-citation></ref><ref id="b45"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Mulrow</surname><given-names>CD</given-names></name></person-group><article-title>Systematic reviews—rationale for systematic reviews</article-title><source>British Medical Journal</source><year>1994</year><volume>309</volume><fpage>597</fpage><lpage>599</lpage><pub-id pub-id-type="pmid">8086953</pub-id></element-citation></ref><ref id="b46"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Newton</surname><given-names>AC</given-names></name><name><surname>Stewart</surname><given-names>GB</given-names></name><name><surname>Diaz</surname><given-names>A</given-names></name><name><surname>Golicher</surname><given-names>D</given-names></name></person-group><person-group person-group-type="author"><name><surname>Pullin</surname><given-names>AS</given-names></name></person-group><article-title>Bayesian belief networks as a tool for evidence-based conservation management</article-title><source>Journal for Nature Conservation</source><year>2007</year><volume>15</volume><fpage>144</fpage><lpage>160</lpage></element-citation></ref><ref id="b47"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Newton</surname><given-names>AC</given-names></name><name><surname>Stewart</surname><given-names>GB</given-names></name><name><surname>Myers</surname><given-names>G</given-names></name><name><surname>Diaz</surname><given-names>A</given-names></name><name><surname>Lake</surname><given-names>S</given-names></name><name><surname>Bullock</surname><given-names>JM</given-names></name></person-group><person-group person-group-type="author"><name><surname>Pullin</surname><given-names>AS</given-names></name></person-group><article-title>Impacts of grazing on lowland heathland in north-west Europe</article-title><source>Biological Conservation</source><year>2009</year><volume>142</volume><fpage>935</fpage><lpage>947</lpage></element-citation></ref><ref id="b48"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Norris</surname><given-names>RH</given-names></name><name><surname>Webb</surname><given-names>JA</given-names></name><name><surname>Nichols</surname><given-names>SJ</given-names></name><name><surname>Stewartson</surname><given-names>MJ</given-names></name></person-group><person-group person-group-type="author"><name><surname>Harrison</surname><given-names>ET</given-names></name></person-group><article-title>Analyzing cause and effect in environmental assessments: using weighted evidence from the literature</article-title><source>Freshwater Science</source><year>2012</year><volume>31</volume><fpage>5</fpage><lpage>21</lpage></element-citation></ref><ref id="b49"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Oro</surname><given-names>D</given-names></name></person-group><person-group person-group-type="author"><name><surname>Martínez-Abraín</surname><given-names>A</given-names></name></person-group><article-title>Deconstructing myths on large gulls and their impact on threatened sympatric waterbirds</article-title><source>Animal Conservation</source><year>2007</year><volume>10</volume><fpage>117</fpage><lpage>126</lpage></element-citation></ref><ref id="b50"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Peppin</surname><given-names>D</given-names></name><name><surname>Fule</surname><given-names>PZ</given-names></name><name><surname>Sieg</surname><given-names>CH</given-names></name><name><surname>Beyers</surname><given-names>JL</given-names></name></person-group><person-group person-group-type="author"><name><surname>Hunter</surname><given-names>ME</given-names></name></person-group><article-title>Post-wildfire seeding in forests of the western United States: an evidence-based review</article-title><source>Forest Ecology and Management</source><year>2010</year><volume>260</volume><fpage>573</fpage><lpage>586</lpage></element-citation></ref><ref id="b51"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Petticrew</surname><given-names>M</given-names></name></person-group><person-group person-group-type="author"><name><surname>Roberts</surname><given-names>H</given-names></name></person-group><article-title>Evidence, hierarchies, and typologies: horses for courses</article-title><source>Journal of Epidemiology and Community Health</source><year>2003</year><volume>57</volume><fpage>527</fpage><lpage>529</lpage><pub-id pub-id-type="pmid">12821702</pub-id></element-citation></ref><ref id="b52"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Pfeffer</surname><given-names>J</given-names></name></person-group><person-group person-group-type="author"><name><surname>Sutton</surname><given-names>RI</given-names></name></person-group><article-title>Knowing “what” to do is not enough: turning knowledge into action</article-title><source>California Management Review</source><year>1999</year><volume>42</volume><fpage>83</fpage><lpage>108</lpage></element-citation></ref><ref id="b53"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Pullin</surname><given-names>AS</given-names></name></person-group><person-group person-group-type="author"><name><surname>Knight</surname><given-names>TM</given-names></name></person-group><article-title>Effectiveness in conservation practice: pointers from medicine and public health</article-title><source>Conservation Biology</source><year>2001</year><volume>15</volume><fpage>50</fpage><lpage>54</lpage></element-citation></ref><ref id="b54"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Pullin</surname><given-names>AS</given-names></name></person-group><person-group person-group-type="author"><name><surname>Knight</surname><given-names>TM</given-names></name></person-group><article-title>Assessing conservation management’s evidence base: a survey of management-plan compilers in the United Kingdom and Australia</article-title><source>Conservation Biology</source><year>2005</year><volume>19</volume><fpage>1989</fpage><lpage>1996</lpage></element-citation></ref><ref id="b55"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Pullin</surname><given-names>AS</given-names></name></person-group><person-group person-group-type="author"><name><surname>Knight</surname><given-names>TM</given-names></name></person-group><article-title>Doing more good than harm—building an evidence-base for conservation and environmental management</article-title><source>Biological Conservation</source><year>2009</year><volume>142</volume><fpage>931</fpage><lpage>934</lpage></element-citation></ref><ref id="b56"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Pullin</surname><given-names>AS</given-names></name><name><surname>Knight</surname><given-names>TM</given-names></name></person-group><person-group person-group-type="author"><name><surname>Watkinson</surname><given-names>AR</given-names></name></person-group><article-title>Linking reductionist science and holistic policy using systematic reviews: unpacking environmental policy questions to construct an evidence-based framework</article-title><source>Journal of Applied Ecology</source><year>2009</year><volume>46</volume><fpage>970</fpage><lpage>975</lpage></element-citation></ref><ref id="b57"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Pullin</surname><given-names>AS</given-names></name></person-group><person-group person-group-type="author"><name><surname>Stewart</surname><given-names>GB</given-names></name></person-group><article-title>Guidelines for systematic review in conservation and environmental management</article-title><source>Conservation Biology</source><year>2006</year><volume>20</volume><fpage>1647</fpage><lpage>1656</lpage><pub-id pub-id-type="pmid">17181800</pub-id></element-citation></ref><ref id="b58"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Radwan</surname><given-names>J</given-names></name><name><surname>Biedrzycka</surname><given-names>A</given-names></name></person-group><person-group person-group-type="author"><name><surname>Babik</surname><given-names>W</given-names></name></person-group><article-title>Does reduced MHC diversity decrease viability of vertebrate populations?</article-title><source>Biological Conservation</source><year>2010</year><volume>143</volume><fpage>537</fpage><lpage>544</lpage></element-citation></ref><ref id="b59"><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Roberts</surname><given-names>PD</given-names></name></person-group><person-group person-group-type="author"><name><surname>Pullin</surname><given-names>AS</given-names></name></person-group><source>The effectiveness of management options used for the control of Spartina species</source><year>2006</year><publisher-loc>Birmingham, United Kingdom</publisher-loc><publisher-name>Collaboration for Environmental Evidence</publisher-name><comment>Systematic Review No. 22.</comment></element-citation></ref><ref id="b60"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Roberts</surname><given-names>PD</given-names></name></person-group><person-group person-group-type="author"><name><surname>Pullin</surname><given-names>AS</given-names></name></person-group><article-title>The effectiveness of management interventions used to control Ragwort species</article-title><source>Environmental Management</source><year>2007a</year><volume>39</volume><fpage>691</fpage><lpage>706</lpage><pub-id pub-id-type="pmid">17377727</pub-id></element-citation></ref><ref id="b61"><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Roberts</surname><given-names>PD</given-names></name></person-group><person-group person-group-type="author"><name><surname>Pullin</surname><given-names>AS</given-names></name></person-group><source>The effectiveness of land-based schemes (incl. Agri-environment) at conserving farmland bird densities within the U.K</source><year>2007b</year><publisher-loc>Bangor, United Kingdom</publisher-loc><publisher-name>Collaboration for Environmental Evidence</publisher-name><comment>Systematic review 11.</comment></element-citation></ref><ref id="b62"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Roberts</surname><given-names>PD</given-names></name><name><surname>Stewart</surname><given-names>GB</given-names></name></person-group><person-group person-group-type="author"><name><surname>Pullin</surname><given-names>AS</given-names></name></person-group><article-title>Are review articles a reliable source of evidence to support conservation and environmental management? A comparison with medicine</article-title><source>Biological Conservation</source><year>2006</year><volume>132</volume><fpage>409</fpage><lpage>423</lpage></element-citation></ref><ref id="b63"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Segan</surname><given-names>DB</given-names></name><name><surname>Bottrill</surname><given-names>MC</given-names></name><name><surname>Baxter</surname><given-names>PWJ</given-names></name></person-group><person-group person-group-type="author"><name><surname>Possingham</surname><given-names>HP</given-names></name></person-group><article-title>Using conservation evidence to guide management</article-title><source>Conservation Biology</source><year>2011</year><volume>25</volume><fpage>200</fpage><lpage>202</lpage><pub-id pub-id-type="pmid">21029161</pub-id></element-citation></ref><ref id="b64"><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Showler</surname><given-names>DA</given-names></name><name><surname>Stewart</surname><given-names>GB</given-names></name><name><surname>Sutherland</surname><given-names>WJ</given-names></name></person-group><person-group person-group-type="author"><name><surname>Pullin</surname><given-names>AS</given-names></name></person-group><source>What is the impact of public access on the breeding success of ground-nesting and cliff-nesting birds?</source><year>2010</year><publisher-loc>Norwich, United Kingdom</publisher-loc><publisher-name>Collaboration for Environmental Evidence</publisher-name><comment>Systematic Review 16.</comment></element-citation></ref><ref id="b65"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Smith</surname><given-names>RK</given-names></name><name><surname>Pullin</surname><given-names>AS</given-names></name><name><surname>Stewart</surname><given-names>GB</given-names></name></person-group><person-group person-group-type="author"><name><surname>Sutherland</surname><given-names>WJ</given-names></name></person-group><article-title>Effectiveness of predator removal for enhancing bird populations</article-title><source>Conservation Biology</source><year>2010</year><volume>24</volume><fpage>820</fpage><lpage>829</lpage><pub-id pub-id-type="pmid">20067492</pub-id></element-citation></ref><ref id="b66"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Smith</surname><given-names>RK</given-names></name><name><surname>Pullin</surname><given-names>AS</given-names></name><name><surname>Stewart</surname><given-names>GB</given-names></name></person-group><person-group person-group-type="author"><name><surname>Sutherland</surname><given-names>WJ</given-names></name></person-group><article-title>Is nest predator exclusion an effective strategy for enhancing bird populations?</article-title><source>Biological Conservation</source><year>2011</year><volume>144</volume><fpage>1</fpage><lpage>10</lpage></element-citation></ref><ref id="b67"><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Stacey</surname><given-names>CJ</given-names></name><name><surname>Springer</surname><given-names>AE</given-names></name></person-group><person-group person-group-type="author"><name><surname>Stevens</surname><given-names>LE</given-names></name></person-group><source>Have arid land springs restoration projects been effective in storing hydrology, geomorphology, and invertebrate and plant species composition comparable to natural springs with minimal anthropogenic disturbance?</source><year>2011</year><publisher-loc>Flagstaff, Arizona</publisher-loc><publisher-name>Collaboration for Environmental Evidence</publisher-name><comment>Systematic review 87.</comment></element-citation></ref><ref id="b68"><element-citation publication-type="book"><person-group person-group-type="editor"><name><surname>Stevens</surname><given-names>A</given-names></name><name><surname>Milne</surname><given-names>R</given-names></name><name><surname>Scally</surname><given-names>G</given-names></name></person-group><article-title>The effectiveness revolution and public health</article-title><source>Progress in public health</source><year>1997</year><publisher-loc>London</publisher-loc><publisher-name>Royal Society of Medical Press</publisher-name><fpage>197</fpage><lpage>255</lpage></element-citation></ref><ref id="b69"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Stewart</surname><given-names>GB</given-names></name><name><surname>Coles</surname><given-names>CF</given-names></name></person-group><person-group person-group-type="author"><name><surname>Pullin</surname><given-names>AS</given-names></name></person-group><article-title>Applying evidence-based practice in conservation management: lessons from the first systematic review and dissemination projects</article-title><source>Biological Conservation</source><year>2005</year><volume>126</volume><fpage>270</fpage><lpage>278</lpage></element-citation></ref><ref id="b70"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Stewart</surname><given-names>GB</given-names></name></person-group><person-group person-group-type="author"><name><surname>Pullin</surname><given-names>AS</given-names></name></person-group><article-title>The relative importance of grazing stock type and grazing intensity for conservation of mesotrophic “old meadow” pasture</article-title><source>Journal for Nature Conservation</source><year>2008</year><volume>16</volume><fpage>175</fpage><lpage>185</lpage></element-citation></ref><ref id="b71"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Stewart</surname><given-names>GB</given-names></name><name><surname>Pullin</surname><given-names>AS</given-names></name></person-group><person-group person-group-type="author"><name><surname>Coles</surname><given-names>CF</given-names></name></person-group><article-title>Poor evidence-base for assessment of windfarm impacts on birds</article-title><source>Environmental Conservation</source><year>2007a</year><volume>34</volume><fpage>1</fpage><lpage>11</lpage></element-citation></ref><ref id="b72"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Stewart</surname><given-names>GB</given-names></name><name><surname>Pullin</surname><given-names>AS</given-names></name></person-group><person-group person-group-type="author"><name><surname>Tyler</surname><given-names>C</given-names></name></person-group><article-title>The effectiveness of asulam for bracken (<italic>Pteridium aquilinum</italic>) control in the United Kingdom: a meta-analysis</article-title><source>Environmental Management</source><year>2007b</year><volume>40</volume><fpage>747</fpage><lpage>760</lpage><pub-id pub-id-type="pmid">17906891</pub-id></element-citation></ref><ref id="b85"><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Stewart</surname><given-names>GB</given-names></name><name><surname>Bayliss</surname><given-names>HR</given-names></name><name><surname>Showler</surname><given-names>DA</given-names></name><name><surname>Sutherland</surname><given-names>WJ</given-names></name></person-group><person-group person-group-type="author"><name><surname>Pullin</surname><given-names>AS</given-names></name></person-group><source>What are the effects of salmonid stocking in lakes on native fish populations and other fauna and flora? Systematic Review No. 13a</source><year>2007c</year><publisher-loc>Bangor, United Kingdom</publisher-loc><publisher-name>Collaboration for Environmental Evidence</publisher-name></element-citation></ref><ref id="b73"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Stewart</surname><given-names>GB</given-names></name><name><surname>Bayliss</surname><given-names>HR</given-names></name><name><surname>Showler</surname><given-names>DA</given-names></name><name><surname>Sutherland</surname><given-names>WJ</given-names></name></person-group><person-group person-group-type="author"><name><surname>Pullin</surname><given-names>AS</given-names></name></person-group><article-title>Effectiveness of engineered in-stream structure mitigation measures to increase salmonid abundance: a systematic review</article-title><source>Ecological Applications</source><year>2009a</year><volume>19</volume><fpage>931</fpage><lpage>941</lpage><pub-id pub-id-type="pmid">19544735</pub-id></element-citation></ref><ref id="b74"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Stewart</surname><given-names>GB</given-names></name><name><surname>Kaiser</surname><given-names>MJ</given-names></name><name><surname>Cote</surname><given-names>IM</given-names></name><name><surname>Halpern</surname><given-names>BS</given-names></name><name><surname>Lester</surname><given-names>SE</given-names></name><name><surname>Bayliss</surname><given-names>HR</given-names></name></person-group><person-group person-group-type="author"><name><surname>Pullin</surname><given-names>AS</given-names></name></person-group><article-title>Temperate marine reserves: global ecological effects and guidelines for future networks</article-title><source>Conservation Letters</source><year>2009b</year><volume>2</volume><fpage>243</fpage><lpage>253</lpage></element-citation></ref><ref id="b75"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Sutherland</surname><given-names>WJ</given-names></name><name><surname>Pullin</surname><given-names>AS</given-names></name><name><surname>Dolman</surname><given-names>PM</given-names></name></person-group><person-group person-group-type="author"><name><surname>Knight</surname><given-names>TM</given-names></name></person-group><article-title>The need for evidence-based conservation</article-title><source>Trends in Ecology & Evolution</source><year>2004</year><volume>19</volume><fpage>305</fpage><lpage>308</lpage><pub-id pub-id-type="pmid">16701275</pub-id></element-citation></ref><ref id="b76"><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Timonen</surname><given-names>J</given-names></name><name><surname>Gustafsson</surname><given-names>L</given-names></name><name><surname>Kotiaho</surname><given-names>JS</given-names></name></person-group><person-group person-group-type="author"><name><surname>Mönkkönen</surname><given-names>M</given-names></name></person-group><source>Are woodland key habitats biodiversity hotspots in boreal forests?</source><year>2011</year><publisher-loc>Jyväskylä, Finland</publisher-loc><publisher-name>Collaboration for Environmental Evidence</publisher-name><comment>Systematic review 81.</comment></element-citation></ref><ref id="b77"><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Tyler</surname><given-names>C</given-names></name><name><surname>Clark</surname><given-names>E</given-names></name></person-group><person-group person-group-type="author"><name><surname>Pullin</surname><given-names>AS</given-names></name></person-group><source>Do management interventions effectively reduce or eradicate populations of the American Mink, <italic>Mustela vison</italic></source><year>2005</year><publisher-loc>Birmingham, United Kingdom</publisher-loc><publisher-name>Collaboration for Environmental Evidence</publisher-name><comment>Systematic review 7.</comment></element-citation></ref><ref id="b78"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Tyler</surname><given-names>C</given-names></name><name><surname>Pullin</surname><given-names>AS</given-names></name></person-group><person-group person-group-type="author"><name><surname>Stewart</surname><given-names>GB</given-names></name></person-group><article-title>Effectiveness of management interventions to control invasion by <italic>Rhododendron ponticum</italic></article-title><source>Environmental Management</source><year>2006</year><volume>37</volume><fpage>513</fpage><lpage>522</lpage><pub-id pub-id-type="pmid">16456628</pub-id></element-citation></ref><ref id="b79"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Waylen</surname><given-names>KA</given-names></name><name><surname>Fischer</surname><given-names>A</given-names></name><name><surname>McGowan</surname><given-names>PJK</given-names></name><name><surname>Thirgood</surname><given-names>SJ</given-names></name></person-group><person-group person-group-type="author"><name><surname>Milner-Gulland</surname><given-names>EJ</given-names></name></person-group><article-title>Effect of local cultural context on the success of community-based conservation interventions</article-title><source>Conservation Biology</source><year>2010</year><volume>24</volume><fpage>1119</fpage><lpage>1129</lpage><pub-id pub-id-type="pmid">20184657</pub-id></element-citation></ref><ref id="b80"><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Webb</surname><given-names>JA</given-names></name><name><surname>Wealands</surname><given-names>SR</given-names></name><name><surname>Lea</surname><given-names>P</given-names></name><name><surname>Nichols</surname><given-names>SJ</given-names></name><name><surname>de Little</surname><given-names>SC</given-names></name><name><surname>Stewartson</surname><given-names>MJ</given-names></name></person-group><person-group person-group-type="author"><name><surname>Norris</surname><given-names>RH</given-names></name></person-group><person-group person-group-type="editor"><name><surname>Chan</surname><given-names>F</given-names></name><name><surname>Marinova</surname><given-names>D</given-names></name></person-group><person-group person-group-type="editor"><name><surname>Anderssen</surname><given-names>SR</given-names></name></person-group><article-title>Eco evidence: using the scientific literature to inform evidence-based decision making in environmental management</article-title><source>19th International congress on modelling and simulation</source><year>2011</year><publisher-loc>Perth, Australia</publisher-loc><publisher-name>Modelling and Simulation Society of Australia and New Zealand</publisher-name><fpage>2472</fpage><lpage>2478</lpage></element-citation></ref><ref id="b81"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Whitlock</surname><given-names>EP</given-names></name><name><surname>Lin</surname><given-names>JS</given-names></name><name><surname>Chou</surname><given-names>R</given-names></name><name><surname>Shekelle</surname><given-names>P</given-names></name></person-group><person-group person-group-type="author"><name><surname>Robinson</surname><given-names>KA</given-names></name></person-group><article-title>Using existing systematic reviews in complex systematic reviews</article-title><source>Annals of Internal Medicine</source><year>2008</year><volume>148</volume><fpage>776</fpage><lpage>782</lpage><pub-id pub-id-type="pmid">18490690</pub-id></element-citation></ref><ref id="b82"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Whitten</surname><given-names>T</given-names></name><name><surname>Holmes</surname><given-names>D</given-names></name></person-group><person-group person-group-type="author"><name><surname>MacKinnon</surname><given-names>K</given-names></name></person-group><article-title>Conservation biology: A displacement behavior for academia?</article-title><source>Conservation Biology</source><year>2001</year><volume>15</volume><fpage>1</fpage><lpage>3</lpage></element-citation></ref><ref id="b83"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Young</surname><given-names>KD</given-names></name></person-group><person-group person-group-type="author"><name><surname>Van Aarde</surname><given-names>RJ</given-names></name></person-group><article-title>Science and elephant management decisions in South Africa</article-title><source>Biological Conservation</source><year>2011</year><volume>144</volume><fpage>876</fpage><lpage>885</lpage></element-citation></ref><ref id="b84"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Zavaleta</surname><given-names>E</given-names></name><name><surname>Miller</surname><given-names>DC</given-names></name><name><surname>Salafsky</surname><given-names>N</given-names></name><name><surname>Fleishman</surname><given-names>E</given-names></name><name><surname>Webster</surname><given-names>M</given-names></name><name><surname>Gold</surname><given-names>B</given-names></name><name><surname>Hulse</surname><given-names>D</given-names></name><name><surname>Rowen</surname><given-names>M</given-names></name><name><surname>Tabor</surname><given-names>G</given-names></name></person-group><person-group person-group-type="author"><name><surname>Vanderryn</surname><given-names>J</given-names></name></person-group><article-title>Enhancing the engagement of the U.S. private foundations with conservation science</article-title><source>Conservation Biology</source><year>2008</year><volume>22</volume><fpage>1477</fpage><lpage>1484</lpage><pub-id pub-id-type="pmid">18847442</pub-id></element-citation></ref></ref-list><sec sec-type="supplementary-material"><title>Supporting Information</title><p>A description of the variables extracted from each systematic review and the source of these data(Appendix S1), the geographic and taxonomic scope and coverage of each systematic review (Appendix S2); a list of the systematic reviews that met the criteria for inclusion in this study sorted by the audience for the review (Appendix S3), and a list of studies that failed to meet the criteria for inclusion and the rationale for exclusion (Appendix S4) are available online. The authors are solely responsible for the content and functionality of these materials. Queries (other than absence of the material) should be directed to the corresponding author.</p><supplementary-material content-type="local-data" id="SD1"><media mimetype="docx" mime-subtype="docx" xlink:href="cobi0027-0902-SD1.docx" xlink:type="simple" id="d35e4333" position="anchor"></media></supplementary-material></sec></back></pmc></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Wicri/Belgique/explor/OpenAccessBelV2/Data/Pmc/Corpus
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000355 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Pmc/Corpus/biblio.hfd -nk 000355 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Wicri/Belgique
|area= OpenAccessBelV2
|flux= Pmc
|étape= Corpus
|type= RBID
|clé= PMC:4232040
|texte= Contribution of Systematic Reviews to Management Decisions
}}
Pour générer des pages wiki
HfdIndexSelect -h $EXPLOR_AREA/Data/Pmc/Corpus/RBID.i -Sk "pubmed:24001025" \
| HfdSelect -Kh $EXPLOR_AREA/Data/Pmc/Corpus/biblio.hfd \
| NlmPubMed2Wicri -a OpenAccessBelV2
| This area was generated with Dilib version V0.6.25. |  |