Systematic reviews and meta-analysis of preclinical studies: why perform them and how to appraise them critically
Identifieur interne : 000148 ( Pmc/Corpus ); précédent : 000147; suivant : 000149Systematic reviews and meta-analysis of preclinical studies: why perform them and how to appraise them critically
Auteurs : Emily S. Sena ; Gillian L. Currie ; Sarah K. Mccann ; Malcolm R. Macleod ; David W. HowellsSource :
- Journal of Cerebral Blood Flow & Metabolism [ 0271-678X ] ; 2014.
Abstract
The use of systematic review and meta-analysis of preclinical studies has become more common, including those of studies describing the modeling of cerebrovascular diseases. Empirical evidence suggests that too many preclinical experiments lack methodological rigor, and this leads to inflated treatment effects. The aim of this review is to describe the concepts of systematic review and meta-analysis and consider how these tools may be used to provide empirical evidence to spur the field to improve the rigor of the conduct and reporting of preclinical research akin to their use in improving the conduct and reporting of randomized controlled trials in clinical research. As with other research domains, systematic reviews are subject to bias. Therefore, we have also suggested guidance for their conduct, reporting, and critical appraisal.
Url:
DOI: 10.1038/jcbfm.2014.28
PubMed: 24549183
PubMed Central: 4013765
Links to Exploration step
PMC:4013765Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">Systematic reviews and meta-analysis of preclinical studies: why perform them and how to appraise them critically</title>
<author><name sortKey="Sena, Emily S" sort="Sena, Emily S" uniqKey="Sena E" first="Emily S" last="Sena">Emily S. Sena</name>
<affiliation><nlm:aff id="aff1"><institution>Department of Clinical Neurosciences, University of Edinburgh</institution>
, Edinburgh,<country>UK</country>
</nlm:aff>
</affiliation>
<affiliation><nlm:aff id="aff2"><institution>Stroke Division, Florey Institute of Neuroscience and Mental Health</institution>
, Melbourne, Victoria,<country>Australia</country>
</nlm:aff>
</affiliation>
</author>
<author><name sortKey="Currie, Gillian L" sort="Currie, Gillian L" uniqKey="Currie G" first="Gillian L" last="Currie">Gillian L. Currie</name>
<affiliation><nlm:aff id="aff1"><institution>Department of Clinical Neurosciences, University of Edinburgh</institution>
, Edinburgh,<country>UK</country>
</nlm:aff>
</affiliation>
</author>
<author><name sortKey="Mccann, Sarah K" sort="Mccann, Sarah K" uniqKey="Mccann S" first="Sarah K" last="Mccann">Sarah K. Mccann</name>
<affiliation><nlm:aff id="aff2"><institution>Stroke Division, Florey Institute of Neuroscience and Mental Health</institution>
, Melbourne, Victoria,<country>Australia</country>
</nlm:aff>
</affiliation>
</author>
<author><name sortKey="Macleod, Malcolm R" sort="Macleod, Malcolm R" uniqKey="Macleod M" first="Malcolm R" last="Macleod">Malcolm R. Macleod</name>
<affiliation><nlm:aff id="aff1"><institution>Department of Clinical Neurosciences, University of Edinburgh</institution>
, Edinburgh,<country>UK</country>
</nlm:aff>
</affiliation>
</author>
<author><name sortKey="Howells, David W" sort="Howells, David W" uniqKey="Howells D" first="David W" last="Howells">David W. Howells</name>
<affiliation><nlm:aff id="aff2"><institution>Stroke Division, Florey Institute of Neuroscience and Mental Health</institution>
, Melbourne, Victoria,<country>Australia</country>
</nlm:aff>
</affiliation>
</author>
</titleStmt>
<publicationStmt><idno type="wicri:source">PMC</idno>
<idno type="pmid">24549183</idno>
<idno type="pmc">4013765</idno>
<idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4013765</idno>
<idno type="RBID">PMC:4013765</idno>
<idno type="doi">10.1038/jcbfm.2014.28</idno>
<date when="2014">2014</date>
<idno type="wicri:Area/Pmc/Corpus">000148</idno>
<idno type="wicri:explorRef" wicri:stream="Pmc" wicri:step="Corpus" wicri:corpus="PMC">000148</idno>
</publicationStmt>
<sourceDesc><biblStruct><analytic><title xml:lang="en" level="a" type="main">Systematic reviews and meta-analysis of preclinical studies: why perform them and how to appraise them critically</title>
<author><name sortKey="Sena, Emily S" sort="Sena, Emily S" uniqKey="Sena E" first="Emily S" last="Sena">Emily S. Sena</name>
<affiliation><nlm:aff id="aff1"><institution>Department of Clinical Neurosciences, University of Edinburgh</institution>
, Edinburgh,<country>UK</country>
</nlm:aff>
</affiliation>
<affiliation><nlm:aff id="aff2"><institution>Stroke Division, Florey Institute of Neuroscience and Mental Health</institution>
, Melbourne, Victoria,<country>Australia</country>
</nlm:aff>
</affiliation>
</author>
<author><name sortKey="Currie, Gillian L" sort="Currie, Gillian L" uniqKey="Currie G" first="Gillian L" last="Currie">Gillian L. Currie</name>
<affiliation><nlm:aff id="aff1"><institution>Department of Clinical Neurosciences, University of Edinburgh</institution>
, Edinburgh,<country>UK</country>
</nlm:aff>
</affiliation>
</author>
<author><name sortKey="Mccann, Sarah K" sort="Mccann, Sarah K" uniqKey="Mccann S" first="Sarah K" last="Mccann">Sarah K. Mccann</name>
<affiliation><nlm:aff id="aff2"><institution>Stroke Division, Florey Institute of Neuroscience and Mental Health</institution>
, Melbourne, Victoria,<country>Australia</country>
</nlm:aff>
</affiliation>
</author>
<author><name sortKey="Macleod, Malcolm R" sort="Macleod, Malcolm R" uniqKey="Macleod M" first="Malcolm R" last="Macleod">Malcolm R. Macleod</name>
<affiliation><nlm:aff id="aff1"><institution>Department of Clinical Neurosciences, University of Edinburgh</institution>
, Edinburgh,<country>UK</country>
</nlm:aff>
</affiliation>
</author>
<author><name sortKey="Howells, David W" sort="Howells, David W" uniqKey="Howells D" first="David W" last="Howells">David W. Howells</name>
<affiliation><nlm:aff id="aff2"><institution>Stroke Division, Florey Institute of Neuroscience and Mental Health</institution>
, Melbourne, Victoria,<country>Australia</country>
</nlm:aff>
</affiliation>
</author>
</analytic>
<series><title level="j">Journal of Cerebral Blood Flow & Metabolism</title>
<idno type="ISSN">0271-678X</idno>
<idno type="eISSN">1559-7016</idno>
<imprint><date when="2014">2014</date>
</imprint>
</series>
</biblStruct>
</sourceDesc>
</fileDesc>
<profileDesc><textClass></textClass>
</profileDesc>
</teiHeader>
<front><div type="abstract" xml:lang="en"><p>The use of systematic review and meta-analysis of preclinical studies has become more common, including those of studies describing the modeling of cerebrovascular diseases. Empirical evidence suggests that too many preclinical experiments lack methodological rigor, and this leads to inflated treatment effects. The aim of this review is to describe the concepts of systematic review and meta-analysis and consider how these tools may be used to provide empirical evidence to spur the field to improve the rigor of the conduct and reporting of preclinical research akin to their use in improving the conduct and reporting of randomized controlled trials in clinical research. As with other research domains, systematic reviews are subject to bias. Therefore, we have also suggested guidance for their conduct, reporting, and critical appraisal.</p>
</div>
</front>
<back><div1 type="bibliography"><listBibl><biblStruct><analytic><author><name sortKey="Glass, G" uniqKey="Glass G">G Glass</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="O Collins, Ve" uniqKey="O Collins V">VE O'Collins</name>
</author>
<author><name sortKey="Macleod, Mr" uniqKey="Macleod M">MR Macleod</name>
</author>
<author><name sortKey="Donnan, Ga" uniqKey="Donnan G">GA Donnan</name>
</author>
<author><name sortKey="Horky, Ll" uniqKey="Horky L">LL Horky</name>
</author>
<author><name sortKey="Van Der Worp, Bh" uniqKey="Van Der Worp B">BH van der Worp</name>
</author>
<author><name sortKey="Howells, Dw" uniqKey="Howells D">DW Howells</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Schulz, Kf" uniqKey="Schulz K">KF Schulz</name>
</author>
<author><name sortKey="Chalmers, I" uniqKey="Chalmers I">I Chalmers</name>
</author>
<author><name sortKey="Hayes, Rj" uniqKey="Hayes R">RJ Hayes</name>
</author>
<author><name sortKey="Altman, Dg" uniqKey="Altman D">DG Altman</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Chalmers, Tc" uniqKey="Chalmers T">TC Chalmers</name>
</author>
<author><name sortKey="Celano, P" uniqKey="Celano P">P Celano</name>
</author>
<author><name sortKey="Sacks, Hs" uniqKey="Sacks H">HS Sacks</name>
</author>
<author><name sortKey="Smith, H" uniqKey="Smith H">H Smith</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Bonnie, S" uniqKey="Bonnie S">S Bonnie</name>
</author>
<author><name sortKey="Martin, R" uniqKey="Martin R">R Martin</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Begg, C" uniqKey="Begg C">C Begg</name>
</author>
<author><name sortKey="Cho, M" uniqKey="Cho M">M Cho</name>
</author>
<author><name sortKey="Eastwood, S" uniqKey="Eastwood S">S Eastwood</name>
</author>
<author><name sortKey="Horton, R" uniqKey="Horton R">R Horton</name>
</author>
<author><name sortKey="Moher, D" uniqKey="Moher D">D Moher</name>
</author>
<author><name sortKey="Olkin, I" uniqKey="Olkin I">I Olkin</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Crossley, Na" uniqKey="Crossley N">NA Crossley</name>
</author>
<author><name sortKey="Sena, E" uniqKey="Sena E">E Sena</name>
</author>
<author><name sortKey="Goehler, J" uniqKey="Goehler J">J Goehler</name>
</author>
<author><name sortKey="Horn, J" uniqKey="Horn J">J Horn</name>
</author>
<author><name sortKey="Van Der Worp, B" uniqKey="Van Der Worp B">B van der Worp</name>
</author>
<author><name sortKey="Bath, Pmw" uniqKey="Bath P">PMW Bath</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Sena, Es" uniqKey="Sena E">ES Sena</name>
</author>
<author><name sortKey="Macleod, Mr" uniqKey="Macleod M">MR Macleod</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Sena, Es" uniqKey="Sena E">ES Sena</name>
</author>
<author><name sortKey="Van Der Worp, Hb" uniqKey="Van Der Worp H">HB van der Worp</name>
</author>
<author><name sortKey="Bath, Pmw" uniqKey="Bath P">PMW Bath</name>
</author>
<author><name sortKey="Howells, Dw" uniqKey="Howells D">DW Howells</name>
</author>
<author><name sortKey="Macleod, Mr" uniqKey="Macleod M">MR Macleod</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Tsilidis, Kk" uniqKey="Tsilidis K">KK Tsilidis</name>
</author>
<author><name sortKey="Panagiotou, Oa" uniqKey="Panagiotou O">OA Panagiotou</name>
</author>
<author><name sortKey="Sena, Es" uniqKey="Sena E">ES Sena</name>
</author>
<author><name sortKey="Aretouli, E" uniqKey="Aretouli E">E Aretouli</name>
</author>
<author><name sortKey="Evangelou, E" uniqKey="Evangelou E">E Evangelou</name>
</author>
<author><name sortKey="Howells, Dw" uniqKey="Howells D">DW Howells</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Vesterinen, Hm" uniqKey="Vesterinen H">HM Vesterinen</name>
</author>
<author><name sortKey="Sena, Es" uniqKey="Sena E">ES Sena</name>
</author>
<author><name sortKey="Ffrench Constant, C" uniqKey="Ffrench Constant C">C Ffrench-Constant</name>
</author>
<author><name sortKey="Williams, A" uniqKey="Williams A">A Williams</name>
</author>
<author><name sortKey="Chandran, S" uniqKey="Chandran S">S Chandran</name>
</author>
<author><name sortKey="Macleod, Mr" uniqKey="Macleod M">MR Macleod</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Van Der Worp, Hb" uniqKey="Van Der Worp H">HB van der Worp</name>
</author>
<author><name sortKey="Sena, Es" uniqKey="Sena E">ES Sena</name>
</author>
<author><name sortKey="Donnan, Ga" uniqKey="Donnan G">GA Donnan</name>
</author>
<author><name sortKey="Howells, Dw" uniqKey="Howells D">DW Howells</name>
</author>
<author><name sortKey="Macleod, Mr" uniqKey="Macleod M">MR Macleod</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Macleod, Mr" uniqKey="Macleod M">MR Macleod</name>
</author>
<author><name sortKey="Van Der Worp, Hb" uniqKey="Van Der Worp H">HB van der Worp</name>
</author>
<author><name sortKey="Sena, Es" uniqKey="Sena E">ES Sena</name>
</author>
<author><name sortKey="Howells, Dw" uniqKey="Howells D">DW Howells</name>
</author>
<author><name sortKey="Dirnagl, U" uniqKey="Dirnagl U">U Dirnagl</name>
</author>
<author><name sortKey="Donnan, Ga" uniqKey="Donnan G">GA Donnan</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Sena, Es" uniqKey="Sena E">ES Sena</name>
</author>
<author><name sortKey="Briscoe, Cl" uniqKey="Briscoe C">CL Briscoe</name>
</author>
<author><name sortKey="Howells, Dw" uniqKey="Howells D">DW Howells</name>
</author>
<author><name sortKey="Donnan, Ga" uniqKey="Donnan G">GA Donnan</name>
</author>
<author><name sortKey="Sandercock, Pa" uniqKey="Sandercock P">PA Sandercock</name>
</author>
<author><name sortKey="Macleod, Mr" uniqKey="Macleod M">MR Macleod</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Henderson, Vc" uniqKey="Henderson V">VC Henderson</name>
</author>
<author><name sortKey="Kimmelman, J" uniqKey="Kimmelman J">J Kimmelman</name>
</author>
<author><name sortKey="Fergusson, D" uniqKey="Fergusson D">D Fergusson</name>
</author>
<author><name sortKey="Grimshaw, Jm" uniqKey="Grimshaw J">JM Grimshaw</name>
</author>
<author><name sortKey="Hackam, Dg" uniqKey="Hackam D">DG Hackam</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Van Der Worp, Hb" uniqKey="Van Der Worp H">HB van der Worp</name>
</author>
<author><name sortKey="Howells, Dw" uniqKey="Howells D">DW Howells</name>
</author>
<author><name sortKey="Sena, Es" uniqKey="Sena E">ES Sena</name>
</author>
<author><name sortKey="Porritt, Mj" uniqKey="Porritt M">MJ Porritt</name>
</author>
<author><name sortKey="Rewell, S" uniqKey="Rewell S">S Rewell</name>
</author>
<author><name sortKey="O Collins, V" uniqKey="O Collins V">V O'Collins</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Sutton, Aj" uniqKey="Sutton A">AJ Sutton</name>
</author>
<author><name sortKey="Song, F" uniqKey="Song F">F Song</name>
</author>
<author><name sortKey="Gilbody, Sm" uniqKey="Gilbody S">SM Gilbody</name>
</author>
<author><name sortKey="Abrams, Kr" uniqKey="Abrams K">KR Abrams</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Ioannidis, Jpa" uniqKey="Ioannidis J">JPA Ioannidis</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Mignini, Le" uniqKey="Mignini L">LE Mignini</name>
</author>
<author><name sortKey="Khan, Ks" uniqKey="Khan K">KS Khan</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Peters, Jl" uniqKey="Peters J">JL Peters</name>
</author>
<author><name sortKey="Sutton, Aj" uniqKey="Sutton A">AJ Sutton</name>
</author>
<author><name sortKey="Jones, Dr" uniqKey="Jones D">DR Jones</name>
</author>
<author><name sortKey="Rushton, L" uniqKey="Rushton L">L Rushton</name>
</author>
<author><name sortKey="Abrams, Kr" uniqKey="Abrams K">KR Abrams</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Moher, D" uniqKey="Moher D">D Moher</name>
</author>
<author><name sortKey="Liberati, A" uniqKey="Liberati A">A Liberati</name>
</author>
<author><name sortKey="Tetzlaff, J" uniqKey="Tetzlaff J">J Tetzlaff</name>
</author>
<author><name sortKey="Altman, Dg" uniqKey="Altman D">DG Altman</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Garg, Ax" uniqKey="Garg A">AX Garg</name>
</author>
<author><name sortKey="Hackam, D" uniqKey="Hackam D">D Hackam</name>
</author>
<author><name sortKey="Tonelli, M" uniqKey="Tonelli M">M Tonelli</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Meline, T" uniqKey="Meline T">T Meline</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Slavin, Re" uniqKey="Slavin R">RE Slavin</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Egger, M" uniqKey="Egger M">M Egger</name>
</author>
<author><name sortKey="Zellweger Z Hner, T" uniqKey="Zellweger Z Hner T">T Zellweger-Z+ñhner</name>
</author>
<author><name sortKey="Schneider, M" uniqKey="Schneider M">M Schneider</name>
</author>
<author><name sortKey="Junker, C" uniqKey="Junker C">C Junker</name>
</author>
<author><name sortKey="Lengeler, C" uniqKey="Lengeler C">C Lengeler</name>
</author>
<author><name sortKey="Antes, G" uniqKey="Antes G">G Antes</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Vesterinen, Hm" uniqKey="Vesterinen H">HM Vesterinen</name>
</author>
<author><name sortKey="Sena, Es" uniqKey="Sena E">ES Sena</name>
</author>
<author><name sortKey="Egan, Kj" uniqKey="Egan K">KJ Egan</name>
</author>
<author><name sortKey="Hirst, Tc" uniqKey="Hirst T">TC Hirst</name>
</author>
<author><name sortKey="Churolov, L" uniqKey="Churolov L">L Churolov</name>
</author>
<author><name sortKey="Currie, Gl" uniqKey="Currie G">GL Currie</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Moher, D" uniqKey="Moher D">D Moher</name>
</author>
<author><name sortKey="Schulz, K" uniqKey="Schulz K">K Schulz</name>
</author>
<author><name sortKey="Altman, D" uniqKey="Altman D">D Altman</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Kilkenny, C" uniqKey="Kilkenny C">C Kilkenny</name>
</author>
<author><name sortKey="Browne, Wj" uniqKey="Browne W">WJ Browne</name>
</author>
<author><name sortKey="Cuthill, Ic" uniqKey="Cuthill I">IC Cuthill</name>
</author>
<author><name sortKey="Emerson, M" uniqKey="Emerson M">M Emerson</name>
</author>
<author><name sortKey="Altman, Dg" uniqKey="Altman D">DG Altman</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Landis, Sc" uniqKey="Landis S">SC Landis</name>
</author>
<author><name sortKey="Amara, Sg" uniqKey="Amara S">SG Amara</name>
</author>
<author><name sortKey="Asadullah, K" uniqKey="Asadullah K">K Asadullah</name>
</author>
<author><name sortKey="Austin, Cp" uniqKey="Austin C">CP Austin</name>
</author>
<author><name sortKey="Blumenstein, R" uniqKey="Blumenstein R">R Blumenstein</name>
</author>
<author><name sortKey="Bradley, Ew" uniqKey="Bradley E">EW Bradley</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Egan, Kj" uniqKey="Egan K">KJ Egan</name>
</author>
<author><name sortKey="Sena, Es" uniqKey="Sena E">ES Sena</name>
</author>
<author><name sortKey="Vesterinen, Hm" uniqKey="Vesterinen H">HM Vesterinen</name>
</author>
<author><name sortKey="Macleod, Mr" uniqKey="Macleod M">MR Macleod</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Rooke, Ed" uniqKey="Rooke E">ED Rooke</name>
</author>
<author><name sortKey="Vesterinen, Hm" uniqKey="Vesterinen H">HM Vesterinen</name>
</author>
<author><name sortKey="Sena, Es" uniqKey="Sena E">ES Sena</name>
</author>
<author><name sortKey="Egan, Kj" uniqKey="Egan K">KJ Egan</name>
</author>
<author><name sortKey="Macleod, Mr" uniqKey="Macleod M">MR Macleod</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Frantzias, J" uniqKey="Frantzias J">J Frantzias</name>
</author>
<author><name sortKey="Sena, Es" uniqKey="Sena E">ES Sena</name>
</author>
<author><name sortKey="Macleod, Mr" uniqKey="Macleod M">MR Macleod</name>
</author>
<author><name sortKey="Salman, Ra S" uniqKey="Salman R">RA-S Salman</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Jerndal, M" uniqKey="Jerndal M">M Jerndal</name>
</author>
<author><name sortKey="Forsberg, K" uniqKey="Forsberg K">K Forsberg</name>
</author>
<author><name sortKey="Sena, Es" uniqKey="Sena E">ES Sena</name>
</author>
<author><name sortKey="Macleod, Mr" uniqKey="Macleod M">MR Macleod</name>
</author>
<author><name sortKey="O Collins, Ve" uniqKey="O Collins V">VE O'Collins</name>
</author>
<author><name sortKey="Linden, T" uniqKey="Linden T">T Linden</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Sena, E" uniqKey="Sena E">E Sena</name>
</author>
<author><name sortKey="Wheble, P" uniqKey="Wheble P">P Wheble</name>
</author>
<author><name sortKey="Sandercock, P" uniqKey="Sandercock P">P Sandercock</name>
</author>
<author><name sortKey="Macleod, M" uniqKey="Macleod M">M Macleod</name>
</author>
</analytic>
</biblStruct>
</listBibl>
</div1>
</back>
</TEI>
<pmc article-type="review-article"><pmc-dir>properties open_access</pmc-dir>
<front><journal-meta><journal-id journal-id-type="nlm-ta">J Cereb Blood Flow Metab</journal-id>
<journal-id journal-id-type="iso-abbrev">J. Cereb. Blood Flow Metab</journal-id>
<journal-title-group><journal-title>Journal of Cerebral Blood Flow & Metabolism</journal-title>
</journal-title-group>
<issn pub-type="ppub">0271-678X</issn>
<issn pub-type="epub">1559-7016</issn>
<publisher><publisher-name>Nature Publishing Group</publisher-name>
</publisher>
</journal-meta>
<article-meta><article-id pub-id-type="pmid">24549183</article-id>
<article-id pub-id-type="pmc">4013765</article-id>
<article-id pub-id-type="pii">jcbfm201428</article-id>
<article-id pub-id-type="doi">10.1038/jcbfm.2014.28</article-id>
<article-categories><subj-group subj-group-type="heading"><subject>Review Article</subject>
</subj-group>
</article-categories>
<title-group><article-title>Systematic reviews and meta-analysis of preclinical studies: why perform them and how to appraise them critically</article-title>
<alt-title alt-title-type="running">Systematic review and meta-analysis: why and how?</alt-title>
</title-group>
<contrib-group><contrib contrib-type="author"><name><surname>Sena</surname>
<given-names>Emily S</given-names>
</name>
<xref ref-type="aff" rid="aff1">1</xref>
<xref ref-type="aff" rid="aff2">2</xref>
<xref ref-type="corresp" rid="caf1">*</xref>
</contrib>
<contrib contrib-type="author"><name><surname>Currie</surname>
<given-names>Gillian L</given-names>
</name>
<xref ref-type="aff" rid="aff1">1</xref>
</contrib>
<contrib contrib-type="author"><name><surname>McCann</surname>
<given-names>Sarah K</given-names>
</name>
<xref ref-type="aff" rid="aff2">2</xref>
</contrib>
<contrib contrib-type="author"><name><surname>Macleod</surname>
<given-names>Malcolm R</given-names>
</name>
<xref ref-type="aff" rid="aff1">1</xref>
</contrib>
<contrib contrib-type="author"><name><surname>Howells</surname>
<given-names>David W</given-names>
</name>
<xref ref-type="aff" rid="aff2">2</xref>
</contrib>
<aff id="aff1"><label>1</label>
<institution>Department of Clinical Neurosciences, University of Edinburgh</institution>
, Edinburgh,<country>UK</country>
</aff>
<aff id="aff2"><label>2</label>
<institution>Stroke Division, Florey Institute of Neuroscience and Mental Health</institution>
, Melbourne, Victoria,<country>Australia</country>
</aff>
</contrib-group>
<author-notes><corresp id="caf1"><label>*</label>
<institution>Department of Clinical Neurosciences, University of Edinburgh, Chancellor's Building, 49 Little France Crescent</institution>
, Edinburgh EH16 4SB, <country>UK</country>
. E-mail: <email>emily.sena@ed.ac.uk</email>
</corresp>
</author-notes>
<pub-date pub-type="ppub"><month>05</month>
<year>2014</year>
</pub-date>
<pub-date pub-type="epub"><day>19</day>
<month>02</month>
<year>2014</year>
</pub-date>
<pub-date pub-type="pmc-release"><day>1</day>
<month>5</month>
<year>2014</year>
</pub-date>
<volume>34</volume>
<issue>5</issue>
<fpage>737</fpage>
<lpage>742</lpage>
<history><date date-type="received"><day>11</day>
<month>12</month>
<year>2013</year>
</date>
<date date-type="accepted"><day>21</day>
<month>01</month>
<year>2014</year>
</date>
</history>
<permissions><copyright-statement>Copyright © 2014 International Society for Cerebral Blood Flow & Metabolism, Inc.</copyright-statement>
<copyright-year>2014</copyright-year>
<copyright-holder>International Society for Cerebral Blood Flow & Metabolism, Inc.</copyright-holder>
<license license-type="open-access" xlink:href="http://creativecommons.org/licenses/by/3.0/"><pmc-comment>author-paid</pmc-comment>
<license-p>This work is licensed under a Creative Commons Attribution 3.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by/3.0/</license-p>
</license>
</permissions>
<abstract><p>The use of systematic review and meta-analysis of preclinical studies has become more common, including those of studies describing the modeling of cerebrovascular diseases. Empirical evidence suggests that too many preclinical experiments lack methodological rigor, and this leads to inflated treatment effects. The aim of this review is to describe the concepts of systematic review and meta-analysis and consider how these tools may be used to provide empirical evidence to spur the field to improve the rigor of the conduct and reporting of preclinical research akin to their use in improving the conduct and reporting of randomized controlled trials in clinical research. As with other research domains, systematic reviews are subject to bias. Therefore, we have also suggested guidance for their conduct, reporting, and critical appraisal.</p>
</abstract>
<kwd-group><kwd>acute stroke</kwd>
<kwd>animal models</kwd>
<kwd>basic science</kwd>
<kwd>Biostatistics</kwd>
<kwd>experimental</kwd>
</kwd-group>
</article-meta>
</front>
<body><sec sec-type="intro"><title>Introduction</title>
<p>Animal models are invaluable tools for enriching our understanding of the mechanisms and etiology of human diseases. The number of preclinical experiments performed each year continues to increase and our understanding of disease mechanisms is improving, but the number of novel interventions reaching the clinic to treat cerebrovascular diseases continues to fall. It is clear that there are limitations to the translational paradigm as it currently exists. It is also clear from the sheer volume of preclinical research that structured methods are required to make objective sense of the available data. Systematic review and meta-analysis are useful tools which can address some, but not all, of the challenges of translational stroke research. They provide a less biased summary of research findings and allow judgement of both the range of available evidence (and hence the external validity) and the likelihood that conclusions are at risk of bias (the internal validity).</p>
<p>Systematic review sets out to use a structured process to identify all data relevant to a specific research question. This may be followed by meta-analysis, a statistical process that provides a summary estimate of the outcomes from a group of studies, and allows these outcomes from different groups of studies to be compared. Although the first meta-analysis was performed in 1904 by Karl Pearson, it was only in 1976 that Gene Glass coined the term ‘meta-analysis' to refer to this statistical pooling to allow the integration of findings. He suggests that meta-analysis was created out of the need to extract useful information from the cryptic records of inferential data analyses in the abbreviated reports of research in journals and other printed sources.<sup><xref ref-type="bibr" rid="bib1">1</xref>
</sup>
Meta-analysis is now used in many fields of research including psychology, criminology, and education. Its use in clinical medicine is routine, and the Cochrane Collaboration has been instrumental in establishing the framework for evidence-based healthcare to guide clinical practice and healthcare policy. However, in preclinical research, the use of systematic review and meta-analysis is relatively novel.</p>
<p>Glass considers necessity was the mother of invention where meta-analysis is concerned; if it had not happened in the early 1970s, it was sure to happen soon after. We suggest that the same holds for meta-analysis in preclinical stroke research. In the early years of the millennium, the dogma had developed that ‘everything works in animals, but nothing works in humans'. In 2006, O'Collins <italic>et al</italic>
<sup><xref ref-type="bibr" rid="bib2">2</xref>
</sup>
published a review reporting that of more than 500 interventions that were reported to be efficacious in animal models of stroke, only thrombolysis with rtPA had been shown to be effective in stroke patients. A search for <italic>in vivo</italic>
animal stroke studies published in the last 10 years yields more than 5,700 articles, but still no new therapies to treat acute stroke have been developed. If the purpose of preclinical cerebrovascular research was to develop new treatments for human stroke then clearly there were substantial problems. The complexities of translational research led our group, and others, to adapt the techniques of meta-analysis, at that time largely restricted to clinical research, to the preclinical domain, in an attempt to provide empirical evidence for weaknesses in the prevailing translational paradigm, evidence which might guide improvements in the translational process.</p>
<p>In this narrative review, we aim to explain the concepts of systematic review and meta-analysis; to describe how their use changed clinical medicine; and to explore the contribution they might make to preclinical research. We also describe some of the elements to consider in the critical appraisal of systematic reviews and meta-analyses of preclinical research.</p>
</sec>
<sec><title>The concept</title>
<p>In any type of review, there are two fundamental steps that are taken; identify the studies that are relevant to your research questions and then synthesize these identified data to reach conclusions. The benefit of narrative reviews is that they include a broad overview of relevant information, perhaps interpreted by an experienced author tempered by years of practical knowledge of the field; in many cases, they are highly useful. Unfortunately, they also have limitations. The selection methods used to identify studies that contribute to the review are often not transparent. The credence given to individual studies is inherently subjective and often unclear. Often, the reviewer themselves may be unable to articulate the processes through which they reached the conclusions presented. Systematic reviews are not bias free, but the transparency of the methods used are designed to reduce bias. In a systematic review, the researcher is required to outline aims, objectives, and methodology. The principle is that an independent researcher could perform the same identification process and yield the same data set. As is often the case, in the interpretation of primary research studies, the conclusions drawn from a meta-analysis may differ from one reviewer to the next. However, the transparency and objectivity of the techniques used provide a framework for these discussions.</p>
<p>The data synthesis process in meta-analysis has a number of steps once the individual studies have been identified. First, the effect sizes of individual studies are determined. This is often a treatment effect that is a measure of the difference between control and treatment groups. Effect sizes are not limited to effects of drugs, but may represent a relationship between any two variables. Second, the precision of an effect size is determined by its standard error. The broad aim is to calculate an average effect size across the studies, termed the summary estimate of effect. Third, because some effect sizes are more precise than others, this averaging process is often weighted so that more precise studies are given more weight in a meta-analysis than less precise ones. Finally, the differences between the component effect sizes—the heterogeneity–are assessed. We expect variation of effect sizes to occur due both to random error and to real differences in experimental design. In our view, it is this exploration of sources of heterogeneity—the identification of those aspects of experimental design that cause exaggerations or underestimations in treatment effects, or those aspects of drug delivery that give maximum efficacy—which is the true strength of meta-analysis. However, because we are simply observing a “cohort” of experiments, rather than testing the impact of these influences experimentally, findings from meta-analysis should be considered hypothesis generating rather than confirmatory.</p>
</sec>
<sec><title>In clinical research</title>
<p>Although systematic reviews and meta-analyses are now routinely used by medical researchers to inform practice and policy, they also had a pivotal role in providing empirical evidence of the impact of bias in the conduct of controlled clinical trials. Chalmers and others provided evidence that studies that do not adequately mask treatment allocation are associated with bias and inflated treatment effects.<sup><xref ref-type="bibr" rid="bib3">3</xref>
, <xref ref-type="bibr" rid="bib4">4</xref>
</sup>
In the hierarchy of evidence randomized controlled trials are now considered the gold standard in clinical trial design. Conceptually, the ability of randomization to account for systematic differences in factors, known or unknown, between groups that may affect outcome is apparent; as is ensuring that preconceived views of patients and clinicians do not bias the assessment of outcomes.<sup><xref ref-type="bibr" rid="bib5">5</xref>
</sup>
But it required empirical evidence to revolutionize clinical research and to convince trialists of the importance of methodological rigor in both the conduct and reporting of their studies.<sup><xref ref-type="bibr" rid="bib6">6</xref>
</sup>
</p>
</sec>
<sec><title>What could meta-analysis do for preclinical research?</title>
<p>Across the modeling of a number of cerebrovascular diseases, there is a considerable volume of often conflicting data. Systematic review and meta-analysis can be used to describe which interventions have been tested in models of disease, to provide an indication of the attrition rate of interventions (i.e., the number of interventions not progressing to clinical trial), and to describe the range of conditions under which efficacy has been tested. Furthermore, pooling data using meta-analysis can be used to assess both the overall efficacy of an intervention and the impact of factors relating to internal and external validity, giving valuable insights into the causes of translational successes and failures.</p>
<p>In recent years we, and others, have presented empirical evidence that suggests that the usefulness of data from experiments testing drug efficacy in animal models of various neurologic diseases may be substantially impaired by limited methodological quality, limited generalizability, and by significant publication bias.<sup><xref ref-type="bibr" rid="bib7">7</xref>
, <xref ref-type="bibr" rid="bib8">8</xref>
, <xref ref-type="bibr" rid="bib9">9</xref>
, <xref ref-type="bibr" rid="bib10">10</xref>
</sup>
</p>
<sec><title>Methodological Quality</title>
<p>In an experiment, the credibility of the inferred causal relationship between treatment and outcome is dependent upon on the statistical power and internal validity.</p>
<p>Preclinical animal research is confounded by pressures to reduce the number of animals used because of concerns about cost, time, ethics, and practicalities of disease modeling that might lead to studies either being underpowered or of unknown power. Determining the required sample size to answer a research question is crucial. Too small and the results are imprecise and lack statistical power. Too large and unnecessary costs are incurred. <italic>A priori</italic>
sample size calculations also provide assurance that animals are not added to a study incrementally in response to (unreported) interim analyses.</p>
<p>The internal validity of an experiment ensures that the changes observed in outcomes are due to an induced change in one or more of the independent variables rather than some other confounding factor. The internal validity of an experiment may be threatened by a range of biases. These include, but are not limited to, selection bias, performance bias, and detection bias. Selection bias occurs when there are systematic differences between study groups at the start of an experiment. Performance bias occurs when systematic differences occur in how the groups are handled during a study and detection bias occurs when systematic differences occur between groups in how outcomes are ascertained, diagnosed, or verified. Measures to reduce the impact of these biases include randomization, allocation concealment and masked assessment of outcome.</p>
<p>Systematic review and meta-analysis of experimental studies covering a range of neurologic disorders have provided evidence that few studies take measures to reduce bias or perform formal power calculations to determine sample size (<xref rid="tbl1" ref-type="table">Table 1</xref>
).</p>
<p>Meta-analysis can be used to assess the impact of methodological quality on reported outcomes. Unfortunately, sample size calculations are so seldom reported that it has not been possible to assess whether performing a sample size calculation influences outcome. However, in animal models of experimental autoimmune encephalomyelitis, we showed that reported efficacy was largest in the smallest studies<sup><xref ref-type="bibr" rid="bib11">11</xref>
</sup>
(<xref ref-type="fig" rid="fig1">Figure 1</xref>
).</p>
<p>Fortunately, we have been able to generate empirical evidence describing the impact of reporting of measures to reduce bias on outcome. In a meta-analysis of therapeutic hypothermia in experimental stroke, we observed treatment effects were 10% larger in non-randomized studies and 8% larger in unmasked studies than those that did take these measures to reduce bias.<sup><xref ref-type="bibr" rid="bib12">12</xref>
</sup>
Similarly, in a meta-analysis of NXY-059 in experimental stroke, NXY-059 was reported to be 30% more effective in studies that were not randomized or masked than in studies that reported randomization and blinding.<sup><xref ref-type="bibr" rid="bib13">13</xref>
</sup>
</p>
</sec>
<sec><title>External and Construct Validity</title>
<p>If preclinical models of disease are to inform human health, experiments require external validity and the models used require construct validity; both types of validity relate to the generalizability of a study. External validity refers to the ability to generalize the findings to different measures, settings, and times. Construct validity refers to adequate representation of theoretical constructs, in disease modeling this may be threatened where only specific characteristics of a complex disease are modeled. Aspects of both these validity types are clearly disease specific. For example, in the modeling of ischemic stroke, associated co-morbidities, age of animals, and the time to treatment are important factors. Using systematic review, we have identified that the majority of preclinical stroke studies use young male normotensive rats. Furthermore, meta-analysis has also provided evidence of no detectable effect of either tissue plasminogen activator or NXY-059 in hypertensive animals,<sup><xref ref-type="bibr" rid="bib13">13</xref>
, <xref ref-type="bibr" rid="bib14">14</xref>
</sup>
which would appear to be concordant with results in humans.</p>
<p>The most common recommendations from preclinical research guidelines to improve external validity are that experiments should be replicated in different models of the same disease, in different species and that findings should be replicated independently.<sup><xref ref-type="bibr" rid="bib15">15</xref>
</sup>
Others recommend that the time that treatment is started after disease/injury induction should be realistic in terms of what is possible in the clinic.<sup><xref ref-type="bibr" rid="bib16">16</xref>
</sup>
The most common recommendations to improve construct validity include characterization of disease phenotype in the animal model before experimentation, matching the model to the human disease and matching outcome measures to the clinical setting.<sup><xref ref-type="bibr" rid="bib15">15</xref>
</sup>
</p>
</sec>
<sec><title>Reporting Bias</title>
<p>The validity of a systematic review may be limited by reporting biases of the component studies. It has long been recognized that neutral studies often remain unpublished or take longer to get published than those reporting statistically significant results. They are also more likely to be published in journals of low impact or in languages other than English.<sup><xref ref-type="bibr" rid="bib17">17</xref>
</sup>
Such work is less likely to be identified in narrative and even in systematic review, and such publication bias can lead to the overstatement of summary effects in meta-analysis. Published meta-analyses now routinely report the presence or lack of publication bias in their reviews.</p>
<p>Data from meta-analyses of 525 unique publications and 16 interventions tested in models of experimental stroke were combined and imprecise study effects consistent with publication bias were seen in funnel plot asymmetry and confirmed with Egger Regression (<xref ref-type="fig" rid="fig2">Figures 2A and 2B</xref>
). Using a meta-analytical technique known as trim-and-fill that imputes theoretical missing studies, the overall efficacy was significantly reduced from 30.1% (28.7 to 31.6%) to 23.3% (21.7 to 24.9%), a relative overstatement in efficacy of 31%. Two hundred studies were deemed to be missing and were ‘filled' into the data set (<xref ref-type="fig" rid="fig2">Figure 2C</xref>
). Furthermore, only 2% of publications reported no significant treatment effects.<sup><xref ref-type="bibr" rid="bib9">9</xref>
</sup>
</p>
<p>Other reporting biases that are less commonly assessed in systematic reviews include selective outcome reporting and selective analysis reporting. These biases may occur where many outcome measures are assessed or many statistical analyses are performed but only the ‘best' results are presented. This in turn leads to a body of evidence with an inflated proportion of statistically significant results.<sup><xref ref-type="bibr" rid="bib18">18</xref>
</sup>
In a review of 160 meta-analyses including 4,445 experiments from the modeling of six neurologic disorders (Alzheimer's, encephalomyelitis, focal ischemia, intracerebral hemorrhage, Parkinson's disease, and spinal cord injury) we assessed, using the Excess Significance Test, whether too many of the individual studies in the meta-analyses reported statistically significant results.<sup><xref ref-type="bibr" rid="bib10">10</xref>
</sup>
We expected 21% of the results to be significant but observed 39% significant results, suggesting the presence of bias in this data set. These issues may, in part, be addressed by the use of published protocols.</p>
</sec>
</sec>
<sec><title>How to appraise critically a systematic review and meta-analysis of preclinical studies</title>
<p>In a systematic review of systematic reviews of preclinical studies, Mignini and Khan found that 30% specified a testable hypothesis, 27% performed a literature search without language restrictions, 17% assessed for the presence of publication bias, half assessed study validity, and 2% investigated sources of heterogeneity.<sup><xref ref-type="bibr" rid="bib19">19</xref>
</sup>
As with any type of research, systematic reviews and meta-analyses are susceptible to bias, and it is only through clear reporting of what was done that it is possible to assess this risk of bias.</p>
<p>As systematic reviews and meta-analyses of preclinical research become more common, a number of different approaches have been used and readers—and reviewers—need to be able to assess whether the methodologies used are sound and the interpretation is valid. However, we are not aware of any study that provides empirical evidence of the presence or magnitude of the risk of bias associated with different aspects of the conduct or reporting of systematic reviews and meta-analyses of data from <italic>in vivo</italic>
experiments.</p>
<p>Without such data, guidelines have less validity, but in a developing field, it is, we believe, reasonable to make some recommendations, based in part on our experience in conducting such reviews and in part on guidelines in other, related fields. In <xref rid="tbl2" ref-type="table">Table 2</xref>
, we make some recommendations for reporting systematic reviews and meta-analyses of animal studies using key elements of the guidelines proposed by Peters <italic>et al</italic>
<sup><xref ref-type="bibr" rid="bib20">20</xref>
</sup>
that are akin to the PRISMA guidelines for the reporting of systematic reviews and meta-analyses of healthcare interventions in human clinical studies.<sup><xref ref-type="bibr" rid="bib21">21</xref>
</sup>
We suggest the following steps should be considered in the critical appraisal of a systematic review and meta-analysis (<xref rid="tbl3" ref-type="table">Table 3</xref>
; adapted from Garg <italic>et al</italic>
<sup><xref ref-type="bibr" rid="bib22">22</xref>
</sup>
).</p>
<sec><title>Does the Study Follow a Pre-Specified Protocol?</title>
<p>If a protocol exists, the manuscript should provide a reference to where it might be found.</p>
<p>A pre-specified written protocol is likely to improve the standard of a systematic review and meta-analysis by reducing the risk of ‘data dredging' and <italic>post hoc</italic>
revisions of study aims. Making the protocol publicly available to the research community also allows reviewers to obtain feedback on drafts through peer review. It is often the case that protocols evolve during the course of the review in light of clearer understanding of the research field and the data available; if such iterations occur, the changes should be justified and the date of these changes should be given in a revised protocol. The protocol should clearly define the research question, objectives, inclusion criteria, search strategy, data collection processes, and data analysis plan. A protocol should allow readers to judge whether the final study did indeed follow a pre-specified plan.</p>
</sec>
<sec><title>Was the Research Question Focused and Clearly Defined?</title>
<p>The manuscript should provide a clear statement of the research question that is addressed</p>
<p>As with any study, the research question of a systematic review and meta-analysis needs to be focussed and clearly defined. It also needs to be appropriate to the type of study being performed, and its answer meaningful to the field.</p>
</sec>
<sec><title>Are the Inclusion Criteria Appropriate?</title>
<p>The manuscript should define clear inclusion and exclusion criteria relating to the identification of relevant publications.</p>
<p>The reader should be confident that the eligibility criteria for inclusion in a systematic review are not biased and are appropriate to the research questions being asked. The scope of the inclusion criteria determines the validity of the conclusions drawn. There has been a debate on how broad or narrow the selection process should be;<sup><xref ref-type="bibr" rid="bib23">23</xref>
</sup>
some argue that only studies that meet a high standard of methodological quality should be included<sup><xref ref-type="bibr" rid="bib24">24</xref>
</sup>
while others argue that meta-analyses should deal with the good, bad, and indifferent of included studies.<sup><xref ref-type="bibr" rid="bib1">1</xref>
</sup>
There is no correct approach but the degree of caution with which the results are interpreted and conclusions drawn should take this into account. Some reviews are restricted to studies published in English, we suspect because of the ease of data abstraction. Language bias occurs if studies performed in non-English speaking countries are more likely to publish their statistically significant results in English language journals and non-significant results in non-English language journals.<sup><xref ref-type="bibr" rid="bib25">25</xref>
</sup>
The impact of language bias on systematic reviews of preclinical data is yet to be determined. It may not be always practical to translate all non-English studies, but the reviewers should at least identify and report how many studies were excluded for reason of language. This is usually possible as titles and abstracts are often translated even if the full papers are not.</p>
</sec>
<sec><title>How Comprehensive was the Search Strategy?</title>
<p>The manuscript should define the search strategy, including the search terms used, the databases searched, and the date(s) of the search(es).</p>
<p>The number of investigators screening publications for inclusion, and the method for dealing with inconsistencies, should be described.</p>
<p>Identifying relevant studies for a systematic review can be arduous. Biomedical journals are the most common source of relevant data and these are identified via the searching of bibliographic databases. A range of bibliographic databases should be searched as no database has complete coverage of all health-related literature. The core databases used are Medline and Embase; Medline is often searched via PubMed, but other search services may be used. Embase indexes more European and Asian journals and has roughly a 60% overlap with Medline. There are other sources of data that may be appropriate, including other specialized databases, conference proceedings, personal communications, and books.</p>
<p>The search strategy used needs to be comprehensive enough to identify most relevant studies. The screening of identified studies for inclusion is susceptible to random error and may be subjective. For this reason, we advise that two independent reviewers screen studies for inclusion, and the number of reviewers should be reported in the manuscript.</p>
<p>A comprehensive search reduces the possibility of publication bias in a review. Publication bias may be present because of an incomplete search of the literature or because the studies themselves are not in the public domain to be identified in the search process. There are various techniques for assessing for the presence and impact of publication bias in a meta-analysis<sup><xref ref-type="bibr" rid="bib17">17</xref>
</sup>
that reviewers should consider.</p>
</sec>
<sec><title>Was the Data Abstraction from Each Study Appropriate?</title>
<p>The choice of data (times, outcome measures) to be extracted from each publication should be defined.</p>
<p>The number of investigators extracting data from publications, and the method for dealing with inconsistencies, should be described.</p>
<p>The reviewers should be rigorous and their methods reproducible in extracting data for included studies. Ideally, this process should also be performed by two independent reviewers. The assessment of methodological quality of included studies should be reported. Understanding the rigor and validity of included studies is important in the interpretation of the conclusions drawn.</p>
</sec>
<sec><title>Were the Data Pooled Appropriately?</title>
<p>The manuscript should identify a primary outcome variable or the statistical limits to any subdivision of the data.</p>
<p>The manuscript should describe the method of pooling of data and provide summary estimates, estimates of uncertainty (e.g. 95% confidence intervals), and a measure of heterogeneity (e.g. Q, I<sup>2</sup>
).</p>
<p>The statistical pooling of aggregate data in a meta-analysis gives greater weight to more precise studies. The assumption of this pooling may be performed under a ‘fixed' or ‘random' effects model. More detailed discussion of the merits of each model in the pooling of preclinical data can be found elsewhere<sup><xref ref-type="bibr" rid="bib26">26</xref>
</sup>
but on the whole, given the heterogeneity often observed in preclinical studies, random effects meta-analysis is more appropriate. Formal assessment of heterogeneity should be performed. Attempts to stratify data to account for, or explain, some of the heterogeneity are useful.</p>
</sec>
</sec>
<sec><title>Summary</title>
<p>Recent years have seen improvements in the conduct and reporting of clinical trial design after the publication of the CONSORT statement.<sup><xref ref-type="bibr" rid="bib27">27</xref>
</sup>
Analogous to this, the ARRIVE guidelines<sup><xref ref-type="bibr" rid="bib28">28</xref>
</sup>
and Landis paper<sup><xref ref-type="bibr" rid="bib29">29</xref>
</sup>
hope to promote the same improvements in animal experiments.</p>
<p>Systematic review and meta-analysis have provided empirical evidence that too many preclinical experiments lack methodological rigor, and this leads to inflated treatment effects. There is of course no guarantee that improvements in the validity of preclinical animal studies and reduced publication bias will improve the translational hit of interventions from bench to bedside. However, we hope that the mounting empirical evidence drives the preclinical research community toward improved rigor. Despite some very reasonable concerns about the novelty of the methodological approach and the difficulty of confirming these hypotheses experimentally, findings from meta-analyses cover such a wide range of disease models and have been reported by so many different research groups that it is highly unlikely that these conclusions do not reflect a real and present problem with the use of animal models. As consumers of systematic reviews and meta-analyses of preclinical research, it is important that we are able to discern, as we do for primary research studies, the rigor with which the meta-analyses are performed and reported.</p>
<p>We hope that this empirical evidence of bias, akin to that reported in clinical research more than 30 years ago, spurs a similar change in the way we conduct and report preclinical research. Whether this leads to improved translation we are yet to see. However, what we will observe is an improvement in the conduct and reporting of preclinical research that reasonably can only be of benefit to this troubled field of research.</p>
</sec>
</body>
<back><notes><p>The authors declare no conflict of interest.</p>
</notes>
<ref-list><ref id="bib1"><mixed-citation publication-type="other"><person-group person-group-type="author"><name><surname>Glass</surname>
<given-names>G</given-names>
</name>
</person-group>
Meta-analysis at 25<x></x>
<ext-link ext-link-type="uri" xlink:href="http://www.gvglassinfo/papers/meta25.html">http://www.gvglassinfo/papers/meta25.html</ext-link>
<year>2013</year>
</mixed-citation>
</ref>
<ref id="bib2"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>O'Collins</surname>
<given-names>VE</given-names>
</name>
<name><surname>Macleod</surname>
<given-names>MR</given-names>
</name>
<name><surname>Donnan</surname>
<given-names>GA</given-names>
</name>
<name><surname>Horky</surname>
<given-names>LL</given-names>
</name>
<name><surname>van der Worp</surname>
<given-names>BH</given-names>
</name>
<name><surname>Howells</surname>
<given-names>DW</given-names>
</name>
</person-group>
<article-title>1,026 experimental treatments in acute stroke</article-title>
<source>Ann Neurol</source>
<year>2006</year>
<volume>59</volume>
<fpage>467</fpage>
<lpage>477</lpage>
<pub-id pub-id-type="pmid">16453316</pub-id>
</mixed-citation>
</ref>
<ref id="bib3"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Schulz</surname>
<given-names>KF</given-names>
</name>
<name><surname>Chalmers</surname>
<given-names>I</given-names>
</name>
<name><surname>Hayes</surname>
<given-names>RJ</given-names>
</name>
<name><surname>Altman</surname>
<given-names>DG</given-names>
</name>
</person-group>
<article-title>Empirical-evidence of bias—dimensions of methodological quality associated with estimates of treatment effects in controlled trials</article-title>
<source>JAMA</source>
<year>1995</year>
<volume>273</volume>
<fpage>408</fpage>
<lpage>412</lpage>
<pub-id pub-id-type="pmid">7823387</pub-id>
</mixed-citation>
</ref>
<ref id="bib4"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Chalmers</surname>
<given-names>TC</given-names>
</name>
<name><surname>Celano</surname>
<given-names>P</given-names>
</name>
<name><surname>Sacks</surname>
<given-names>HS</given-names>
</name>
<name><surname>Smith</surname>
<given-names>H</given-names>
</name>
</person-group>
<article-title>Bias in treatment assignment in controlled clinical trials</article-title>
<source>N Engl J Med</source>
<year>1983</year>
<volume>309</volume>
<fpage>1358</fpage>
<lpage>1361</lpage>
<pub-id pub-id-type="pmid">6633598</pub-id>
</mixed-citation>
</ref>
<ref id="bib5"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bonnie</surname>
<given-names>S</given-names>
</name>
<name><surname>Martin</surname>
<given-names>R</given-names>
</name>
</person-group>
<article-title>Understanding controlled trials: why are randomised controlled trials important</article-title>
<source>BMJ</source>
<year>1998</year>
<volume>316</volume>
<fpage>201</fpage>
<pub-id pub-id-type="pmid">9468688</pub-id>
</mixed-citation>
</ref>
<ref id="bib6"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Begg</surname>
<given-names>C</given-names>
</name>
<name><surname>Cho</surname>
<given-names>M</given-names>
</name>
<name><surname>Eastwood</surname>
<given-names>S</given-names>
</name>
<name><surname>Horton</surname>
<given-names>R</given-names>
</name>
<name><surname>Moher</surname>
<given-names>D</given-names>
</name>
<name><surname>Olkin</surname>
<given-names>I</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Improving the quality of reporting of randomized controlled trials—The CONSORT statement</article-title>
<source>JAMA</source>
<year>1996</year>
<volume>276</volume>
<fpage>637</fpage>
<lpage>639</lpage>
<pub-id pub-id-type="pmid">8773637</pub-id>
</mixed-citation>
</ref>
<ref id="bib7"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Crossley</surname>
<given-names>NA</given-names>
</name>
<name><surname>Sena</surname>
<given-names>E</given-names>
</name>
<name><surname>Goehler</surname>
<given-names>J</given-names>
</name>
<name><surname>Horn</surname>
<given-names>J</given-names>
</name>
<name><surname>van der Worp</surname>
<given-names>B</given-names>
</name>
<name><surname>Bath</surname>
<given-names>PMW</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Empirical evidence of bias in the design of experimental stroke studies - a metaepidemiologic approach</article-title>
<source>Stroke</source>
<year>2008</year>
<volume>39</volume>
<fpage>929</fpage>
<lpage>934</lpage>
<pub-id pub-id-type="pmid">18239164</pub-id>
</mixed-citation>
</ref>
<ref id="bib8"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Sena</surname>
<given-names>ES</given-names>
</name>
<name><surname>Macleod</surname>
<given-names>MR</given-names>
</name>
</person-group>
<article-title>Concordance between laboratory and clinical drug efficacy: lessons from systematic review and meta-analysis</article-title>
<source>Stroke</source>
<year>2007</year>
<volume>38</volume>
<fpage>502</fpage>
</mixed-citation>
</ref>
<ref id="bib9"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Sena</surname>
<given-names>ES</given-names>
</name>
<name><surname>van der Worp</surname>
<given-names>HB</given-names>
</name>
<name><surname>Bath</surname>
<given-names>PMW</given-names>
</name>
<name><surname>Howells</surname>
<given-names>DW</given-names>
</name>
<name><surname>Macleod</surname>
<given-names>MR</given-names>
</name>
</person-group>
<article-title>Publication bias in reports of animal stroke studies leads to major overstatement of efficacy</article-title>
<source>PLoS Biol</source>
<year>2010</year>
<volume>8</volume>
<fpage>e1000344</fpage>
<pub-id pub-id-type="pmid">20361022</pub-id>
</mixed-citation>
</ref>
<ref id="bib10"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Tsilidis</surname>
<given-names>KK</given-names>
</name>
<name><surname>Panagiotou</surname>
<given-names>OA</given-names>
</name>
<name><surname>Sena</surname>
<given-names>ES</given-names>
</name>
<name><surname>Aretouli</surname>
<given-names>E</given-names>
</name>
<name><surname>Evangelou</surname>
<given-names>E</given-names>
</name>
<name><surname>Howells</surname>
<given-names>DW</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Evaluation of excess significance bias in animal studies of neurological diseases</article-title>
<source>PLoS Biol</source>
<year>2013</year>
<volume>11</volume>
<fpage>e1001609</fpage>
<pub-id pub-id-type="pmid">23874156</pub-id>
</mixed-citation>
</ref>
<ref id="bib11"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Vesterinen</surname>
<given-names>HM</given-names>
</name>
<name><surname>Sena</surname>
<given-names>ES</given-names>
</name>
<name><surname>Ffrench-Constant</surname>
<given-names>C</given-names>
</name>
<name><surname>Williams</surname>
<given-names>A</given-names>
</name>
<name><surname>Chandran</surname>
<given-names>S</given-names>
</name>
<name><surname>Macleod</surname>
<given-names>MR</given-names>
</name>
</person-group>
<article-title>Improving the translational hit of experimental treatments in multiple sclerosis</article-title>
<source>Mult Scler</source>
<year>2010</year>
<volume>16</volume>
<fpage>1044</fpage>
<lpage>1055</lpage>
<pub-id pub-id-type="pmid">20685763</pub-id>
</mixed-citation>
</ref>
<ref id="bib12"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>van der Worp</surname>
<given-names>HB</given-names>
</name>
<name><surname>Sena</surname>
<given-names>ES</given-names>
</name>
<name><surname>Donnan</surname>
<given-names>GA</given-names>
</name>
<name><surname>Howells</surname>
<given-names>DW</given-names>
</name>
<name><surname>Macleod</surname>
<given-names>MR</given-names>
</name>
</person-group>
<article-title>Hypothermia in animal models of acute ischaemic stroke: a systematic review and meta-analysis</article-title>
<source>Brain</source>
<year>2007</year>
<volume>130</volume>
<fpage>3063</fpage>
<lpage>3074</lpage>
<pub-id pub-id-type="pmid">17478443</pub-id>
</mixed-citation>
</ref>
<ref id="bib13"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Macleod</surname>
<given-names>MR</given-names>
</name>
<name><surname>van der Worp</surname>
<given-names>HB</given-names>
</name>
<name><surname>Sena</surname>
<given-names>ES</given-names>
</name>
<name><surname>Howells</surname>
<given-names>DW</given-names>
</name>
<name><surname>Dirnagl</surname>
<given-names>U</given-names>
</name>
<name><surname>Donnan</surname>
<given-names>GA</given-names>
</name>
</person-group>
<article-title>Evidence for the efficacy of NXY-059 in experimental focal cerebral ischaemia is confounded by study quality</article-title>
<source>Stroke</source>
<year>2008</year>
<volume>39</volume>
<fpage>2824</fpage>
<lpage>2829</lpage>
<pub-id pub-id-type="pmid">18635842</pub-id>
</mixed-citation>
</ref>
<ref id="bib14"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Sena</surname>
<given-names>ES</given-names>
</name>
<name><surname>Briscoe</surname>
<given-names>CL</given-names>
</name>
<name><surname>Howells</surname>
<given-names>DW</given-names>
</name>
<name><surname>Donnan</surname>
<given-names>GA</given-names>
</name>
<name><surname>Sandercock</surname>
<given-names>PA</given-names>
</name>
<name><surname>Macleod</surname>
<given-names>MR</given-names>
</name>
</person-group>
<article-title>Factors affecting the apparent efficacy and safety of tissue plasminogen activator in thrombotic occlusion models of stroke: systematic review and meta-analysis</article-title>
<source>J Cereb Blood Flow Metab</source>
<year>2010</year>
<volume>30</volume>
<fpage>1905</fpage>
<lpage>1913</lpage>
<pub-id pub-id-type="pmid">20648038</pub-id>
</mixed-citation>
</ref>
<ref id="bib15"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Henderson</surname>
<given-names>VC</given-names>
</name>
<name><surname>Kimmelman</surname>
<given-names>J</given-names>
</name>
<name><surname>Fergusson</surname>
<given-names>D</given-names>
</name>
<name><surname>Grimshaw</surname>
<given-names>JM</given-names>
</name>
<name><surname>Hackam</surname>
<given-names>DG</given-names>
</name>
</person-group>
<article-title>Threats to validity in the design and conduct of preclinical efficacy studies: a systematic review of guidelines for <italic>in vivo</italic>
animal experiments</article-title>
<source>PLoS Med</source>
<year>2013</year>
<volume>10</volume>
<fpage>e1001489</fpage>
<pub-id pub-id-type="pmid">23935460</pub-id>
</mixed-citation>
</ref>
<ref id="bib16"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>van der Worp</surname>
<given-names>HB</given-names>
</name>
<name><surname>Howells</surname>
<given-names>DW</given-names>
</name>
<name><surname>Sena</surname>
<given-names>ES</given-names>
</name>
<name><surname>Porritt</surname>
<given-names>MJ</given-names>
</name>
<name><surname>Rewell</surname>
<given-names>S</given-names>
</name>
<name><surname>O'Collins</surname>
<given-names>V</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Can animal models of disease reliably inform human studies</article-title>
<source>PLoS Med</source>
<year>2010</year>
<volume>7</volume>
<fpage>e1000245</fpage>
<pub-id pub-id-type="pmid">20361020</pub-id>
</mixed-citation>
</ref>
<ref id="bib17"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Sutton</surname>
<given-names>AJ</given-names>
</name>
<name><surname>Song</surname>
<given-names>F</given-names>
</name>
<name><surname>Gilbody</surname>
<given-names>SM</given-names>
</name>
<name><surname>Abrams</surname>
<given-names>KR</given-names>
</name>
</person-group>
<article-title>Modelling publication bias in meta-analysis: a review</article-title>
<source>Stat Methods Med Res</source>
<year>2000</year>
<volume>9</volume>
<fpage>421</fpage>
<lpage>445</lpage>
<pub-id pub-id-type="pmid">11191259</pub-id>
</mixed-citation>
</ref>
<ref id="bib18"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ioannidis</surname>
<given-names>JPA</given-names>
</name>
</person-group>
<article-title>Why most discovered true associations are inflated</article-title>
<source>Epidemiology</source>
<year>2008</year>
<volume>19</volume>
<fpage>640</fpage>
<lpage>648</lpage>
<pub-id pub-id-type="pmid">18633328</pub-id>
</mixed-citation>
</ref>
<ref id="bib19"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Mignini</surname>
<given-names>LE</given-names>
</name>
<name><surname>Khan</surname>
<given-names>KS</given-names>
</name>
</person-group>
<article-title>Methodological quality of systematic reviews of animal studies: a survey of reviews of basic research</article-title>
<source>BMC Med Res Methodol</source>
<year>2006</year>
<volume>6</volume>
<fpage>10</fpage>
<pub-id pub-id-type="pmid">16533396</pub-id>
</mixed-citation>
</ref>
<ref id="bib20"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Peters</surname>
<given-names>JL</given-names>
</name>
<name><surname>Sutton</surname>
<given-names>AJ</given-names>
</name>
<name><surname>Jones</surname>
<given-names>DR</given-names>
</name>
<name><surname>Rushton</surname>
<given-names>L</given-names>
</name>
<name><surname>Abrams</surname>
<given-names>KR</given-names>
</name>
</person-group>
<article-title>A systematic review of systematic reviews and meta-analyses of animal experiments with guidelines for reporting</article-title>
<source>J Environ Sci Health B</source>
<year>2006</year>
<volume>41</volume>
<fpage>1245</fpage>
<lpage>1258</lpage>
<pub-id pub-id-type="pmid">16923604</pub-id>
</mixed-citation>
</ref>
<ref id="bib21"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Moher</surname>
<given-names>D</given-names>
</name>
<name><surname>Liberati</surname>
<given-names>A</given-names>
</name>
<name><surname>Tetzlaff</surname>
<given-names>J</given-names>
</name>
<name><surname>Altman</surname>
<given-names>DG</given-names>
</name>
<collab>PRISMA Group</collab>
</person-group>
<article-title>Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement</article-title>
<source>BMJ</source>
<year>2009</year>
<volume>8</volume>
<fpage>336</fpage>
<lpage>41</lpage>
</mixed-citation>
</ref>
<ref id="bib22"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Garg</surname>
<given-names>AX</given-names>
</name>
<name><surname>Hackam</surname>
<given-names>D</given-names>
</name>
<name><surname>Tonelli</surname>
<given-names>M</given-names>
</name>
</person-group>
<article-title>Systematic review and meta-analysis: when one study is just not enough</article-title>
<source>Clin J Am Soc Nephrol</source>
<year>2008</year>
<volume>3</volume>
<fpage>253</fpage>
<lpage>260</lpage>
<pub-id pub-id-type="pmid">18178786</pub-id>
</mixed-citation>
</ref>
<ref id="bib23"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Meline</surname>
<given-names>T</given-names>
</name>
</person-group>
<article-title>Selecting studies for systematic review: inclusion and exclusion criteria</article-title>
<source>Contemp Issues in Commun Sci Disord</source>
<year>2006</year>
<volume>33</volume>
<fpage>21</fpage>
<lpage>27</lpage>
</mixed-citation>
</ref>
<ref id="bib24"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Slavin</surname>
<given-names>RE</given-names>
</name>
</person-group>
<article-title>Best-evidence synthesis: why less is more</article-title>
<source>Educ Res</source>
<year>1987</year>
<volume>16</volume>
<fpage>15</fpage>
<lpage>16</lpage>
</mixed-citation>
</ref>
<ref id="bib25"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Egger</surname>
<given-names>M</given-names>
</name>
<name><surname>Zellweger-Z+ñhner</surname>
<given-names>T</given-names>
</name>
<name><surname>Schneider</surname>
<given-names>M</given-names>
</name>
<name><surname>Junker</surname>
<given-names>C</given-names>
</name>
<name><surname>Lengeler</surname>
<given-names>C</given-names>
</name>
<name><surname>Antes</surname>
<given-names>G</given-names>
</name>
</person-group>
<article-title>Language bias in randomised controlled trials published in English and German</article-title>
<source>Lancet</source>
<year>1997</year>
<volume>350</volume>
<fpage>326</fpage>
<lpage>329</lpage>
<pub-id pub-id-type="pmid">9251637</pub-id>
</mixed-citation>
</ref>
<ref id="bib26"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Vesterinen</surname>
<given-names>HM</given-names>
</name>
<name><surname>Sena</surname>
<given-names>ES</given-names>
</name>
<name><surname>Egan</surname>
<given-names>KJ</given-names>
</name>
<name><surname>Hirst</surname>
<given-names>TC</given-names>
</name>
<name><surname>Churolov</surname>
<given-names>L</given-names>
</name>
<name><surname>Currie</surname>
<given-names>GL</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Meta-analysis of data from animal studies: a practical guide</article-title>
<source>J Neurosci Methods</source>
<year>2014</year>
<volume>221</volume>
<fpage>92</fpage>
<lpage>102</lpage>
<pub-id pub-id-type="pmid">24099992</pub-id>
</mixed-citation>
</ref>
<ref id="bib27"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Moher</surname>
<given-names>D</given-names>
</name>
<name><surname>Schulz</surname>
<given-names>K</given-names>
</name>
<name><surname>Altman</surname>
<given-names>D</given-names>
</name>
</person-group>
<article-title>The CONSORT statement: revised recommendations for improving the quality of reports of parallel group randomized trials</article-title>
<source>BMC Med Res Methodol</source>
<year>2001</year>
<volume>1</volume>
<fpage>2</fpage>
<pub-id pub-id-type="pmid">11336663</pub-id>
</mixed-citation>
</ref>
<ref id="bib28"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kilkenny</surname>
<given-names>C</given-names>
</name>
<name><surname>Browne</surname>
<given-names>WJ</given-names>
</name>
<name><surname>Cuthill</surname>
<given-names>IC</given-names>
</name>
<name><surname>Emerson</surname>
<given-names>M</given-names>
</name>
<name><surname>Altman</surname>
<given-names>DG</given-names>
</name>
</person-group>
<article-title>Improving bioscience research reporting: the ARRIVE guidelines for reporting animal research</article-title>
<source>PLoS Biol</source>
<year>2010</year>
<volume>8</volume>
<fpage>e1000412</fpage>
<pub-id pub-id-type="pmid">20613859</pub-id>
</mixed-citation>
</ref>
<ref id="bib29"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Landis</surname>
<given-names>SC</given-names>
</name>
<name><surname>Amara</surname>
<given-names>SG</given-names>
</name>
<name><surname>Asadullah</surname>
<given-names>K</given-names>
</name>
<name><surname>Austin</surname>
<given-names>CP</given-names>
</name>
<name><surname>Blumenstein</surname>
<given-names>R</given-names>
</name>
<name><surname>Bradley</surname>
<given-names>EW</given-names>
</name>
<etal></etal>
</person-group>
<article-title>A call for transparent reporting to optimize the predictive value of preclinical research</article-title>
<source>Nature</source>
<year>2012</year>
<volume>490</volume>
<fpage>187</fpage>
<lpage>191</lpage>
<pub-id pub-id-type="pmid">23060188</pub-id>
</mixed-citation>
</ref>
<ref id="bib30"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Egan</surname>
<given-names>KJ</given-names>
</name>
<name><surname>Sena</surname>
<given-names>ES</given-names>
</name>
<name><surname>Vesterinen</surname>
<given-names>HM</given-names>
</name>
<name><surname>Macleod</surname>
<given-names>MR</given-names>
</name>
</person-group>
<article-title>Developing our understanding of the pathogenesis of Alzheimer's disease using a systematically identified dataset of interventions tested in transgenic mouse models</article-title>
<source>Eur J Neurol</source>
<year>2012</year>
<volume>19</volume>
<fpage>460</fpage>
</mixed-citation>
</ref>
<ref id="bib31"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Rooke</surname>
<given-names>ED</given-names>
</name>
<name><surname>Vesterinen</surname>
<given-names>HM</given-names>
</name>
<name><surname>Sena</surname>
<given-names>ES</given-names>
</name>
<name><surname>Egan</surname>
<given-names>KJ</given-names>
</name>
<name><surname>Macleod</surname>
<given-names>MR</given-names>
</name>
</person-group>
<article-title>Dopamine agonists in animal models of Parkinson's disease: a systematic review and meta-analysis</article-title>
<source>Parkinsonism Relat Disord</source>
<year>2011</year>
<volume>17</volume>
<fpage>313</fpage>
<lpage>320</lpage>
<pub-id pub-id-type="pmid">21376651</pub-id>
</mixed-citation>
</ref>
<ref id="bib32"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Frantzias</surname>
<given-names>J</given-names>
</name>
<name><surname>Sena</surname>
<given-names>ES</given-names>
</name>
<name><surname>Macleod</surname>
<given-names>MR</given-names>
</name>
<name><surname>Salman</surname>
<given-names>RA-S</given-names>
</name>
</person-group>
<article-title>Treatment of intracerebral hemorrhage in animal models: meta-analysis</article-title>
<source>Ann Neurol</source>
<year>2011</year>
<volume>69</volume>
<fpage>389</fpage>
<lpage>399</lpage>
<pub-id pub-id-type="pmid">21387381</pub-id>
</mixed-citation>
</ref>
<ref id="bib33"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Jerndal</surname>
<given-names>M</given-names>
</name>
<name><surname>Forsberg</surname>
<given-names>K</given-names>
</name>
<name><surname>Sena</surname>
<given-names>ES</given-names>
</name>
<name><surname>Macleod</surname>
<given-names>MR</given-names>
</name>
<name><surname>O'Collins</surname>
<given-names>VE</given-names>
</name>
<name><surname>Linden</surname>
<given-names>T</given-names>
</name>
<etal></etal>
</person-group>
<article-title>A systematic review and meta-analysis of erythropoietin in experimental stroke</article-title>
<source>J Cereb Blood Flow Metab</source>
<year>2010</year>
<volume>30</volume>
<fpage>961</fpage>
<lpage>968</lpage>
<pub-id pub-id-type="pmid">20040929</pub-id>
</mixed-citation>
</ref>
<ref id="bib34"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Sena</surname>
<given-names>E</given-names>
</name>
<name><surname>Wheble</surname>
<given-names>P</given-names>
</name>
<name><surname>Sandercock</surname>
<given-names>P</given-names>
</name>
<name><surname>Macleod</surname>
<given-names>M</given-names>
</name>
</person-group>
<article-title>Systematic review and meta-analysis of the efficacy of tirilazad in experimental stroke</article-title>
<source>Stroke</source>
<year>2007</year>
<volume>38</volume>
<fpage>388</fpage>
<lpage>394</lpage>
<pub-id pub-id-type="pmid">17204689</pub-id>
</mixed-citation>
</ref>
</ref-list>
</back>
<floats-group><fig id="fig1"><label>Figure 1</label>
<caption><p>The effect of the mean sample size on the estimate of effect size for neurobehavioural score in models of encephalomyelitis. The horizontal gray bar represents the 95% confidence limits for the summary estimate of effect. The vertical error bars represent the 95% confidence intervals for the individual estimate. The widths of the bar represent the log of the number of animals contributing to that comparison.<sup><xref ref-type="bibr" rid="bib11">11</xref>
</sup>
</p>
</caption>
<graphic xlink:href="jcbfm201428f1"></graphic>
</fig>
<fig id="fig2"><label>Figure 2</label>
<caption><p>Publication bias. Plots describing (<bold>A</bold>
) funnel plot, (<bold>B</bold>
) Egger regression, and (<bold>C</bold>
) trim-and-fill.<sup><xref ref-type="bibr" rid="bib9">9</xref>
</sup>
</p>
</caption>
<graphic xlink:href="jcbfm201428f2"></graphic>
</fig>
<table-wrap id="tbl1"><label>Table 1</label>
<caption><title>Number and percentages of studies across the modeling of different neurologic diseases reporting measures to reduce the risk of bias</title>
</caption>
<table frame="hsides" rules="groups" border="1"><colgroup><col align="left"></col>
<col align="char" char="."></col>
<col align="char" char="("></col>
<col align="char" char="("></col>
<col align="center"></col>
<col align="char" char="("></col>
</colgroup>
<thead valign="bottom"><tr><th align="left" valign="top" charoff="50"> </th>
<th align="center" valign="top" char="." charoff="50"><italic>Number of publications</italic>
</th>
<th align="center" valign="top" char="(" charoff="50"><italic>Masked assessment of outcome (%)</italic>
</th>
<th align="center" valign="top" char="(" charoff="50"><italic>Random allocation to group (%)</italic>
</th>
<th align="center" valign="top" charoff="50"><italic>Allocation concealment (%)</italic>
</th>
<th align="center" valign="top" char="(" charoff="50"><italic>Sample size calculation (%)</italic>
</th>
</tr>
</thead>
<tbody valign="top"><tr><td align="left" valign="top" charoff="50">Alzheimer's disease<sup><xref ref-type="bibr" rid="bib30">30</xref>
</sup>
</td>
<td align="char" valign="top" char="." charoff="50">428</td>
<td align="char" valign="top" char="(" charoff="50">95 (22)</td>
<td align="char" valign="top" char="(" charoff="50">67 (16)</td>
<td align="center" valign="top" charoff="50">NA</td>
<td align="char" valign="top" char="(" charoff="50">0 (0)</td>
</tr>
<tr><td align="left" valign="top" charoff="50">Multiple sclerosis<sup><xref ref-type="bibr" rid="bib11">11</xref>
</sup>
</td>
<td align="char" valign="top" char="." charoff="50">1,117</td>
<td align="char" valign="top" char="(" charoff="50">178 (16)</td>
<td align="char" valign="top" char="(" charoff="50">106 (9)</td>
<td align="center" valign="top" charoff="50">NA</td>
<td align="char" valign="top" char="(" charoff="50">2 (<1)</td>
</tr>
<tr><td align="left" valign="top" charoff="50">Parkinson's disease<sup><xref ref-type="bibr" rid="bib31">31</xref>
</sup>
</td>
<td align="char" valign="top" char="." charoff="50">252</td>
<td align="char" valign="top" char="(" charoff="50">38 (15)</td>
<td align="char" valign="top" char="(" charoff="50">40 (16)</td>
<td align="center" valign="top" charoff="50">NA</td>
<td align="char" valign="top" char="(" charoff="50">1 (<1)</td>
</tr>
<tr><td align="left" valign="top" charoff="50">Intracerebral hemorrhage<sup><xref ref-type="bibr" rid="bib32">32</xref>
</sup>
</td>
<td align="char" valign="top" char="." charoff="50">88</td>
<td align="char" valign="top" char="(" charoff="50">43 (49)</td>
<td align="char" valign="top" char="(" charoff="50">27 (31)</td>
<td align="char" valign="top" char="(" charoff="50">7 (8)</td>
<td align="char" valign="top" char="(" charoff="50">0 (0)</td>
</tr>
<tr><td align="left" valign="top" charoff="50"> </td>
<td align="char" valign="top" char="." charoff="50"> </td>
<td align="char" valign="top" char="(" charoff="50"> </td>
<td align="char" valign="top" char="(" charoff="50"> </td>
<td align="center" valign="top" charoff="50"> </td>
<td align="char" valign="top" char="(" charoff="50"> </td>
</tr>
<tr><td colspan="6" align="left" valign="top" charoff="50"><italic>Focal ischemia</italic>
</td>
</tr>
<tr><td align="left" valign="top" charoff="50"> NXY 059<sup><xref ref-type="bibr" rid="bib13">13</xref>
</sup>
</td>
<td align="char" valign="top" char="." charoff="50">9</td>
<td align="char" valign="top" char="(" charoff="50">4 (44)</td>
<td align="char" valign="top" char="(" charoff="50">3 (33)</td>
<td align="char" valign="top" char="(" charoff="50">5 (56)</td>
<td align="char" valign="top" char="(" charoff="50">2 (22)</td>
</tr>
<tr><td align="left" valign="top" charoff="50"> Hypothermia<sup><xref ref-type="bibr" rid="bib12">12</xref>
</sup>
</td>
<td align="char" valign="top" char="." charoff="50">101</td>
<td align="char" valign="top" char="(" charoff="50">38 (38)</td>
<td align="char" valign="top" char="(" charoff="50">36 (36)</td>
<td align="char" valign="top" char="(" charoff="50">4 (4)</td>
<td align="char" valign="top" char="(" charoff="50">0 (0)</td>
</tr>
<tr><td align="left" valign="top" charoff="50"> Erythropoietin<sup><xref ref-type="bibr" rid="bib33">33</xref>
</sup>
</td>
<td align="char" valign="top" char="." charoff="50">19</td>
<td align="char" valign="top" char="(" charoff="50">8 (42)</td>
<td align="char" valign="top" char="(" charoff="50">7 (37)</td>
<td align="char" valign="top" char="(" charoff="50">4 (21)</td>
<td align="char" valign="top" char="(" charoff="50">0 (0)</td>
</tr>
<tr><td align="left" valign="top" charoff="50"> Tirilazad<sup><xref ref-type="bibr" rid="bib34">34</xref>
</sup>
</td>
<td align="char" valign="top" char="." charoff="50">18</td>
<td align="char" valign="top" char="(" charoff="50">13 (72)</td>
<td align="char" valign="top" char="(" charoff="50">12 (67)</td>
<td align="char" valign="top" char="(" charoff="50">1 (6)</td>
<td align="char" valign="top" char="(" charoff="50">0 (0)</td>
</tr>
<tr><td align="left" valign="top" charoff="50"> tPA<sup><xref ref-type="bibr" rid="bib14">14</xref>
</sup>
</td>
<td align="char" valign="top" char="." charoff="50">113</td>
<td align="char" valign="top" char="(" charoff="50">24 (21)</td>
<td align="char" valign="top" char="(" charoff="50">42 (37)</td>
<td align="char" valign="top" char="(" charoff="50">23 (20)</td>
<td align="char" valign="top" char="(" charoff="50">8 (7)</td>
</tr>
</tbody>
</table>
<table-wrap-foot><fn id="t1-fn1"><p>NA, not applicable; tPA, tissue plasminogen activator.</p>
</fn>
</table-wrap-foot>
</table-wrap>
<table-wrap id="tbl2"><label>Table 2</label>
<caption><title>Guidelines for reporting systematic reviews and meta-analyses of animal studies</title>
</caption>
<table frame="hsides" rules="groups" border="1"><colgroup><col align="left"></col>
<col align="left"></col>
</colgroup>
<tbody valign="top"><tr><td align="left" valign="top" charoff="50">Title</td>
<td align="left" valign="top" charoff="50">Identify the report as a systematic review and/or meta-analysis of animal experiments.</td>
</tr>
<tr><td align="left" valign="top" charoff="50">Abstract</td>
<td align="left" valign="top" charoff="50">Provide a structured abstract covering the following: objectives, data sources, review methods, results, and conclusion.</td>
</tr>
<tr><td align="left" valign="top" charoff="50">Introduction</td>
<td align="left" valign="top" charoff="50">Clearly defined and focussed research question.</td>
</tr>
<tr><td align="left" valign="top" charoff="50"> </td>
<td align="left" valign="top" charoff="50"> </td>
</tr>
<tr><td colspan="2" align="left" valign="top" charoff="50"><italic>Methods</italic>
</td>
</tr>
<tr><td align="left" valign="top" charoff="50"><bold> </bold>
Protocol</td>
<td align="left" valign="top" charoff="50">Indicate if a protocol exists and where it can be found (i.e., web address).</td>
</tr>
<tr><td align="left" valign="top" charoff="50"><bold> </bold>
Searching</td>
<td align="left" valign="top" charoff="50">Describe the information sources in detail, including keywords, search strategy, any restrictions, and special efforts to include all available data.</td>
</tr>
<tr><td align="left" valign="top" charoff="50"><bold> </bold>
Selection</td>
<td align="left" valign="top" charoff="50">Describe the inclusion and exclusion criteria.</td>
</tr>
<tr><td align="left" valign="top" charoff="50"><bold> </bold>
Validity and quality assessment</td>
<td align="left" valign="top" charoff="50">Describe the criteria and process used to assess validity.</td>
</tr>
<tr><td align="left" valign="top" charoff="50"><bold> </bold>
Data abstraction</td>
<td align="left" valign="top" charoff="50">Describe the process or processes used (e.g., completed independently, in duplicate).</td>
</tr>
<tr><td align="left" valign="top" charoff="50"> </td>
<td align="left" valign="top" charoff="50">Describe whether aggregate data or individual animal data are abstracted.</td>
</tr>
<tr><td align="left" valign="top" charoff="50"><bold> </bold>
Study characteristics</td>
<td align="left" valign="top" charoff="50">Describe the study characteristics relevant to your research question.</td>
</tr>
<tr><td align="left" valign="top" charoff="50"><bold> </bold>
Quantitative data synthesis</td>
<td align="left" valign="top" charoff="50">Describe the principal measures of effect, method of combining results, handling of missing data; how statistical heterogeneity was assessed; and any assessment of publication bias—all in enough detail to allow replication.</td>
</tr>
<tr><td align="left" valign="top" charoff="50"> </td>
<td align="left" valign="top" charoff="50"> </td>
</tr>
<tr><td colspan="2" align="left" valign="top" charoff="50"><italic>Results</italic>
</td>
</tr>
<tr><td align="left" valign="top" charoff="50"><bold> </bold>
Flow chart</td>
<td align="left" valign="top" charoff="50">A meta-analysis profile summarizing study flow giving total number of experiments in the meta-analysis.</td>
</tr>
<tr><td align="left" valign="top" charoff="50"><bold> </bold>
Study characteristics</td>
<td align="left" valign="top" charoff="50">Descriptive data for each experiment.</td>
</tr>
<tr><td align="left" valign="top" charoff="50"><bold> </bold>
Quantitative data synthesis</td>
<td align="left" valign="top" charoff="50">Present simple summary results (e.g., forest plot); identify sources of heterogeneity, impact of study quality, and publication bias.</td>
</tr>
<tr><td align="left" valign="top" charoff="50">Discussion</td>
<td align="left" valign="top" charoff="50">Summarize the main findings; discuss limitations;
provide general interpretation of the results in the context of other findings, and implications for future research.</td>
</tr>
<tr><td align="left" valign="top" charoff="50">Funding</td>
<td align="left" valign="top" charoff="50">Describe sources of funding for the review and other support. The role of funders should be presented.</td>
</tr>
<tr><td align="left" valign="top" charoff="50">Conflict of interest</td>
<td align="left" valign="top" charoff="50">Any potential conflict of interests should be reported.</td>
</tr>
</tbody>
</table>
</table-wrap>
<table-wrap id="tbl3"><label>Table 3</label>
<caption><title>Points to consider in the critical appraisal of systematic reviews and meta-analyses of animal studies</title>
</caption>
<table frame="hsides" rules="groups" border="1"><colgroup><col align="left"></col>
</colgroup>
<thead valign="bottom"><tr><th align="left" valign="top" charoff="50"> </th>
</tr>
</thead>
<tbody valign="top"><tr><td align="left" valign="top" charoff="50">1. Does the study follow a pre-specified protocol?</td>
</tr>
<tr><td align="left" valign="top" charoff="50">2. Was the research question focused and clearly defined?</td>
</tr>
<tr><td align="left" valign="top" charoff="50">3. Are the inclusion criteria appropriate?</td>
</tr>
<tr><td align="left" valign="top" charoff="50">4. How comprehensive was the search strategy?</td>
</tr>
<tr><td align="left" valign="top" charoff="50">5. Was the data abstraction from each study appropriate?</td>
</tr>
<tr><td align="left" valign="top" charoff="50">6. Were the data pooled appropriately?</td>
</tr>
</tbody>
</table>
</table-wrap>
</floats-group>
</pmc>
</record>
Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Wicri/Asie/explor/AustralieFrV1/Data/Pmc/Corpus
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000148 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Pmc/Corpus/biblio.hfd -nk 000148 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien |wiki= Wicri/Asie |area= AustralieFrV1 |flux= Pmc |étape= Corpus |type= RBID |clé= PMC:4013765 |texte= Systematic reviews and meta-analysis of preclinical studies: why perform them and how to appraise them critically }}
Pour générer des pages wiki
HfdIndexSelect -h $EXPLOR_AREA/Data/Pmc/Corpus/RBID.i -Sk "pubmed:24549183" \ | HfdSelect -Kh $EXPLOR_AREA/Data/Pmc/Corpus/biblio.hfd \ | NlmPubMed2Wicri -a AustralieFrV1
![]() | This area was generated with Dilib version V0.6.33. | ![]() |