Links to Exploration step
Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions</title><author><name sortKey="Sterne, Jonathan Ac" sort="Sterne, Jonathan Ac" uniqKey="Sterne J" first="Jonathan Ac" last="Sterne">Jonathan Ac Sterne</name><affiliation><nlm:aff id="aff1">School of Social and Community Medicine, University of Bristol, Bristol BS8 2PS, UK</nlm:aff></affiliation></author><author><name sortKey="Hernan, Miguel A" sort="Hernan, Miguel A" uniqKey="Hernan M" first="Miguel A" last="Hernán">Miguel A. Hernán</name><affiliation><nlm:aff id="aff2">Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, Massachusetts, USA; and Department of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, Massachusetts, USA; and Harvard-Massachusetts Institute of Technology Division of Health Sciences and Technology, Boston, Massachusetts, USA</nlm:aff></affiliation></author><author><name sortKey="Reeves, Barnaby C" sort="Reeves, Barnaby C" uniqKey="Reeves B" first="Barnaby C" last="Reeves">Barnaby C. Reeves</name><affiliation><nlm:aff id="aff3">School of Clinical Sciences, University of Bristol, Bristol, BS2 8HW, UK</nlm:aff></affiliation></author><author><name sortKey="Savovi, Jelena" sort="Savovi, Jelena" uniqKey="Savovi J" first="Jelena" last="Savovi">Jelena Savovi</name><affiliation><nlm:aff>NONE</nlm:aff></affiliation><affiliation><nlm:aff id="aff4">National Institute for Health Research Collaboration for Leadership in Applied Health Research and Care West (NIHR CLAHRC West) at University Hospitals Bristol NHS Foundation Trust, Bristol BS1 2NT, UK</nlm:aff></affiliation></author><author><name sortKey="Berkman, Nancy D" sort="Berkman, Nancy D" uniqKey="Berkman N" first="Nancy D" last="Berkman">Nancy D. Berkman</name><affiliation><nlm:aff id="aff5">Program on Health Care Quality and Outcomes, Division of Health Services and Social Policy Research, RTI International, Research Triangle Park, NC 27709, USA</nlm:aff></affiliation></author><author><name sortKey="Viswanathan, Meera" sort="Viswanathan, Meera" uniqKey="Viswanathan M" first="Meera" last="Viswanathan">Meera Viswanathan</name><affiliation><nlm:aff id="aff6">RTI-UNC Evidence-based Practice Center, RTI International, Research Triangle Park, NC 27709, USA</nlm:aff></affiliation></author><author><name sortKey="Henry, David" sort="Henry, David" uniqKey="Henry D" first="David" last="Henry">David Henry</name><affiliation><nlm:aff id="aff7">Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada</nlm:aff></affiliation></author><author><name sortKey="Altman, Douglas G" sort="Altman, Douglas G" uniqKey="Altman D" first="Douglas G" last="Altman">Douglas G. Altman</name><affiliation><nlm:aff id="aff8">Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology & Musculoskeletal Sciences, University of Oxford, Oxford OX3 7LD, UK</nlm:aff></affiliation></author><author><name sortKey="Ansari, Mohammed T" sort="Ansari, Mohammed T" uniqKey="Ansari M" first="Mohammed T" last="Ansari">Mohammed T. Ansari</name><affiliation><nlm:aff id="aff9">School of Epidemiology, Public Health and Preventive Medicine, Faculty of Medicine, University of Ottawa, Ottawa, Ontario, K1H 8M5, Canada</nlm:aff></affiliation></author><author><name sortKey="Boutron, Isabelle" sort="Boutron, Isabelle" uniqKey="Boutron I" first="Isabelle" last="Boutron">Isabelle Boutron</name><affiliation><nlm:aff id="aff10">METHODS Team, Centre of Epidemiology and Statistics Sorbonne Paris Cité Research, INSERM UMR 1153, University Paris Descartes, Paris, France</nlm:aff></affiliation></author><author><name sortKey="Carpenter, James R" sort="Carpenter, James R" uniqKey="Carpenter J" first="James R" last="Carpenter">James R. Carpenter</name><affiliation><nlm:aff id="aff11">Department of Medical Statistics, London School of Hygiene and Tropical Medicine and MRC Clinical Trials Unit at UCL, London, UK</nlm:aff></affiliation></author><author><name sortKey="Chan, An Wen" sort="Chan, An Wen" uniqKey="Chan A" first="An-Wen" last="Chan">An-Wen Chan</name><affiliation><nlm:aff id="aff12">Women's College Research Institute, Department of Medicine, University of Toronto, Canada</nlm:aff></affiliation></author><author><name sortKey="Churchill, Rachel" sort="Churchill, Rachel" uniqKey="Churchill R" first="Rachel" last="Churchill">Rachel Churchill</name><affiliation><nlm:aff id="aff13">Centre for Reviews and Dissemination, University of York, York, YO10 5DD, UK</nlm:aff></affiliation></author><author><name sortKey="Deeks, Jonathan J" sort="Deeks, Jonathan J" uniqKey="Deeks J" first="Jonathan J" last="Deeks">Jonathan J. Deeks</name><affiliation><nlm:aff id="aff14">Institute of Applied Health Research, University of Birmingham, Birmingham B15 2TT, UK</nlm:aff></affiliation></author><author><name sortKey="Hr Bjartsson, Asbj Rn" sort="Hr Bjartsson, Asbj Rn" uniqKey="Hr Bjartsson A" first="Asbj Rn" last="Hr Bjartsson">Asbj Rn Hr Bjartsson</name><affiliation><nlm:aff id="aff15">Center for Evidence-Based Medicine, University of Southern Denmark & Odense University Hospital, 5000 Odense C, Denmark</nlm:aff></affiliation></author><author><name sortKey="Kirkham, Jamie" sort="Kirkham, Jamie" uniqKey="Kirkham J" first="Jamie" last="Kirkham">Jamie Kirkham</name><affiliation><nlm:aff id="aff16">Department of Biostatistics, University of Liverpool, Liverpool, L69 3GL, UK</nlm:aff></affiliation></author><author><name sortKey="Juni, Peter" sort="Juni, Peter" uniqKey="Juni P" first="Peter" last="Jüni">Peter Jüni</name><affiliation><nlm:aff id="aff17">Applied Health Research Centre (AHRC), Li Ka Shing Knowledge Institute of St Michael’s Hospital, and Department of Medicine, University of Toronto, Toronto, Ontario, Canada</nlm:aff></affiliation></author><author><name sortKey="Loke, Yoon K" sort="Loke, Yoon K" uniqKey="Loke Y" first="Yoon K" last="Loke">Yoon K. Loke</name><affiliation><nlm:aff id="aff18">Norwich Medical School, University of East Anglia, Norwich NR4 7TJ, UK</nlm:aff></affiliation></author><author><name sortKey="Pigott, Theresa D" sort="Pigott, Theresa D" uniqKey="Pigott T" first="Theresa D" last="Pigott">Theresa D. Pigott</name><affiliation><nlm:aff id="aff19">School of Education, Loyola University Chicago, Chicago, IL 60611, USA</nlm:aff></affiliation></author><author><name sortKey="Ramsay, Craig R" sort="Ramsay, Craig R" uniqKey="Ramsay C" first="Craig R" last="Ramsay">Craig R. Ramsay</name><affiliation><nlm:aff id="aff20">Health Services Research Unit, University of Aberdeen, Aberdeen, AB25 2ZD, UK.</nlm:aff></affiliation></author><author><name sortKey="Regidor, Deborah" sort="Regidor, Deborah" uniqKey="Regidor D" first="Deborah" last="Regidor">Deborah Regidor</name><affiliation><nlm:aff id="aff21">Evidence Services, Kaiser Permanente, Care Management Institute, Oakland, CA 94612, USA</nlm:aff></affiliation></author><author><name sortKey="Rothstein, Hannah R" sort="Rothstein, Hannah R" uniqKey="Rothstein H" first="Hannah R" last="Rothstein">Hannah R. Rothstein</name><affiliation><nlm:aff id="aff22">Department of Management, Zicklin School of Business, Baruch College—CUNY, New York, NY 10010, USA</nlm:aff></affiliation></author><author><name sortKey="Sandhu, Lakhbir" sort="Sandhu, Lakhbir" uniqKey="Sandhu L" first="Lakhbir" last="Sandhu">Lakhbir Sandhu</name><affiliation><nlm:aff id="aff23">Division of General Surgery, University of Toronto, Toronto, Canada</nlm:aff></affiliation></author><author><name sortKey="Santaguida, Pasqualina L" sort="Santaguida, Pasqualina L" uniqKey="Santaguida P" first="Pasqualina L" last="Santaguida">Pasqualina L. Santaguida</name><affiliation><nlm:aff id="aff24">Department of Clinical Epidemiology and Biostatistics, McMaster University, Hamilton, Ontario, L8S 4K1, Canada</nlm:aff></affiliation></author><author><name sortKey="Schunemann, Holger J" sort="Schunemann, Holger J" uniqKey="Schunemann H" first="Holger J" last="Schünemann">Holger J. Schünemann</name><affiliation><nlm:aff id="aff25">Departments of Clinical Epidemiology and Biostatistics and of Medicine, Cochrane Applicability and Recommendations Methods (GRADEing) Group, MacGRADE center, Ontario, L8N 4K1, Canada</nlm:aff></affiliation></author><author><name sortKey="Shea, Beverly" sort="Shea, Beverly" uniqKey="Shea B" first="Beverly" last="Shea">Beverly Shea</name><affiliation><nlm:aff id="aff26">Ottawa Hospital Research Institute, Center for Practice Changing Research and School of Epidemiology, Public Health and Preventive Medicine, Faculty of Medicine, University of Ottawa, Ottawa, Ontario, K1H 8M5, Canada</nlm:aff></affiliation></author><author><name sortKey="Shrier, Ian" sort="Shrier, Ian" uniqKey="Shrier I" first="Ian" last="Shrier">Ian Shrier</name><affiliation><nlm:aff id="aff27">Centre for Clinical Epidemiology, Lady Davis Institute, Jewish General Hospital, McGill University, Montreal, Quebec, Canada</nlm:aff></affiliation></author><author><name sortKey="Tugwell, Peter" sort="Tugwell, Peter" uniqKey="Tugwell P" first="Peter" last="Tugwell">Peter Tugwell</name><affiliation><nlm:aff id="aff28">Department of Medicine and School of Epidemiology, Public Health and Preventive Medicine, University of Ottawa, Ottawa, Ontario, Canada</nlm:aff></affiliation></author><author><name sortKey="Turner, Lucy" sort="Turner, Lucy" uniqKey="Turner L" first="Lucy" last="Turner">Lucy Turner</name><affiliation><nlm:aff id="aff29">Ottawa Hospital Research Institute, Ottawa, ON, Canada</nlm:aff></affiliation></author><author><name sortKey="Valentine, Jeffrey C" sort="Valentine, Jeffrey C" uniqKey="Valentine J" first="Jeffrey C" last="Valentine">Jeffrey C. Valentine</name><affiliation><nlm:aff id="aff30">University of Louisville, Louisville, KY 40292, USA</nlm:aff></affiliation></author><author><name sortKey="Waddington, Hugh" sort="Waddington, Hugh" uniqKey="Waddington H" first="Hugh" last="Waddington">Hugh Waddington</name><affiliation><nlm:aff id="aff31">International Initiative for Impact Evaluation, London School of Hygiene and Tropical Medicine, and London International Development Centre, London, UK</nlm:aff></affiliation></author><author><name sortKey="Waters, Elizabeth" sort="Waters, Elizabeth" uniqKey="Waters E" first="Elizabeth" last="Waters">Elizabeth Waters</name><affiliation><nlm:aff id="aff32">Jack Brockhoff Child Health & Wellbeing Program, Melbourne School of Population and Global Health, University of Melbourne, Melbourne, VIC 3010, Australia</nlm:aff></affiliation></author><author><name sortKey="Wells, George A" sort="Wells, George A" uniqKey="Wells G" first="George A" last="Wells">George A. Wells</name><affiliation><nlm:aff id="aff33">School of Epidemiology, Public Health and Preventive Medicine and Director, Cardiovascular Research Methods Centre, University of Ottawa Heart Institute, Ottawa, Ontario, K1Y 4W7, Canada</nlm:aff></affiliation></author><author><name sortKey="Whiting, Penny F" sort="Whiting, Penny F" uniqKey="Whiting P" first="Penny F" last="Whiting">Penny F. Whiting</name><affiliation><nlm:aff id="aff34">School of Social and Community Medicine, University of Bristol, Bristol BS8 2PS, UK; and National Institute for Health Research Collaboration for Leadership in Applied Health Research and Care West (NIHR CLAHRC West) at University Hospitals Bristol NHS Foundation Trust, Bristol BS1 2NT, UK</nlm:aff></affiliation></author><author><name sortKey="Higgins, Julian Pt" sort="Higgins, Julian Pt" uniqKey="Higgins J" first="Julian Pt" last="Higgins">Julian Pt Higgins</name><affiliation><nlm:aff id="aff35">School of Social and Community Medicine, University of Bristol, Bristol BS8 2PS, UK</nlm:aff></affiliation></author></titleStmt><publicationStmt><idno type="wicri:source">PMC</idno><idno type="pmid">27733354</idno><idno type="pmc">5062054</idno><idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC5062054</idno><idno type="RBID">PMC:5062054</idno><idno type="doi">10.1136/bmj.i4919</idno><date when="2016">2016</date><idno type="wicri:Area/Pmc/Corpus">001337</idno><idno type="wicri:explorRef" wicri:stream="Pmc" wicri:step="Corpus" wicri:corpus="PMC">001337</idno></publicationStmt><sourceDesc><biblStruct><analytic><title xml:lang="en" level="a" type="main">ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions</title><author><name sortKey="Sterne, Jonathan Ac" sort="Sterne, Jonathan Ac" uniqKey="Sterne J" first="Jonathan Ac" last="Sterne">Jonathan Ac Sterne</name><affiliation><nlm:aff id="aff1">School of Social and Community Medicine, University of Bristol, Bristol BS8 2PS, UK</nlm:aff></affiliation></author><author><name sortKey="Hernan, Miguel A" sort="Hernan, Miguel A" uniqKey="Hernan M" first="Miguel A" last="Hernán">Miguel A. Hernán</name><affiliation><nlm:aff id="aff2">Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, Massachusetts, USA; and Department of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, Massachusetts, USA; and Harvard-Massachusetts Institute of Technology Division of Health Sciences and Technology, Boston, Massachusetts, USA</nlm:aff></affiliation></author><author><name sortKey="Reeves, Barnaby C" sort="Reeves, Barnaby C" uniqKey="Reeves B" first="Barnaby C" last="Reeves">Barnaby C. Reeves</name><affiliation><nlm:aff id="aff3">School of Clinical Sciences, University of Bristol, Bristol, BS2 8HW, UK</nlm:aff></affiliation></author><author><name sortKey="Savovi, Jelena" sort="Savovi, Jelena" uniqKey="Savovi J" first="Jelena" last="Savovi">Jelena Savovi</name><affiliation><nlm:aff>NONE</nlm:aff></affiliation><affiliation><nlm:aff id="aff4">National Institute for Health Research Collaboration for Leadership in Applied Health Research and Care West (NIHR CLAHRC West) at University Hospitals Bristol NHS Foundation Trust, Bristol BS1 2NT, UK</nlm:aff></affiliation></author><author><name sortKey="Berkman, Nancy D" sort="Berkman, Nancy D" uniqKey="Berkman N" first="Nancy D" last="Berkman">Nancy D. Berkman</name><affiliation><nlm:aff id="aff5">Program on Health Care Quality and Outcomes, Division of Health Services and Social Policy Research, RTI International, Research Triangle Park, NC 27709, USA</nlm:aff></affiliation></author><author><name sortKey="Viswanathan, Meera" sort="Viswanathan, Meera" uniqKey="Viswanathan M" first="Meera" last="Viswanathan">Meera Viswanathan</name><affiliation><nlm:aff id="aff6">RTI-UNC Evidence-based Practice Center, RTI International, Research Triangle Park, NC 27709, USA</nlm:aff></affiliation></author><author><name sortKey="Henry, David" sort="Henry, David" uniqKey="Henry D" first="David" last="Henry">David Henry</name><affiliation><nlm:aff id="aff7">Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada</nlm:aff></affiliation></author><author><name sortKey="Altman, Douglas G" sort="Altman, Douglas G" uniqKey="Altman D" first="Douglas G" last="Altman">Douglas G. Altman</name><affiliation><nlm:aff id="aff8">Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology & Musculoskeletal Sciences, University of Oxford, Oxford OX3 7LD, UK</nlm:aff></affiliation></author><author><name sortKey="Ansari, Mohammed T" sort="Ansari, Mohammed T" uniqKey="Ansari M" first="Mohammed T" last="Ansari">Mohammed T. Ansari</name><affiliation><nlm:aff id="aff9">School of Epidemiology, Public Health and Preventive Medicine, Faculty of Medicine, University of Ottawa, Ottawa, Ontario, K1H 8M5, Canada</nlm:aff></affiliation></author><author><name sortKey="Boutron, Isabelle" sort="Boutron, Isabelle" uniqKey="Boutron I" first="Isabelle" last="Boutron">Isabelle Boutron</name><affiliation><nlm:aff id="aff10">METHODS Team, Centre of Epidemiology and Statistics Sorbonne Paris Cité Research, INSERM UMR 1153, University Paris Descartes, Paris, France</nlm:aff></affiliation></author><author><name sortKey="Carpenter, James R" sort="Carpenter, James R" uniqKey="Carpenter J" first="James R" last="Carpenter">James R. Carpenter</name><affiliation><nlm:aff id="aff11">Department of Medical Statistics, London School of Hygiene and Tropical Medicine and MRC Clinical Trials Unit at UCL, London, UK</nlm:aff></affiliation></author><author><name sortKey="Chan, An Wen" sort="Chan, An Wen" uniqKey="Chan A" first="An-Wen" last="Chan">An-Wen Chan</name><affiliation><nlm:aff id="aff12">Women's College Research Institute, Department of Medicine, University of Toronto, Canada</nlm:aff></affiliation></author><author><name sortKey="Churchill, Rachel" sort="Churchill, Rachel" uniqKey="Churchill R" first="Rachel" last="Churchill">Rachel Churchill</name><affiliation><nlm:aff id="aff13">Centre for Reviews and Dissemination, University of York, York, YO10 5DD, UK</nlm:aff></affiliation></author><author><name sortKey="Deeks, Jonathan J" sort="Deeks, Jonathan J" uniqKey="Deeks J" first="Jonathan J" last="Deeks">Jonathan J. Deeks</name><affiliation><nlm:aff id="aff14">Institute of Applied Health Research, University of Birmingham, Birmingham B15 2TT, UK</nlm:aff></affiliation></author><author><name sortKey="Hr Bjartsson, Asbj Rn" sort="Hr Bjartsson, Asbj Rn" uniqKey="Hr Bjartsson A" first="Asbj Rn" last="Hr Bjartsson">Asbj Rn Hr Bjartsson</name><affiliation><nlm:aff id="aff15">Center for Evidence-Based Medicine, University of Southern Denmark & Odense University Hospital, 5000 Odense C, Denmark</nlm:aff></affiliation></author><author><name sortKey="Kirkham, Jamie" sort="Kirkham, Jamie" uniqKey="Kirkham J" first="Jamie" last="Kirkham">Jamie Kirkham</name><affiliation><nlm:aff id="aff16">Department of Biostatistics, University of Liverpool, Liverpool, L69 3GL, UK</nlm:aff></affiliation></author><author><name sortKey="Juni, Peter" sort="Juni, Peter" uniqKey="Juni P" first="Peter" last="Jüni">Peter Jüni</name><affiliation><nlm:aff id="aff17">Applied Health Research Centre (AHRC), Li Ka Shing Knowledge Institute of St Michael’s Hospital, and Department of Medicine, University of Toronto, Toronto, Ontario, Canada</nlm:aff></affiliation></author><author><name sortKey="Loke, Yoon K" sort="Loke, Yoon K" uniqKey="Loke Y" first="Yoon K" last="Loke">Yoon K. Loke</name><affiliation><nlm:aff id="aff18">Norwich Medical School, University of East Anglia, Norwich NR4 7TJ, UK</nlm:aff></affiliation></author><author><name sortKey="Pigott, Theresa D" sort="Pigott, Theresa D" uniqKey="Pigott T" first="Theresa D" last="Pigott">Theresa D. Pigott</name><affiliation><nlm:aff id="aff19">School of Education, Loyola University Chicago, Chicago, IL 60611, USA</nlm:aff></affiliation></author><author><name sortKey="Ramsay, Craig R" sort="Ramsay, Craig R" uniqKey="Ramsay C" first="Craig R" last="Ramsay">Craig R. Ramsay</name><affiliation><nlm:aff id="aff20">Health Services Research Unit, University of Aberdeen, Aberdeen, AB25 2ZD, UK.</nlm:aff></affiliation></author><author><name sortKey="Regidor, Deborah" sort="Regidor, Deborah" uniqKey="Regidor D" first="Deborah" last="Regidor">Deborah Regidor</name><affiliation><nlm:aff id="aff21">Evidence Services, Kaiser Permanente, Care Management Institute, Oakland, CA 94612, USA</nlm:aff></affiliation></author><author><name sortKey="Rothstein, Hannah R" sort="Rothstein, Hannah R" uniqKey="Rothstein H" first="Hannah R" last="Rothstein">Hannah R. Rothstein</name><affiliation><nlm:aff id="aff22">Department of Management, Zicklin School of Business, Baruch College—CUNY, New York, NY 10010, USA</nlm:aff></affiliation></author><author><name sortKey="Sandhu, Lakhbir" sort="Sandhu, Lakhbir" uniqKey="Sandhu L" first="Lakhbir" last="Sandhu">Lakhbir Sandhu</name><affiliation><nlm:aff id="aff23">Division of General Surgery, University of Toronto, Toronto, Canada</nlm:aff></affiliation></author><author><name sortKey="Santaguida, Pasqualina L" sort="Santaguida, Pasqualina L" uniqKey="Santaguida P" first="Pasqualina L" last="Santaguida">Pasqualina L. Santaguida</name><affiliation><nlm:aff id="aff24">Department of Clinical Epidemiology and Biostatistics, McMaster University, Hamilton, Ontario, L8S 4K1, Canada</nlm:aff></affiliation></author><author><name sortKey="Schunemann, Holger J" sort="Schunemann, Holger J" uniqKey="Schunemann H" first="Holger J" last="Schünemann">Holger J. Schünemann</name><affiliation><nlm:aff id="aff25">Departments of Clinical Epidemiology and Biostatistics and of Medicine, Cochrane Applicability and Recommendations Methods (GRADEing) Group, MacGRADE center, Ontario, L8N 4K1, Canada</nlm:aff></affiliation></author><author><name sortKey="Shea, Beverly" sort="Shea, Beverly" uniqKey="Shea B" first="Beverly" last="Shea">Beverly Shea</name><affiliation><nlm:aff id="aff26">Ottawa Hospital Research Institute, Center for Practice Changing Research and School of Epidemiology, Public Health and Preventive Medicine, Faculty of Medicine, University of Ottawa, Ottawa, Ontario, K1H 8M5, Canada</nlm:aff></affiliation></author><author><name sortKey="Shrier, Ian" sort="Shrier, Ian" uniqKey="Shrier I" first="Ian" last="Shrier">Ian Shrier</name><affiliation><nlm:aff id="aff27">Centre for Clinical Epidemiology, Lady Davis Institute, Jewish General Hospital, McGill University, Montreal, Quebec, Canada</nlm:aff></affiliation></author><author><name sortKey="Tugwell, Peter" sort="Tugwell, Peter" uniqKey="Tugwell P" first="Peter" last="Tugwell">Peter Tugwell</name><affiliation><nlm:aff id="aff28">Department of Medicine and School of Epidemiology, Public Health and Preventive Medicine, University of Ottawa, Ottawa, Ontario, Canada</nlm:aff></affiliation></author><author><name sortKey="Turner, Lucy" sort="Turner, Lucy" uniqKey="Turner L" first="Lucy" last="Turner">Lucy Turner</name><affiliation><nlm:aff id="aff29">Ottawa Hospital Research Institute, Ottawa, ON, Canada</nlm:aff></affiliation></author><author><name sortKey="Valentine, Jeffrey C" sort="Valentine, Jeffrey C" uniqKey="Valentine J" first="Jeffrey C" last="Valentine">Jeffrey C. Valentine</name><affiliation><nlm:aff id="aff30">University of Louisville, Louisville, KY 40292, USA</nlm:aff></affiliation></author><author><name sortKey="Waddington, Hugh" sort="Waddington, Hugh" uniqKey="Waddington H" first="Hugh" last="Waddington">Hugh Waddington</name><affiliation><nlm:aff id="aff31">International Initiative for Impact Evaluation, London School of Hygiene and Tropical Medicine, and London International Development Centre, London, UK</nlm:aff></affiliation></author><author><name sortKey="Waters, Elizabeth" sort="Waters, Elizabeth" uniqKey="Waters E" first="Elizabeth" last="Waters">Elizabeth Waters</name><affiliation><nlm:aff id="aff32">Jack Brockhoff Child Health & Wellbeing Program, Melbourne School of Population and Global Health, University of Melbourne, Melbourne, VIC 3010, Australia</nlm:aff></affiliation></author><author><name sortKey="Wells, George A" sort="Wells, George A" uniqKey="Wells G" first="George A" last="Wells">George A. Wells</name><affiliation><nlm:aff id="aff33">School of Epidemiology, Public Health and Preventive Medicine and Director, Cardiovascular Research Methods Centre, University of Ottawa Heart Institute, Ottawa, Ontario, K1Y 4W7, Canada</nlm:aff></affiliation></author><author><name sortKey="Whiting, Penny F" sort="Whiting, Penny F" uniqKey="Whiting P" first="Penny F" last="Whiting">Penny F. Whiting</name><affiliation><nlm:aff id="aff34">School of Social and Community Medicine, University of Bristol, Bristol BS8 2PS, UK; and National Institute for Health Research Collaboration for Leadership in Applied Health Research and Care West (NIHR CLAHRC West) at University Hospitals Bristol NHS Foundation Trust, Bristol BS1 2NT, UK</nlm:aff></affiliation></author><author><name sortKey="Higgins, Julian Pt" sort="Higgins, Julian Pt" uniqKey="Higgins J" first="Julian Pt" last="Higgins">Julian Pt Higgins</name><affiliation><nlm:aff id="aff35">School of Social and Community Medicine, University of Bristol, Bristol BS8 2PS, UK</nlm:aff></affiliation></author></analytic><series><title level="j">The BMJ</title><idno type="ISSN">0959-8138</idno><idno type="eISSN">1756-1833</idno><imprint><date when="2016">2016</date></imprint></series></biblStruct></sourceDesc></fileDesc><profileDesc><textClass></textClass></profileDesc></teiHeader><front><div type="abstract" xml:lang="en"><p>Non-randomised studies of the effects of interventions are critical to many areas of healthcare evaluation, but their results may be biased. It is therefore important to understand and appraise their strengths and weaknesses. We developed ROBINS-I (“Risk Of Bias In Non-randomised Studies - of Interventions”), a new tool for evaluating risk of bias in estimates of the comparative effectiveness (harm or benefit) of interventions from studies that did not use randomisation to allocate units (individuals or clusters of individuals) to comparison groups. The tool will be particularly useful to those undertaking systematic reviews that include non-randomised studies.</p></div></front><back><div1 type="bibliography"><listBibl><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct></listBibl></div1></back></TEI><pmc article-type="other"><pmc-dir>properties open_access</pmc-dir>
<front><journal-meta><journal-id journal-id-type="nlm-ta">BMJ</journal-id><journal-id journal-id-type="iso-abbrev">BMJ</journal-id><journal-id journal-id-type="publisher-id">bmj</journal-id><journal-title-group><journal-title>The BMJ</journal-title></journal-title-group><issn pub-type="ppub">0959-8138</issn><issn pub-type="epub">1756-1833</issn><publisher><publisher-name>BMJ Publishing Group Ltd.</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="pmid">27733354</article-id><article-id pub-id-type="pmc">5062054</article-id><article-id pub-id-type="publisher-id">stej032658</article-id><article-id pub-id-type="doi">10.1136/bmj.i4919</article-id><article-categories><subj-group subj-group-type="heading"><subject>Research Methods & Reporting</subject></subj-group></article-categories><title-group><article-title>ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions</article-title></title-group><contrib-group><contrib contrib-type="author" corresp="yes"><name><surname>Sterne</surname><given-names>Jonathan AC</given-names></name><role>professor</role><xref ref-type="aff" rid="aff1">1</xref></contrib><contrib contrib-type="author"><name><surname>Hernán</surname><given-names>Miguel A</given-names></name><role>professor</role><xref ref-type="aff" rid="aff2">2</xref></contrib><contrib contrib-type="author"><name><surname>Reeves</surname><given-names>Barnaby C</given-names></name><role>professorial research fellow</role><xref ref-type="aff" rid="aff3">3</xref></contrib><contrib contrib-type="author"><name><surname>Savović</surname><given-names>Jelena</given-names></name><role>research fellow</role><xref ref-type="aff" rid="aff1">1 </xref><xref ref-type="aff" rid="aff4">4</xref></contrib><contrib contrib-type="author"><name><surname>Berkman</surname><given-names>Nancy D</given-names></name><role>senior health policy research analyst</role><xref ref-type="aff" rid="aff5">5</xref></contrib><contrib contrib-type="author"><name><surname>Viswanathan</surname><given-names>Meera</given-names></name><role>director</role><xref ref-type="aff" rid="aff6">6</xref></contrib><contrib contrib-type="author"><name><surname>Henry</surname><given-names>David</given-names></name><role>professor</role><xref ref-type="aff" rid="aff7">7</xref></contrib><contrib contrib-type="author"><name><surname>Altman</surname><given-names>Douglas G</given-names></name><role>professor</role><xref ref-type="aff" rid="aff8">8</xref></contrib><contrib contrib-type="author"><name><surname>Ansari</surname><given-names>Mohammed T</given-names></name><role>adjunct professor</role><xref ref-type="aff" rid="aff9">9</xref></contrib><contrib contrib-type="author"><name><surname>Boutron</surname><given-names>Isabelle</given-names></name><role>professor</role><xref ref-type="aff" rid="aff10">10</xref></contrib><contrib contrib-type="author"><name><surname>Carpenter</surname><given-names>James R</given-names></name><role>professor</role><xref ref-type="aff" rid="aff11">11</xref></contrib><contrib contrib-type="author"><name><surname>Chan</surname><given-names>An-Wen</given-names></name><role>Phelan scientist</role><xref ref-type="aff" rid="aff12">12</xref></contrib><contrib contrib-type="author"><name><surname>Churchill</surname><given-names>Rachel</given-names></name><role>professor</role><xref ref-type="aff" rid="aff13">13</xref></contrib><contrib contrib-type="author"><name><surname>Deeks</surname><given-names>Jonathan J</given-names></name><role>professor</role><xref ref-type="aff" rid="aff14">14</xref></contrib><contrib contrib-type="author"><name><surname>Hróbjartsson</surname><given-names>Asbjørn</given-names></name><role>professor</role><xref ref-type="aff" rid="aff15">15</xref></contrib><contrib contrib-type="author"><name><surname>Kirkham</surname><given-names>Jamie</given-names></name><role>lecturer</role><xref ref-type="aff" rid="aff16">16</xref></contrib><contrib contrib-type="author"><name><surname>Jüni</surname><given-names>Peter</given-names></name><role>professor</role><xref ref-type="aff" rid="aff17">17</xref></contrib><contrib contrib-type="author"><name><surname>Loke</surname><given-names>Yoon K</given-names></name><role>professor</role><xref ref-type="aff" rid="aff18">18</xref></contrib><contrib contrib-type="author"><name><surname>Pigott</surname><given-names>Theresa D</given-names></name><role>professor</role><xref ref-type="aff" rid="aff19">19</xref></contrib><contrib contrib-type="author"><name><surname>Ramsay</surname><given-names>Craig R</given-names></name><role>professor</role><xref ref-type="aff" rid="aff20">20</xref></contrib><contrib contrib-type="author"><name><surname>Regidor</surname><given-names>Deborah</given-names></name><role>senior consultant</role><xref ref-type="aff" rid="aff21">21</xref></contrib><contrib contrib-type="author"><name><surname>Rothstein</surname><given-names>Hannah R</given-names></name><role>professor</role><xref ref-type="aff" rid="aff22">22</xref></contrib><contrib contrib-type="author"><name><surname>Sandhu</surname><given-names>Lakhbir</given-names></name><role>resident</role><xref ref-type="aff" rid="aff23">23</xref></contrib><contrib contrib-type="author"><name><surname>Santaguida</surname><given-names>Pasqualina L</given-names></name><role>assistant professor</role><xref ref-type="aff" rid="aff24">24</xref></contrib><contrib contrib-type="author"><name><surname>Schünemann</surname><given-names>Holger J</given-names></name><role>professor</role><xref ref-type="aff" rid="aff25">25</xref></contrib><contrib contrib-type="author"><name><surname>Shea</surname><given-names>Beverly</given-names></name><xref ref-type="aff" rid="aff26">26</xref></contrib><contrib contrib-type="author"><name><surname>Shrier</surname><given-names>Ian</given-names></name><role>investigator</role><xref ref-type="aff" rid="aff27">27</xref></contrib><contrib contrib-type="author"><name><surname>Tugwell</surname><given-names>Peter</given-names></name><role>professor</role><xref ref-type="aff" rid="aff28">28</xref></contrib><contrib contrib-type="author"><name><surname>Turner</surname><given-names>Lucy</given-names></name><role>senior research associate</role><xref ref-type="aff" rid="aff29">29</xref></contrib><contrib contrib-type="author"><name><surname>Valentine</surname><given-names>Jeffrey C</given-names></name><role>associate professor</role><xref ref-type="aff" rid="aff30">30</xref></contrib><contrib contrib-type="author"><name><surname>Waddington</surname><given-names>Hugh</given-names></name><role>lecturer</role><xref ref-type="aff" rid="aff31">31</xref></contrib><contrib contrib-type="author"><name><surname>Waters</surname><given-names>Elizabeth</given-names></name><role>professor (deceased 2015)</role><xref ref-type="aff" rid="aff32">32</xref></contrib><contrib contrib-type="author"><name><surname>Wells</surname><given-names>George A</given-names></name><role>professor</role><xref ref-type="aff" rid="aff33">33</xref></contrib><contrib contrib-type="author"><name><surname>Whiting</surname><given-names>Penny F</given-names></name><role>senior research fellow</role><xref ref-type="aff" rid="aff34">34</xref></contrib><contrib contrib-type="author"><name><surname>Higgins</surname><given-names>Julian PT</given-names></name><role>professor</role><xref ref-type="aff" rid="aff35">35</xref></contrib><aff id="aff1"><label>1</label>School of Social and Community Medicine, University of Bristol, Bristol BS8 2PS, UK</aff><aff id="aff2"><label>2</label>Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, Massachusetts, USA; and Department of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, Massachusetts, USA; and Harvard-Massachusetts Institute of Technology Division of Health Sciences and Technology, Boston, Massachusetts, USA</aff><aff id="aff3"><label>3</label>School of Clinical Sciences, University of Bristol, Bristol, BS2 8HW, UK</aff><aff id="aff4"><label>4</label>National Institute for Health Research Collaboration for Leadership in Applied Health Research and Care West (NIHR CLAHRC West) at University Hospitals Bristol NHS Foundation Trust, Bristol BS1 2NT, UK</aff><aff id="aff5"><label>5</label>Program on Health Care Quality and Outcomes, Division of Health Services and Social Policy Research, RTI International, Research Triangle Park, NC 27709, USA</aff><aff id="aff6"><label>6</label>RTI-UNC Evidence-based Practice Center, RTI International, Research Triangle Park, NC 27709, USA</aff><aff id="aff7"><label>7</label>Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada</aff><aff id="aff8"><label>8</label>Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology & Musculoskeletal Sciences, University of Oxford, Oxford OX3 7LD, UK</aff><aff id="aff9"><label>9</label>School of Epidemiology, Public Health and Preventive Medicine, Faculty of Medicine, University of Ottawa, Ottawa, Ontario, K1H 8M5, Canada</aff><aff id="aff10"><label>10</label>METHODS Team, Centre of Epidemiology and Statistics Sorbonne Paris Cité Research, INSERM UMR 1153, University Paris Descartes, Paris, France</aff><aff id="aff11"><label>11</label>Department of Medical Statistics, London School of Hygiene and Tropical Medicine and MRC Clinical Trials Unit at UCL, London, UK</aff><aff id="aff12"><label>12</label>Women's College Research Institute, Department of Medicine, University of Toronto, Canada</aff><aff id="aff13"><label>13</label>Centre for Reviews and Dissemination, University of York, York, YO10 5DD, UK</aff><aff id="aff14"><label>14</label>Institute of Applied Health Research, University of Birmingham, Birmingham B15 2TT, UK</aff><aff id="aff15"><label>15</label>Center for Evidence-Based Medicine, University of Southern Denmark & Odense University Hospital, 5000 Odense C, Denmark</aff><aff id="aff16"><label>16</label>Department of Biostatistics, University of Liverpool, Liverpool, L69 3GL, UK</aff><aff id="aff17"><label>17</label>Applied Health Research Centre (AHRC), Li Ka Shing Knowledge Institute of St Michael’s Hospital, and Department of Medicine, University of Toronto, Toronto, Ontario, Canada</aff><aff id="aff18"><label>18</label>Norwich Medical School, University of East Anglia, Norwich NR4 7TJ, UK</aff><aff id="aff19"><label>19</label>School of Education, Loyola University Chicago, Chicago, IL 60611, USA</aff><aff id="aff20"><label>20</label>Health Services Research Unit, University of Aberdeen, Aberdeen, AB25 2ZD, UK.</aff><aff id="aff21"><label>21</label>Evidence Services, Kaiser Permanente, Care Management Institute, Oakland, CA 94612, USA</aff><aff id="aff22"><label>22</label>Department of Management, Zicklin School of Business, Baruch College—CUNY, New York, NY 10010, USA</aff><aff id="aff23"><label>23</label>Division of General Surgery, University of Toronto, Toronto, Canada</aff><aff id="aff24"><label>24</label>Department of Clinical Epidemiology and Biostatistics, McMaster University, Hamilton, Ontario, L8S 4K1, Canada</aff><aff id="aff25"><label>25</label>Departments of Clinical Epidemiology and Biostatistics and of Medicine, Cochrane Applicability and Recommendations Methods (GRADEing) Group, MacGRADE center, Ontario, L8N 4K1, Canada</aff><aff id="aff26"><label>26</label>Ottawa Hospital Research Institute, Center for Practice Changing Research and School of Epidemiology, Public Health and Preventive Medicine, Faculty of Medicine, University of Ottawa, Ottawa, Ontario, K1H 8M5, Canada</aff><aff id="aff27"><label>27</label>Centre for Clinical Epidemiology, Lady Davis Institute, Jewish General Hospital, McGill University, Montreal, Quebec, Canada</aff><aff id="aff28"><label>28</label>Department of Medicine and School of Epidemiology, Public Health and Preventive Medicine, University of Ottawa, Ottawa, Ontario, Canada</aff><aff id="aff29"><label>29</label>Ottawa Hospital Research Institute, Ottawa, ON, Canada</aff><aff id="aff30"><label>30</label>University of Louisville, Louisville, KY 40292, USA</aff><aff id="aff31"><label>31</label>International Initiative for Impact Evaluation, London School of Hygiene and Tropical Medicine, and London International Development Centre, London, UK</aff><aff id="aff32"><label>32</label>Jack Brockhoff Child Health & Wellbeing Program, Melbourne School of Population and Global Health, University of Melbourne, Melbourne, VIC 3010, Australia</aff><aff id="aff33"><label>33</label>School of Epidemiology, Public Health and Preventive Medicine and Director, Cardiovascular Research Methods Centre, University of Ottawa Heart Institute, Ottawa, Ontario, K1Y 4W7, Canada</aff><aff id="aff34"><label>34</label>School of Social and Community Medicine, University of Bristol, Bristol BS8 2PS, UK; and National Institute for Health Research Collaboration for Leadership in Applied Health Research and Care West (NIHR CLAHRC West) at University Hospitals Bristol NHS Foundation Trust, Bristol BS1 2NT, UK</aff><aff id="aff35"><label>35</label>School of Social and Community Medicine, University of Bristol, Bristol BS8 2PS, UK</aff></contrib-group><author-notes><corresp id="cor1">Correspondence to: J A C Sterne <email xlink:href="jonathan.sterne@bristol.ac.uk">jonathan.sterne@bristol.ac.uk</email></corresp></author-notes><pub-date pub-type="collection"><year>2016</year></pub-date><pub-date pub-type="epub"><day>12</day><month>10</month><year>2016</year></pub-date><volume>355</volume><elocation-id>i4919</elocation-id><permissions><copyright-statement>Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to <ext-link ext-link-type="uri" xlink:href="http://group.bmj.com/group/rights-licensing/permissions">http://group.bmj.com/group/rights-licensing/permissions</ext-link></copyright-statement><copyright-year>2016</copyright-year><copyright-holder>BMJ</copyright-holder><license license-type="open-access"><license-p>This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 3.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: <ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/licenses/by-nc/3.0/">http://creativecommons.org/licenses/by-nc/3.0/</ext-link>.</license-p></license></permissions><self-uri xlink:title="pdf" xlink:type="simple" xlink:href="bmj.i4919_default.pdf"></self-uri><abstract abstract-type="teaser"><p>Non-randomised studies of the effects of interventions are critical to many areas of healthcare evaluation, but their results may be biased. It is therefore important to understand and appraise their strengths and weaknesses. We developed ROBINS-I (“Risk Of Bias In Non-randomised Studies - of Interventions”), a new tool for evaluating risk of bias in estimates of the comparative effectiveness (harm or benefit) of interventions from studies that did not use randomisation to allocate units (individuals or clusters of individuals) to comparison groups. The tool will be particularly useful to those undertaking systematic reviews that include non-randomised studies.</p></abstract></article-meta></front><body><boxed-text position="float" id="boxa"><sec><title>Summary points</title><list list-type="bullet" id="L1"><list-item><p>Non-randomised studies of the effects of interventions are critical to many areas of healthcare evaluation but are subject to confounding and a range of other potential biases</p></list-item><list-item><p>We developed, piloted, and refined a new tool, ROBINS-I, to assess “Risk Of Bias In Non-randomised Studies - of Interventions”</p></list-item><list-item><p>The tool views each study as an attempt to emulate (mimic) a hypothetical pragmatic randomised trial, and covers seven distinct domains through which bias might be introduced</p></list-item><list-item><p>We use “signalling questions” to help users of ROBINS-I to judge risk of bias within each domain</p></list-item><list-item><p>The judgements within each domain carry forward to an overall risk of bias judgement across bias domains for the outcome being assessed</p></list-item></list></sec></boxed-text><p>Non-randomised studies of the effects of interventions (NRSI) are critical to many areas of healthcare evaluation. Designs of NRSI that can be used to evaluate the effects of interventions include observational studies such as cohort studies and case-control studies in which intervention groups are allocated during the course of usual treatment decisions, and quasi-randomised studies in which the method of allocation falls short of full randomisation. Non-randomised studies can provide evidence additional to that available from randomised trials about long term outcomes, rare events, adverse effects and populations that are typical of real world practice.<xref rid="ref1" ref-type="bibr">1</xref><xref rid="ref2" ref-type="bibr">2</xref> The availability of linked databases and compilations of electronic health records has enabled NRSI to be conducted in large representative population cohorts.<xref rid="ref3" ref-type="bibr">3</xref> For many types of organisational or public health interventions, NRSI are the main source of evidence about the likely impact of the intervention because randomised trials are difficult or impossible to conduct on an area-wide basis. Therefore systematic reviews addressing the effects of health related interventions often include NRSI. It is essential that methods are available to evaluate these studies, so that clinical, policy, and individual decisions are transparent and based on a full understanding of the strengths and weaknesses of the evidence.</p><p>Many tools to assess the methodological quality of observational studies in the context of a systematic review have been proposed.<xref rid="ref4" ref-type="bibr">4</xref><xref rid="ref5" ref-type="bibr">5</xref> The Newcastle-Ottawa<xref rid="ref6" ref-type="bibr">6</xref> and Downs-Black<xref rid="ref7" ref-type="bibr">7</xref> tools have been two of the most popular: both were on a shortlist of methodologically sound tools,<xref rid="ref5" ref-type="bibr">5</xref> but each includes items relating to external as well as internal validity and a lack of comprehensive manuals means that instructions may be interpreted differently by different users.<xref rid="ref5" ref-type="bibr">5</xref></p><p>In the past decade, major developments have been made in tools to assess study validity. A shift in focus from methodological quality to risk of bias has been accompanied by a move from checklists and numeric scores towards domain-based assessments in which different types of bias are considered in turn. Examples are the Cochrane Risk of Bias tool for randomised trials,<xref rid="ref8" ref-type="bibr">8</xref> the QUADAS 2 tool for diagnostic test accuracy studies,<xref rid="ref9" ref-type="bibr">9</xref> and the ROBIS tool for systematic reviews.<xref rid="ref10" ref-type="bibr">10</xref> However, there is no satisfactory domain-based assessment tool for NRSI.<xref rid="ref4" ref-type="bibr">4</xref></p><p>In this paper we describe the development of ROBINS-I (“Risk Of Bias In Non-randomised Studies - of Interventions”), which is concerned with evaluating risk of bias in estimates of the effectiveness or safety (benefit or harm) of an intervention from studies that did not use randomisation to allocate interventions.</p><sec><title>Development of a new tool</title><p>We developed the tool over three years, largely by expert consensus, and following the seven principles we previously described for assessing risk of bias in clinical trials.<xref rid="ref8" ref-type="bibr">8</xref> A core group coordinated development of the tool, including recruitment of collaborators, preparation and revision of documents, and administrative support. An initial scoping meeting in October 2011 was followed by a survey of Cochrane Review Groups in March 2012 to gather information about the methods they were using to assess risk of bias in NRSI. A meeting in April 2012 identified the relevant bias domains and established working groups focusing on each of these. We agreed at this stage to use the approach previously adopted in the QUADAS-2 tool, in which answers to “signalling questions” help reviewers judge the risk of bias within each domain.<xref rid="ref9" ref-type="bibr">9</xref> We distributed briefing documents to working groups in June 2012, specifying considerations for how signalling questions should be formulated and how answers to these would lead to a risk of bias judgement. We also identified methodological issues that would underpin the new tool: these are described below.</p><p>After collation and harmonisation by the core group of the working groups’ contributions, all collaborators considered draft signalling questions and agreed on the main features of the new tool during a two-day face-to-face meeting in March 2013. A preliminary version of the tool was piloted within the working groups between September 2013 and March 2014, using NRSI in several review topic areas. Substantial revisions, based on results of the piloting, were agreed by leads of working groups in June 2014. Further piloting took place, along with a series of telephone interviews with people using the tool for the first time that explored whether they were interpreting the tool and the guidance as intended. We posted version 1.0.0, along with detailed guidance, at <ext-link ext-link-type="uri" xlink:href="http://www.riskofbias.info">www.riskofbias.info</ext-link> in September 2014. We explained the tool during a three-day workshop involving members of Cochrane Review Groups in December 2014, and applied it in small groups to six papers reporting NRSI. Further modifications to the tool, particularly regarding wording, were based on feedback from this event and from subsequent training events conducted during 2015.</p></sec><sec><title>Methodological issues in assessing risk of bias in non-randomised studies</title><sec><title>The target trial</title><p>Evaluations of risk of bias in the results of NRSI are facilitated by considering each NRSI as an attempt to emulate (mimic) a “target” trial. This is the hypothetical pragmatic randomised trial, conducted on the same participant group and without features putting it at risk of bias, whose results would answer the question addressed by the NRSI.<xref rid="ref11" ref-type="bibr">11</xref><xref rid="ref12" ref-type="bibr">12</xref> Such a “target” trial need not be feasible or ethical: for example, it could compare individuals who were and were not assigned to start smoking. Description of the target trial for the NRSI being assessed includes details of the population, experimental intervention, comparator, and outcomes of interest. Correspondingly, we define bias as a systematic difference between the results of the NRSI and the results expected from the target trial. Such bias is distinct from issues of generalisability (applicability or transportability) to types of individuals who were not included in the study.</p></sec><sec><title>The effect of interest</title><p>In the target trial, the effect of interest will typically be that of either:</p><list list-type="order" id="L2"><list-item><p>Assignment to intervention at baseline (start of follow up), regardless of the extent to which the intervention was received during the follow-up (sometimes referred to as the “intention-to-treat” effect)</p></list-item><list-item><p>Starting and adhering to the intervention as indicated in the trial protocol (sometimes referred to as the “per-protocol” effect).</p></list-item></list><p>For example, in a trial of cancer screening, our interest might be in the effect of either sending an invitation to attend screening or of responding to the invitation and undergoing screening.</p><p>Analogues of these effects can be defined for NRSI. For example, the intention-to-treat effect in a study comparing aspirin with no aspirin can be approximated by the effect of being prescribed aspirin or (if using dispensing rather than prescription data) the effect of starting aspirin (this corresponds to the intention-to-treat effect in a trial in which participants assigned to an intervention always start that intervention). Alternatively, we might be interested in the effect of starting and adhering to aspirin.</p><p>The type of effect of interest influences assessments of risk of bias related to deviations from intervention. When the effect of interest is that of assignment to (or starting) intervention, risk of bias assessments generally need not be concerned with post-baseline deviations from interventions.<xref rid="ref13" ref-type="bibr">13</xref> By contrast, unbiased estimation of the effect of starting and adhering to intervention requires consideration of both adherence and differences in additional interventions (“co-interventions”) between intervention groups.</p></sec><sec><title>Domains of bias</title><p>We achieved consensus on seven domains through which bias might be introduced into a NRSI (see table 1<xref ref-type="table" rid="tbl1"></xref> and appendix in supplementary data). The first two domains, covering confounding and selection of participants into the study, address issues before the start of the interventions that are to be compared (“baseline”). The third domain addresses classification of the interventions themselves. The other four domains address issues after the start of interventions: biases due to deviations from intended interventions, missing data, measurement of outcomes, and selection of the reported result.</p><table-wrap id="tbl1" position="float"><label>Table 1</label><caption><p>Bias domains included in ROBINS-I</p></caption><table frame="hsides" rules="groups"><thead><tr><th valign="top" align="left" scope="col" colspan="1" rowspan="1">Domain</th><th valign="top" align="center" scope="col" colspan="1" rowspan="1">Explanation</th></tr></thead><tbody><tr><td valign="top" align="left" scope="row" colspan="1" rowspan="1"><bold>Pre-intervention</bold></td><td valign="top" align="center" colspan="1" rowspan="1"><bold>Risk of bias assessment is mainly distinct from assessments of randomised trials</bold></td></tr><tr><td valign="top" align="left" scope="row" colspan="1" rowspan="1">Bias due to confounding</td><td valign="top" align="left" colspan="1" rowspan="1">Baseline confounding occurs when one or more prognostic variables (factors that predict the outcome of interest) also predicts the intervention received at baseline<break></break>ROBINS-I can also address time-varying confounding, which occurs when individuals switch between the interventions being compared and when post-baseline prognostic factors affect the intervention received after baseline</td></tr><tr><td valign="top" align="left" scope="row" colspan="1" rowspan="1">Bias in selection of participants into the study</td><td valign="top" align="left" colspan="1" rowspan="1">When exclusion of some eligible participants, or the initial follow-up time of some participants, or some outcome events is related to both intervention and outcome, there will be an association between interventions and outcome even if the effects of the interventions are identical<break></break>This form of selection bias is distinct from confounding—A specific example is bias due to the inclusion of prevalent users, rather than new users, of an intervention</td></tr><tr><td valign="top" align="left" scope="row" colspan="1" rowspan="1"><bold>At intervention</bold></td><td valign="top" align="center" colspan="1" rowspan="1"><bold>Risk of bias assessment is mainly distinct from assessments of randomised trials</bold></td></tr><tr><td valign="top" align="left" scope="row" colspan="1" rowspan="1">Bias in classification of interventions</td><td valign="top" align="left" colspan="1" rowspan="1">Bias introduced by either differential or non-differential misclassification of intervention status<break></break>Non-differential misclassification is unrelated to the outcome and will usually bias the estimated effect of intervention towards the null<break></break>Differential misclassification occurs when misclassification of intervention status is related to the outcome or the risk of the outcome, and is likely to lead to bias</td></tr><tr><td valign="top" align="left" scope="row" colspan="1" rowspan="1"><bold>Post-intervention</bold></td><td valign="top" align="center" colspan="1" rowspan="1"><bold>Risk of bias assessment has substantial overlap with assessments of randomised trials</bold></td></tr><tr><td valign="top" align="left" scope="row" colspan="1" rowspan="1">Bias due to deviations from intended interventions</td><td valign="top" align="left" colspan="1" rowspan="1">Bias that arises when there are systematic differences between experimental intervention and comparator groups in the care provided, which represent a deviation from the intended intervention(s)<break></break>Assessment of bias in this domain will depend on the type of effect of interest (either the effect of assignment to intervention or the effect of starting and adhering to intervention).</td></tr><tr><td valign="top" align="left" scope="row" colspan="1" rowspan="1">Bias due to missing data</td><td valign="top" align="left" colspan="1" rowspan="1">Bias that arises when later follow-up is missing for individuals initially included and followed (such as differential loss to follow-up that is affected by prognostic factors); bias due to exclusion of individuals with missing information about intervention status or other variables such as confounders</td></tr><tr><td valign="top" align="left" scope="row" colspan="1" rowspan="1">Bias in measurement of outcomes</td><td valign="top" align="left" colspan="1" rowspan="1">Bias introduced by either differential or non-differential errors in measurement of outcome data. Such bias can arise when outcome assessors are aware of intervention status, if different methods are used to assess outcomes in different intervention groups, or if measurement errors are related to intervention status or effects</td></tr><tr><td valign="top" align="left" scope="row" colspan="1" rowspan="1">Bias in selection of the reported result</td><td valign="top" align="left" colspan="1" rowspan="1">Selective reporting of results in a way that depends on the findings and prevents the estimate from being included in a meta-analysis (or other synthesis)</td></tr></tbody></table></table-wrap><p>For the first three domains, risk of bias assessments for NRSI are mainly distinct from assessments of randomised trials because randomisation, if properly implemented, protects against biases that arise before the start of intervention. However, randomisation does not protect against biases that arise after the start of intervention. Therefore, there is substantial overlap for the last four domains between bias assessments in NRSI and randomised trials.</p><p>Variation in terminology proved a challenge to development of ROBINS-I. The same terms are sometimes used to refer to different types of bias in randomised trials and NRSI literature,<xref rid="ref13" ref-type="bibr">13</xref> and different types of bias are often described by a host of different terms: those used within ROBINS-I are shown in the first column of table 1<xref ref-type="table" rid="tbl1"></xref>.</p></sec></sec><sec><title>The risk of bias tool, ROBINS-I</title><p>The full ROBINS-I tool is shown in tables A, B, and C in the supplementary data.</p><sec><title>Planning the risk of bias assessment</title><p>It is very important that experts in both subject matter and epidemiological methods are included in any team evaluating a NRSI. The risk of bias assessment should begin with consideration of what problems might arise, in the context of the research question, in making a causal assessment of the effect of the intervention(s) of interest on the basis of NRSI. This will be based on experts’ knowledge of the literature: the team should also address whether conflicts of interest might affect experts’ judgements.</p><p>The research question is conceptualised by defining the population, experimental intervention, comparator, and outcomes of interest (supplementary table A, stage I). The comparator could be “no intervention,” “usual care,” or an alternative intervention. It is important to consider in advance the confounding factors and co-interventions that have the potential to lead to bias. Relevant confounding domains are the prognostic factors that predict whether an individual receives one or the other intervention of interest. Relevant co-interventions are those that individuals might receive with or after starting the intervention of interest and that are both related to the intervention received and prognostic for the outcome of interest. Both confounding domains and co-interventions are likely to be identified through the expert knowledge of members of the review group and through initial (scoping) reviews of the literature. Discussions with health professionals who make intervention decisions for the target patient or population groups may also help in identification of prognostic factors that influence treatment decisions.</p></sec><sec><title>Assessing a specific study</title><p>The assessment of each NRSI included in the review involves following the six steps below (supplementary table A, stage II). Steps 3 to 6 should be repeated for each key outcome of interest:</p><list list-type="order" id="L3"><list-item><p>Specify the research question through consideration of a target trial</p></list-item><list-item><p>Specify the outcome and result being assessed</p></list-item><list-item><p>For the specified result, examine how the confounders and co-interventions were addressed</p></list-item><list-item><p>Answer signalling questions for the seven bias domains</p></list-item><list-item><p>Formulate risk of bias judgements for each of the seven bias domains, informed by answers to the signalling questions</p></list-item><list-item><p>Formulate an overall judgement on risk of bias for the outcome and result being assessed.</p></list-item></list><p>Examination of confounders and co-interventions involves determining whether the important confounders and co-interventions were measured or administered in the study at hand, and whether additional confounders and co-interventions were identified. Supplementary table A provides a structured approach to assessing the potential for bias due to confounding and co-interventions and includes the full tool with the signalling questions to be addressed within each bias domain.</p><p>The signalling questions are broadly factual in nature and aim to facilitate judgements about the risk of bias. The response options are: “Yes”; “Probably yes”; “Probably no”; “No”; and “No information”. Some questions are answered only if the response to a previous question is “Yes” or “Probably yes” (or “No” or “Probably no”). Responses of “Yes” are intended to have similar implications to responses of “Probably yes” (and similarly for “No” and “Probably no”), but allow for a distinction between something that is known and something that is likely to be the case. Free text should be used to provide support for each answer, using direct quotations from the text of the study where possible.</p><p>Responses to signalling questions provide the basis for domain-level judgements about risk of bias, which then provide the basis for an overall risk of bias judgement for a particular outcome. The use of the word “judgement” to describe this process is important and reflects the need for review authors to consider both the severity of the bias in a particular domain and the relative consequences of bias in different domains.</p><p>The categories for risk of bias judgements are “Low risk”, “Moderate risk”, “Serious risk” and “Critical risk” of bias. Importantly, “Low risk” corresponds to the risk of bias in a high quality randomised trial. Only exceptionally will an NRSI be assessed as at low risk of bias due to confounding. Criteria for reaching risk of bias judgements for the seven domains are provided in supplementary tables B and C. If none of the answers to the signalling questions for a domain suggests a potential problem then risk of bias for the domain can be judged to be low. Otherwise, potential for bias exists. Review authors must then make a judgement on the extent to which the results of the study are at risk of bias. “Risk of bias” is to be interpreted as “risk of material bias”. That is, concerns should be expressed only about issues that are likely to affect the ability to draw valid conclusions from the study: a serious risk of a very small degree of bias should not be considered “Serious risk” of bias. The “No information” category should be used only when insufficient data are reported to permit a judgement.</p><p>The judgements within each domain carry forward to an overall risk of bias judgement for the outcome being assessed (across bias domains, that is), as summarised in table 2<xref ref-type="table" rid="tbl2"></xref> (also saved as supplementary table D). The key to applying the tool is to make domain-level judgements about risk of bias that have the same meaning across domains with respect to concern about the impact of bias on the trustworthiness of the result. If domain-level judgements are made consistently, then judging the overall risk of bias for a particular outcome is relatively straightforward. For instance, a “Serious risk” of bias in one domain means the effect estimate from the study is at serious risk of bias or worse, even if the risk of bias is judged to be lower in the other domains.</p><table-wrap id="tbl2" position="float"><label>Table 2</label><caption><p>Interpretation of domain-level and overall risk of bias judgements in ROBINS-I*</p></caption><table frame="above" rules="groups"><thead><tr><th valign="top" align="left" scope="col" colspan="1" rowspan="1">Judgement</th><th valign="top" align="center" scope="col" colspan="1" rowspan="1">Within each domain</th><th valign="top" align="center" scope="col" colspan="1" rowspan="1">Across domains</th><th valign="top" align="center" scope="col" colspan="1" rowspan="1">Criterion</th></tr></thead><tbody><tr><td valign="top" align="left" scope="row" colspan="1" rowspan="1">Low risk of bias</td><td valign="top" align="left" colspan="1" rowspan="1">The study is comparable to a well performed randomised trial with regard to this domain</td><td valign="top" align="left" colspan="1" rowspan="1">The study is comparable to a well performed randomised trial</td><td valign="top" align="left" colspan="1" rowspan="1">The study is judged to be at <bold>low risk of bias for all domains</bold></td></tr><tr><td valign="top" align="left" scope="row" colspan="1" rowspan="1">Moderate risk of bias</td><td valign="top" align="left" colspan="1" rowspan="1">The study is sound for a non-randomised study with regard to this domain but cannot be considered comparable to a well performed randomised trial</td><td valign="top" align="left" colspan="1" rowspan="1">The study provides sound evidence for a non-randomised study but cannot be considered comparable to a well performed randomised trial</td><td valign="top" align="left" colspan="1" rowspan="1">The study is judged to be at <bold>low or moderate risk of bias for all domains</bold></td></tr><tr><td valign="top" align="left" scope="row" colspan="1" rowspan="1">Serious risk of bias</td><td valign="top" align="left" colspan="1" rowspan="1">The study has some important problems in this domain</td><td valign="top" align="left" colspan="1" rowspan="1">The study has some important problems</td><td valign="top" align="left" colspan="1" rowspan="1">The study is judged to be at <bold>serious risk of bias</bold> in at least one domain, but not at critical risk of bias in any domain</td></tr><tr><td valign="top" align="left" scope="row" colspan="1" rowspan="1">Critical risk of bias</td><td valign="top" align="left" colspan="1" rowspan="1">The study is too problematic in this domain to provide any useful evidence on the effects of intervention</td><td valign="top" align="left" colspan="1" rowspan="1">The study is too problematic to provide any useful evidence and should not be included in any synthesis</td><td valign="top" align="left" colspan="1" rowspan="1">The study is judged to be at <bold>critical risk of bias in at least one domain</bold></td></tr><tr><td valign="top" align="left" scope="row" colspan="1" rowspan="1">No information</td><td valign="top" align="left" colspan="1" rowspan="1">No information on which to base a judgement about risk of bias for this domain</td><td valign="top" align="left" colspan="1" rowspan="1">No information on which to base a judgement about risk of bias</td><td valign="top" align="left" colspan="1" rowspan="1">There is no clear indication that the study is at serious or critical risk of bias <italic>and</italic> there is a lack of information in one or more key domains of bias (<italic>a judgement is required for this</italic>)</td></tr></tbody></table><table-wrap-foot><p>*Also saved as supplementary table D.</p></table-wrap-foot></table-wrap><p>It would be highly desirable to know the magnitude and direction of any potential biases identified, but this is considerably more challenging than judging the risk of bias. The tool includes an optional component to predict the direction of the bias for each domain, and overall. For some domains, the bias is most easily thought of as being towards or away from the null. For example, suspicion of selective non-reporting of statistically non-significant results would suggest bias against the null. However, for other domains (in particular confounding, selection bias and forms of measurement bias such as differential misclassification), the bias needs to be thought of as an increase or decrease in the effect estimate and not in relation to the null. For example, confounding bias that decreases the effect estimate would be towards the null if the true risk ratio were greater than 1, and away from the null if the risk ratio were less than 1.</p></sec></sec><sec sec-type="discussion"><title>Discussion</title><p>We developed a tool for assessing risk of bias in the results of non-randomised studies of interventions that addresses weaknesses in previously available approaches.<xref rid="ref4" ref-type="bibr">4</xref> Our approach builds on recent developments in risk of bias assessment of randomised trials and diagnostic test accuracy studies.<xref rid="ref8" ref-type="bibr">8</xref><xref rid="ref9" ref-type="bibr">9</xref> Key features of ROBINS-I include specification of the target trial and effect of interest, use of signalling questions to inform judgements of risk of bias, and assessments within seven bias domains.</p><p>The ROBINS-I tool was developed through consensus among a group that included both methodological experts and systematic review authors and editors, and was substantially revised based on extensive piloting and user feedback. It includes a structured approach to assessment of risk of bias due to confounding that starts at the review protocol stage. Use of ROBINS-I requires that review groups include members with substantial methodological expertise and familiarity with modern epidemiological thinking. We tried to make ROBINS-I as accessible and easy to use as possible, given the requirement for comprehensive risk of bias assessments that are applicable to a wide range of study designs and analyses. An illustrative assessment using ROBINS-I can be found at <ext-link ext-link-type="uri" xlink:href="http://www.riskofbias.info">www.riskofbias.info</ext-link>; detailed guidance and further training materials will also be available.</p><p>ROBINS-I separates relatively factual answers to signalling questions from more subjective judgements about risk of bias. We hope that the explicit links between answers to signalling questions and risk of bias judgements will improve reliability of the domain-specific and overall risk of bias assessments.<xref rid="ref14" ref-type="bibr">14</xref> Nonetheless, we expect that the technical difficulty in making risk of bias judgements will limit reliability. Despite this, ROBINS-I provides a comprehensive and structured approach to assessing non-randomised studies of interventions. It should therefore facilitate debates and improve mutual understanding about the ways in which bias can influence effects estimated in NRSI, and clarify reasons for disagreements about specific risk of bias judgements. Note that the tool focuses specifically on bias and does not address problems related to imprecision of results, for example when statistical analyses fail to account for clustering or matching of participants.</p><p>We developed the ROBINS-I tool primarily for use in the context of a systematic review. Broader potential uses include the assessment of funding applications and peer review of journal submissions. Furthermore, ROBINS-I may be used to guide researchers about issues to consider when designing a primary study to evaluate the effect(s) of an intervention.</p><p>Figure 1<xref ref-type="fig" rid="f1"></xref> summarises the process of assessing risk of bias using the tool in the context of a systematic review of NRSI. To draw conclusions about the extent to which observed intervention effects might be causal, the studies included in the review should be compared and contrasted so that their strengths and weaknesses can be considered jointly. Studies with different designs may present different types of bias, and “triangulation” of findings across these studies may provide assurance either that the biases are minimal or that they are real. Syntheses of findings across studies through meta-analysis must consider the risks of bias in the studies available. We recommend against including studies assessed as at “Critical risk” of bias in any meta-analysis, and advocate caution for studies assessed as at “Serious risk” of bias. Subgroup analyses (in which intervention effects are estimated separately according to risk of bias), meta-regression analyses, and sensitivity analyses (excluding studies at higher risk of bias) might be considered, either within specific bias domains or overall. Risk of bias assessments might alternatively be used as the basis for deriving adjustments for bias through prior distributions in Bayesian meta-analyses.<xref rid="ref15" ref-type="bibr">15</xref><xref rid="ref16" ref-type="bibr">16</xref></p><fig id="f1" fig-type="figure" position="float"><caption><p><bold>Fig 1</bold> Summary of the process of assessing risk of bias in a systematic review of non-randomised studies of interventions (NRSI)</p></caption><graphic xlink:href="stej032658.f1_default"></graphic></fig><p>The GRADE system for assessing confidence in estimates of the effects of interventions currently assigns a starting rating of “Low certainty, confidence or quality” to non-randomised studies, a downgrading by default of two levels.<xref rid="ref17" ref-type="bibr">17</xref> ROBINS-I provides a thorough assessment of risk of bias in relation to a hypothetical randomised trial, and “Low risk” of bias corresponds to the risk of bias in a high quality randomised trial. This opens up the possibility of using the risk of bias assessment, rather than the lack of randomisation per se, to determine the degree of downgrading of a study result, and means that results of NRSI and randomised trials could be synthesised if they are assessed to be at similar risks of bias. In general, however, we advocate analysing these study designs separately and focusing on evidence from NRSI when evidence from trials is not available.</p><p>Planned developments of ROBINS-I include further consideration of the extent to which it works for specific types of NRSI, such as self-controlled designs, controlled before-and-after studies, interrupted time series studies, and studies based on regression discontinuity and instrumental variable analyses. We also plan to develop interactive software to facilitate use of ROBINS-I. Furthermore, the discussions that led up to the tool will inform a reconsideration of the tool for randomised trials, particularly in the four post-intervention domains.<xref rid="ref8" ref-type="bibr">8</xref></p><p>The role of NRSI in informing treatment decisions remains controversial. Because randomised trials are expensive, time consuming, and may not reflect real world experience with healthcare interventions, research funders are enthusiastic about the possible use of observational studies to provide evidence about the comparative effectiveness of different interventions,<xref rid="ref18" ref-type="bibr">18</xref> and encourage use of large, routinely collected datasets assembled through data linkage.<xref rid="ref18" ref-type="bibr">18</xref> However, fear that evidence from NRSI may be biased, based on misleading results of some NRSI,<xref rid="ref19" ref-type="bibr">19</xref><xref rid="ref20" ref-type="bibr">20</xref> has led to caution in their use in making judgements about efficacy. There is greater confidence in the capacity of NRSI to quantify uncommon adverse effects of interventions.<xref rid="ref21" ref-type="bibr">21</xref> We believe that evidence from NRSI should complement that from randomised trials, such as in providing evidence about effects on rare and adverse outcomes and long term effects to be balanced against the outcomes more readily addressed in randomised trials.<xref rid="ref22" ref-type="bibr">22</xref></p></sec></body><back><notes notes-type="data-supplement"><label>Web Extra</label><p>Extra material supplied by the author</p><supplementary-material content-type="local-data"><caption><p>Appendix: The seven domains of bias addressed in the ROBINS-I assessment tool</p></caption><media xlink:href="stej032658.w1_default.pdf"><caption><p>Click here for additional data file.</p></caption></media></supplementary-material><supplementary-material content-type="local-data"><caption><p>Supplementary tables. Table A: Risk Of Bias In Non-randomized Studies – of Interventions (ROBINS-I) assessment tool. Table B: Reaching risk of bias judgements in ROBINS-I: pre-intervention and at-intervention domains. Table C: Reaching risk of bias judgements in ROBINS-I: post-intervention domains. Table D: Interpretation of domain-level and overall risk of bias judgements in ROBINS-I</p></caption><media xlink:href="stej032658.wt1_default.pdf"><caption><p>Click here for additional data file.</p></caption></media></supplementary-material></notes><notes><fn-group><fn><p>The ROBINS-I tool is reproduced from riskofbias.info with the permission of the authors. The tool should not be modified for use.</p><p>We thank Professor Jan Vandenbroucke for his contributions to discussions within working groups and during face-to-face meetings. Professor David Moher and Dr Vivan Welch contributed to the grant application and to initial discussions. We thank all those individuals who contributed to development of ROBINS-I through discussions during workshops and training events, and through their work on piloting.</p></fn><fn fn-type="participating-researchers"><p>Contributions of authors: JACS, BCR, JS, LT, YKL, EW, CRR, PT, GAW, and JPTH conceived the project. JACS, JPTH, BCR, JS, and LT oversaw the project. JACS, DH, JPTH, IB, and BRR led working groups. MAH developed the idea of the target trial and its role in ROBINS-I. NDB and MV undertook cognitive testing of previous drafts of the tool. All authors contributed to development of ROBINS-I and to writing associated guidance. JACS, MAH, and JPTH led on drafting the manuscript. All authors reviewed and commented on drafts of the manuscript.</p></fn><fn fn-type="financial-disclosure"><p>Funding: Development of ROBINS-I was funded by a Methods Innovation Fund grant from Cochrane and Medical Research Council (MRC) grant MR/M025209/1. Sterne and Higgins are members of the MRC Integrative Epidemiology Unit at the University of Bristol, which is supported by the MRC and the University of Bristol (grant MC_UU_12013/9). This research was partly funded by NIH grant P01 CA134294. Sterne was supported by National Institute for Health Research (NIHR) Senior Investigator award NF-SI-0611-10168. Savović and Whiting were supported by NIHR Collaboration for Leadership in Applied Health Research and Care West (NIHR CLAHRC West). Reeves was supported by the NIHR Bristol Biomedical Research Unit in Cardiovascular Disease. None of the funders had a role in the development of the ROBINS-I tool, although employees of Cochrane contributed to some of the meetings and workshops. The views expressed are those of the authors and not necessarily those of Cochrane, the NHS, NIHR, or Department of Health.</p></fn><fn fn-type="COI-statement"><p>Competing interests: All authors have completed the ICMJE uniform disclosure form at <ext-link ext-link-type="uri" xlink:href="http://www.icmje.org/coi_disclosure.pdf">http://www.icmje.org/coi_disclosure.pdf</ext-link> and declare: grants from Cochrane, MRC, and NIHR during the conduct of the study. Dr Carpenter reports personal fees from Pfizer, grants and non-financial support from GSK and grants from Novartis, outside the submitted work. Dr Reeves is a co-convenor of the Cochrane Non-Randomised Studies Methods Group. The authors report no other relationships or activities that could appear to have influenced the submitted work.</p></fn><fn fn-type="other"><p>Provenance: The authors are epidemiologists, statisticians, systematic reviewers, trialists, and health services researchers, many of whom are involved with Cochrane systematic reviews, methods groups and training events. Development of ROBINS-I was informed by relevant methodological literature, previously published tools for assessing methodological quality of non-randomised studies, systematic reviews of such tools and relevant literature, and by the authors’ experience of developing tools to assess risk of bias in randomised trials, diagnostic test accuracy studies, and systematic reviews. All authors contributed to development of ROBINS-I and to writing associated guidance. All authors reviewed and commented on drafts of the manuscript. J Sterne will act as guarantor.</p></fn></fn-group></notes><ref-list><ref id="ref1"><label>1</label><mixed-citation publication-type="journal">Black N. Why we need observational studies to evaluate the effectiveness of health care. <source>BMJ</source><year>1996</year>;<volume>312</volume>:<fpage>1215</fpage>-<lpage>8</lpage>. <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1136/bmj.312.7040.1215">doi:10.1136/bmj.312.7040.1215</ext-link> <ext-link ext-link-type="uri" xlink:href="http://www.ncbi.nlm.nih.gov/pubmed/?term=8634569">pmid:8634569</ext-link>.<pub-id pub-id-type="pmid">8634569</pub-id></mixed-citation></ref><ref id="ref2"><label>2</label><mixed-citation publication-type="journal">Feinstein AR. An additional basic science for clinical medicine: II. The limitations of randomized trials. <source>Ann Intern Med</source><year>1983</year>;<volume>99</volume>:<fpage>544</fpage>-<lpage>50</lpage>. <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.7326/0003-4819-99-4-544">doi:10.7326/0003-4819-99-4-544</ext-link> <ext-link ext-link-type="uri" xlink:href="http://www.ncbi.nlm.nih.gov/pubmed/?term=6625387">pmid:6625387</ext-link>.<pub-id pub-id-type="pmid">6625387</pub-id></mixed-citation></ref><ref id="ref3"><label>3</label><mixed-citation publication-type="book">Strom B. Overview of automated databases in pharmacoepidemiology. In: Strom BL, Hennessy S, eds. <italic>Pharmacoepidemiology</italic>. 5th ed. Wiley, 2012.</mixed-citation></ref><ref id="ref4"><label>4</label><mixed-citation publication-type="journal">Sanderson S, Tatt ID, Higgins JPT. Tools for assessing quality and susceptibility to bias in observational studies in epidemiology: a systematic review and annotated bibliography. <source>Int J Epidemiol</source><year>2007</year>;<volume>36</volume>:<fpage>666</fpage>-<lpage>76</lpage>. <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1093/ije/dym018">doi:10.1093/ije/dym018</ext-link> <ext-link ext-link-type="uri" xlink:href="http://www.ncbi.nlm.nih.gov/pubmed/?term=17470488">pmid:17470488</ext-link>.<pub-id pub-id-type="pmid">17470488</pub-id></mixed-citation></ref><ref id="ref5"><label>5</label><mixed-citation publication-type="journal">Deeks JJ, Dinnes J, D’Amico R, et al. International Stroke Trial Collaborative Group European Carotid Surgery Trial Collaborative Group. Evaluating non-randomised intervention studies. <source>Health Technol Assess</source><year>2003</year>;<volume>7</volume>:<fpage>iii</fpage>-<lpage>x, 1-173</lpage>. <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.3310/hta7270">doi:10.3310/hta7270</ext-link> <ext-link ext-link-type="uri" xlink:href="http://www.ncbi.nlm.nih.gov/pubmed/?term=14499048">pmid:14499048</ext-link>.</mixed-citation></ref><ref id="ref6"><label>6</label><mixed-citation publication-type="webpage">Wells GA, Shea B, O’Connell D, et al. The Newcastle-Ottawa Scale (NOS) for assessing the quality of nonrandomised studies in meta-analyses. 2008. <ext-link ext-link-type="uri" xlink:href="http://www.ohri.ca/programs/clinical_epidemiology/oxford.asp">http://www.ohri.ca/programs/clinical_epidemiology/oxford.asp</ext-link> (accessed 1/03/2016).</mixed-citation></ref><ref id="ref7"><label>7</label><mixed-citation publication-type="journal">Downs SH, Black N. The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies of health care interventions. <source>J Epidemiol Community Health</source><year>1998</year>;<volume>52</volume>:<fpage>377</fpage>-<lpage>84</lpage>. <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1136/jech.52.6.377">doi:10.1136/jech.52.6.377</ext-link> <ext-link ext-link-type="uri" xlink:href="http://www.ncbi.nlm.nih.gov/pubmed/?term=9764259">pmid:9764259</ext-link>.<pub-id pub-id-type="pmid">9764259</pub-id></mixed-citation></ref><ref id="ref8"><label>8</label><mixed-citation publication-type="journal">Higgins JPT, Altman DG, Gøtzsche PC, et al. Cochrane Bias Methods Group Cochrane Statistical Methods Group. The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. <source>BMJ</source><year>2011</year>;<volume>343</volume>:<fpage>d5928</fpage><ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1136/bmj.d5928">doi:10.1136/bmj.d5928</ext-link> <ext-link ext-link-type="uri" xlink:href="http://www.ncbi.nlm.nih.gov/pubmed/?term=22008217">pmid:22008217</ext-link>.<pub-id pub-id-type="pmid">22008217</pub-id></mixed-citation></ref><ref id="ref9"><label>9</label><mixed-citation publication-type="journal">Whiting PF, Rutjes AW, Westwood ME, et al. QUADAS-2 Group. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. <source>Ann Intern Med</source><year>2011</year>;<volume>155</volume>:<fpage>529</fpage>-<lpage>36</lpage>. <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.7326/0003-4819-155-8-201110180-00009">doi:10.7326/0003-4819-155-8-201110180-00009</ext-link> <ext-link ext-link-type="uri" xlink:href="http://www.ncbi.nlm.nih.gov/pubmed/?term=22007046">pmid:22007046</ext-link>.<pub-id pub-id-type="pmid">22007046</pub-id></mixed-citation></ref><ref id="ref10"><label>10</label><mixed-citation publication-type="journal">Whiting P, Savović J, Higgins JPT, et al. ROBIS group. ROBIS: A new tool to assess risk of bias in systematic reviews was developed. <source>J Clin Epidemiol</source><year>2016</year>;<volume>69</volume>:<fpage>225</fpage>-<lpage>34</lpage>. <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1016/j.jclinepi.2015.06.005">doi:10.1016/j.jclinepi.2015.06.005</ext-link> <ext-link ext-link-type="uri" xlink:href="http://www.ncbi.nlm.nih.gov/pubmed/?term=26092286">pmid:26092286</ext-link>.<pub-id pub-id-type="pmid">26092286</pub-id></mixed-citation></ref><ref id="ref11"><label>11</label><mixed-citation publication-type="book"> Institute of Medicine. <source>Ethical and Scientific Issues in Studying the Safety of Approved Drugs.</source>The National Academies Press, <year>2012</year>.</mixed-citation></ref><ref id="ref12"><label>12</label><mixed-citation publication-type="journal">Hernán MA, Robins JM. Using big data to emulate a target trial when a randomized trial is not available. <source>Am J Epidemiol</source><year>2016</year>;<volume>183</volume>:<fpage>758</fpage>-<lpage>64</lpage>. <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1093/aje/kwv254">doi:10.1093/aje/kwv254</ext-link> <ext-link ext-link-type="uri" xlink:href="http://www.ncbi.nlm.nih.gov/pubmed/?term=26994063">pmid:26994063</ext-link>.<pub-id pub-id-type="pmid">26994063</pub-id></mixed-citation></ref><ref id="ref13"><label>13</label><mixed-citation publication-type="journal">Mansournia MA, Higgins JPT, Sterne JAC, et al. Biases in randomized trials: a conversation between trialists and epidemiologists. <source>Epidemiology</source> [<comment>forthcoming</comment>].</mixed-citation></ref><ref id="ref14"><label>14</label><mixed-citation publication-type="journal">Hartling L, Hamm MP, Milne A, et al. Testing the risk of bias tool showed low reliability between individual reviewers and across consensus assessments of reviewer pairs. <source>J Clin Epidemiol</source><year>2013</year>;<volume>66</volume>:<fpage>973</fpage>-<lpage>81</lpage>. <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1016/j.jclinepi.2012.07.005">doi:10.1016/j.jclinepi.2012.07.005</ext-link> <ext-link ext-link-type="uri" xlink:href="http://www.ncbi.nlm.nih.gov/pubmed/?term=22981249">pmid:22981249</ext-link>.<pub-id pub-id-type="pmid">22981249</pub-id></mixed-citation></ref><ref id="ref15"><label>15</label><mixed-citation publication-type="journal">Turner RM, Spiegelhalter DJ, Smith GCS, Thompson SG. Bias modelling in evidence synthesis. <source>J R Stat Soc Ser A Stat Soc</source><year>2009</year>;<volume>172</volume>:<fpage>21</fpage>-<lpage>47</lpage>. <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1111/j.1467-985X.2008.00547.x">doi:10.1111/j.1467-985X.2008.00547.x</ext-link> <ext-link ext-link-type="uri" xlink:href="http://www.ncbi.nlm.nih.gov/pubmed/?term=19381328">pmid:19381328</ext-link>.</mixed-citation></ref><ref id="ref16"><label>16</label><mixed-citation publication-type="journal">Wilks DC, Sharp SJ, Ekelund U, et al. Objectively measured physical activity and fat mass in children: a bias-adjusted meta-analysis of prospective studies. <source>PLoS One</source><year>2011</year>;<volume>6</volume>:<fpage>e17205</fpage><ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1371/journal.pone.0017205">doi:10.1371/journal.pone.0017205</ext-link> <ext-link ext-link-type="uri" xlink:href="http://www.ncbi.nlm.nih.gov/pubmed/?term=21383837">pmid:21383837</ext-link>.<pub-id pub-id-type="pmid">21383837</pub-id></mixed-citation></ref><ref id="ref17"><label>17</label><mixed-citation publication-type="journal">Guyatt GH, Oxman AD, Schünemann HJ, Tugwell P, Knottnerus A. GRADE guidelines: a new series of articles in the Journal of Clinical Epidemiology. <source>J Clin Epidemiol</source><year>2011</year>;<volume>64</volume>:<fpage>380</fpage>-<lpage>2</lpage>. <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1016/j.jclinepi.2010.09.011">doi:10.1016/j.jclinepi.2010.09.011</ext-link> <ext-link ext-link-type="uri" xlink:href="http://www.ncbi.nlm.nih.gov/pubmed/?term=21185693">pmid:21185693</ext-link>.<pub-id pub-id-type="pmid">21185693</pub-id></mixed-citation></ref><ref id="ref18"><label>18</label><mixed-citation publication-type="journal">Sox HC, Greenfield S. Comparative effectiveness research: a report from the Institute of Medicine. <source>Ann Intern Med</source><year>2009</year>;<volume>151</volume>:<fpage>203</fpage>-<lpage>5</lpage>. <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.7326/0003-4819-151-3-200908040-00125">doi:10.7326/0003-4819-151-3-200908040-00125</ext-link> <ext-link ext-link-type="uri" xlink:href="http://www.ncbi.nlm.nih.gov/pubmed/?term=19567618">pmid:19567618</ext-link>.<pub-id pub-id-type="pmid">19567618</pub-id></mixed-citation></ref><ref id="ref19"><label>19</label><mixed-citation publication-type="journal">Bjelakovic G, Nikolova D, Gluud LL, Simonetti RG, Gluud C. Mortality in randomized trials of antioxidant supplements for primary and secondary prevention: systematic review and meta-analysis. <source>JAMA</source><year>2007</year>;<volume>297</volume>:<fpage>842</fpage>-<lpage>57</lpage>. <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1001/jama.297.8.842">doi:10.1001/jama.297.8.842</ext-link> <ext-link ext-link-type="uri" xlink:href="http://www.ncbi.nlm.nih.gov/pubmed/?term=17327526">pmid:17327526</ext-link>.<pub-id pub-id-type="pmid">17327526</pub-id></mixed-citation></ref><ref id="ref20"><label>20</label><mixed-citation publication-type="journal">Hernán MA, Alonso A, Logan R, et al. Observational studies analyzed like randomized experiments: an application to postmenopausal hormone therapy and coronary heart disease. <source>Epidemiology</source><year>2008</year>;<volume>19</volume>:<fpage>766</fpage>-<lpage>79</lpage>. <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1097/EDE.0b013e3181875e61">doi:10.1097/EDE.0b013e3181875e61</ext-link> <ext-link ext-link-type="uri" xlink:href="http://www.ncbi.nlm.nih.gov/pubmed/?term=18854702">pmid:18854702</ext-link>.<pub-id pub-id-type="pmid">18854702</pub-id></mixed-citation></ref><ref id="ref21"><label>21</label><mixed-citation publication-type="journal">Golder S, Loke YK, Bland M. Meta-analyses of adverse effects data derived from randomised controlled trials as compared to observational studies: methodological overview. <source>PLoS Med</source><year>2011</year>;<volume>8</volume>:<fpage>e1001026</fpage><ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1371/journal.pmed.1001026">doi:10.1371/journal.pmed.1001026</ext-link> <ext-link ext-link-type="uri" xlink:href="http://www.ncbi.nlm.nih.gov/pubmed/?term=21559325">pmid:21559325</ext-link>.<pub-id pub-id-type="pmid">21559325</pub-id></mixed-citation></ref><ref id="ref22"><label>22</label><mixed-citation publication-type="journal">Schünemann HJ, Tugwell P, Reeves BC, et al. Non-randomized studies as a source of complementary, sequential or replacement evidence for randomized controlled trials in systematic reviews on the effects of interventions. <source>Res Synth Methods</source><year>2013</year>;<volume>4</volume>:<fpage>49</fpage>-<lpage>62</lpage>. <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1002/jrsm.1078">doi:10.1002/jrsm.1078</ext-link> <ext-link ext-link-type="uri" xlink:href="http://www.ncbi.nlm.nih.gov/pubmed/?term=26053539">pmid:26053539</ext-link>.<pub-id pub-id-type="pmid">26053539</pub-id></mixed-citation></ref></ref-list></back></pmc></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Wicri/Asie/explor/AustralieFrV1/Data/Pmc/Corpus
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 0013370 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Pmc/Corpus/biblio.hfd -nk 0013370 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Wicri/Asie
|area= AustralieFrV1
|flux= Pmc
|étape= Corpus
|type= RBID
|clé=
|texte=
}}
| This area was generated with Dilib version V0.6.33. |  |