Variable performance of models for predicting methicillin-resistant Staphylococcus aureus carriage in European surgical wards
Identifieur interne : 000A94 ( Pmc/Corpus ); précédent : 000A93; suivant : 000A95Variable performance of models for predicting methicillin-resistant Staphylococcus aureus carriage in European surgical wards
Auteurs : Andie S. Lee ; Angelo Pan ; Stephan Harbarth ; Andrea Patroni ; Annie Chalfine ; George L. Daikos ; Silvia Garilli ; José Antonio Martínez ; Ben S. CooperSource :
- BMC Infectious Diseases [ 1471-2334 ] ; 2015.
Abstract
Predictive models to identify unknown methicillin-resistant
The study analysed data collected during a prospective cohort study which enrolled consecutive adult patients admitted to 13 surgical wards in 4 European hospitals. The participating hospitals were located in Athens (Greece), Barcelona (Spain), Cremona (Italy) and Paris (France). Universal admission MRSA screening was performed in the surgical wards. Data regarding demographic characteristics and potential risk factors for MRSA carriage were prospectively collected during the study period. Four logistic regression models were used to predict probabilities of unknown MRSA carriage using risk factor data: “Stepwise” (variables selected by backward elimination); “Best BMA” (model with highest posterior probability using Bayesian model averaging which accounts for uncertainty in model choice); “BMA” (average of all models selected with BMA); and “Simple” (model including variables selected >50% of the time by both Stepwise and BMA approaches applied to repeated random sub-samples of 50% of the data). To assess model performance, cross-validation against data not used for model fitting was conducted and net reclassification improvement (NRI) was calculated.
Of 2,901 patients enrolled, 111 (3.8%) were newly identified MRSA carriers. Recent hospitalisation and presence of a wound/ulcer were significantly associated with MRSA carriage in all models. While all models demonstrated limited predictive ability (mean
Though commonly used, models developed using stepwise variable selection can have relatively poor predictive value. When developing MRSA risk indices, simpler models, which account for uncertainty in model selection, may better stratify patients’ risk of unknown MRSA carriage.
Url:
DOI: 10.1186/s12879-015-0834-y
PubMed: 25880328
PubMed Central: 4347652
Links to Exploration step
PMC:4347652Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">Variable performance of models for predicting methicillin-resistant <italic>Staphylococcus aureus</italic> carriage in European surgical wards</title><author><name sortKey="Lee, Andie S" sort="Lee, Andie S" uniqKey="Lee A" first="Andie S" last="Lee">Andie S. Lee</name><affiliation><nlm:aff id="Aff1">Infection Control Program, University of Geneva Hospitals and Faculty of Medicine, Geneva, Switzerland</nlm:aff></affiliation><affiliation><nlm:aff id="Aff2">Departments of Infectious Diseases and Microbiology, Royal Prince Alfred Hospital, Sydney, Australia</nlm:aff></affiliation></author><author><name sortKey="Pan, Angelo" sort="Pan, Angelo" uniqKey="Pan A" first="Angelo" last="Pan">Angelo Pan</name><affiliation><nlm:aff id="Aff3">Infectious and Tropical Diseases Unit, Istituti Ospitalieri di Cremona, Cremona, Italy</nlm:aff></affiliation></author><author><name sortKey="Harbarth, Stephan" sort="Harbarth, Stephan" uniqKey="Harbarth S" first="Stephan" last="Harbarth">Stephan Harbarth</name><affiliation><nlm:aff id="Aff1">Infection Control Program, University of Geneva Hospitals and Faculty of Medicine, Geneva, Switzerland</nlm:aff></affiliation></author><author><name sortKey="Patroni, Andrea" sort="Patroni, Andrea" uniqKey="Patroni A" first="Andrea" last="Patroni">Andrea Patroni</name><affiliation><nlm:aff id="Aff4">General Medicine Unit, Ospedale di Esine, Esine, Italy</nlm:aff></affiliation></author><author><name sortKey="Chalfine, Annie" sort="Chalfine, Annie" uniqKey="Chalfine A" first="Annie" last="Chalfine">Annie Chalfine</name><affiliation><nlm:aff id="Aff5">Infection Control Unit, Groupe Hospitalier Paris Saint-Joseph, Paris, France</nlm:aff></affiliation></author><author><name sortKey="Daikos, George L" sort="Daikos, George L" uniqKey="Daikos G" first="George L" last="Daikos">George L. Daikos</name><affiliation><nlm:aff id="Aff6">First Department of Propaedeutic Medicine, Laiko General Hospital, Athens, Greece</nlm:aff></affiliation></author><author><name sortKey="Garilli, Silvia" sort="Garilli, Silvia" uniqKey="Garilli S" first="Silvia" last="Garilli">Silvia Garilli</name><affiliation><nlm:aff id="Aff3">Infectious and Tropical Diseases Unit, Istituti Ospitalieri di Cremona, Cremona, Italy</nlm:aff></affiliation></author><author><name sortKey="Martinez, Jose Antonio" sort="Martinez, Jose Antonio" uniqKey="Martinez J" first="José Antonio" last="Martínez">José Antonio Martínez</name><affiliation><nlm:aff id="Aff7">Service of Infectious Diseases, Hospital Clinic de Barcelona, Barcelona, Spain</nlm:aff></affiliation></author><author><name sortKey="Cooper, Ben S" sort="Cooper, Ben S" uniqKey="Cooper B" first="Ben S" last="Cooper">Ben S. Cooper</name><affiliation><nlm:aff id="Aff8">Mahidol-Oxford Tropical Medicine Research Unit, Faculty of Tropical Medicine, Mahidol University, Bangkok, Thailand</nlm:aff></affiliation><affiliation><nlm:aff id="Aff9">Centre for Clinical Vaccinology and Tropical Medicine, Nuffield Department of Clinical Medicine, University of Oxford, Oxford, UK</nlm:aff></affiliation></author></titleStmt><publicationStmt><idno type="wicri:source">PMC</idno><idno type="pmid">25880328</idno><idno type="pmc">4347652</idno><idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4347652</idno><idno type="RBID">PMC:4347652</idno><idno type="doi">10.1186/s12879-015-0834-y</idno><date when="2015">2015</date><idno type="wicri:Area/Pmc/Corpus">000A94</idno><idno type="wicri:explorRef" wicri:stream="Pmc" wicri:step="Corpus" wicri:corpus="PMC">000A94</idno></publicationStmt><sourceDesc><biblStruct><analytic><title xml:lang="en" level="a" type="main">Variable performance of models for predicting methicillin-resistant <italic>Staphylococcus aureus</italic> carriage in European surgical wards</title><author><name sortKey="Lee, Andie S" sort="Lee, Andie S" uniqKey="Lee A" first="Andie S" last="Lee">Andie S. Lee</name><affiliation><nlm:aff id="Aff1">Infection Control Program, University of Geneva Hospitals and Faculty of Medicine, Geneva, Switzerland</nlm:aff></affiliation><affiliation><nlm:aff id="Aff2">Departments of Infectious Diseases and Microbiology, Royal Prince Alfred Hospital, Sydney, Australia</nlm:aff></affiliation></author><author><name sortKey="Pan, Angelo" sort="Pan, Angelo" uniqKey="Pan A" first="Angelo" last="Pan">Angelo Pan</name><affiliation><nlm:aff id="Aff3">Infectious and Tropical Diseases Unit, Istituti Ospitalieri di Cremona, Cremona, Italy</nlm:aff></affiliation></author><author><name sortKey="Harbarth, Stephan" sort="Harbarth, Stephan" uniqKey="Harbarth S" first="Stephan" last="Harbarth">Stephan Harbarth</name><affiliation><nlm:aff id="Aff1">Infection Control Program, University of Geneva Hospitals and Faculty of Medicine, Geneva, Switzerland</nlm:aff></affiliation></author><author><name sortKey="Patroni, Andrea" sort="Patroni, Andrea" uniqKey="Patroni A" first="Andrea" last="Patroni">Andrea Patroni</name><affiliation><nlm:aff id="Aff4">General Medicine Unit, Ospedale di Esine, Esine, Italy</nlm:aff></affiliation></author><author><name sortKey="Chalfine, Annie" sort="Chalfine, Annie" uniqKey="Chalfine A" first="Annie" last="Chalfine">Annie Chalfine</name><affiliation><nlm:aff id="Aff5">Infection Control Unit, Groupe Hospitalier Paris Saint-Joseph, Paris, France</nlm:aff></affiliation></author><author><name sortKey="Daikos, George L" sort="Daikos, George L" uniqKey="Daikos G" first="George L" last="Daikos">George L. Daikos</name><affiliation><nlm:aff id="Aff6">First Department of Propaedeutic Medicine, Laiko General Hospital, Athens, Greece</nlm:aff></affiliation></author><author><name sortKey="Garilli, Silvia" sort="Garilli, Silvia" uniqKey="Garilli S" first="Silvia" last="Garilli">Silvia Garilli</name><affiliation><nlm:aff id="Aff3">Infectious and Tropical Diseases Unit, Istituti Ospitalieri di Cremona, Cremona, Italy</nlm:aff></affiliation></author><author><name sortKey="Martinez, Jose Antonio" sort="Martinez, Jose Antonio" uniqKey="Martinez J" first="José Antonio" last="Martínez">José Antonio Martínez</name><affiliation><nlm:aff id="Aff7">Service of Infectious Diseases, Hospital Clinic de Barcelona, Barcelona, Spain</nlm:aff></affiliation></author><author><name sortKey="Cooper, Ben S" sort="Cooper, Ben S" uniqKey="Cooper B" first="Ben S" last="Cooper">Ben S. Cooper</name><affiliation><nlm:aff id="Aff8">Mahidol-Oxford Tropical Medicine Research Unit, Faculty of Tropical Medicine, Mahidol University, Bangkok, Thailand</nlm:aff></affiliation><affiliation><nlm:aff id="Aff9">Centre for Clinical Vaccinology and Tropical Medicine, Nuffield Department of Clinical Medicine, University of Oxford, Oxford, UK</nlm:aff></affiliation></author></analytic><series><title level="j">BMC Infectious Diseases</title><idno type="eISSN">1471-2334</idno><imprint><date when="2015">2015</date></imprint></series></biblStruct></sourceDesc></fileDesc><profileDesc><textClass></textClass></profileDesc></teiHeader><front><div type="abstract" xml:lang="en"><sec><title>Background</title><p>Predictive models to identify unknown methicillin-resistant <italic>Staphylococcus aureus</italic> (MRSA) carriage on admission may optimise targeted MRSA screening and efficient use of resources. However, common approaches to model selection can result in overconfident estimates and poor predictive performance. We aimed to compare the performance of various models to predict previously unknown MRSA carriage on admission to surgical wards.</p></sec><sec><title>Methods</title><p>The study analysed data collected during a prospective cohort study which enrolled consecutive adult patients admitted to 13 surgical wards in 4 European hospitals. The participating hospitals were located in Athens (Greece), Barcelona (Spain), Cremona (Italy) and Paris (France). Universal admission MRSA screening was performed in the surgical wards. Data regarding demographic characteristics and potential risk factors for MRSA carriage were prospectively collected during the study period. Four logistic regression models were used to predict probabilities of unknown MRSA carriage using risk factor data: “Stepwise” (variables selected by backward elimination); “Best BMA” (model with highest posterior probability using Bayesian model averaging which accounts for uncertainty in model choice); “BMA” (average of all models selected with BMA); and “Simple” (model including variables selected >50% of the time by both Stepwise and BMA approaches applied to repeated random sub-samples of 50% of the data). To assess model performance, cross-validation against data not used for model fitting was conducted and net reclassification improvement (NRI) was calculated.</p></sec><sec><title>Results</title><p>Of 2,901 patients enrolled, 111 (3.8%) were newly identified MRSA carriers. Recent hospitalisation and presence of a wound/ulcer were significantly associated with MRSA carriage in all models. While all models demonstrated limited predictive ability (mean <italic>c</italic>-statistics <0.7) the Simple model consistently detected more MRSA-positive individuals despite screening fewer patients than the Stepwise model. Moreover, the Simple model improved reclassification of patients into appropriate risk strata compared with the Stepwise model (NRI 6.6%, <italic>P</italic> = .07).</p></sec><sec><title>Conclusions</title><p>Though commonly used, models developed using stepwise variable selection can have relatively poor predictive value. When developing MRSA risk indices, simpler models, which account for uncertainty in model selection, may better stratify patients’ risk of unknown MRSA carriage.</p></sec></div></front><back><div1 type="bibliography"><listBibl><biblStruct><analytic><author><name sortKey="Weber, Sg" uniqKey="Weber S">SG Weber</name></author><author><name sortKey="Huang, Ss" uniqKey="Huang S">SS Huang</name></author><author><name sortKey="Oriola, S" uniqKey="Oriola S">S Oriola</name></author><author><name sortKey="Huskins, Wc" uniqKey="Huskins W">WC Huskins</name></author><author><name sortKey="Noskin, Ga" uniqKey="Noskin G">GA Noskin</name></author><author><name sortKey="Harriman, K" uniqKey="Harriman K">K Harriman</name></author></analytic></biblStruct><biblStruct></biblStruct><biblStruct><analytic><author><name sortKey="Murthy, A" uniqKey="Murthy A">A Murthy</name></author><author><name sortKey="De Angelis, G" uniqKey="De Angelis G">G De Angelis</name></author><author><name sortKey="Pittet, D" uniqKey="Pittet D">D Pittet</name></author><author><name sortKey="Schrenzel, J" uniqKey="Schrenzel J">J Schrenzel</name></author><author><name sortKey="Uckay, I" uniqKey="Uckay I">I Uckay</name></author><author><name sortKey="Harbarth, S" uniqKey="Harbarth S">S Harbarth</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Robotham, Jv" uniqKey="Robotham J">JV Robotham</name></author><author><name sortKey="Graves, N" uniqKey="Graves N">N Graves</name></author><author><name sortKey="Cookson, Bd" uniqKey="Cookson B">BD Cookson</name></author><author><name sortKey="Barnett, Ag" uniqKey="Barnett A">AG Barnett</name></author><author><name sortKey="Wilson, Ja" uniqKey="Wilson J">JA Wilson</name></author><author><name sortKey="Edgeworth, Jd" uniqKey="Edgeworth J">JD Edgeworth</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Collins, J" uniqKey="Collins J">J Collins</name></author><author><name sortKey="Raza, M" uniqKey="Raza M">M Raza</name></author><author><name sortKey="Ford, M" uniqKey="Ford M">M Ford</name></author><author><name sortKey="Hall, L" uniqKey="Hall L">L Hall</name></author><author><name sortKey="Brydon, S" uniqKey="Brydon S">S Brydon</name></author><author><name sortKey="Gould, Fk" uniqKey="Gould F">FK Gould</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Kang, J" uniqKey="Kang J">J Kang</name></author><author><name sortKey="Mandsager, P" uniqKey="Mandsager P">P Mandsager</name></author><author><name sortKey="Biddle, Ak" uniqKey="Biddle A">AK Biddle</name></author><author><name sortKey="Weber, Dj" uniqKey="Weber D">DJ Weber</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Safdar, N" uniqKey="Safdar N">N Safdar</name></author><author><name sortKey="Bradley, Ea" uniqKey="Bradley E">EA Bradley</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Lee, As" uniqKey="Lee A">AS Lee</name></author><author><name sortKey="Cooper, Bs" uniqKey="Cooper B">BS Cooper</name></author><author><name sortKey="Malhotra Kumar, S" uniqKey="Malhotra Kumar S">S Malhotra-Kumar</name></author><author><name sortKey="Chalfine, A" uniqKey="Chalfine A">A Chalfine</name></author><author><name sortKey="Daikos, Gl" uniqKey="Daikos G">GL Daikos</name></author><author><name sortKey="Fankhauser, C" uniqKey="Fankhauser C">C Fankhauser</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Schweizer, M" uniqKey="Schweizer M">M Schweizer</name></author><author><name sortKey="Perencevich, E" uniqKey="Perencevich E">E Perencevich</name></author><author><name sortKey="Mcdanel, J" uniqKey="Mcdanel J">J McDanel</name></author><author><name sortKey="Carson, J" uniqKey="Carson J">J Carson</name></author><author><name sortKey="Formanek, M" uniqKey="Formanek M">M Formanek</name></author><author><name sortKey="Hafner, J" uniqKey="Hafner J">J Hafner</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Furuno, Jp" uniqKey="Furuno J">JP Furuno</name></author><author><name sortKey="Harris, Ad" uniqKey="Harris A">AD Harris</name></author><author><name sortKey="Wright, Mo" uniqKey="Wright M">MO Wright</name></author><author><name sortKey="Mcgregor, Jc" uniqKey="Mcgregor J">JC McGregor</name></author><author><name sortKey="Venezia, Ra" uniqKey="Venezia R">RA Venezia</name></author><author><name sortKey="Zhu, J" uniqKey="Zhu J">J Zhu</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Harbarth, S" uniqKey="Harbarth S">S Harbarth</name></author><author><name sortKey="Sax, H" uniqKey="Sax H">H Sax</name></author><author><name sortKey="Fankhauser Rodriguez, C" uniqKey="Fankhauser Rodriguez C">C Fankhauser-Rodriguez</name></author><author><name sortKey="Schrenzel, J" uniqKey="Schrenzel J">J Schrenzel</name></author><author><name sortKey="Agostinho, A" uniqKey="Agostinho A">A Agostinho</name></author><author><name sortKey="Pittet, D" uniqKey="Pittet D">D Pittet</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Furuno, Jp" uniqKey="Furuno J">JP Furuno</name></author><author><name sortKey="Mcgregor, Jc" uniqKey="Mcgregor J">JC McGregor</name></author><author><name sortKey="Harris, Ad" uniqKey="Harris A">AD Harris</name></author><author><name sortKey="Johnson, Ja" uniqKey="Johnson J">JA Johnson</name></author><author><name sortKey="Johnson, Jk" uniqKey="Johnson J">JK Johnson</name></author><author><name sortKey="Langenberg, P" uniqKey="Langenberg P">P Langenberg</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Haley, Cc" uniqKey="Haley C">CC Haley</name></author><author><name sortKey="Mittal, D" uniqKey="Mittal D">D Mittal</name></author><author><name sortKey="Laviolette, A" uniqKey="Laviolette A">A Laviolette</name></author><author><name sortKey="Jannapureddy, S" uniqKey="Jannapureddy S">S Jannapureddy</name></author><author><name sortKey="Parvez, N" uniqKey="Parvez N">N Parvez</name></author><author><name sortKey="Haley, Rw" uniqKey="Haley R">RW Haley</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Harbarth, S" uniqKey="Harbarth S">S Harbarth</name></author><author><name sortKey="Sax, H" uniqKey="Sax H">H Sax</name></author><author><name sortKey="Uckay, I" uniqKey="Uckay I">I Uckay</name></author><author><name sortKey="Fankhauser, C" uniqKey="Fankhauser C">C Fankhauser</name></author><author><name sortKey="Agostinho, A" uniqKey="Agostinho A">A Agostinho</name></author><author><name sortKey="Christenson, Jt" uniqKey="Christenson J">JT Christenson</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Riedel, S" uniqKey="Riedel S">S Riedel</name></author><author><name sortKey="Von Stein, D" uniqKey="Von Stein D">D Von Stein</name></author><author><name sortKey="Richardson, K" uniqKey="Richardson K">K Richardson</name></author><author><name sortKey="Page, J" uniqKey="Page J">J Page</name></author><author><name sortKey="Miller, S" uniqKey="Miller S">S Miller</name></author><author><name sortKey="Winokur, P" uniqKey="Winokur P">P Winokur</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Morgan, Dj" uniqKey="Morgan D">DJ Morgan</name></author><author><name sortKey="Day, Hr" uniqKey="Day H">HR Day</name></author><author><name sortKey="Furuno, Jp" uniqKey="Furuno J">JP Furuno</name></author><author><name sortKey="Young, A" uniqKey="Young A">A Young</name></author><author><name sortKey="Johnson, Jk" uniqKey="Johnson J">JK Johnson</name></author><author><name sortKey="Bradham, Dd" uniqKey="Bradham D">DD Bradham</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Robicsek, A" uniqKey="Robicsek A">A Robicsek</name></author><author><name sortKey="Beaumont, Jl" uniqKey="Beaumont J">JL Beaumont</name></author><author><name sortKey="Wright, Mo" uniqKey="Wright M">MO Wright</name></author><author><name sortKey="Thomson, Rb" uniqKey="Thomson R">RB Thomson</name></author><author><name sortKey="Kaul, Kl" uniqKey="Kaul K">KL Kaul</name></author><author><name sortKey="Peterson, Lr" uniqKey="Peterson L">LR Peterson</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Yeung, Ky" uniqKey="Yeung K">KY Yeung</name></author><author><name sortKey="Bumgarner, Re" uniqKey="Bumgarner R">RE Bumgarner</name></author><author><name sortKey="Raftery, Ae" uniqKey="Raftery A">AE Raftery</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Wang, D" uniqKey="Wang D">D Wang</name></author><author><name sortKey="Zhang, W" uniqKey="Zhang W">W Zhang</name></author><author><name sortKey="Bakhai, A" uniqKey="Bakhai A">A Bakhai</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Pan, A" uniqKey="Pan A">A Pan</name></author><author><name sortKey="Lee, A" uniqKey="Lee A">A Lee</name></author><author><name sortKey="Cooper, B" uniqKey="Cooper B">B Cooper</name></author><author><name sortKey="Chalfine, A" uniqKey="Chalfine A">A Chalfine</name></author><author><name sortKey="Daikos, Gl" uniqKey="Daikos G">GL Daikos</name></author><author><name sortKey="Garilli, S" uniqKey="Garilli S">S Garilli</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Van Heirstraeten, L" uniqKey="Van Heirstraeten L">L Van Heirstraeten</name></author><author><name sortKey="Cortinas Abrahantes, J" uniqKey="Cortinas Abrahantes J">J Cortinas Abrahantes</name></author><author><name sortKey="Lammens, C" uniqKey="Lammens C">C Lammens</name></author><author><name sortKey="Lee, A" uniqKey="Lee A">A Lee</name></author><author><name sortKey="Harbarth, S" uniqKey="Harbarth S">S Harbarth</name></author><author><name sortKey="Molenberghs, G" uniqKey="Molenberghs G">G Molenberghs</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Gazin, M" uniqKey="Gazin M">M Gazin</name></author><author><name sortKey="Lee, A" uniqKey="Lee A">A Lee</name></author><author><name sortKey="Derde, L" uniqKey="Derde L">L Derde</name></author><author><name sortKey="Kazma, M" uniqKey="Kazma M">M Kazma</name></author><author><name sortKey="Lammens, C" uniqKey="Lammens C">C Lammens</name></author><author><name sortKey="Ieven, M" uniqKey="Ieven M">M Ieven</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Cook, Nr" uniqKey="Cook N">NR Cook</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Pencina, Mj" uniqKey="Pencina M">MJ Pencina</name></author><author><name sortKey="D Agostino, Rb" uniqKey="D Agostino R">RB D'Agostino</name></author><author><name sortKey="D Agostino, Rb" uniqKey="D Agostino R">RB D'Agostino</name></author><author><name sortKey="Vasan, Rs" uniqKey="Vasan R">RS Vasan</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Raftery, A" uniqKey="Raftery A">A Raftery</name></author><author><name sortKey="Hoeting, J" uniqKey="Hoeting J">J Hoeting</name></author><author><name sortKey="Volinsky, C" uniqKey="Volinsky C">C Volinsky</name></author><author><name sortKey="Painter, I" uniqKey="Painter I">I Painter</name></author><author><name sortKey="Yeung, Ky" uniqKey="Yeung K">KY Yeung</name></author></analytic></biblStruct><biblStruct></biblStruct><biblStruct><analytic><author><name sortKey="Royston, P" uniqKey="Royston P">P Royston</name></author><author><name sortKey="Moons, Kg" uniqKey="Moons K">KG Moons</name></author><author><name sortKey="Altman, Dg" uniqKey="Altman D">DG Altman</name></author><author><name sortKey="Vergouwe, Y" uniqKey="Vergouwe Y">Y Vergouwe</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Hesterberg, T" uniqKey="Hesterberg T">T Hesterberg</name></author><author><name sortKey="Choi, Nh" uniqKey="Choi N">NH Choi</name></author><author><name sortKey="Meier, L" uniqKey="Meier L">L Meier</name></author><author><name sortKey="Fraley, C" uniqKey="Fraley C">C Fraley</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Babyak, Ma" uniqKey="Babyak M">MA Babyak</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Steyerberg, Ew" uniqKey="Steyerberg E">EW Steyerberg</name></author><author><name sortKey="Harrell, Fe" uniqKey="Harrell F">FE Harrell</name></author><author><name sortKey="Borsboom, Gj" uniqKey="Borsboom G">GJ Borsboom</name></author><author><name sortKey="Eijkemans, Mj" uniqKey="Eijkemans M">MJ Eijkemans</name></author><author><name sortKey="Vergouwe, Y" uniqKey="Vergouwe Y">Y Vergouwe</name></author><author><name sortKey="Habbema, Jd" uniqKey="Habbema J">JD Habbema</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Genell, A" uniqKey="Genell A">A Genell</name></author><author><name sortKey="Nemes, S" uniqKey="Nemes S">S Nemes</name></author><author><name sortKey="Steineck, G" uniqKey="Steineck G">G Steineck</name></author><author><name sortKey="Dickman, Pw" uniqKey="Dickman P">PW Dickman</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Concato, J" uniqKey="Concato J">J Concato</name></author><author><name sortKey="Feinstein, Ar" uniqKey="Feinstein A">AR Feinstein</name></author><author><name sortKey="Holford, Tr" uniqKey="Holford T">TR Holford</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Steyerberg, Ew" uniqKey="Steyerberg E">EW Steyerberg</name></author><author><name sortKey="Vickers, Aj" uniqKey="Vickers A">AJ Vickers</name></author><author><name sortKey="Cook, Nr" uniqKey="Cook N">NR Cook</name></author><author><name sortKey="Gerds, T" uniqKey="Gerds T">T Gerds</name></author><author><name sortKey="Gonen, M" uniqKey="Gonen M">M Gonen</name></author><author><name sortKey="Obuchowski, N" uniqKey="Obuchowski N">N Obuchowski</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Mckinnell, Ja" uniqKey="Mckinnell J">JA McKinnell</name></author><author><name sortKey="Huang, Ss" uniqKey="Huang S">SS Huang</name></author><author><name sortKey="Eells, Sj" uniqKey="Eells S">SJ Eells</name></author><author><name sortKey="Cui, E" uniqKey="Cui E">E Cui</name></author><author><name sortKey="Miller, Lg" uniqKey="Miller L">LG Miller</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Daum, Rs" uniqKey="Daum R">RS Daum</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Voss, A" uniqKey="Voss A">A Voss</name></author><author><name sortKey="Loeffen, F" uniqKey="Loeffen F">F Loeffen</name></author><author><name sortKey="Bakker, J" uniqKey="Bakker J">J Bakker</name></author><author><name sortKey="Klaassen, C" uniqKey="Klaassen C">C Klaassen</name></author><author><name sortKey="Wulf, M" uniqKey="Wulf M">M Wulf</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Tsiodras, S" uniqKey="Tsiodras S">S Tsiodras</name></author><author><name sortKey="Daikos, Gl" uniqKey="Daikos G">GL Daikos</name></author><author><name sortKey="Lee, A" uniqKey="Lee A">A Lee</name></author><author><name sortKey="Plachouras, D" uniqKey="Plachouras D">D Plachouras</name></author><author><name sortKey="Antoniadou, A" uniqKey="Antoniadou A">A Antoniadou</name></author><author><name sortKey="Ploiarchopoulou, F" uniqKey="Ploiarchopoulou F">F Ploiarchopoulou</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Altman, Dg" uniqKey="Altman D">DG Altman</name></author><author><name sortKey="Vergouwe, Y" uniqKey="Vergouwe Y">Y Vergouwe</name></author><author><name sortKey="Royston, P" uniqKey="Royston P">P Royston</name></author><author><name sortKey="Moons, Kg" uniqKey="Moons K">KG Moons</name></author></analytic></biblStruct><biblStruct></biblStruct><biblStruct><analytic><author><name sortKey="Lee, As" uniqKey="Lee A">AS Lee</name></author><author><name sortKey="Huttner, B" uniqKey="Huttner B">B Huttner</name></author><author><name sortKey="Harbarth, S" uniqKey="Harbarth S">S Harbarth</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Bode, Lg" uniqKey="Bode L">LG Bode</name></author><author><name sortKey="Kluytmans, Ja" uniqKey="Kluytmans J">JA Kluytmans</name></author><author><name sortKey="Wertheim, Hf" uniqKey="Wertheim H">HF Wertheim</name></author><author><name sortKey="Bogaers, D" uniqKey="Bogaers D">D Bogaers</name></author><author><name sortKey="Vandenbroucke Grauls, Cm" uniqKey="Vandenbroucke Grauls C">CM Vandenbroucke-Grauls</name></author><author><name sortKey="Roosendaal, R" uniqKey="Roosendaal R">R Roosendaal</name></author></analytic></biblStruct></listBibl></div1></back></TEI><pmc article-type="research-article"><pmc-dir>properties open_access</pmc-dir>
<front><journal-meta><journal-id journal-id-type="nlm-ta">BMC Infect Dis</journal-id><journal-id journal-id-type="iso-abbrev">BMC Infect. Dis</journal-id><journal-title-group><journal-title>BMC Infectious Diseases</journal-title></journal-title-group><issn pub-type="epub">1471-2334</issn><publisher><publisher-name>BioMed Central</publisher-name><publisher-loc>London</publisher-loc></publisher></journal-meta><article-meta><article-id pub-id-type="pmid">25880328</article-id><article-id pub-id-type="pmc">4347652</article-id><article-id pub-id-type="publisher-id">834</article-id><article-id pub-id-type="doi">10.1186/s12879-015-0834-y</article-id><article-categories><subj-group subj-group-type="heading"><subject>Research Article</subject></subj-group></article-categories><title-group><article-title>Variable performance of models for predicting methicillin-resistant <italic>Staphylococcus aureus</italic> carriage in European surgical wards</article-title></title-group><contrib-group><contrib contrib-type="author" corresp="yes"><name><surname>Lee</surname><given-names>Andie S</given-names></name><address><email>andie.lee@live.com.au</email></address><xref ref-type="aff" rid="Aff1"></xref><xref ref-type="aff" rid="Aff2"></xref></contrib><contrib contrib-type="author"><name><surname>Pan</surname><given-names>Angelo</given-names></name><address><email>angelo.pan1@tin.it</email></address><xref ref-type="aff" rid="Aff3"></xref></contrib><contrib contrib-type="author"><name><surname>Harbarth</surname><given-names>Stephan</given-names></name><address><email>stephan.harbarth@hcuge.ch</email></address><xref ref-type="aff" rid="Aff1"></xref></contrib><contrib contrib-type="author"><name><surname>Patroni</surname><given-names>Andrea</given-names></name><address><email>andreapatroni@hotmail.com</email></address><xref ref-type="aff" rid="Aff4"></xref></contrib><contrib contrib-type="author"><name><surname>Chalfine</surname><given-names>Annie</given-names></name><address><email>achalfine@hpsj.fr</email></address><xref ref-type="aff" rid="Aff5"></xref></contrib><contrib contrib-type="author"><name><surname>Daikos</surname><given-names>George L</given-names></name><address><email>gdaikos@med.uoa.gr</email></address><xref ref-type="aff" rid="Aff6"></xref></contrib><contrib contrib-type="author"><name><surname>Garilli</surname><given-names>Silvia</given-names></name><address><email>garillisilvia@libero.it</email></address><xref ref-type="aff" rid="Aff3"></xref></contrib><contrib contrib-type="author"><name><surname>Martínez</surname><given-names>José Antonio</given-names></name><address><email>jamarti@clinic.ub.es</email></address><xref ref-type="aff" rid="Aff7"></xref></contrib><contrib contrib-type="author"><name><surname>Cooper</surname><given-names>Ben S</given-names></name><address><email>ben.s.cooper@gmail.com</email></address><xref ref-type="aff" rid="Aff8"></xref><xref ref-type="aff" rid="Aff9"></xref></contrib><contrib contrib-type="author"><collab>in collaboration with the MOSAR-04 Study Team</collab></contrib><aff id="Aff1"><label></label>Infection Control Program, University of Geneva Hospitals and Faculty of Medicine, Geneva, Switzerland</aff><aff id="Aff2"><label></label>Departments of Infectious Diseases and Microbiology, Royal Prince Alfred Hospital, Sydney, Australia</aff><aff id="Aff3"><label></label>Infectious and Tropical Diseases Unit, Istituti Ospitalieri di Cremona, Cremona, Italy</aff><aff id="Aff4"><label></label>General Medicine Unit, Ospedale di Esine, Esine, Italy</aff><aff id="Aff5"><label></label>Infection Control Unit, Groupe Hospitalier Paris Saint-Joseph, Paris, France</aff><aff id="Aff6"><label></label>First Department of Propaedeutic Medicine, Laiko General Hospital, Athens, Greece</aff><aff id="Aff7"><label></label>Service of Infectious Diseases, Hospital Clinic de Barcelona, Barcelona, Spain</aff><aff id="Aff8"><label></label>Mahidol-Oxford Tropical Medicine Research Unit, Faculty of Tropical Medicine, Mahidol University, Bangkok, Thailand</aff><aff id="Aff9"><label></label>Centre for Clinical Vaccinology and Tropical Medicine, Nuffield Department of Clinical Medicine, University of Oxford, Oxford, UK</aff></contrib-group><pub-date pub-type="epub"><day>27</day><month>2</month><year>2015</year></pub-date><pub-date pub-type="pmc-release"><day>27</day><month>2</month><year>2015</year></pub-date><pub-date pub-type="collection"><year>2015</year></pub-date><volume>15</volume><elocation-id>105</elocation-id><history><date date-type="received"><day>20</day><month>9</month><year>2014</year></date><date date-type="accepted"><day>12</day><month>2</month><year>2015</year></date></history><permissions><copyright-statement>© Lee et al.; licensee BioMed Central. 2015</copyright-statement><license license-type="open-access"><license-p>This is an Open Access article distributed under the terms of the Creative Commons Attribution License (<ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/licenses/by/4.0">http://creativecommons.org/licenses/by/4.0</ext-link>), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (<ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/publicdomain/zero/1.0/">http://creativecommons.org/publicdomain/zero/1.0/</ext-link>) applies to the data made available in this article, unless otherwise stated.</license-p></license></permissions><abstract id="Abs1"><sec><title>Background</title><p>Predictive models to identify unknown methicillin-resistant <italic>Staphylococcus aureus</italic> (MRSA) carriage on admission may optimise targeted MRSA screening and efficient use of resources. However, common approaches to model selection can result in overconfident estimates and poor predictive performance. We aimed to compare the performance of various models to predict previously unknown MRSA carriage on admission to surgical wards.</p></sec><sec><title>Methods</title><p>The study analysed data collected during a prospective cohort study which enrolled consecutive adult patients admitted to 13 surgical wards in 4 European hospitals. The participating hospitals were located in Athens (Greece), Barcelona (Spain), Cremona (Italy) and Paris (France). Universal admission MRSA screening was performed in the surgical wards. Data regarding demographic characteristics and potential risk factors for MRSA carriage were prospectively collected during the study period. Four logistic regression models were used to predict probabilities of unknown MRSA carriage using risk factor data: “Stepwise” (variables selected by backward elimination); “Best BMA” (model with highest posterior probability using Bayesian model averaging which accounts for uncertainty in model choice); “BMA” (average of all models selected with BMA); and “Simple” (model including variables selected >50% of the time by both Stepwise and BMA approaches applied to repeated random sub-samples of 50% of the data). To assess model performance, cross-validation against data not used for model fitting was conducted and net reclassification improvement (NRI) was calculated.</p></sec><sec><title>Results</title><p>Of 2,901 patients enrolled, 111 (3.8%) were newly identified MRSA carriers. Recent hospitalisation and presence of a wound/ulcer were significantly associated with MRSA carriage in all models. While all models demonstrated limited predictive ability (mean <italic>c</italic>-statistics <0.7) the Simple model consistently detected more MRSA-positive individuals despite screening fewer patients than the Stepwise model. Moreover, the Simple model improved reclassification of patients into appropriate risk strata compared with the Stepwise model (NRI 6.6%, <italic>P</italic> = .07).</p></sec><sec><title>Conclusions</title><p>Though commonly used, models developed using stepwise variable selection can have relatively poor predictive value. When developing MRSA risk indices, simpler models, which account for uncertainty in model selection, may better stratify patients’ risk of unknown MRSA carriage.</p></sec></abstract><kwd-group xml:lang="en"><title>Keywords</title><kwd>Methicillin-resistant <italic>Staphylococcus aureus</italic></kwd><kwd>Screening</kwd><kwd>Predictive models</kwd></kwd-group><custom-meta-group><custom-meta><meta-name>issue-copyright-statement</meta-name><meta-value>© The Author(s) 2015</meta-value></custom-meta></custom-meta-group></article-meta></front><body><sec id="Sec1"><title>Background</title><p>Mandatory universal methicillin-resistant <italic>Staphylococcus aureus</italic> (MRSA) screening has been introduced in healthcare facilities in many countries, including parts of Europe [<xref ref-type="bibr" rid="CR1">1</xref>,<xref ref-type="bibr" rid="CR2">2</xref>]. Recent evidence, however, demonstrates that this approach is not cost-effective in low prevalence settings [<xref ref-type="bibr" rid="CR3">3</xref>-<xref ref-type="bibr" rid="CR6">6</xref>] and all European countries have now abandoned mandatory universal MRSA screening. Instead, targeted screening has been advocated. The success of this strategy, however, relies on the development of well-validated MRSA risk indices to guide selection of patients for screening. This is particularly important in surgical wards where appropriate use of perioperative prophylaxis and decolonisation for MRSA carriers may significantly reduce surgical site infections [<xref ref-type="bibr" rid="CR7">7</xref>-<xref ref-type="bibr" rid="CR9">9</xref>].</p><p>Statistical models have been used to develop risk prediction systems to identify potential MRSA carriers for screening [<xref ref-type="bibr" rid="CR10">10</xref>-<xref ref-type="bibr" rid="CR17">17</xref>]. Despite their widespread use, common approaches to prediction modelling, such as stepwise regression, ignore the uncertainty in model selection which can result in overconfident estimates and poor predictive accuracy [<xref ref-type="bibr" rid="CR18">18</xref>,<xref ref-type="bibr" rid="CR19">19</xref>]. These limitations may be addressed with other variable selection methods such as model averaging [<xref ref-type="bibr" rid="CR19">19</xref>]. To our knowledge, no studies have reported the clinical implications of using different model selection techniques for developing MRSA risk indices.</p><p>We aimed to compare the performance of various models to predict previously unknown MRSA carriage on admission to surgical wards in 4 European hospitals. We hypothesised that the predictive ability of the commonly-used multivariable stepwise logistic regression method is inferior to other approaches, such as Bayesian model averaging, which account for model uncertainty.</p></sec><sec id="Sec2" sec-type="methods"><title>Methods</title><sec id="Sec3"><title>Study design and setting</title><p>This study analysed data collected from a prospective cohort study conducted in 13 surgical wards of 4 hospitals in 4 European countries (Athens, Greece; Barcelona, Spain; Cremona, Italy; and Paris, France) [<xref ref-type="bibr" rid="CR20">20</xref>]. The enrolled wards included vascular (4), orthopaedic (4), cardiac (2), general (2) and neurosurgery (1) subspecialties. The number of annual admissions to the surgical wards at each hospital ranged from 2,723 in Paris to 3,932 in Cremona, with the annual number of surgical procedures ranging from 1,792 in Athens to 3,083 in Paris. Universal MRSA screening on admission was performed on these wards between December 2008 and January 2010. Consecutive adult patients admitted to these wards during this time were eligible for study enrolment. Patients were excluded if they were admitted for less than 24 hours or not screened within 48 hours of admission. Patients already known to be MRSA colonised or infected were also excluded as we were interested in risk profiling patients to identify previously unknown MRSA carriers.</p></sec><sec id="Sec4"><title>MRSA screening</title><p>MRSA screening swabs were collected from the nose, perineum and wounds if present. Swabs were inoculated directly onto an MRSA chromogenic medium (BBL CHROMagar MRSA II, BD Diagnostics, Belgium) as well as being placed in an enrichment broth to increase the sensitivity of MRSA detection [<xref ref-type="bibr" rid="CR21">21</xref>]. After incubation at 37°C for 20–24 hours, any characteristically coloured colonies on the chromogenic media were subcultured onto blood agar and incubated overnight. The tube coagulase test, mannitol salt agar subculture and/or the latex agglutination test were used to confirm isolates as <italic>S. aureus</italic>. The enrichment broth, after overnight incubation, was inoculated onto MRSA chromogenic medium if the results of direct plating were negative or indeterminate, then the same procedure as for direct plating was followed.</p><p>Screening specimens were processed in local microbiology laboratories which participated in an external quality assurance program [<xref ref-type="bibr" rid="CR22">22</xref>]. Confirmation of MRSA identification and susceptibility testing was also performed at the study’s central laboratory at the University of Antwerp, Belgium.</p></sec><sec id="Sec5"><title>Data collection</title><p>Data regarding demographic characteristics, comorbidities and potential risk factors for MRSA carriage were collected using a standardised case report form. These data included age, sex, surgical subspecialty, chronic medical conditions, hospitalisation in the last year, surgery in the last 3 months, history of transfer from another ward or healthcare facility, nursing home residency, presence of a skin wound or pressure sore, antibiotic use in the last 6 months and the presence of long-term invasive devices.</p><p>The primary outcome of interest was previously unknown MRSA colonisation on admission defined as the detection of MRSA from a screening swab or clinical sample collected within 48 hours of admission to the surgical ward.</p></sec><sec id="Sec6"><title>Statistical analysis</title><p>Univariable analyses of baseline characteristics were performed using χ<sup>2</sup> test or Student’s <italic>t</italic>-test as appropriate. For the multivariable analysis, we compared the commonly used stepwise variable selection approach with Bayesian model averaging (BMA) which provides a mechanism for accounting for model uncertainty with the aim of improving prediction accuracy [<xref ref-type="bibr" rid="CR18">18</xref>,<xref ref-type="bibr" rid="CR19">19</xref>]. The stepwise approach involved stepwise backward logistic regression with inclusion of all covariates with <italic>P</italic> < .2 in the primary model. Likelihood ratio tests were used to guide exclusion of covariates from the model. Covariates with <italic>P</italic> ≤ .05 were retained in the model. The BMA approach averaged over multiple models and used the posterior probabilities of these models to perform all inferences and predictions [<xref ref-type="bibr" rid="CR19">19</xref>]. We developed 4 multivariable logistic regression models: 1) “Stepwise” model – which used stepwise backward elimination; 2) “Best BMA” model – which was the model with the highest posterior probability after using the Bayesian model averaging approach; 3) “BMA” model – which included all covariates with a posterior probability greater than zero with Bayesian model averaging; 4) “Simple” model – which included covariates selected at least half the time in both Stepwise and BMA models on repeated random sub-samples of 50% of the data from the whole cohort. The aim of the “Simple” model strategy was to develop a simple or parsimonious model with a clinically meaningful level of prediction with as few predictor variables as possible. All tests were 2-tailed and <italic>P</italic> ≤ .05 was considered statistically significant.</p><p>To evaluate the predictive performance of the models, cross-validation was performed using 1000 repeated random sub-samples of the data of the entire cohort divided in a 1:1 ratio into derivation and validation datasets. Models were constructed with the first half of the data (derivation dataset). The results of this analysis were then used to predict unknown MRSA carriage in the other half of the data (validation dataset). The <italic>c</italic>-statistic (or area under the receiver operating characteristic (ROC) curve which plots sensitivity against 1-specificity) was calculated to determine the models’ ability to discriminate between individuals who were and were not MRSA colonised. The <italic>c</italic>-statistic has a theoretical range from 0 to 1, with a statistically meaningful range from 0.5 (no predictive ability) to 1 (perfect discrimination) [<xref ref-type="bibr" rid="CR23">23</xref>]. A mean <italic>c</italic>-statistic was calculated from the logistic models fitted to the derivation cohorts from the repeated random sub-samples of the data. To assess the agreement between predicted and observed MRSA carriage, the relative frequencies of predicted probabilities (density plots) of MRSA colonisation were plotted by observed MRSA colonisation status as determined by admission screening. Because the derivation and validation datasets are from the same 4 hospitals, the results may overestimate the likely predictive performance when applied to other hospitals. To overcome this problem, models were fitted using data from 3 of 4 hospitals as the derivation dataset with each hospital in turn being used as the validation dataset.</p><p>Similarly, the clinical utility of the models was evaluated by selecting a random sample of 50% of the full cohort as the derivation dataset and using the remaining data as the validation dataset. We calculated the sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV) for screening patients at varying levels of predicted probabilities of MRSA carriage as determined by the 4 models. We then used a cut-off of 4% predicted probability of MRSA carriage to categorise patients as low- or high-risk using the Stepwise model. The accuracy with which each model stratified risk was compared with that of the Stepwise model by calculating the number of patients who were reclassified into different risk categories using each model [<xref ref-type="bibr" rid="CR23">23</xref>]. Any upward movement in predicted risk for subjects with MRSA implied improved reclassification, and any downward movement indicated worse reclassification. The opposite applied for MRSA negative subjects. The improvement in reclassification was quantified as the net reclassification improvement (NRI) (sum of differences in proportion of individuals moving up minus the proportion moving down for those with MRSA, and the proportion of individuals moving down minus the proportion moving up for those without MRSA) [<xref ref-type="bibr" rid="CR24">24</xref>]. The analyses were performed with R statistical software including the BMA package [<xref ref-type="bibr" rid="CR25">25</xref>,<xref ref-type="bibr" rid="CR26">26</xref>].</p></sec><sec id="Sec7"><title>Ethics statement</title><p>The study was approved by the Institutional Review Board of the University of Geneva Hospitals (Comité d’Ethique N.A.C.), the location of the coordinating centre. Local ethics committee approval was also obtained from each participating hospital as a quality improvement project with a waiver of individual informed consent (Institution Review Board of Laiko General Hospital, Athens; Comité Etico de Investigación Clínica, Barcelona; Comitato Etico degli Istituti Ospitalieri di Cremona, Cremona; Comité de Protection des Personnes – Ile-de-France IX, Paris).</p></sec></sec><sec id="Sec8" sec-type="results"><title>Results</title><p>There were 2,935 patients screened on admission to the surgical wards. Among these, 34 (1.2%) patients were excluded as they were previously known to be MRSA colonised or infected. The remaining 2,901 patients were included in the study, of which 111 (3.8%) were newly identified MRSA carriers. Patient characteristics are shown in Table <xref rid="Tab1" ref-type="table">1</xref>. Risk factors for MRSA carriage on admission on univariable analysis included older age, cerebrovascular disease, diabetes mellitus, chronic obstructive pulmonary disease, chronic skin disease, hospitalisation in the last year, nursing home residency, presence of a skin wound or pressure sore, antibiotic use in the last 6 months, urinary catheterisation and presence of a tracheostomy.<table-wrap id="Tab1"><label>Table 1</label><caption><p><bold>Characteristics of patients colonised and not colonised with methicillin-resistant</bold><bold><italic>Staphylococcus aureus</italic></bold><bold>on admission</bold></p></caption><table frame="hsides" rules="groups"><thead><tr valign="top"><th rowspan="2"><bold>Characteristic</bold></th><th><bold>MRSA positive</bold></th><th><bold>MRSA negative</bold></th><th rowspan="2"><bold><italic>P</italic></bold></th></tr><tr valign="top"><th><bold>(</bold><bold><italic>n</italic></bold>
<bold>= 111)</bold></th><th><bold>(</bold><bold><italic>n</italic></bold>
<bold>= 2,790)</bold></th></tr></thead><tbody><tr valign="top"><td>Hospital</td><td></td><td></td><td><.001</td></tr><tr valign="top"><td> Athens (<italic>n</italic> = 985)</td><td>51 (5.2)</td><td>934 (94.8)</td><td></td></tr><tr valign="top"><td> Barcelona (<italic>n</italic> = 510)</td><td>9 (1.8)</td><td>501 (98.2)</td><td></td></tr><tr valign="top"><td> Cremona (<italic>n</italic> = 817)</td><td>20 (2.4)</td><td>797 (97.6)</td><td></td></tr><tr valign="top"><td> Paris (<italic>n</italic> = 589)</td><td>31 (5.3)</td><td>558 (94.7)</td><td></td></tr><tr valign="top"><td>Age, mean (SD), years</td><td>70.3 (16.5)</td><td>64.5 (17.9)</td><td><.001</td></tr><tr valign="top"><td>Female sex</td><td>59 (53.2)</td><td>1,358 (48.7)</td><td>.355</td></tr><tr valign="top"><td>Surgical subspecialty</td><td></td><td></td><td>.112</td></tr><tr valign="top"><td> General</td><td>29 (26.1)</td><td>639 (22.9)</td><td></td></tr><tr valign="top"><td> Vascular</td><td>31 (27.9)</td><td>779 (27.9)</td><td></td></tr><tr valign="top"><td> Neurosurgery</td><td>7 (6.3)</td><td>229 (8.2)</td><td></td></tr><tr valign="top"><td> Orthopaedics</td><td>42 (37.8)</td><td>910 (32.6)</td><td></td></tr><tr valign="top"><td> Cardiothoracic</td><td>2 (1.8)</td><td>233 (8.4)</td><td></td></tr><tr valign="top"><td>Comorbidities</td><td></td><td></td><td></td></tr><tr valign="top"><td> Chronic renal failure</td><td>8 (7.2)</td><td>131 (4.7)</td><td>.224</td></tr><tr valign="top"><td> Haemodialysis</td><td>1 (0.9)</td><td>27 (1.0)</td><td>.944</td></tr><tr valign="top"><td> Cardiovascular disease</td><td>69 (62.2)</td><td>1,584 (56.8)</td><td>.261</td></tr><tr valign="top"><td> Cerebrovascular disease</td><td>4 (3.6)</td><td>33 (1.2)</td><td>.026</td></tr><tr valign="top"><td> Diabetes mellitus</td><td>34 (30.6)</td><td>471 (16.9)</td><td><.001</td></tr><tr valign="top"><td> COPD</td><td>19 (17.1)</td><td>273 (9.8)</td><td>.012</td></tr><tr valign="top"><td> Solid organ malignancy</td><td>18 (16.2)</td><td>402 (14.4)</td><td>.596</td></tr><tr valign="top"><td> Haematological malignancy</td><td>1 (0.9)</td><td>10 (0.4)</td><td>.362</td></tr><tr valign="top"><td> Autoimmune disease</td><td>1 (0.9)</td><td>63 (2.3)</td><td>.340</td></tr><tr valign="top"><td> Liver cirrhosis</td><td>4 (3.6)</td><td>58 (2.1)</td><td>.276</td></tr><tr valign="top"><td> HIV infection</td><td>0 (0.0)</td><td>11 (0.4)</td><td>.507</td></tr><tr valign="top"><td> Trauma</td><td>24 (21.6)</td><td>554 (19.9)</td><td>.648</td></tr><tr valign="top"><td> Chronic skin disease</td><td>12 (10.8)</td><td>98 (3.5)</td><td><.001</td></tr><tr valign="top"><td>Recent hospitalisation (<1 year)</td><td>60 (54.1)</td><td>862 (30.9)</td><td><.001</td></tr><tr valign="top"><td>Recent surgery (<3 months)</td><td>17 (15.3)</td><td>277 (9.9)</td><td>.065</td></tr><tr valign="top"><td>Transfer from another ward or hospital</td><td>8 (7.2)</td><td>231 (8.3)</td><td>.687</td></tr><tr valign="top"><td>Nursing home resident</td><td>11 (9.9)</td><td>75 (2.7)</td><td><.001</td></tr><tr valign="top"><td>Skin wound/ulcer</td><td>26 (23.4)</td><td>200 (7.2)</td><td><.001</td></tr><tr valign="top"><td>Recent antibiotic use (<6 months)</td><td>47 (42.3)</td><td>674 (24.2)</td><td><.001</td></tr><tr valign="top"><td>Indwelling devices</td><td></td><td></td><td></td></tr><tr valign="top"><td> Long-term vascular catheter</td><td>1 (0.9)</td><td>22 (0.8)</td><td>.896</td></tr><tr valign="top"><td> Urinary catheter</td><td>8 (7.2)</td><td>42 (1.5)</td><td><.001</td></tr><tr valign="top"><td> Tracheostomy</td><td>3 (2.7)</td><td>17 (0.6)</td><td>.009</td></tr><tr valign="top"><td> Other device</td><td>2 (1.8)</td><td>53 (1.9)</td><td>.941</td></tr></tbody></table><table-wrap-foot><p>Note. Data are no. (%) of patients unless otherwise indicated. COPD, chronic obstructive pulmonary disease; HIV, human immunodeficiency virus; MRSA, methicillin-resistant <italic>Staphylococcus aureus</italic>; SD, standard deviation.</p></table-wrap-foot></table-wrap></p><sec id="Sec9"><title>Multivariable models</title><p>Independent predictors of MRSA carriage on admission for each multivariable model are shown in Table <xref rid="Tab2" ref-type="table">2</xref>. Recent hospitalisation and the presence of a wound or pressure sore were significantly associated with MRSA carriage in all models. The Stepwise model identified 6 independent risk factors for MRSA colonisation (older age, chronic skin disease, hospitalisation in the last year, nursing home residency, presence of a wound or pressure sore and urinary catheterisation). The covariates in the first 27 models selected by the BMA approach are illustrated in Figure <xref rid="Fig1" ref-type="fig">1</xref>. The Best BMA model, the model with the highest posterior probability (Model #1 in Figure <xref rid="Fig1" ref-type="fig">1</xref>), included nursing home residency and urinary catheterisation in addition to the 2 risk factors selected in all models. The BMA model, which averaged over the multiple selected models, only identified the 2 risk factors common to all models as significant but included 10 risk factors in total. In the Simple model, MRSA carriage was associated with 5 covariates (those of the Stepwise model excluding urinary catheterisation).<table-wrap id="Tab2"><label>Table 2</label><caption><p><bold>Results of multivariable models of risk factors for methicillin-resistant</bold><bold><italic>Staphylococcus aureus</italic></bold><bold>carriage on admission</bold></p></caption><table frame="hsides" rules="groups"><thead><tr valign="top"><th rowspan="2"><bold>Risk factor</bold></th><th colspan="3"><bold>Stepwise model</bold></th><th colspan="3"><bold>Best BMA model</bold></th><th colspan="4"><bold>BMA model</bold></th><th colspan="3"><bold>Simple model</bold></th></tr><tr valign="top"><th><bold>OR</bold></th><th><bold>95% CI</bold></th><th><bold><italic>P</italic></bold></th><th><bold>OR</bold></th><th><bold>95% CI</bold></th><th><bold><italic>P</italic></bold></th><th><bold>Posterior Probability</bold></th><th><bold>OR</bold></th><th><bold>95% CI</bold></th><th><bold><italic>P</italic></bold></th><th><bold>OR</bold></th><th><bold>95% CI</bold></th><th><bold><italic>P</italic></bold></th></tr></thead><tbody><tr valign="top"><td>Female sex</td><td></td><td></td><td></td><td></td><td></td><td></td><td>2.3</td><td>1.0</td><td>0.9-1.1</td><td>.894</td><td></td><td></td><td></td></tr><tr valign="top"><td>Age (per 1-year increment)</td><td>1.02</td><td>1.00-1.03</td><td>.009</td><td></td><td></td><td></td><td>44.8</td><td>1.01</td><td>0.99-1.03</td><td>.421</td><td>1.02</td><td>1.00-1.03</td><td>.009</td></tr><tr valign="top"><td>Diabetes</td><td></td><td></td><td></td><td></td><td></td><td></td><td>7.8</td><td>1.0</td><td>0.8-1.4</td><td>.796</td><td></td><td></td><td></td></tr><tr valign="top"><td>Chronic skin disease</td><td>3.0</td><td>1.5-5.8</td><td>.002</td><td></td><td></td><td></td><td>49.3</td><td>1.7</td><td>0.5-5.3</td><td>.369</td><td>2.9</td><td>1.5-5.6</td><td>.002</td></tr><tr valign="top"><td>Hospitalisation (<1 year)</td><td>2.2</td><td>1.5-3.3</td><td><.001</td><td>2.3</td><td>1.5-3.4</td><td><.001</td><td>100</td><td>2.2</td><td>1.5-3.4</td><td><.001</td><td>2.2</td><td>1.5-3.3</td><td><.001</td></tr><tr valign="top"><td>Nursing home resident</td><td>3.4</td><td>1.6–6.8</td><td>.001</td><td>4.2</td><td>2.1-8.3</td><td><.001</td><td>82.4</td><td>3.1</td><td>0.9-10.3</td><td>.070</td><td>3.4</td><td>1.7-6.9</td><td>.001</td></tr><tr valign="top"><td>Skin wound/sore</td><td>2.7</td><td>1.7-4.4</td><td><.001</td><td>3.0</td><td>1.8-4.8</td><td><.001</td><td>100</td><td>2.9</td><td>1.7-4.7</td><td><.001</td><td>2.8</td><td>1.7-4.6</td><td><.001</td></tr><tr valign="top"><td>Antibiotics (<6 months)</td><td></td><td></td><td></td><td></td><td></td><td></td><td>2.6</td><td>1.0</td><td>0.9-1.2</td><td>.890</td><td></td><td></td><td></td></tr><tr valign="top"><td>Urinary catheter</td><td>4.5</td><td>2.0-10.3</td><td>.018</td><td>4.3</td><td>1.9-9.6</td><td><.001</td><td>72.4</td><td>2.9</td><td>0.7-12.8</td><td>.152</td><td></td><td></td><td></td></tr><tr valign="top"><td>Tracheostomy</td><td></td><td></td><td></td><td></td><td></td><td></td><td>3.1</td><td>1.1</td><td>0.6-2.0</td><td>.867</td><td></td><td></td><td></td></tr><tr valign="top"><td colspan="14"><italic>C</italic>-statistics for validation dataset</td></tr><tr valign="top"><td>Cross-validation, mean (SD)<sup>a</sup></td><td colspan="3">0.643 (0.029)</td><td colspan="3">0.663 (0.028)</td><td></td><td colspan="3">0.653 (0.031)</td><td colspan="3">0.687 (0.030)</td></tr><tr valign="top"><td>Athens</td><td>0.598</td><td></td><td></td><td>0.610</td><td></td><td></td><td></td><td>0.606</td><td></td><td></td><td>0.640</td><td></td><td></td></tr><tr valign="top"><td>Barcelona</td><td>0.762</td><td></td><td></td><td>0.797</td><td></td><td></td><td></td><td>0.798</td><td></td><td></td><td>0.797</td><td></td><td></td></tr><tr valign="top"><td>Cremona</td><td>0.585</td><td></td><td></td><td>0.641</td><td></td><td></td><td></td><td>0.601</td><td></td><td></td><td>0.670</td><td></td><td></td></tr><tr valign="top"><td>Paris</td><td>0.585</td><td></td><td></td><td>0.579</td><td></td><td></td><td></td><td>0.627</td><td></td><td></td><td>0.686</td><td></td><td></td></tr></tbody></table><table-wrap-foot><p>Note. The Stepwise model used stepwise backward elimination; the Best BMA model was the model with the highest posterior probability with the Bayesian model averaging approach; the BMA model included all covariates with a posterior probability of greater than zero using Bayesian model averaging; the Simple model included variables selected at least half the time in both Stepwise and BMA models on repeated random sub-samples of 50% of the cohort. CI, confidence interval; OR, odds ratio; SD, standard deviation.</p><p><sup>a</sup>Cross-validation by repeated random sub-sampling of 50% of the full cohort data for derivation and validation datasets.</p></table-wrap-foot></table-wrap><fig id="Fig1"><label>Figure 1</label><caption><p><bold>Methicillin-resistant</bold><bold><italic>Staphylococcus aureus</italic></bold><bold>predictors selected in various models by Bayesian model averaging.</bold> Note. HIV, human immunodeficiency virus.</p></caption><graphic xlink:href="12879_2015_834_Fig1_HTML" id="MO1"></graphic></fig></p></sec><sec id="Sec10"><title>Assessment of the performance of the prediction models</title><p>After cross-validation, the mean <italic>c</italic>-statistics were 0.643 (SD 0.029) for the Stepwise model, 0.663 (SD 0.028) for the Best BMA model, 0.653 (SD 0.031) for the BMA model, and 0.687 (SD 0.030) for the Simple model (Table <xref rid="Tab2" ref-type="table">2</xref>), demonstrating limited ability of all the models to discriminate between patients who were and were not MRSA colonised. The ROC curves for all models were similar, though showed that the Stepwise model consistently had the worst performance and the Simple model was consistently best (Figure <xref rid="Fig2" ref-type="fig">2</xref>). The density plots in Figure <xref rid="Fig3" ref-type="fig">3</xref> also show that there is considerable overlap between MRSA positive and negative patients for the range of probabilities of MRSA carriage predicted by the models, particularly for low predicted probabilities.<fig id="Fig2"><label>Figure 2</label><caption><p><bold>Receiver operating characteristic (ROC) curves for the multivariable models of admission methicillin-resistant</bold><bold><italic>Staphylococcus aureus</italic></bold><bold>carriage.</bold> Note. BMA, Bayesian model averaging.</p></caption><graphic xlink:href="12879_2015_834_Fig2_HTML" id="MO2"></graphic></fig><fig id="Fig3"><label>Figure 3</label><caption><p><bold>Density plots showing the relative frequencies of predicted probabilities of admission methicillin-resistant</bold><bold><italic>Staphylococcus aureus</italic></bold><bold>colonisation.</bold> Note. BMA, Bayesian model averaging.</p></caption><graphic xlink:href="12879_2015_834_Fig3_HTML" id="MO3"></graphic></fig></p><p>When each hospital was used in turn as the validation cohort, the Simple model was again most discriminatory in all models (<italic>c</italic>-statistics in Table <xref rid="Tab2" ref-type="table">2</xref>). However, these models performed less well than the models that were fitted to data from the whole cohort. The discrimination of the models was in the poor to limited range (<italic>c</italic>-statistics 0.579 to 0.686) except when the models were validated in the Barcelona cohort where the models had higher <italic>c</italic>-statistic values (0.762 to 0.798).</p><p>Table <xref rid="Tab3" ref-type="table">3</xref> summarises the changes in screening performance with the use of different cut-offs of predicted probability of MRSA carriage. For all cut-offs, the Simple model detected more MRSA-positive patients than the Stepwise model despite screening fewer patients in total, giving an improvement in PPV of up to 15%. Targeted screening of patients with a predicted MRSA carriage risk of greater than or equal to 4% would result in similar reduction in screening volume using all four models (64% to 68%). For this cut-off, the sensitivity for detecting MRSA carriers ranged from 61% to 69%, with the lowest sensitivity for the Stepwise model and the highest for the Best BMA model. The Simple model, however, had the highest PPV, on account of the smaller number of patients screened, while the Stepwise model had the lowest PPV. At higher cut-offs, larger differences between models were seen. For example, with a cut-off of 6%, the Best BMA model would screen 45% fewer patients than the Stepwise model, but detect only one fewer MRSA patient, corresponding to a 70% improvement in the PPV. Due to the relatively low prevalence of MRSA carriage in this cohort (3.8%), all models had high NPVs.<table-wrap id="Tab3"><label>Table 3</label><caption><p><bold>Comparison of methicillin-resistant</bold><bold><italic>Staphylococcus aureus</italic></bold><bold>(MRSA) screening strategies using different predictive models</bold></p></caption><table frame="hsides" rules="groups"><thead><tr valign="top"><th><bold>Cut-off for screening</bold></th><th><bold>No. of patients to be screened (%)</bold></th><th><bold>No. of patients MRSA positive</bold></th><th><bold>Sensitivity (%)</bold></th><th><bold>Specificity (%)</bold></th><th><bold>PPV (%)</bold></th><th><bold>NPV (%)</bold></th></tr></thead><tbody><tr valign="top"><td>Universal screening</td><td>1,451 (100)</td><td>49</td><td>100</td><td>0</td><td>3.4</td><td>-</td></tr><tr valign="top"><td>Predicted probability ≥ 2%</td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr valign="top"><td> Stepwise model</td><td>1,213 (83.6)</td><td>46</td><td>93.9</td><td>16.8</td><td>3.8</td><td>98.7</td></tr><tr valign="top"><td> Best BMA model</td><td>1,451 (100)</td><td>49</td><td>100</td><td>0</td><td>3.4</td><td>-</td></tr><tr valign="top"><td> BMA model</td><td>1,437 (99.0)</td><td>49</td><td>100</td><td>1.0</td><td>3.4</td><td>100</td></tr><tr valign="top"><td> Simple model</td><td>1,201 (82.8)</td><td>47</td><td>95.9</td><td>17.7</td><td>3.9</td><td>99.2</td></tr><tr valign="top"><td>Predicted probability ≥ 3%</td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr valign="top"><td> Stepwise model</td><td>813 (56.0)</td><td>37</td><td>75.5</td><td>44.7</td><td>4.6</td><td>98.1</td></tr><tr valign="top"><td> Best BMA model</td><td>528 (36.4)</td><td>34</td><td>69.4</td><td>64.8</td><td>6.4</td><td>98.4</td></tr><tr valign="top"><td> BMA model</td><td>1,137 (78.4)</td><td>44</td><td>89.8</td><td>22.0</td><td>3.9</td><td>98.4</td></tr><tr valign="top"><td> Simple model</td><td>776 (53.5)</td><td>39</td><td>79.6</td><td>47.4</td><td>5.0</td><td>98.5</td></tr><tr valign="top"><td>Predicted probability ≥ 4%</td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr valign="top"><td> Stepwise model</td><td>482 (33.2)</td><td>30</td><td>61.2</td><td>67.8</td><td>6.2</td><td>98.0</td></tr><tr valign="top"><td> Best BMA model</td><td>528 (36.4)</td><td>34</td><td>69.4</td><td>64.8</td><td>6.4</td><td>98.4</td></tr><tr valign="top"><td> BMA model</td><td>463 (31.9)</td><td>31</td><td>63.3</td><td>69.2</td><td>6.7</td><td>98.2</td></tr><tr valign="top"><td> Simple model</td><td>479 (33.0)</td><td>33</td><td>67.3</td><td>68.2</td><td>6.9</td><td>98.4</td></tr><tr valign="top"><td>Predicted probability ≥ 5%</td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr valign="top"><td> Stepwise model</td><td>354 (24.4)</td><td>26</td><td>53.1</td><td>76.6</td><td>7.3</td><td>97.9</td></tr><tr valign="top"><td> Best BMA model</td><td>167 (11.5)</td><td>19</td><td>38.8</td><td>89.4</td><td>11.4</td><td>97.7</td></tr><tr valign="top"><td> BMA model</td><td>133 (9.2)</td><td>16</td><td>32.7</td><td>91.7</td><td>12.0</td><td>97.5</td></tr><tr valign="top"><td> Simple model</td><td>336 (23.2)</td><td>27</td><td>55.1</td><td>78.0</td><td>8.0</td><td>98.0</td></tr><tr valign="top"><td>Predicted probability ≥ 6%</td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr valign="top"><td> Stepwise model</td><td>229 (15.8)</td><td>18</td><td>36.7</td><td>85.0</td><td>7.9</td><td>97.5</td></tr><tr valign="top"><td> Best BMA model</td><td>126 (8.7)</td><td>17</td><td>34.7</td><td>92.2</td><td>13.5</td><td>97.6</td></tr><tr valign="top"><td> BMA model</td><td>64 (4.4)</td><td>6</td><td>12.2</td><td>95.9</td><td>9.4</td><td>96.9</td></tr><tr valign="top"><td> Simple model</td><td>220 (15.2)</td><td>20</td><td>40.8</td><td>85.7</td><td>9.1</td><td>97.6</td></tr></tbody></table><table-wrap-foot><p>Note. The table shows the results when a random sample of 50% of the full cohort was used as the derivation dataset with the remaining data used as the validation dataset. MRSA, methicillin-resistant <italic>Staphylococcus aureus</italic>; NPV, negative predictive value; PPV, positive predictive value.</p></table-wrap-foot></table-wrap></p><p>Using a cut-off of 4% for the predicted probability of MRSA carriage led to the classification of 482 of 1,451 (33.2%) patients in the validation cohort as high-risk with the Stepwise model. Table <xref rid="Tab4" ref-type="table">4</xref> shows how patients are reclassified into risk groups for each model compared with the Stepwise model for this cut-off. The measure of correct reclassification (NRI) was 5.2% (95% CI −6.3%-16.6%, <italic>P</italic> = .38) for the Best BMA model compared to the Stepwise model, indicating that 5.2% more MRSA positive patients were appropriately moved up a risk category than down compared to MRSA negative patients. The NRIs were 5.6% (95% CI −3.4%-14.6%, <italic>P</italic> = .22) and 6.6% (95% CI −0.5%-13.6%, <italic>P</italic> = .07) for the BMA and Simple models compared to the Stepwise model, respectively.<table-wrap id="Tab4"><label>Table 4</label><caption><p><bold>Reclassification in predicted risk of methicillin-resistant</bold><bold><italic>Staphylococcus aureus</italic></bold><bold>carriage between models</bold></p></caption><table frame="hsides" rules="groups"><thead><tr valign="top"><th><bold>Stepwise model</bold></th><th colspan="3"><bold>Best BMA model</bold></th><th colspan="3"><bold>BMA model</bold></th><th colspan="3"><bold>Simple model</bold></th></tr><tr valign="top"><th><bold>Frequency (Row %)</bold></th><th><bold><4%</bold></th><th><bold>≥4%</bold></th><th><bold>Total</bold></th><th><bold><4%</bold></th><th><bold>≥4%</bold></th><th><bold>Total</bold></th><th><bold><4%</bold></th><th><bold>≥4%</bold></th><th><bold>Total</bold></th></tr></thead><tbody><tr valign="top"><td colspan="10">Patients who screened MRSA positive</td></tr><tr valign="top"><td><4%</td><td>13 (68.4)</td><td>6 (31.6)</td><td>19</td><td>16 (84.2)</td><td>3 (15.8)</td><td>19</td><td>16 (84.2)</td><td>3 (15.8)</td><td>19</td></tr><tr valign="top"><td>≥4%</td><td>2 (6.7)</td><td>28 (93.3)</td><td>30</td><td>2 (6.7)</td><td>28 (93.3)</td><td>30</td><td>0 (0)</td><td>30 (100)</td><td>30</td></tr><tr valign="top"><td>Total</td><td>15</td><td>34</td><td>49</td><td>18</td><td>31</td><td>49</td><td>16</td><td>33</td><td>49</td></tr><tr valign="top"><td colspan="10">Patients who screened MRSA negative</td></tr><tr valign="top"><td><4%</td><td>852 (89.7)</td><td>98 (10.3)</td><td>950</td><td>917 (96.5)</td><td>33 (3.5)</td><td>950</td><td>915 (96.3)</td><td>35 (3.7)</td><td>950</td></tr><tr valign="top"><td>≥4%</td><td>56 (12.4)</td><td>396 (87.6)</td><td>452</td><td>53 (11.7)</td><td>399 (88.3)</td><td>452</td><td>41 (9.1)</td><td>411 (90.9)</td><td>452</td></tr><tr valign="top"><td>Total</td><td>908</td><td>494</td><td>1,402</td><td>970</td><td>432</td><td>1,402</td><td>956</td><td>446</td><td>1,402</td></tr><tr valign="top"><td>NRI (95% CI)</td><td colspan="3">5.2% (−6.3%-16.6%) <italic>P</italic> = .376</td><td colspan="3">5.6% (−3.4%-14.6%) <italic>P</italic> = .222</td><td colspan="3">6.6% (−0.5%-13.6%) <italic>P</italic> = .068</td></tr></tbody></table><table-wrap-foot><p>Note. The table shows the results when a random sample of 50% of the full cohort was used as the derivation dataset with the remaining data used as the validation dataset. CI, confidence interval; MRSA, methicillin-resistant <italic>Staphylococcus aureus</italic>; NRI, net reclassification improvement of each model compared with the Stepwise model.</p></table-wrap-foot></table-wrap></p></sec></sec><sec id="Sec11" sec-type="discussion"><title>Discussion</title><p>The development of a successful targeted MRSA screening strategy requires a robust tool for identifying individuals at increased risk of MRSA carriage. Prediction models can quantify this risk and therefore facilitate screening of individuals with a predicted risk above a selected threshold, with the ultimate aim of increasing the cost-effectiveness of the screening strategy [<xref ref-type="bibr" rid="CR12">12</xref>]. We compared different modelling approaches and found that the predictive performance of the models to identify unknown MRSA carriage on admission to surgical wards was limited. However, when we assessed model performance using cross-validation, we were able to demonstrate that the commonly-used stepwise model selection approach has inferior predictive performance to approaches that account for model uncertainty.</p><p>There is no consensus on the optimal approach to building a multivariable predictive model [<xref ref-type="bibr" rid="CR27">27</xref>]. Alternative methods to stepwise variable selection include use of full(er) models which leave non-significant variables in the model, expert knowledge to guide variable selection and automated approaches such as Lasso and Least Angle Regression (LAR) methods [<xref ref-type="bibr" rid="CR28">28</xref>]. Each approach has its advantages and disadvantages. We specifically set out to compare stepwise logistic regression, as it is widely used in prediction modelling despite its problems, with Bayesian Model Averaging, which can potentially overcome some of the limitations of stepwise approaches. The stepwise strategy ignores the variables which are not selected as well as the uncertainty or imprecision resulting from the variable selection process itself since the final single model is assumed to be “optimal” [<xref ref-type="bibr" rid="CR19">19</xref>]. Because automated stepwise variable selection procedures generate a model to provide the best fit for the available data, there is the potential that the model will be overfitted and hence provide an optimistic assessment of its predictive ability [<xref ref-type="bibr" rid="CR29">29</xref>]. This “optimism” results in worse prediction in independent data [<xref ref-type="bibr" rid="CR30">30</xref>]. In contrast, BMA selects a number of all possible single models and uses their posterior probabilities to perform all inferences with the aim of improving predictive performance [<xref ref-type="bibr" rid="CR18">18</xref>]. BMA has been shown to be less likely than stepwise regression to select redundant variables while having a similar probability of selecting a true predictor [<xref ref-type="bibr" rid="CR31">31</xref>]. We found that the modelling approaches that account for model uncertainty out-performed the stepwise strategy when used to predict MRSA carriage risk. Similar findings have been demonstrated in other areas of research such as cardiovascular risk prediction [<xref ref-type="bibr" rid="CR19">19</xref>].</p><p>In our study, targeted screening of patients with predicted probabilities of MRSA carriage of greater than or equal to 4% would reduce screening burden by about two-thirds compared with universal screening using both the Stepwise and Simple models. However, the Simple model was more sensitive, identifying 6.1% more MRSA carriers. The rationale for the Simple model was twofold. First, it accounted for model uncertainty by incorporating the BMA approach in the strategy. It also included covariates that were selected in the majority of models on repeated random sub-samples of the data with the aim of identifying factors that were truly informative since repetition of the procedure allowed more of the data to be used for derivation of the models. Second, it was expected that this approach would result in a more parsimonious model containing fewer covariates as it only included those that were commonly selected by both Stepwise and BMA models. This “simple” model would reduce the risk of overfitting. Indeed, this approach produced the model with the best predictive performance. A “simple” model would also be easier to implement in the clinical setting as the number of variables for which information would need to be collected would be smaller.</p><p>The risk of overfitting a model increases if the number of outcomes is small [<xref ref-type="bibr" rid="CR32">32</xref>]. Thus the performance of predictive models developed from cohorts with high MRSA prevalence would be expected to be superior to that of models based on cohorts with few MRSA positive subjects. Indeed this was demonstrated in our evaluation of model performance where each hospital was used in turn as the validation dataset. The number of MRSA-positive subjects was lowest in the Barcelona cohort in which only 9 (1.8%) patients were MRSA positive compared with 20 to 51 (2.4% to 5.2%) MRSA carriers in the other hospitals. This difference in MRSA prevalence may explain why the models did not perform well, as measured by the <italic>c</italic>-statistic, except when data from Barcelona were used in the validation rather than the derivation dataset. The superior performance of the models to predict MRSA carriage in the Barcelona cohort could also be explained by the relatively homogenous group of MRSA patients in this hospital. Most patients had the “typical” risk factors of older age, recent hospitalisation, nursing home residency and presence of wounds.</p><p>We evaluated the clinical implications of using each model compared with the Stepwise model by quantifying the reclassification of patients into appropriate risk groups. Our results showed that a cut-off of 4% for the predicted probability of MRSA carriage would classify 33.2% of patients as high-risk using the Stepwise model. These patients could be targeted for screening. However, compared with the Stepwise model, use of the Simple model would increase appropriate patient screening by approximately 6.6% (<italic>P</italic> = .07). This improvement in reclassification of patients with the Simple model occurred despite little change in the <italic>c</italic>-statistic, demonstrating that the traditionally used <italic>c</italic>-statistic may be an insensitive measure of model performance. Novel measures, such as the NRI, may be more useful for comparing prediction models [<xref ref-type="bibr" rid="CR23">23</xref>,<xref ref-type="bibr" rid="CR33">33</xref>]. Once the model is chosen, the risk cut-off selected for the screening algorithm will be a trade-off between the sensitivity and specificity, and where this cut-off is set is an economic decision which should ideally be evaluated using decision models.</p><p>We explored risk factors for MRSA carriage in a number of surgical units in different countries using a large sample size, reducing the risk of overfitting the models. Previous studies have limited their analyses to single centres or a number of centres in the same country [<xref ref-type="bibr" rid="CR10">10</xref>,<xref ref-type="bibr" rid="CR14">14</xref>,<xref ref-type="bibr" rid="CR15">15</xref>,<xref ref-type="bibr" rid="CR17">17</xref>]. In addition, we included subjects who were expected to have varying levels of MRSA carriage risk. The data used in the study was also collected prospectively, increasing the quality of the information on risk factors. We screened at least two anatomic sites for MRSA carriage as well as using overnight enrichment for screening specimens [<xref ref-type="bibr" rid="CR21">21</xref>,<xref ref-type="bibr" rid="CR34">34</xref>], increasing the sensitivity of MRSA detection. Screening for MRSA from nasal samples alone or with less sensitive laboratory techniques may underestimate true MRSA carriage rates and lead to differences in results between studies. We attempted to correct for overoptimistic model predictions by cross-validation. In addition, we assessed the performance of the models in different patient groups by using each hospital in turn as the validation set.</p><p>Our study has some limitations. The predictive performance of the models may be affected by the emergence of community-associated MRSA which, in some regions, is now the commonest cause of soft tissue infection among persons who have not had healthcare contact [<xref ref-type="bibr" rid="CR35">35</xref>]. Livestock-related MRSA is also an increasing problem in some countries [<xref ref-type="bibr" rid="CR36">36</xref>]. These emerging strains of MRSA are not necessarily associated with the traditional risk factors of healthcare-associated strains. However, in the 4 hospitals participating in our study, these new MRSA strains remain relatively rare [<xref ref-type="bibr" rid="CR37">37</xref>]. It would be important to externally validate our predictive models, using a dataset different in time and place to the one from which it was developed, to determine if their performance properties are maintained in, and therefore generalisable to, different patient populations [<xref ref-type="bibr" rid="CR38">38</xref>]. Geographic variations in MRSA epidemiology may warrant the development of local prediction rules to increase the accuracy of risk stratification for selection of patients for MRSA screening.</p></sec><sec id="Sec12" sec-type="conclusions"><title>Conclusions</title><p>Multidrug-resistant organisms are an increasing global problem [<xref ref-type="bibr" rid="CR39">39</xref>]. Risk prediction models which can accurately quantify the probability of carriage with these organisms can assist in targeting active surveillance and control measures, thus increasing the cost-effectiveness of these interventions [<xref ref-type="bibr" rid="CR40">40</xref>]. It is important to note, however, that the performance of different model selection approaches to develop MRSA risk indices varies. Our study showed that although the predictive performance of the various approaches was limited, simpler or more parsimonious models, which account for model uncertainty, may perform better than commonly-used stepwise models when assessed with novel, clinically relevant performance measures. With emerging evidence to support preoperative interventions to reduce infections in individuals colonised with <italic>S. aureus</italic> [<xref ref-type="bibr" rid="CR9">9</xref>,<xref ref-type="bibr" rid="CR41">41</xref>], the development of robust risk profiling tools to identify carriers of both methicillin-sensitive as well as methicillin-resistant <italic>S. aureus</italic> would be an important focus for future research.</p></sec></body><back><glossary><title>Abbreviations</title><def-list><def-list><def-item><term>BMA</term><def><p>Bayesian model averaging</p></def></def-item><def-item><term>CI</term><def><p>Confidence interval</p></def></def-item><def-item><term>COPD</term><def><p>Chronic obstructive pulmonary disease</p></def></def-item><def-item><term>HIV</term><def><p>Human immunodeficiency virus</p></def></def-item><def-item><term>MRSA</term><def><p>Methicillin-resistant <italic>Staphylococcus aureus</italic></p></def></def-item><def-item><term>NPV</term><def><p>Negative predictive value</p></def></def-item><def-item><term>NRI</term><def><p>Net reclassification improvement</p></def></def-item><def-item><term>OR</term><def><p>Odds ratio</p></def></def-item><def-item><term>PPV</term><def><p>Positive predictive value</p></def></def-item><def-item><term>ROC</term><def><p>Receiver operating characteristic</p></def></def-item><def-item><term>SD</term><def><p>Standard deviation</p></def></def-item></def-list></def-list></glossary><fn-group><fn><p><bold>Competing interests</bold></p><p>SH is a member of the speakers’ bureau for bioMérieux and the scientific advisory board of Destiny Pharma, DaVolterra, and bioMérieux. He has also received financial support for MRSA research activities from Geneva University Hospitals, B.Braun, and Pfizer. AP (Pan) is a member of the speakers’ bureau for Cubist and has received financial support for MRSA research activities from BD. All other authors declare that they have no competing interests.</p></fn><fn><p><bold>Authors’ contributions</bold></p><p>AL was involved in the coordination of the study, analysed and interpreted data and wrote the first draft of the manuscript. AP (Pan) was involved in the conception and design of the study and data acquisition. SH contributed to the conception and design of the study, supervised the study and assisted in drafting the manuscript. AP (Patroni) was involved in data analysis. AC, GD, SG and JAM contributed to the acquisition of data. BSC analysed and interpreted data and assisted with drafting of the manuscript. All authors have critically revised the content of the manuscript and approved the final version.</p></fn></fn-group><ack><title>Acknowledgements</title><p>This work is part of the activities of the MOSAR integrated project supported by the European Commission under the Life Science Health priority of the 6<sup>th</sup> Framework Program (Contract n° LSHP-CT-2007-037941). BSC was supported by The Oak Foundation and The Medical Research Council and Department for International Development [grant number MR/K006924/1]. The Wellcome Trust-Mahidol University-Oxford Tropical Medicine Research Programme is supported by the Wellcome Trust of Great Britain (089275/Z/09/Z). The funding bodies had no role in the study design, data collection, analysis, data interpretation, preparation of the manuscript or decision to submit the manuscript for publication.</p></ack><ref-list id="Bib1"><title>References</title><ref id="CR1"><label>1.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Weber</surname><given-names>SG</given-names></name><name><surname>Huang</surname><given-names>SS</given-names></name><name><surname>Oriola</surname><given-names>S</given-names></name><name><surname>Huskins</surname><given-names>WC</given-names></name><name><surname>Noskin</surname><given-names>GA</given-names></name><name><surname>Harriman</surname><given-names>K</given-names></name><etal></etal></person-group><article-title>Legislative mandates for use of active surveillance cultures to screen for methicillin-resistant <italic>Staphylococcus aureus</italic> and vancomycin-resistant enterococci: Position statement from the Joint SHEA and APIC Task Force</article-title><source>Am J Infect Control</source><year>2007</year><volume>35</volume><fpage>73</fpage><lpage>85</lpage><pub-id pub-id-type="doi">10.1016/j.ajic.2007.01.001</pub-id><pub-id pub-id-type="pmid">17327185</pub-id></element-citation></ref><ref id="CR2"><label>2.</label><mixed-citation publication-type="other">UK Department of Health. MRSA Screening - Operational Guidance 2. [<ext-link ext-link-type="uri" xlink:href="http://webarchive.nationalarchives.gov.uk/20130107105354/http://www.dh.gov.uk/en/Publicationsandstatistics/Lettersandcirculars/Dearcolleagueletters/DH_092844">http://webarchive.nationalarchives.gov.uk/20130107105354/http://www.dh.gov.uk/en/Publicationsandstatistics/Lettersandcirculars/Dearcolleagueletters/DH_092844</ext-link>]</mixed-citation></ref><ref id="CR3"><label>3.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Murthy</surname><given-names>A</given-names></name><name><surname>De Angelis</surname><given-names>G</given-names></name><name><surname>Pittet</surname><given-names>D</given-names></name><name><surname>Schrenzel</surname><given-names>J</given-names></name><name><surname>Uckay</surname><given-names>I</given-names></name><name><surname>Harbarth</surname><given-names>S</given-names></name></person-group><article-title>Cost-effectiveness of universal MRSA screening on admission to surgery</article-title><source>Clin Microbiol Infect</source><year>2010</year><volume>16</volume><fpage>1747</fpage><lpage>1753</lpage><pub-id pub-id-type="doi">10.1111/j.1469-0691.2010.03220.x</pub-id><pub-id pub-id-type="pmid">20331684</pub-id></element-citation></ref><ref id="CR4"><label>4.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Robotham</surname><given-names>JV</given-names></name><name><surname>Graves</surname><given-names>N</given-names></name><name><surname>Cookson</surname><given-names>BD</given-names></name><name><surname>Barnett</surname><given-names>AG</given-names></name><name><surname>Wilson</surname><given-names>JA</given-names></name><name><surname>Edgeworth</surname><given-names>JD</given-names></name><etal></etal></person-group><article-title>Screening, isolation, and decolonisation strategies in the control of meticillin resistant <italic>Staphylococcus aureus</italic> in intensive care units: cost effectiveness evaluation</article-title><source>BMJ</source><year>2011</year><volume>343</volume><fpage>d5694</fpage><pub-id pub-id-type="doi">10.1136/bmj.d5694</pub-id><pub-id pub-id-type="pmid">21980062</pub-id></element-citation></ref><ref id="CR5"><label>5.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Collins</surname><given-names>J</given-names></name><name><surname>Raza</surname><given-names>M</given-names></name><name><surname>Ford</surname><given-names>M</given-names></name><name><surname>Hall</surname><given-names>L</given-names></name><name><surname>Brydon</surname><given-names>S</given-names></name><name><surname>Gould</surname><given-names>FK</given-names></name></person-group><article-title>Review of a three-year meticillin-resistant <italic>Staphylococcus aureus</italic> screening programme</article-title><source>J Hosp Infect</source><year>2011</year><volume>78</volume><fpage>81</fpage><lpage>85</lpage><pub-id pub-id-type="doi">10.1016/j.jhin.2011.02.012</pub-id><pub-id pub-id-type="pmid">21507518</pub-id></element-citation></ref><ref id="CR6"><label>6.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kang</surname><given-names>J</given-names></name><name><surname>Mandsager</surname><given-names>P</given-names></name><name><surname>Biddle</surname><given-names>AK</given-names></name><name><surname>Weber</surname><given-names>DJ</given-names></name></person-group><article-title>Cost-effectiveness analysis of active surveillance screening for methicillin-resistant <italic>Staphylococcus aureus</italic> in an academic hospital setting</article-title><source>Infect Control Hosp Epidemiol</source><year>2012</year><volume>33</volume><fpage>477</fpage><lpage>486</lpage><pub-id pub-id-type="doi">10.1086/665315</pub-id><pub-id pub-id-type="pmid">22476274</pub-id></element-citation></ref><ref id="CR7"><label>7.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Safdar</surname><given-names>N</given-names></name><name><surname>Bradley</surname><given-names>EA</given-names></name></person-group><article-title>The risk of infection after nasal colonization with <italic>Staphylococcus aureus</italic></article-title><source>Am J Med</source><year>2008</year><volume>121</volume><fpage>310</fpage><lpage>315</lpage><pub-id pub-id-type="doi">10.1016/j.amjmed.2007.07.034</pub-id><pub-id pub-id-type="pmid">18374690</pub-id></element-citation></ref><ref id="CR8"><label>8.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Lee</surname><given-names>AS</given-names></name><name><surname>Cooper</surname><given-names>BS</given-names></name><name><surname>Malhotra-Kumar</surname><given-names>S</given-names></name><name><surname>Chalfine</surname><given-names>A</given-names></name><name><surname>Daikos</surname><given-names>GL</given-names></name><name><surname>Fankhauser</surname><given-names>C</given-names></name><etal></etal></person-group><article-title>Comparison of strategies to reduce meticillin-resistant <italic>Staphylococcus aureus</italic> rates in surgical patients: a controlled multicentre intervention trial</article-title><source>BMJ Open</source><year>2013</year><volume>3</volume><fpage>e003126</fpage><pub-id pub-id-type="pmid">24056477</pub-id></element-citation></ref><ref id="CR9"><label>9.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Schweizer</surname><given-names>M</given-names></name><name><surname>Perencevich</surname><given-names>E</given-names></name><name><surname>McDanel</surname><given-names>J</given-names></name><name><surname>Carson</surname><given-names>J</given-names></name><name><surname>Formanek</surname><given-names>M</given-names></name><name><surname>Hafner</surname><given-names>J</given-names></name><etal></etal></person-group><article-title>Effectiveness of a bundled intervention of decolonization and prophylaxis to decrease Gram positive surgical site infections after cardiac or orthopedic surgery: systematic review and meta-analysis</article-title><source>BMJ</source><year>2013</year><volume>346</volume><fpage>f2743</fpage><pub-id pub-id-type="doi">10.1136/bmj.f2743</pub-id><pub-id pub-id-type="pmid">23766464</pub-id></element-citation></ref><ref id="CR10"><label>10.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Furuno</surname><given-names>JP</given-names></name><name><surname>Harris</surname><given-names>AD</given-names></name><name><surname>Wright</surname><given-names>MO</given-names></name><name><surname>McGregor</surname><given-names>JC</given-names></name><name><surname>Venezia</surname><given-names>RA</given-names></name><name><surname>Zhu</surname><given-names>J</given-names></name><etal></etal></person-group><article-title>Prediction rules to identify patients with methicillin-resistant <italic>Staphylococcus aureus</italic> and vancomycin-resistant enterococci upon hospital admission</article-title><source>Am J Infect Control</source><year>2004</year><volume>32</volume><fpage>436</fpage><lpage>440</lpage><pub-id pub-id-type="doi">10.1016/j.ajic.2004.03.009</pub-id><pub-id pub-id-type="pmid">15573048</pub-id></element-citation></ref><ref id="CR11"><label>11.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Harbarth</surname><given-names>S</given-names></name><name><surname>Sax</surname><given-names>H</given-names></name><name><surname>Fankhauser-Rodriguez</surname><given-names>C</given-names></name><name><surname>Schrenzel</surname><given-names>J</given-names></name><name><surname>Agostinho</surname><given-names>A</given-names></name><name><surname>Pittet</surname><given-names>D</given-names></name></person-group><article-title>Evaluating the probability of previously unknown carriage of MRSA at hospital admission</article-title><source>Am J Med</source><year>2006</year><volume>119</volume><fpage>275</fpage><pub-id pub-id-type="doi">10.1016/j.amjmed.2005.04.042</pub-id><pub-id pub-id-type="pmid">16490475</pub-id></element-citation></ref><ref id="CR12"><label>12.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Furuno</surname><given-names>JP</given-names></name><name><surname>McGregor</surname><given-names>JC</given-names></name><name><surname>Harris</surname><given-names>AD</given-names></name><name><surname>Johnson</surname><given-names>JA</given-names></name><name><surname>Johnson</surname><given-names>JK</given-names></name><name><surname>Langenberg</surname><given-names>P</given-names></name><etal></etal></person-group><article-title>Identifying groups at high risk for carriage of antibiotic-resistant bacteria</article-title><source>Arch Int Med</source><year>2006</year><volume>166</volume><fpage>580</fpage><lpage>585</lpage><pub-id pub-id-type="doi">10.1001/archinte.166.5.580</pub-id><pub-id pub-id-type="pmid">16534047</pub-id></element-citation></ref><ref id="CR13"><label>13.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Haley</surname><given-names>CC</given-names></name><name><surname>Mittal</surname><given-names>D</given-names></name><name><surname>Laviolette</surname><given-names>A</given-names></name><name><surname>Jannapureddy</surname><given-names>S</given-names></name><name><surname>Parvez</surname><given-names>N</given-names></name><name><surname>Haley</surname><given-names>RW</given-names></name></person-group><article-title>Methicillin-resistant <italic>Staphylococcus aureus</italic> infection or colonization present at hospital admission: multivariable risk factor screening to increase efficiency of surveillance culturing</article-title><source>J Clin Microbiol</source><year>2007</year><volume>45</volume><fpage>3031</fpage><lpage>3038</lpage><pub-id pub-id-type="doi">10.1128/JCM.00315-07</pub-id><pub-id pub-id-type="pmid">17626171</pub-id></element-citation></ref><ref id="CR14"><label>14.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Harbarth</surname><given-names>S</given-names></name><name><surname>Sax</surname><given-names>H</given-names></name><name><surname>Uckay</surname><given-names>I</given-names></name><name><surname>Fankhauser</surname><given-names>C</given-names></name><name><surname>Agostinho</surname><given-names>A</given-names></name><name><surname>Christenson</surname><given-names>JT</given-names></name><etal></etal></person-group><article-title>A predictive model for identifying surgical patients at risk of methicillin-resistant <italic>Staphylococcus aureus</italic> carriage on admission</article-title><source>J Am Coll Surg</source><year>2008</year><volume>207</volume><fpage>683</fpage><lpage>689</lpage><pub-id pub-id-type="doi">10.1016/j.jamcollsurg.2008.05.023</pub-id><pub-id pub-id-type="pmid">18954780</pub-id></element-citation></ref><ref id="CR15"><label>15.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Riedel</surname><given-names>S</given-names></name><name><surname>Von Stein</surname><given-names>D</given-names></name><name><surname>Richardson</surname><given-names>K</given-names></name><name><surname>Page</surname><given-names>J</given-names></name><name><surname>Miller</surname><given-names>S</given-names></name><name><surname>Winokur</surname><given-names>P</given-names></name><etal></etal></person-group><article-title>Development of a prediction rule for methicillin-resistant <italic>Staphylococcus aureus</italic> and vancomycin-resistant enterococcus carriage in a Veterans Affairs Medical Center population</article-title><source>Infect Control Hosp Epidemiol</source><year>2008</year><volume>29</volume><fpage>969</fpage><lpage>971</lpage><pub-id pub-id-type="doi">10.1086/590662</pub-id><pub-id pub-id-type="pmid">18702599</pub-id></element-citation></ref><ref id="CR16"><label>16.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Morgan</surname><given-names>DJ</given-names></name><name><surname>Day</surname><given-names>HR</given-names></name><name><surname>Furuno</surname><given-names>JP</given-names></name><name><surname>Young</surname><given-names>A</given-names></name><name><surname>Johnson</surname><given-names>JK</given-names></name><name><surname>Bradham</surname><given-names>DD</given-names></name><etal></etal></person-group><article-title>Improving efficiency in active surveillance for methicillin-resistant <italic>Staphylococcus aureus</italic> or vancomycin-resistant Enterococcus at hospital admission</article-title><source>Infect Control Hosp Epidemiol</source><year>2010</year><volume>31</volume><fpage>1230</fpage><lpage>1235</lpage><pub-id pub-id-type="doi">10.1086/657335</pub-id><pub-id pub-id-type="pmid">21028966</pub-id></element-citation></ref><ref id="CR17"><label>17.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Robicsek</surname><given-names>A</given-names></name><name><surname>Beaumont</surname><given-names>JL</given-names></name><name><surname>Wright</surname><given-names>MO</given-names></name><name><surname>Thomson</surname><given-names>RB</given-names><suffix>Jr</suffix></name><name><surname>Kaul</surname><given-names>KL</given-names></name><name><surname>Peterson</surname><given-names>LR</given-names></name></person-group><article-title>Electronic prediction rules for methicillin-resistant <italic>Staphylococcus aureus</italic> colonization</article-title><source>Infect Control Hosp Epidemiol</source><year>2011</year><volume>32</volume><fpage>9</fpage><lpage>19</lpage><pub-id pub-id-type="doi">10.1086/657631</pub-id><pub-id pub-id-type="pmid">21121818</pub-id></element-citation></ref><ref id="CR18"><label>18.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Yeung</surname><given-names>KY</given-names></name><name><surname>Bumgarner</surname><given-names>RE</given-names></name><name><surname>Raftery</surname><given-names>AE</given-names></name></person-group><article-title>Bayesian model averaging: development of an improved multi-class, gene selection and classification tool for microarray data</article-title><source>Bioinformatics</source><year>2005</year><volume>21</volume><fpage>2394</fpage><lpage>2402</lpage><pub-id pub-id-type="doi">10.1093/bioinformatics/bti319</pub-id><pub-id pub-id-type="pmid">15713736</pub-id></element-citation></ref><ref id="CR19"><label>19.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Wang</surname><given-names>D</given-names></name><name><surname>Zhang</surname><given-names>W</given-names></name><name><surname>Bakhai</surname><given-names>A</given-names></name></person-group><article-title>Comparison of Bayesian model averaging and stepwise methods for model selection in logistic regression</article-title><source>Stat Med</source><year>2004</year><volume>23</volume><fpage>3451</fpage><lpage>3467</lpage><pub-id pub-id-type="doi">10.1002/sim.1930</pub-id><pub-id pub-id-type="pmid">15505893</pub-id></element-citation></ref><ref id="CR20"><label>20.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Pan</surname><given-names>A</given-names></name><name><surname>Lee</surname><given-names>A</given-names></name><name><surname>Cooper</surname><given-names>B</given-names></name><name><surname>Chalfine</surname><given-names>A</given-names></name><name><surname>Daikos</surname><given-names>GL</given-names></name><name><surname>Garilli</surname><given-names>S</given-names></name><etal></etal></person-group><article-title>Risk factors for previously unknown meticillin-resistant <italic>Staphylococcus aureus</italic> carriage on admission to 13 surgical wards in Europe</article-title><source>J Hosp Infect</source><year>2013</year><volume>83</volume><fpage>107</fpage><lpage>113</lpage><pub-id pub-id-type="doi">10.1016/j.jhin.2012.09.020</pub-id><pub-id pub-id-type="pmid">23201397</pub-id></element-citation></ref><ref id="CR21"><label>21.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Van Heirstraeten</surname><given-names>L</given-names></name><name><surname>Cortinas Abrahantes</surname><given-names>J</given-names></name><name><surname>Lammens</surname><given-names>C</given-names></name><name><surname>Lee</surname><given-names>A</given-names></name><name><surname>Harbarth</surname><given-names>S</given-names></name><name><surname>Molenberghs</surname><given-names>G</given-names></name><etal></etal></person-group><article-title>Impact of a short period of pre-enrichment on detection and bacterial loads of methicillin-resistant <italic>Staphylococcus aureus</italic> from screening specimens</article-title><source>J Clin Microbiol</source><year>2009</year><volume>47</volume><fpage>3326</fpage><lpage>3328</lpage><pub-id pub-id-type="doi">10.1128/JCM.01088-09</pub-id><pub-id pub-id-type="pmid">19675216</pub-id></element-citation></ref><ref id="CR22"><label>22.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gazin</surname><given-names>M</given-names></name><name><surname>Lee</surname><given-names>A</given-names></name><name><surname>Derde</surname><given-names>L</given-names></name><name><surname>Kazma</surname><given-names>M</given-names></name><name><surname>Lammens</surname><given-names>C</given-names></name><name><surname>Ieven</surname><given-names>M</given-names></name><etal></etal></person-group><article-title>Culture-based detection of methicillin-resistant <italic>Staphylococcus aureus</italic> by a network of European laboratories: an external quality assessment study</article-title><source>Eur J Clin Microbiol Infect Dis</source><year>2012</year><volume>31</volume><fpage>1765</fpage><lpage>1770</lpage><pub-id pub-id-type="doi">10.1007/s10096-011-1499-0</pub-id><pub-id pub-id-type="pmid">22160823</pub-id></element-citation></ref><ref id="CR23"><label>23.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Cook</surname><given-names>NR</given-names></name></person-group><article-title>Statistical evaluation of prognostic versus diagnostic models: beyond the ROC curve</article-title><source>Clin Chem</source><year>2008</year><volume>54</volume><fpage>17</fpage><lpage>23</lpage><pub-id pub-id-type="doi">10.1373/clinchem.2007.096529</pub-id><pub-id pub-id-type="pmid">18024533</pub-id></element-citation></ref><ref id="CR24"><label>24.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Pencina</surname><given-names>MJ</given-names></name><name><surname>D'Agostino</surname><given-names>RB</given-names><suffix>Sr</suffix></name><name><surname>D'Agostino</surname><given-names>RB</given-names><suffix>Jr</suffix></name><name><surname>Vasan</surname><given-names>RS</given-names></name></person-group><article-title>Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond</article-title><source>Stat Med</source><year>2008</year><volume>27</volume><fpage>157</fpage><lpage>172</lpage><pub-id pub-id-type="doi">10.1002/sim.2929</pub-id><pub-id pub-id-type="pmid">17569110</pub-id></element-citation></ref><ref id="CR25"><label>25.</label><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Raftery</surname><given-names>A</given-names></name><name><surname>Hoeting</surname><given-names>J</given-names></name><name><surname>Volinsky</surname><given-names>C</given-names></name><name><surname>Painter</surname><given-names>I</given-names></name><name><surname>Yeung</surname><given-names>KY</given-names></name></person-group><source>BMA: Bayesian Model Averaging. R package version 3.14.1</source><year>2011</year></element-citation></ref><ref id="CR26"><label>26.</label><mixed-citation publication-type="other">R Development Core Team. R. A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. 2010. ISBN 3-900051-07-0 [<ext-link ext-link-type="uri" xlink:href="http://www.r-project.org/">http://www.R-project.org/</ext-link>]</mixed-citation></ref><ref id="CR27"><label>27.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Royston</surname><given-names>P</given-names></name><name><surname>Moons</surname><given-names>KG</given-names></name><name><surname>Altman</surname><given-names>DG</given-names></name><name><surname>Vergouwe</surname><given-names>Y</given-names></name></person-group><article-title>Prognosis and prognostic research: Developing a prognostic model</article-title><source>BMJ</source><year>2009</year><volume>338</volume><fpage>b604</fpage><pub-id pub-id-type="doi">10.1136/bmj.b604</pub-id><pub-id pub-id-type="pmid">19336487</pub-id></element-citation></ref><ref id="CR28"><label>28.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Hesterberg</surname><given-names>T</given-names></name><name><surname>Choi</surname><given-names>NH</given-names></name><name><surname>Meier</surname><given-names>L</given-names></name><name><surname>Fraley</surname><given-names>C</given-names></name></person-group><article-title>Least angle and <italic>l</italic><sub>1</sub> penalized regression: A review</article-title><source>Statist Surv</source><year>2008</year><volume>2</volume><fpage>61</fpage><lpage>93</lpage><pub-id pub-id-type="doi">10.1214/08-SS035</pub-id></element-citation></ref><ref id="CR29"><label>29.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Babyak</surname><given-names>MA</given-names></name></person-group><article-title>What you see may not be what you get: a brief, nontechnical introduction to overfitting in regression-type models</article-title><source>Psychosom Med</source><year>2004</year><volume>66</volume><fpage>411</fpage><lpage>421</lpage><pub-id pub-id-type="pmid">15184705</pub-id></element-citation></ref><ref id="CR30"><label>30.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Steyerberg</surname><given-names>EW</given-names></name><name><surname>Harrell</surname><given-names>FE</given-names><suffix>Jr</suffix></name><name><surname>Borsboom</surname><given-names>GJ</given-names></name><name><surname>Eijkemans</surname><given-names>MJ</given-names></name><name><surname>Vergouwe</surname><given-names>Y</given-names></name><name><surname>Habbema</surname><given-names>JD</given-names></name></person-group><article-title>Internal validation of predictive models: efficiency of some procedures for logistic regression analysis</article-title><source>J Clin Epidemiol</source><year>2001</year><volume>54</volume><fpage>774</fpage><lpage>781</lpage><pub-id pub-id-type="doi">10.1016/S0895-4356(01)00341-9</pub-id><pub-id pub-id-type="pmid">11470385</pub-id></element-citation></ref><ref id="CR31"><label>31.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Genell</surname><given-names>A</given-names></name><name><surname>Nemes</surname><given-names>S</given-names></name><name><surname>Steineck</surname><given-names>G</given-names></name><name><surname>Dickman</surname><given-names>PW</given-names></name></person-group><article-title>Model selection in medical research: a simulation study comparing Bayesian model averaging and stepwise regression</article-title><source>BMC Med Res Methodol</source><year>2010</year><volume>10</volume><fpage>108</fpage><pub-id pub-id-type="doi">10.1186/1471-2288-10-108</pub-id><pub-id pub-id-type="pmid">21134252</pub-id></element-citation></ref><ref id="CR32"><label>32.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Concato</surname><given-names>J</given-names></name><name><surname>Feinstein</surname><given-names>AR</given-names></name><name><surname>Holford</surname><given-names>TR</given-names></name></person-group><article-title>The risk of determining risk with multivariable models</article-title><source>Ann Intern Med</source><year>1993</year><volume>118</volume><fpage>201</fpage><lpage>210</lpage><pub-id pub-id-type="doi">10.7326/0003-4819-118-3-199302010-00009</pub-id><pub-id pub-id-type="pmid">8417638</pub-id></element-citation></ref><ref id="CR33"><label>33.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Steyerberg</surname><given-names>EW</given-names></name><name><surname>Vickers</surname><given-names>AJ</given-names></name><name><surname>Cook</surname><given-names>NR</given-names></name><name><surname>Gerds</surname><given-names>T</given-names></name><name><surname>Gonen</surname><given-names>M</given-names></name><name><surname>Obuchowski</surname><given-names>N</given-names></name><etal></etal></person-group><article-title>Assessing the performance of prediction models: a framework for traditional and novel measures</article-title><source>Epidemiology</source><year>2010</year><volume>21</volume><fpage>128</fpage><lpage>138</lpage><pub-id pub-id-type="doi">10.1097/EDE.0b013e3181c30fb2</pub-id><pub-id pub-id-type="pmid">20010215</pub-id></element-citation></ref><ref id="CR34"><label>34.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>McKinnell</surname><given-names>JA</given-names></name><name><surname>Huang</surname><given-names>SS</given-names></name><name><surname>Eells</surname><given-names>SJ</given-names></name><name><surname>Cui</surname><given-names>E</given-names></name><name><surname>Miller</surname><given-names>LG</given-names></name></person-group><article-title>Quantifying the impact of extranasal testing of body sites for methicillin-resistant <italic>Staphylococcus aureus</italic> colonization at the time of hospital or intensive care unit admission</article-title><source>Infect Control Hosp Epidemiol</source><year>2013</year><volume>34</volume><fpage>161</fpage><lpage>170</lpage><pub-id pub-id-type="doi">10.1086/669095</pub-id><pub-id pub-id-type="pmid">23295562</pub-id></element-citation></ref><ref id="CR35"><label>35.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Daum</surname><given-names>RS</given-names></name></person-group><article-title>Clinical practice. Skin and soft-tissue infections caused by methicillin-resistant <italic>Staphylococcus aureus</italic></article-title><source>N Eng J Med</source><year>2007</year><volume>357</volume><fpage>380</fpage><lpage>390</lpage><pub-id pub-id-type="doi">10.1056/NEJMcp070747</pub-id></element-citation></ref><ref id="CR36"><label>36.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Voss</surname><given-names>A</given-names></name><name><surname>Loeffen</surname><given-names>F</given-names></name><name><surname>Bakker</surname><given-names>J</given-names></name><name><surname>Klaassen</surname><given-names>C</given-names></name><name><surname>Wulf</surname><given-names>M</given-names></name></person-group><article-title>Methicillin-resistant <italic>Staphylococcus aureus</italic> in pig farming</article-title><source>Emerg Infect Dis</source><year>2005</year><volume>11</volume><fpage>1965</fpage><lpage>1966</lpage><pub-id pub-id-type="doi">10.3201/eid1112.050428</pub-id><pub-id pub-id-type="pmid">16485492</pub-id></element-citation></ref><ref id="CR37"><label>37.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Tsiodras</surname><given-names>S</given-names></name><name><surname>Daikos</surname><given-names>GL</given-names></name><name><surname>Lee</surname><given-names>A</given-names></name><name><surname>Plachouras</surname><given-names>D</given-names></name><name><surname>Antoniadou</surname><given-names>A</given-names></name><name><surname>Ploiarchopoulou</surname><given-names>F</given-names></name><etal></etal></person-group><article-title>Risk factors for Community-Associated MRSA in a large metropolitan area in Greece: An Epidemiological Study Using Two Case Definitions</article-title><source>J Global Antimicrobial Resistance</source><year>2014</year><volume>2</volume><fpage>27</fpage><lpage>33</lpage><pub-id pub-id-type="doi">10.1016/j.jgar.2013.10.001</pub-id></element-citation></ref><ref id="CR38"><label>38.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Altman</surname><given-names>DG</given-names></name><name><surname>Vergouwe</surname><given-names>Y</given-names></name><name><surname>Royston</surname><given-names>P</given-names></name><name><surname>Moons</surname><given-names>KG</given-names></name></person-group><article-title>Prognosis and prognostic research: validating a prognostic model</article-title><source>BMJ</source><year>2009</year><volume>338</volume><fpage>b605</fpage><pub-id pub-id-type="doi">10.1136/bmj.b605</pub-id><pub-id pub-id-type="pmid">19477892</pub-id></element-citation></ref><ref id="CR39"><label>39.</label><mixed-citation publication-type="other">WHO. Report on the burden of endemic health care-associated infection worldwide. [<ext-link ext-link-type="uri" xlink:href="http://www.who.int/gpsc/country_work/burden_hcai/en/">http://www.who.int/gpsc/country_work/burden_hcai/en/</ext-link>]</mixed-citation></ref><ref id="CR40"><label>40.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Lee</surname><given-names>AS</given-names></name><name><surname>Huttner</surname><given-names>B</given-names></name><name><surname>Harbarth</surname><given-names>S</given-names></name></person-group><article-title>Control of methicillin-resistant <italic>Staphylococcus aureus</italic></article-title><source>Infect Dis Clin North Am</source><year>2011</year><volume>25</volume><fpage>155</fpage><lpage>179</lpage><pub-id pub-id-type="doi">10.1016/j.idc.2010.11.002</pub-id><pub-id pub-id-type="pmid">21315999</pub-id></element-citation></ref><ref id="CR41"><label>41.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bode</surname><given-names>LG</given-names></name><name><surname>Kluytmans</surname><given-names>JA</given-names></name><name><surname>Wertheim</surname><given-names>HF</given-names></name><name><surname>Bogaers</surname><given-names>D</given-names></name><name><surname>Vandenbroucke-Grauls</surname><given-names>CM</given-names></name><name><surname>Roosendaal</surname><given-names>R</given-names></name><etal></etal></person-group><article-title>Preventing surgical-site infections in nasal carriers of <italic>Staphylococcus aureus</italic></article-title><source>N Eng J Med</source><year>2010</year><volume>362</volume><fpage>9</fpage><lpage>17</lpage><pub-id pub-id-type="doi">10.1056/NEJMoa0808939</pub-id></element-citation></ref></ref-list></back></pmc></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Wicri/Asie/explor/AustralieFrV1/Data/Pmc/Corpus
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000A94 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Pmc/Corpus/biblio.hfd -nk 000A94 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Wicri/Asie
|area= AustralieFrV1
|flux= Pmc
|étape= Corpus
|type= RBID
|clé= PMC:4347652
|texte= Variable performance of models for predicting methicillin-resistant Staphylococcus aureus carriage in European surgical wards
}}
Pour générer des pages wiki
HfdIndexSelect -h $EXPLOR_AREA/Data/Pmc/Corpus/RBID.i -Sk "pubmed:25880328" \
| HfdSelect -Kh $EXPLOR_AREA/Data/Pmc/Corpus/biblio.hfd \
| NlmPubMed2Wicri -a AustralieFrV1
| This area was generated with Dilib version V0.6.33. |  |