The Fundamentals of Laparoscopic Surgery and LapVR evaluation metrics may not correlate with operative performance in a novice cohort
Identifieur interne : 000251 ( Pmc/Curation ); précédent : 000250; suivant : 000252The Fundamentals of Laparoscopic Surgery and LapVR evaluation metrics may not correlate with operative performance in a novice cohort
Auteurs : Sarah N. Steigerwald ; Jason Park ; Krista M. Hardy ; Lawrence Gillman ; Ashley S. VergisSource :
- Medical Education Online [ 1087-2981 ] ; 2015.
Abstract
Considerable resources have been invested in both low- and high-fidelity simulators in surgical training. The purpose of this study was to investigate if the Fundamentals of Laparoscopic Surgery (FLS, low-fidelity box trainer) and LapVR (high-fidelity virtual reality) training systems correlate with operative performance on the Global Operative Assessment of Laparoscopic Skills (GOALS) global rating scale using a porcine cholecystectomy model in a novice surgical group with minimal laparoscopic experience.
Fourteen postgraduate year 1 surgical residents with minimal laparoscopic experience performed tasks from the FLS program and the LapVR simulator as well as a live porcine laparoscopic cholecystectomy. Performance was evaluated using standardized FLS metrics, automatic computer evaluations, and a validated global rating scale.
Overall, FLS score did not show an association with GOALS global rating scale score on the porcine cholecystectomy. None of the five LapVR task scores were significantly associated with GOALS score on the porcine cholecystectomy.
Neither the low-fidelity box trainer or the high-fidelity virtual simulator demonstrated significant correlation with GOALS operative scores. These findings offer caution against the use of these modalities for brief assessments of novice surgical trainees, especially for predictive or selection purposes.
Url:
DOI: 10.3402/meo.v20.30024
PubMed: 26641071
PubMed Central: 4671314
Links toward previous steps (curation, corpus...)
- to stream Pmc, to step Corpus: Pour aller vers cette notice dans l'étape Curation :000251
Links to Exploration step
PMC:4671314Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">The Fundamentals of Laparoscopic Surgery and LapVR evaluation metrics may not correlate with operative performance in a novice cohort</title>
<author><name sortKey="Steigerwald, Sarah N" sort="Steigerwald, Sarah N" uniqKey="Steigerwald S" first="Sarah N." last="Steigerwald">Sarah N. Steigerwald</name>
</author>
<author><name sortKey="Park, Jason" sort="Park, Jason" uniqKey="Park J" first="Jason" last="Park">Jason Park</name>
</author>
<author><name sortKey="Hardy, Krista M" sort="Hardy, Krista M" uniqKey="Hardy K" first="Krista M." last="Hardy">Krista M. Hardy</name>
</author>
<author><name sortKey="Gillman, Lawrence" sort="Gillman, Lawrence" uniqKey="Gillman L" first="Lawrence" last="Gillman">Lawrence Gillman</name>
</author>
<author><name sortKey="Vergis, Ashley S" sort="Vergis, Ashley S" uniqKey="Vergis A" first="Ashley S." last="Vergis">Ashley S. Vergis</name>
</author>
</titleStmt>
<publicationStmt><idno type="wicri:source">PMC</idno>
<idno type="pmid">26641071</idno>
<idno type="pmc">4671314</idno>
<idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4671314</idno>
<idno type="RBID">PMC:4671314</idno>
<idno type="doi">10.3402/meo.v20.30024</idno>
<date when="2015">2015</date>
<idno type="wicri:Area/Pmc/Corpus">000251</idno>
<idno type="wicri:Area/Pmc/Curation">000251</idno>
</publicationStmt>
<sourceDesc><biblStruct><analytic><title xml:lang="en" level="a" type="main">The Fundamentals of Laparoscopic Surgery and LapVR evaluation metrics may not correlate with operative performance in a novice cohort</title>
<author><name sortKey="Steigerwald, Sarah N" sort="Steigerwald, Sarah N" uniqKey="Steigerwald S" first="Sarah N." last="Steigerwald">Sarah N. Steigerwald</name>
</author>
<author><name sortKey="Park, Jason" sort="Park, Jason" uniqKey="Park J" first="Jason" last="Park">Jason Park</name>
</author>
<author><name sortKey="Hardy, Krista M" sort="Hardy, Krista M" uniqKey="Hardy K" first="Krista M." last="Hardy">Krista M. Hardy</name>
</author>
<author><name sortKey="Gillman, Lawrence" sort="Gillman, Lawrence" uniqKey="Gillman L" first="Lawrence" last="Gillman">Lawrence Gillman</name>
</author>
<author><name sortKey="Vergis, Ashley S" sort="Vergis, Ashley S" uniqKey="Vergis A" first="Ashley S." last="Vergis">Ashley S. Vergis</name>
</author>
</analytic>
<series><title level="j">Medical Education Online</title>
<idno type="eISSN">1087-2981</idno>
<imprint><date when="2015">2015</date>
</imprint>
</series>
</biblStruct>
</sourceDesc>
</fileDesc>
<profileDesc><textClass></textClass>
</profileDesc>
</teiHeader>
<front><div type="abstract" xml:lang="en"><sec id="st1"><title>Background</title>
<p>Considerable resources have been invested in both low- and high-fidelity simulators in surgical training. The purpose of this study was to investigate if the Fundamentals of Laparoscopic Surgery (FLS, low-fidelity box trainer) and LapVR (high-fidelity virtual reality) training systems correlate with operative performance on the Global Operative Assessment of Laparoscopic Skills (GOALS) global rating scale using a porcine cholecystectomy model in a novice surgical group with minimal laparoscopic experience.</p>
</sec>
<sec id="st2"><title>Methods</title>
<p>Fourteen postgraduate year 1 surgical residents with minimal laparoscopic experience performed tasks from the FLS program and the LapVR simulator as well as a live porcine laparoscopic cholecystectomy. Performance was evaluated using standardized FLS metrics, automatic computer evaluations, and a validated global rating scale.</p>
</sec>
<sec id="st3"><title>Results</title>
<p>Overall, FLS score did not show an association with GOALS global rating scale score on the porcine cholecystectomy. None of the five LapVR task scores were significantly associated with GOALS score on the porcine cholecystectomy.</p>
</sec>
<sec id="st4"><title>Conclusions</title>
<p>Neither the low-fidelity box trainer or the high-fidelity virtual simulator demonstrated significant correlation with GOALS operative scores. These findings offer caution against the use of these modalities for brief assessments of novice surgical trainees, especially for predictive or selection purposes.</p>
</sec>
</div>
</front>
<back><div1 type="bibliography"><listBibl><biblStruct><analytic><author><name sortKey="Hennessey, Ia" uniqKey="Hennessey I">IA Hennessey</name>
</author>
<author><name sortKey="Hewett, P" uniqKey="Hewett P">P Hewett</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Tansley, P" uniqKey="Tansley P">P Tansley</name>
</author>
<author><name sortKey="Kakar, S" uniqKey="Kakar S">S Kakar</name>
</author>
<author><name sortKey="Withey, S" uniqKey="Withey S">S Withey</name>
</author>
<author><name sortKey="Butler, P" uniqKey="Butler P">P Butler</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Aggarwal, R" uniqKey="Aggarwal R">R Aggarwal</name>
</author>
<author><name sortKey="Moorthy, K" uniqKey="Moorthy K">K Moorthy</name>
</author>
<author><name sortKey="Darzi, A" uniqKey="Darzi A">A Darzi</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Derossis, Am" uniqKey="Derossis A">AM Derossis</name>
</author>
<author><name sortKey="Fried, Gm" uniqKey="Fried G">GM Fried</name>
</author>
<author><name sortKey="Abrahamowicz, M" uniqKey="Abrahamowicz M">M Abrahamowicz</name>
</author>
<author><name sortKey="Sigman, Hh" uniqKey="Sigman H">HH Sigman</name>
</author>
<author><name sortKey="Barkun, Js" uniqKey="Barkun J">JS Barkun</name>
</author>
<author><name sortKey="Meakins, Jl" uniqKey="Meakins J">JL Meakins</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Fried, Gm" uniqKey="Fried G">GM Fried</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Fried, Gm" uniqKey="Fried G">GM Fried</name>
</author>
<author><name sortKey="Feldman, Ls" uniqKey="Feldman L">LS Feldman</name>
</author>
<author><name sortKey="Vassiliou, Mc" uniqKey="Vassiliou M">MC Vassiliou</name>
</author>
<author><name sortKey="Fraser, Sa" uniqKey="Fraser S">SA Fraser</name>
</author>
<author><name sortKey="Stanbridge, D" uniqKey="Stanbridge D">D Stanbridge</name>
</author>
<author><name sortKey="Ghitulescu, G" uniqKey="Ghitulescu G">G Ghitulescu</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Kundhal, Ps" uniqKey="Kundhal P">PS Kundhal</name>
</author>
<author><name sortKey="Grantcharov, Tp" uniqKey="Grantcharov T">TP Grantcharov</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Langelotz, C" uniqKey="Langelotz C">C Langelotz</name>
</author>
<author><name sortKey="Kilian, M" uniqKey="Kilian M">M Kilian</name>
</author>
<author><name sortKey="Paul, C" uniqKey="Paul C">C Paul</name>
</author>
<author><name sortKey="Schwenk, W" uniqKey="Schwenk W">W Schwenk</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Mccluney, Al" uniqKey="Mccluney A">AL McCluney</name>
</author>
<author><name sortKey="Vassiliou, Mc" uniqKey="Vassiliou M">MC Vassiliou</name>
</author>
<author><name sortKey="Kaneva, Pa" uniqKey="Kaneva P">PA Kaneva</name>
</author>
<author><name sortKey="Cao, J" uniqKey="Cao J">J Cao</name>
</author>
<author><name sortKey="Stanbridge, Dd" uniqKey="Stanbridge D">DD Stanbridge</name>
</author>
<author><name sortKey="Feldman, Ls" uniqKey="Feldman L">LS Feldman</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Grantcharov, Tp" uniqKey="Grantcharov T">TP Grantcharov</name>
</author>
<author><name sortKey="Rosenberg, J" uniqKey="Rosenberg J">J Rosenberg</name>
</author>
<author><name sortKey="Pahle, E" uniqKey="Pahle E">E Pahle</name>
</author>
<author><name sortKey="Funch Jensen, P" uniqKey="Funch Jensen P">P Funch-Jensen</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Gallagher, Ag" uniqKey="Gallagher A">AG Gallagher</name>
</author>
<author><name sortKey="Satava, Rm" uniqKey="Satava R">RM Satava</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Gallagher, Ag" uniqKey="Gallagher A">AG Gallagher</name>
</author>
<author><name sortKey="Lederman, Ab" uniqKey="Lederman A">AB Lederman</name>
</author>
<author><name sortKey="Mcglade, K" uniqKey="Mcglade K">K McGlade</name>
</author>
<author><name sortKey="Satava, Rm" uniqKey="Satava R">RM Satava</name>
</author>
<author><name sortKey="Smith, Cd" uniqKey="Smith C">CD Smith</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Gallagher, Ag" uniqKey="Gallagher A">AG Gallagher</name>
</author>
<author><name sortKey="Richie, K" uniqKey="Richie K">K Richie</name>
</author>
<author><name sortKey="Mcclure, N" uniqKey="Mcclure N">N McClure</name>
</author>
<author><name sortKey="Mcguigan, J" uniqKey="Mcguigan J">J McGuigan</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Vassiliou, Mc" uniqKey="Vassiliou M">MC Vassiliou</name>
</author>
<author><name sortKey="Feldman, Ls" uniqKey="Feldman L">LS Feldman</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Fraser, Sa" uniqKey="Fraser S">SA Fraser</name>
</author>
<author><name sortKey="Klassen, Dr" uniqKey="Klassen D">DR Klassen</name>
</author>
<author><name sortKey="Feldman, Ls" uniqKey="Feldman L">LS Feldman</name>
</author>
<author><name sortKey="Ghitulescu, Ga" uniqKey="Ghitulescu G">GA Ghitulescu</name>
</author>
<author><name sortKey="Stanbridge, D" uniqKey="Stanbridge D">D Stanbridge</name>
</author>
<author><name sortKey="Fried, Gm" uniqKey="Fried G">GM Fried</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Feldman, Ls" uniqKey="Feldman L">LS Feldman</name>
</author>
<author><name sortKey="Hagarty, Se" uniqKey="Hagarty S">SE Hagarty</name>
</author>
<author><name sortKey="Ghitulescu, G" uniqKey="Ghitulescu G">G Ghitulescu</name>
</author>
<author><name sortKey="Stanbridge, D" uniqKey="Stanbridge D">D Stanbridge</name>
</author>
<author><name sortKey="Fried, Gm" uniqKey="Fried G">GM Fried</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Aggarwal, R" uniqKey="Aggarwal R">R Aggarwal</name>
</author>
<author><name sortKey="Grantcharov, T" uniqKey="Grantcharov T">T Grantcharov</name>
</author>
<author><name sortKey="Moorthy, K" uniqKey="Moorthy K">K Moorthy</name>
</author>
<author><name sortKey="Milland, T" uniqKey="Milland T">T Milland</name>
</author>
<author><name sortKey="Papasavas, P" uniqKey="Papasavas P">P Papasavas</name>
</author>
<author><name sortKey="Dosis, A" uniqKey="Dosis A">A Dosis</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Hamilton, Ec" uniqKey="Hamilton E">EC Hamilton</name>
</author>
<author><name sortKey="Scott, Dj" uniqKey="Scott D">DJ Scott</name>
</author>
<author><name sortKey="Fleming, Jb" uniqKey="Fleming J">JB Fleming</name>
</author>
<author><name sortKey="Rege, Rv" uniqKey="Rege R">RV Rege</name>
</author>
<author><name sortKey="Laycock, R" uniqKey="Laycock R">R Laycock</name>
</author>
<author><name sortKey="Bergen, Pc" uniqKey="Bergen P">PC Bergen</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Feldman, Ls" uniqKey="Feldman L">LS Feldman</name>
</author>
<author><name sortKey="Sherman, V" uniqKey="Sherman V">V Sherman</name>
</author>
<author><name sortKey="Fried, Gm" uniqKey="Fried G">GM Fried</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Rassweiler, J" uniqKey="Rassweiler J">J Rassweiler</name>
</author>
<author><name sortKey="Klein, J" uniqKey="Klein J">J Klein</name>
</author>
<author><name sortKey="Teber, D" uniqKey="Teber D">D Teber</name>
</author>
<author><name sortKey="Schulze, M" uniqKey="Schulze M">M Schulze</name>
</author>
<author><name sortKey="Frede, T" uniqKey="Frede T">T Frede</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Vassiliou, Mc" uniqKey="Vassiliou M">MC Vassiliou</name>
</author>
<author><name sortKey="Fowler, Dl" uniqKey="Fowler D">DL Fowler</name>
</author>
<author><name sortKey="Hogle, Nj" uniqKey="Hogle N">NJ Hogle</name>
</author>
<author><name sortKey="Andrew, Cg" uniqKey="Andrew C">CG Andrew</name>
</author>
<author><name sortKey="Vergis, A" uniqKey="Vergis A">A Vergis</name>
</author>
<author><name sortKey="Klassen, Dr" uniqKey="Klassen D">DR Klassen</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Steigerwald, Sn" uniqKey="Steigerwald S">SN Steigerwald</name>
</author>
<author><name sortKey="Park, J" uniqKey="Park J">J Park</name>
</author>
<author><name sortKey="Hardy, Km" uniqKey="Hardy K">KM Hardy</name>
</author>
<author><name sortKey="Gillman, L" uniqKey="Gillman L">L Gillman</name>
</author>
<author><name sortKey="Vergis, As" uniqKey="Vergis A">AS Vergis</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Iwata, N" uniqKey="Iwata N">N Iwata</name>
</author>
<author><name sortKey="Fujiwara, M" uniqKey="Fujiwara M">M Fujiwara</name>
</author>
<author><name sortKey="Kodera, Y" uniqKey="Kodera Y">Y Kodera</name>
</author>
<author><name sortKey="Tanaka, C" uniqKey="Tanaka C">C Tanaka</name>
</author>
<author><name sortKey="Ohashi, N" uniqKey="Ohashi N">N Ohashi</name>
</author>
<author><name sortKey="Nakayama, G" uniqKey="Nakayama G">G Nakayama</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Vassiliou, Mc" uniqKey="Vassiliou M">MC Vassiliou</name>
</author>
<author><name sortKey="Feldman, Ls" uniqKey="Feldman L">LS Feldman</name>
</author>
<author><name sortKey="Andrew, Cg" uniqKey="Andrew C">CG Andrew</name>
</author>
<author><name sortKey="Bergman, S" uniqKey="Bergman S">S Bergman</name>
</author>
<author><name sortKey="Leffondre, K" uniqKey="Leffondre K">K Leffondre</name>
</author>
<author><name sortKey="Stanbridge, D" uniqKey="Stanbridge D">D Stanbridge</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Araujo, Se" uniqKey="Araujo S">SE Araujo</name>
</author>
<author><name sortKey="Seid, Ve" uniqKey="Seid V">VE Seid</name>
</author>
<author><name sortKey="Bertoncini, Ab" uniqKey="Bertoncini A">AB Bertoncini</name>
</author>
<author><name sortKey="Horcel, La" uniqKey="Horcel L">LA Horcel</name>
</author>
<author><name sortKey="Nahas, Sc" uniqKey="Nahas S">SC Nahas</name>
</author>
<author><name sortKey="Cecconello, I" uniqKey="Cecconello I">I Cecconello</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Rivard, Jd" uniqKey="Rivard J">JD Rivard</name>
</author>
<author><name sortKey="Vergis, As" uniqKey="Vergis A">AS Vergis</name>
</author>
<author><name sortKey="Unger, Bj" uniqKey="Unger B">BJ Unger</name>
</author>
<author><name sortKey="Hardy, Km" uniqKey="Hardy K">KM Hardy</name>
</author>
<author><name sortKey="Andrew, Cg" uniqKey="Andrew C">CG Andrew</name>
</author>
<author><name sortKey="Gillman, Lm" uniqKey="Gillman L">LM Gillman</name>
</author>
</analytic>
</biblStruct>
</listBibl>
</div1>
</back>
</TEI>
<pmc article-type="research-article"><pmc-dir>properties open_access</pmc-dir>
<front><journal-meta><journal-id journal-id-type="nlm-ta">Med Educ Online</journal-id>
<journal-id journal-id-type="iso-abbrev">Med Educ Online</journal-id>
<journal-id journal-id-type="publisher-id">MEO</journal-id>
<journal-title-group><journal-title>Medical Education Online</journal-title>
</journal-title-group>
<issn pub-type="epub">1087-2981</issn>
<publisher><publisher-name>Co-Action Publishing</publisher-name>
</publisher>
</journal-meta>
<article-meta><article-id pub-id-type="pmid">26641071</article-id>
<article-id pub-id-type="pmc">4671314</article-id>
<article-id pub-id-type="publisher-id">30024</article-id>
<article-id pub-id-type="doi">10.3402/meo.v20.30024</article-id>
<article-categories><subj-group subj-group-type="heading"><subject>Research Article</subject>
</subj-group>
</article-categories>
<title-group><article-title>The Fundamentals of Laparoscopic Surgery and LapVR evaluation metrics may not correlate with operative performance in a novice cohort</article-title>
</title-group>
<contrib-group><contrib contrib-type="author"><name><surname>Steigerwald</surname>
<given-names>Sarah N.</given-names>
</name>
<xref ref-type="corresp" rid="cor1">*</xref>
</contrib>
<contrib contrib-type="author"><name><surname>Park</surname>
<given-names>Jason</given-names>
</name>
</contrib>
<contrib contrib-type="author"><name><surname>Hardy</surname>
<given-names>Krista M.</given-names>
</name>
</contrib>
<contrib contrib-type="author"><name><surname>Gillman</surname>
<given-names>Lawrence</given-names>
</name>
</contrib>
<contrib contrib-type="author"><name><surname>Vergis</surname>
<given-names>Ashley S.</given-names>
</name>
</contrib>
</contrib-group>
<aff>Department of Surgery, University of Manitoba, Winnipeg, Manitoba, Canada</aff>
<author-notes><corresp id="cor1"><label>*</label>
Correspondence to: Sarah N. Steigerwald, Department of Surgery, University of Manitoba, Winnipeg, Manitoba, Canada MB R3T 2N2, Email: <email xlink:href="snsteigerwald@gmail.com">snsteigerwald@gmail.com</email>
</corresp>
</author-notes>
<pub-date pub-type="epub"><day>04</day>
<month>12</month>
<year>2015</year>
</pub-date>
<pub-date pub-type="collection"><year>2015</year>
</pub-date>
<volume>20</volume>
<elocation-id content-type="doi">10.3402/meo.v20.30024</elocation-id>
<history><date date-type="received"><day>13</day>
<month>10</month>
<year>2015</year>
</date>
<date date-type="rev-recd"><day>28</day>
<month>10</month>
<year>2015</year>
</date>
<date date-type="accepted"><day>16</day>
<month>11</month>
<year>2015</year>
</date>
</history>
<permissions><copyright-statement>© 2015 Sarah N. Steigerwald et al.</copyright-statement>
<copyright-year>2015</copyright-year>
<license license-type="open-access" xlink:href="http://creativecommons.org/licenses/by/4.0/"><license-p>This is an Open Access article distributed under the terms of the Creative Commons Attribution 4.0 International License, allowing third parties to copy and redistribute the material in any medium or format and to remix, transform, and build upon the material for any purpose, even commercially, provided the original work is properly cited and states its license.</license-p>
</license>
</permissions>
<abstract><sec id="st1"><title>Background</title>
<p>Considerable resources have been invested in both low- and high-fidelity simulators in surgical training. The purpose of this study was to investigate if the Fundamentals of Laparoscopic Surgery (FLS, low-fidelity box trainer) and LapVR (high-fidelity virtual reality) training systems correlate with operative performance on the Global Operative Assessment of Laparoscopic Skills (GOALS) global rating scale using a porcine cholecystectomy model in a novice surgical group with minimal laparoscopic experience.</p>
</sec>
<sec id="st2"><title>Methods</title>
<p>Fourteen postgraduate year 1 surgical residents with minimal laparoscopic experience performed tasks from the FLS program and the LapVR simulator as well as a live porcine laparoscopic cholecystectomy. Performance was evaluated using standardized FLS metrics, automatic computer evaluations, and a validated global rating scale.</p>
</sec>
<sec id="st3"><title>Results</title>
<p>Overall, FLS score did not show an association with GOALS global rating scale score on the porcine cholecystectomy. None of the five LapVR task scores were significantly associated with GOALS score on the porcine cholecystectomy.</p>
</sec>
<sec id="st4"><title>Conclusions</title>
<p>Neither the low-fidelity box trainer or the high-fidelity virtual simulator demonstrated significant correlation with GOALS operative scores. These findings offer caution against the use of these modalities for brief assessments of novice surgical trainees, especially for predictive or selection purposes.</p>
</sec>
</abstract>
<kwd-group><kwd>education</kwd>
<kwd>assessment</kwd>
<kwd>evaluation</kwd>
<kwd>selection</kwd>
<kwd>novice</kwd>
<kwd>simulation</kwd>
</kwd-group>
</article-meta>
</front>
<body><p>Surgical practice across disciplines continues to evolve and incorporate more technically and visually challenging procedures. There has subsequently been a great deal of attention towards means of improving technical skill education and even predicting an individual's future ability to perform these challenging procedures.</p>
<p>Some authors have gone as far as to suggest that surgical skill assessments can be used for selection purposes (<xref rid="CIT0001" ref-type="bibr">1</xref>
, <xref rid="CIT0002" ref-type="bibr">2</xref>
). The idea of being able to use predictive tests to select those who may have a higher aptitude for surgery or specific disciplines is appealing for a number of reasons. First, it can help programs to select among prospective candidates, specifically those who are, or will be most adept at surgery. Second, it may guide candidates and help them decide if certain fields are appropriate for them. It is an unfortunate event to discover that inherent technical limitations preclude an individual from becoming a surgeon after investing years of pursuit and training.</p>
<p>Minimally invasive surgery (MIS) is a rapidly evolving and increasingly standard part of practice for gastrointestinal surgeons, and trainees preparing to enter practice must learn and master these techniques. MIS involves a distinct skill set compared to traditional open surgery, most significant of which includes working in three dimensions while working off two-dimensional video images, as well as adapting to the fulcrum effect, and less tactile feedback. Related to this distinct skill set, laparoscopy may require a more specific type of evaluation if that assessment is to be considered in any selection process (<xref rid="CIT0003" ref-type="bibr">3</xref>
, <xref rid="CIT0004" ref-type="bibr">4</xref>
).</p>
<p>Considerable resources have gone into investigating the use of basic skills laboratories that incorporate surgical simulation as ways to teach and assess trainees in a safe environment outside of the operating room. Laboratory simulation–based skills training and assessment for laparoscopic surgical skills include lower fidelity physical box or video trainers and the higher fidelity virtual reality trainers. Both demonstrate significant correlations between operative performance and psychomotor performance in lab-based settings and can be used to assess operative laparoscopic skills (<xref rid="CIT0004" ref-type="bibr">4</xref>
–<xref rid="CIT0017" ref-type="bibr">17</xref>
). These physical box trainers are composed of frames supporting traditional laparoscopic video monitors, light sources and camera systems (<xref rid="CIT0018" ref-type="bibr">18</xref>
). Trainees use authentic laparoscopic instruments to perform tasks under videoscopic guidance (<xref rid="CIT0019" ref-type="bibr">19</xref>
). Virtual reality trainers use computer-generated images linked to a human–computer interface enabling users to perform simulated tasks (<xref rid="CIT0020" ref-type="bibr">20</xref>
). There is a spectrum of machines available, with the newer ones incorporating haptic feedback.</p>
<p>The video and virtual reality simulators provide the potential to assess the psychomotor and technical skills required to competently perform laparoscopic surgery outside of the operating room in a safe, controlled environment. Multiple previous studies have demonstrated that validated video trainer–based assessments and some virtual simulators are useful to discriminate between and predict interoperative performance across training levels. However, these studies often include comparisons of widely disparate cohorts, such as complete novices and expert surgeons, and it is difficult to know how well these methods evaluate performance within cohorts. There is limited investigation that evaluates physical box trainers and virtual reality systems for operative assessment purposes in novice groups with minimal laparoscopic experience. This is important as surgical training programs look to novel training, assessment, or even selection methods outside of the operating room. It is particularly problematic for novice groups, as resource and ethical considerations prevent unassisted operative skill observation using traditional human surgical models. This study aims to evaluate and compare the predictive performance of novice surgical trainees using the low-fidelity Fundamentals of Laparoscopic Surgery (FLS) box trainer and the high-fidelity LapVR simulator when assessed against the initial case of a live porcine model of laparoscopic cholecystectomy.</p>
<sec sec-type="methods" id="S0002"><title>Methods</title>
<sec id="S0002-S20001"><title>Participants</title>
<p>First-year urology and general surgery residents at the University of Manitoba were recruited to participate in this study. All subjects were novice operators with essentially no prior laparoscopic experience. Inclusion criteria included a lack of prior laparoscopic experience and availability to participate in the study.</p>
<p>Institutional ethics approval was obtained through The University of Manitoba Health Research Ethics Board for this investigation. Residents first completed a questionnaire outlining their prior laparoscopic experience and any practice on video trainers or virtual reality simulators.</p>
</sec>
<sec id="S0002-S20002"><title>Simulation</title>
<p>Orientation to both the FLS and LapVR tasks with correct technique was provided. Residents performed one repetition each of four of the manual skills portion of the FLS tasks (peg transfer, pattern cutting, ligating loop, and intracorporeal knot tying). Residents also performed one repetition each of five of the level-one essential tasks on the LapVR virtual reality simulator that most closely approximated the FLS tasks (peg transfer, pattern cutting, clip application, needle driving, and knot tying).</p>
</sec>
<sec id="S0002-S20003"><title>Porcine cholecystectomy</title>
<p>All participants performed a live porcine laparoscopic cholecystectomy. Subjects participated in a half-day course that consisted of lectures on the principles of laparoscopic surgery, a review of the relevant anatomy, and videos demonstrating surgical techniques prior to performing the cholecystectomy. The FLS tasks were done prior to the porcine cholecystectomy. Based on infrastructure availability, the LapVR simulation activities were then completed after. Activities were done as close in time as possible, and participants were surveyed with regard to any interim laparoscopic or simulator experience to account for potential confounders.</p>
</sec>
<sec id="S0002-S20004"><title>Outcome measures</title>
<p>The main outcome measure assessed was the correlation or predictive validity between operative Global Assessment of Laparoscopic Skills (GOALS) score and the FLS and LapVR simulator scores.</p>
<p>GOALS is a valid and reliable assessment tool for evaluating laparoscopic skills (<xref rid="CIT0021" ref-type="bibr">21</xref>
) (<xref ref-type="table" rid="T0001">Table 1</xref>
). It consists of several skills domains, each graded on an anchored 5-point Likert scale. GOALS shows near total correlation to the Objective Structured Assessment of Technical Skills (OSATS) scores on recent investigation and is used in our skills laboratory to assess laparoscopic skill (<xref rid="CIT0022" ref-type="bibr">22</xref>
).</p>
<table-wrap id="T0001" position="float"><label>Table 1</label>
<caption><p>Global Operative Assessment of Laparoscopic Skills (GOALS)</p>
</caption>
<table frame="hsides" rules="groups"><thead><tr><th align="left" rowspan="1" colspan="1">Performance</th>
<th align="center" colspan="5" rowspan="1">Rating</th>
</tr>
<tr><th rowspan="1" colspan="1"></th>
<th colspan="5" rowspan="1"><hr></hr>
</th>
</tr>
<tr><th align="left" rowspan="1" colspan="1">characteristic</th>
<th align="center" rowspan="1" colspan="1">1</th>
<th align="center" rowspan="1" colspan="1">2</th>
<th align="center" rowspan="1" colspan="1">3</th>
<th align="center" rowspan="1" colspan="1">4</th>
<th align="center" rowspan="1" colspan="1">5</th>
</tr>
</thead>
<tbody><tr><td align="left" rowspan="1" colspan="1">Depth perception</td>
<td align="left" rowspan="1" colspan="1">Constantly overshoots target, wide swings, slow to correct</td>
<td align="left" rowspan="1" colspan="1"></td>
<td align="left" rowspan="1" colspan="1">Some overshooting or missing of target, but quick to correct</td>
<td align="left" rowspan="1" colspan="1"></td>
<td align="left" rowspan="1" colspan="1">Accurately directs instruments in the correct plane to target</td>
</tr>
<tr><td align="left" rowspan="1" colspan="1">Bimanual dexterity</td>
<td align="left" rowspan="1" colspan="1">Uses only one hand, ignores non-dominant hand, poor coordination between hands</td>
<td align="left" rowspan="1" colspan="1"></td>
<td align="left" rowspan="1" colspan="1">Uses both hands, but does not optimize interaction between hands</td>
<td align="left" rowspan="1" colspan="1"></td>
<td align="left" rowspan="1" colspan="1">Expertly utilizes both hands in a complimentary manner to provide optimal exposure</td>
</tr>
<tr><td align="left" rowspan="1" colspan="1">Efficiency</td>
<td align="left" rowspan="1" colspan="1">Uncertain, inefficient efforts, many tentative movements, constantly changing focus or persisting without progress</td>
<td align="left" rowspan="1" colspan="1"></td>
<td align="left" rowspan="1" colspan="1">Slow, but planned movements that are reasonably organized</td>
<td align="left" rowspan="1" colspan="1"></td>
<td align="left" rowspan="1" colspan="1">Confident, efficient, and safe conduct, maintains focus on task until it is better performed via an alternative approach</td>
</tr>
<tr><td align="left" rowspan="1" colspan="1">Tissue handling</td>
<td align="left" rowspan="1" colspan="1">Rough movements, tears tissues, injures adjacent structures, poor grasper control, grasper frequently slips</td>
<td align="left" rowspan="1" colspan="1"></td>
<td align="left" rowspan="1" colspan="1">Handles tissue reasonably well, minor trauma to adjacent tissue (i.e., occasional unnecessary bleeding or slipping of the grasper)</td>
<td align="left" rowspan="1" colspan="1"></td>
<td align="left" rowspan="1" colspan="1">Handles tissue well, applies appropriate traction, negligible injury to adjacent structures</td>
</tr>
<tr><td align="left" rowspan="1" colspan="1">Autonomy</td>
<td align="left" rowspan="1" colspan="1">Unable to complete entire task, even with verbal guidance</td>
<td align="left" rowspan="1" colspan="1"></td>
<td align="left" rowspan="1" colspan="1">Able to complete task safely with moderate guidance</td>
<td align="left" rowspan="1" colspan="1"></td>
<td align="left" rowspan="1" colspan="1">Able to complete task independently without prompting</td>
</tr>
</tbody>
</table>
<table-wrap-foot><fn><p>Modified from Vassiliou et al. (<xref rid="CIT0024" ref-type="bibr">24</xref>
).</p>
<p><italic>Note</italic>
: 1=worst possible score, 5=best possible score.</p>
</fn>
</table-wrap-foot>
</table-wrap>
<p>FLS task performance was evaluated using standardized FLS metrics (<xref rid="CIT0004" ref-type="bibr">4</xref>
–<xref rid="CIT0006" ref-type="bibr">6</xref>
, <xref rid="CIT0015" ref-type="bibr">15</xref>
). The LapVR generates automatic computer evaluation metrics. Parameters demonstrating validity evidence were then manually extracted (<xref rid="CIT0023" ref-type="bibr">23</xref>
) (see <xref ref-type="table" rid="T0003">Table 3</xref>
in the Results section for specific parameters). A single academic minimally invasive surgeon who was blinded to the results of the FLS and LapVR scores assessed operative performance on the live porcine laparoscopic cholecystectomy using the GOALS rating scale. There were a total of four experienced laparoscopic surgeons involved with the rating process. An overview of how to use the rating tool was provided, and all were previously extensively trained in the use of the instrument. Additionally, two of the four raters participated in the primary and external validation of GOALS (<xref rid="CIT0021" ref-type="bibr">21</xref>
, <xref rid="CIT0024" ref-type="bibr">24</xref>
). The surgeon did not interfere with the resident's conduct of the operative procedure. All forms of outcome measures have been previously validated.</p>
</sec>
<sec id="S0002-S20005"><title>Data analysis</title>
<p>The analyses were carried out using Statistical Analysis System SAS 9.2 (SAS Institute, Cary, NC). All <italic>p</italic>
-values were two tailed and a <italic>p</italic>
-value <0.05 was considered statistically significant. Linear correlation (Pearson's coefficient) was calculated between GOALS and overall FLS scores. This could not be accomplished for LapVR scores as there is no summary metric for available. Thus, multivariable regression analysis was carried out to examine the association between outcome variable (GOALS score) and predictor variables (FLS overall score or LapVR data from each domain: peg transfer, cutting, clipping, needle driving, and knot tying). The <italic>R</italic>
<sup>2</sup>
from these multivariable regression analyses were used as a measure of how strongly FLS and LapVR evaluation metrics correlate with intraoperative performance. Continuous variables (e.g., GOALS score) were summarized in the descriptive analyses using the mean and standard deviations. Categorical variables (e.g., having comprehensive score) were summarized using the number (percent) in various categories.</p>
</sec>
</sec>
<sec sec-type="results" id="S0003"><title>Results</title>
<p>All participants had minimal laparoscopic experience as the primary operator with an average of only 0.8 operations. Similarly, few had spent any significant amount of time practicing on a virtual simulator (average 0.4 h). The subjects did have more average time practicing on the video trainer (11.6 h); however, this number was elevated secondary to an outlier who had 150 h of practice. The rest of the residents had between 0 and 4 h of previous box trainer experience. The average days between activities were 29.9 with a range of 1–77. Interim laparoscopic experience was found to be more useful than days between activities, as residents were rotating on non-surgical rotations and not participating in any operative or simulation activities between sessions. Residents performed no interim laparoscopic procedures (average 0) and did not spend any time on the virtual reality simulator (average 0 h). They spent minimal time practicing on the video trainer with an average of only 1.1 h (<xref ref-type="table" rid="T0002">Table 2</xref>
).</p>
<table-wrap id="T0002" position="float"><label>Table 2</label>
<caption><p>Participant characteristics</p>
</caption>
<table frame="hsides" rules="groups"><thead><tr><th align="left" rowspan="1" colspan="1"></th>
<th align="center" rowspan="1" colspan="1">Overall (<italic>N</italic>
=14)</th>
</tr>
</thead>
<tbody><tr><td align="left" rowspan="1" colspan="1">Age (mean)</td>
<td align="center" rowspan="1" colspan="1">29.2</td>
</tr>
<tr><td align="left" rowspan="1" colspan="1">Gender</td>
<td align="center" rowspan="1" colspan="1"></td>
</tr>
<tr><td align="left" rowspan="1" colspan="1"> F, <italic>n</italic>
(%)</td>
<td align="center" rowspan="1" colspan="1">8.0 (57.1)</td>
</tr>
<tr><td align="left" rowspan="1" colspan="1"> M, <italic>n</italic>
(%)</td>
<td align="center" rowspan="1" colspan="1">6.0 (42.9)</td>
</tr>
<tr><td align="left" rowspan="1" colspan="1">Specialty</td>
<td align="center" rowspan="1" colspan="1"></td>
</tr>
<tr><td align="left" rowspan="1" colspan="1"> General surgery, <italic>n</italic>
(%)</td>
<td align="center" rowspan="1" colspan="1">11.0 (78.6)</td>
</tr>
<tr><td align="left" rowspan="1" colspan="1"> Urology, <italic>n</italic>
(%)</td>
<td align="center" rowspan="1" colspan="1">3.0 (21.4)</td>
</tr>
<tr><td align="left" rowspan="1" colspan="1">Laparoscopic experience (procedures as primary operator) [average (range)]</td>
<td align="center" rowspan="1" colspan="1">0.8 (0–7)</td>
</tr>
<tr><td align="left" rowspan="1" colspan="1">Box trainer experience (h) [average (range)]</td>
<td align="center" rowspan="1" colspan="1">11.6 (0–150)</td>
</tr>
<tr><td align="left" rowspan="1" colspan="1">VR experience (h) [average (range)]</td>
<td align="center" rowspan="1" colspan="1">0.4 (0–3)</td>
</tr>
<tr><td align="left" rowspan="1" colspan="1">Days between laparoscopic cholecystectomy and LapVR simulation activities [average (range)]</td>
<td align="center" rowspan="1" colspan="1">29.9 (1–77)</td>
</tr>
<tr><td align="left" rowspan="1" colspan="1">Interim laparoscopic experience (as primary operator) between porcine cholecystectomy and LapVR activities [average (range)]</td>
<td align="center" rowspan="1" colspan="1">0 (0–0)</td>
</tr>
<tr><td align="left" rowspan="1" colspan="1">Interim box trainer experience (h) between porcine cholecystectomy and LapVR activities [average (range)]</td>
<td align="center" rowspan="1" colspan="1">1.1 (1–2.5)</td>
</tr>
<tr><td align="left" rowspan="1" colspan="1">Interim VR experience (h) between porcine cholecystectomy and LapVR activities [average (range)]</td>
<td align="center" rowspan="1" colspan="1">0 (0–0)</td>
</tr>
</tbody>
</table>
</table-wrap>
<p><xref ref-type="fig" rid="F0001">Figure 1</xref>
illustrates the relationship between overall FLS and GOALS scores (<xref ref-type="table" rid="T0003">Table 3</xref>
). There was no significant relationship demonstrated between overall FLS score and GOALS operative score. Similarly, for the LapVR, none of the five tasks demonstrated a significant relationship with GOALS operative score (<xref ref-type="table" rid="T0004">Table 4</xref>
).</p>
<fig id="F0001" position="float"><label>Fig. 1</label>
<caption><p>Relationship between FLS overall score and GOALS.</p>
</caption>
<graphic xlink:href="MEO-20-30024-g001"></graphic>
</fig>
<table-wrap id="T0003" position="float"><label>Table 3</label>
<caption><p>Descriptive statistics of outcome and predictor variables</p>
</caption>
<table frame="hsides" rules="groups"><thead><tr><th align="left" rowspan="1" colspan="1"></th>
<th align="center" rowspan="1" colspan="1">Overall score (<italic>N</italic>
=14)</th>
</tr>
</thead>
<tbody><tr><td align="left" rowspan="1" colspan="1"><bold>GOALS</bold>
</td>
<td align="center" rowspan="1" colspan="1">21.50 (6.71)</td>
</tr>
<tr><td align="left" rowspan="1" colspan="1"><bold>FLS</bold>
</td>
<td align="center" rowspan="1" colspan="1"></td>
</tr>
<tr><td align="left" rowspan="1" colspan="1">Peg transfer (time, s)</td>
<td align="center" rowspan="1" colspan="1">194.60 (28.40)</td>
</tr>
<tr><td align="left" rowspan="1" colspan="1">Pattern cutting (time, s)</td>
<td align="center" rowspan="1" colspan="1">22.93 (30.38)</td>
</tr>
<tr><td align="left" rowspan="1" colspan="1">Ligating loop (time, s)</td>
<td align="center" rowspan="1" colspan="1">83.89 (37.88)</td>
</tr>
<tr><td align="left" rowspan="1" colspan="1">Intracorporeal suturing (time, s)</td>
<td align="center" rowspan="1" colspan="1">232.03 (141.80)</td>
</tr>
<tr><td align="left" rowspan="1" colspan="1"><bold>Overall score</bold>
</td>
<td align="center" rowspan="1" colspan="1">194.99 (60.55)</td>
</tr>
<tr><td align="left" rowspan="1" colspan="1"><bold>LapVR</bold>
</td>
<td align="center" rowspan="1" colspan="1"></td>
</tr>
<tr><td align="left" rowspan="1" colspan="1"><bold>Peg Transfer</bold>
</td>
<td align="center" rowspan="1" colspan="1"></td>
</tr>
<tr><td align="left" rowspan="1" colspan="1">Time (s)</td>
<td align="center" rowspan="1" colspan="1">145.20 (51.50)</td>
</tr>
<tr><td align="left" rowspan="1" colspan="1">Non-dominant time (s)</td>
<td align="center" rowspan="1" colspan="1">41.93 (18.00)</td>
</tr>
<tr><td align="left" rowspan="1" colspan="1">Non-dominant path length</td>
<td align="center" rowspan="1" colspan="1">3.14 (1.43)</td>
</tr>
<tr><td align="left" rowspan="1" colspan="1">Comprehensive score, yes/no (%)</td>
<td align="center" rowspan="1" colspan="1">7 (50%)</td>
</tr>
<tr><td align="left" rowspan="1" colspan="1"><bold>Cutting</bold>
</td>
<td align="center" rowspan="1" colspan="1"></td>
</tr>
<tr><td align="left" rowspan="1" colspan="1">Time (s)</td>
<td align="center" rowspan="1" colspan="1">289.60 (156.60)</td>
</tr>
<tr><td align="left" rowspan="1" colspan="1">Unsuccessful cuts total</td>
<td align="center" rowspan="1" colspan="1">11.86 (8.40)</td>
</tr>
<tr><td align="left" rowspan="1" colspan="1">Non-dominant path length</td>
<td align="center" rowspan="1" colspan="1">2.58 (2.07)</td>
</tr>
<tr><td align="left" rowspan="1" colspan="1">Comprehensive score, yes/no (%)</td>
<td align="center" rowspan="1" colspan="1">6 (42.9%)</td>
</tr>
<tr><td align="left" rowspan="1" colspan="1"><bold>Clipping</bold>
</td>
<td align="center" rowspan="1" colspan="1"></td>
</tr>
<tr><td align="left" rowspan="1" colspan="1">Time (s)</td>
<td align="center" rowspan="1" colspan="1">91.14 (24.47)</td>
</tr>
<tr><td align="left" rowspan="1" colspan="1"><bold>Needle driving</bold>
</td>
<td align="center" rowspan="1" colspan="1"></td>
</tr>
<tr><td align="left" rowspan="1" colspan="1">Time (s)</td>
<td align="center" rowspan="1" colspan="1">426.90 (185.90)</td>
</tr>
<tr><td align="left" rowspan="1" colspan="1">Dominant path length</td>
<td align="center" rowspan="1" colspan="1">8.36 (3.59)</td>
</tr>
<tr><td align="left" rowspan="1" colspan="1">Non-dominant path length</td>
<td align="center" rowspan="1" colspan="1">5.79 (3.14)</td>
</tr>
<tr><td align="left" rowspan="1" colspan="1"><bold>Knot tying</bold>
</td>
<td align="center" rowspan="1" colspan="1"></td>
</tr>
<tr><td align="left" rowspan="1" colspan="1">Time (s)</td>
<td align="center" rowspan="1" colspan="1">342.80 (171.20)</td>
</tr>
<tr><td align="left" rowspan="1" colspan="1">Dominant path length</td>
<td align="center" rowspan="1" colspan="1">7.91 (5.20)</td>
</tr>
<tr><td align="left" rowspan="1" colspan="1">Non-dominant path length</td>
<td align="center" rowspan="1" colspan="1">7.98 (5.43)</td>
</tr>
</tbody>
</table>
<table-wrap-foot><fn><p><italic>Note:</italic>
Values reported are mean (standard deviation) unless specified.</p>
</fn>
</table-wrap-foot>
</table-wrap>
<table-wrap id="T0004" position="float"><label>Table 4</label>
<caption><p>Multivariable regression analysis for GOALS</p>
</caption>
<table frame="hsides" rules="groups"><thead><tr><th align="left" rowspan="1" colspan="1"></th>
<th align="center" rowspan="1" colspan="1"><italic>R</italic>
<sup>2</sup>
</th>
<th align="center" rowspan="1" colspan="1"><italic>p</italic>
</th>
</tr>
</thead>
<tbody><tr><td align="left" rowspan="1" colspan="1"><bold>FLS</bold>
</td>
<td align="left" rowspan="1" colspan="1"></td>
<td align="left" rowspan="1" colspan="1"></td>
</tr>
<tr><td align="left" rowspan="1" colspan="1">Overall score</td>
<td align="center" rowspan="1" colspan="1">0.000</td>
<td align="center" rowspan="1" colspan="1">0.98</td>
</tr>
<tr><td align="left" rowspan="1" colspan="1"><bold>LapVR</bold>
</td>
<td align="center" rowspan="1" colspan="1"></td>
<td align="center" rowspan="1" colspan="1"></td>
</tr>
<tr><td align="left" rowspan="1" colspan="1">Peg transfer</td>
<td align="center" rowspan="1" colspan="1">0.48</td>
<td align="center" rowspan="1" colspan="1">0.17</td>
</tr>
<tr><td align="left" rowspan="1" colspan="1">Cutting</td>
<td align="center" rowspan="1" colspan="1">0.26</td>
<td align="center" rowspan="1" colspan="1">0.57</td>
</tr>
<tr><td align="left" rowspan="1" colspan="1">Clipping</td>
<td align="center" rowspan="1" colspan="1">0.05</td>
<td align="center" rowspan="1" colspan="1">0.43</td>
</tr>
<tr><td align="left" rowspan="1" colspan="1">Needle driving</td>
<td align="center" rowspan="1" colspan="1">0.49</td>
<td align="center" rowspan="1" colspan="1">0.07</td>
</tr>
<tr><td align="left" rowspan="1" colspan="1">Knot tying</td>
<td align="center" rowspan="1" colspan="1">0.43</td>
<td align="center" rowspan="1" colspan="1">0.15</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec sec-type="discussion" id="S0004"><title>Discussion</title>
<p>The porcine model provides an opportunity for novice trainees to engage in a high fidelity <italic>in vivo</italic>
operative model without attending surgeon interference as may be required for safety in a human model. This affords a novel uncontaminated assessment of trainee skill particularly in the novice.</p>
<p>Overall, FLS score did not correlate with initial GOALS global rating scale using a porcine laparoscopic cholecystectomy model. This is in contrast to previous literature that has demonstrated the predictive validity of FLS (<xref rid="CIT0005" ref-type="bibr">5</xref>
, <xref rid="CIT0006" ref-type="bibr">6</xref>
, <xref rid="CIT0009" ref-type="bibr">9</xref>
). This could potentially be the result of a sample size that was not large enough to show a true effect. However, it is more likely that the evaluation metrics employed may be unable to discriminate between subjects with little variation in their scores due to their nominal abilities. The studies referenced above include participants with a wide range of laparoscopic experience. Thus, the difference's realized between cohorts is not surprising. Additionally, in majority of prior studies, participants generally performed training sessions on the simulator prior to laparoscopic cholecystectomy performance. In the present study, our participants were completely novice operators with minimal prior formal simulator training and this was the first time many of them had been the primary surgeon for a laparoscopic case. As there was no attending surgeon take-over and the residents did not undergo training sessions on the simulators, the operative assessments were reflective of trainee skill and not influenced by staff surgeon involvement. The lack of correlation in this setting suggests that these simulation modalities are not useful forms of assessment in groups who are expected to have minimal skill sets.</p>
<p>The LapVR tasks had to be compared to overall operative score individually as currently there is no validated overall summary score for the tasks as in FLS. Additionally, the individual LapVR tasks could not be compared to the individual FLS tasks as each LapVR task had anywhere from one to four scoring parameters contributing to the task evaluation. None of five LapVR tasks correlated with GOALS operative score. Predictive validity has been demonstrated for virtual reality simulators; however, the literature primarily looks at the MIST VR virtual simulator and the LapSim virtual reality simulator (<xref rid="CIT0007" ref-type="bibr">7</xref>
, <xref rid="CIT0008" ref-type="bibr">8</xref>
, <xref rid="CIT0010" ref-type="bibr">10</xref>
–<xref rid="CIT0013" ref-type="bibr">13</xref>
). For this study, correlation was not shown for the LapVR and GOALS operative score. Again, the lack of demonstration of correlation may be related to the novice level of the residents group as operators.</p>
<p>Only a limited number of studies have focused on how simulation-based assessments can be applied to more purely novice groups of trainees. A Brazilian study demonstrated predictive validity between a group of ‘novice’ operator's laparoscopic colectomy and LAP Mentor (Simbionix, Cleveland, OH) simulation skills (<xref rid="CIT0025" ref-type="bibr">25</xref>
). However, in this study, all subjects had previously independently performed laparoscopic procedures such as cholecystectomy, appendectomy, and fundoplication. Our investigation is unique in that the novice cohort essentially had negligible prior laparoscopic experience. This questions whether a completely untrained group of operators should be assessed using FLS or VR simulation metrics. These results have implications on early assessment of surgical trainees within training programs. They also caution the use of these forms of assessment in candidate selection, as some authors have suggested (<xref rid="CIT0001" ref-type="bibr">1</xref>
, <xref rid="CIT0002" ref-type="bibr">2</xref>
).</p>
</sec>
<sec id="S0005"><title>Limitations</title>
<p>This study has numerous strengths, including a relatively homogeneous cohort of novice surgery residents, the assessment of skill using previously validated outcome measures, and the assessment of operative performance on a live porcine model. This last point is important because it allowed us to assess each participant as they performed an entire <italic>in vivo</italic>
cholecystectomy dissection (not just parts of the procedure), but it allowed us to do so in a controlled and safe environment without ‘attending take-over’ of any parts of the case for patient safety reasons. Several limitations, however, require discussion. First, this study has a limited number of participants (<italic>N</italic>
=14). A follow-up study with a larger sample size would help delineate if any differences exist between the two forms of simulation. Second, there is no overall comprehensive LapVR score as in FLS. Therefore, individual LapVR tasks must be compared to overall FLS score. The development of an overall LapVR score would allow a more direct comparison between the two forms of simulation (<xref rid="CIT0026" ref-type="bibr">26</xref>
). Third, there was some variability in the time between laparoscopic cholecystectomy and simulator tasks. Given the complicated nature of surgical residents’ schedules, opportunity sampling was used. Thus, setting up a specific time frame between the activities was not possible. However, there were no interim laparoscopic procedures performed or virtual simulator experience by any of the participants. As well, interim video trainer experience was limited with subject's performing an average of 1.1 h. Additionally, due to the nature of the lab set up and resident availability, the LapVR tasks had to be completed at a later date. We attempted to control for this as the FLS and laparoscopic cholecystectomy were a one-time intervention and there was no interim training before the LapVR tasks; however, we do recognize this is a potential limitation. Lastly, due to time constraints each participant was only evaluated by one rater. While there is the potential for this to decrease the reliability of the results, the internal consistency and inter-rater reliability of GOALS have been well demonstrated in the past (<xref rid="CIT0024" ref-type="bibr">24</xref>
).</p>
</sec>
<sec sec-type="conclusions" id="S0006"><title>Conclusions</title>
<p>Neither the low-fidelity box trainer nor the high-fidelity virtual simulator demonstrated significant correlation with GOALS scores in this investigation. These findings offer caution against the use of these modalities for brief assessments of novice surgical trainees, especially for predictive or selection purposes.</p>
</sec>
</body>
<back><ack><title>Acknowledgements</title>
<p>The authors acknowledge the faculty members of the Department of Surgery at the University of Manitoba for providing the research grant that made this study possible.</p>
<sec id="S0008"><title>Conflict of interest and funding</title>
<p>The authors have not received any funding or benefits from industry or elsewhere to conduct this study.</p>
</sec>
</ack>
<sec id="S0007"><title>Authors' contributions</title>
<p>All authors were involved with the conception, design, acquisition, and analysis of data. Additionally, all authors were involved with the drafting and revision of the manuscript and have read and approved the final version.</p>
</sec>
<ref-list><title>References</title>
<ref id="CIT0001"><label>1</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Hennessey</surname>
<given-names>IA</given-names>
</name>
<name><surname>Hewett</surname>
<given-names>P</given-names>
</name>
</person-group>
<article-title>Virtual reality versus box laparoscopic simulators in trainee selection and aptitude testing</article-title>
<source>Surg Laparosc Endosc Percutan Tech</source>
<year>2014</year>
<volume>24</volume>
<fpage>318</fpage>
<lpage>21</lpage>
<pub-id pub-id-type="pmid">25077635</pub-id>
</element-citation>
</ref>
<ref id="CIT0002"><label>2</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Tansley</surname>
<given-names>P</given-names>
</name>
<name><surname>Kakar</surname>
<given-names>S</given-names>
</name>
<name><surname>Withey</surname>
<given-names>S</given-names>
</name>
<name><surname>Butler</surname>
<given-names>P</given-names>
</name>
</person-group>
<article-title>Visuospatial and technical ability in the selection and assessment of higher surgical trainees in the London deanery</article-title>
<source>Ann R Coll Surg Engl</source>
<year>2007</year>
<volume>89</volume>
<fpage>591</fpage>
<lpage>5</lpage>
<pub-id pub-id-type="pmid">18201473</pub-id>
</element-citation>
</ref>
<ref id="CIT0003"><label>3</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Aggarwal</surname>
<given-names>R</given-names>
</name>
<name><surname>Moorthy</surname>
<given-names>K</given-names>
</name>
<name><surname>Darzi</surname>
<given-names>A</given-names>
</name>
</person-group>
<article-title>Laparoscopic skills training and assessment</article-title>
<source>Br J Surg</source>
<year>2004</year>
<volume>91</volume>
<fpage>1549</fpage>
<lpage>58</lpage>
<pub-id pub-id-type="pmid">15547882</pub-id>
</element-citation>
</ref>
<ref id="CIT0004"><label>4</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Derossis</surname>
<given-names>AM</given-names>
</name>
<name><surname>Fried</surname>
<given-names>GM</given-names>
</name>
<name><surname>Abrahamowicz</surname>
<given-names>M</given-names>
</name>
<name><surname>Sigman</surname>
<given-names>HH</given-names>
</name>
<name><surname>Barkun</surname>
<given-names>JS</given-names>
</name>
<name><surname>Meakins</surname>
<given-names>JL</given-names>
</name>
</person-group>
<article-title>Development of a model for training and evaluation of laparoscopic skills</article-title>
<source>Am J Surg</source>
<year>1998</year>
<volume>175</volume>
<fpage>482</fpage>
<lpage>7</lpage>
<pub-id pub-id-type="pmid">9645777</pub-id>
</element-citation>
</ref>
<ref id="CIT0005"><label>5</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Fried</surname>
<given-names>GM</given-names>
</name>
</person-group>
<article-title>FLS assessment of competency using simulated laparoscopic tasks</article-title>
<source>J Gastrointest Surg</source>
<year>2008</year>
<volume>12</volume>
<fpage>210</fpage>
<lpage>12</lpage>
<pub-id pub-id-type="pmid">17955315</pub-id>
</element-citation>
</ref>
<ref id="CIT0006"><label>6</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Fried</surname>
<given-names>GM</given-names>
</name>
<name><surname>Feldman</surname>
<given-names>LS</given-names>
</name>
<name><surname>Vassiliou</surname>
<given-names>MC</given-names>
</name>
<name><surname>Fraser</surname>
<given-names>SA</given-names>
</name>
<name><surname>Stanbridge</surname>
<given-names>D</given-names>
</name>
<name><surname>Ghitulescu</surname>
<given-names>G</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Proving the value of simulation in laparoscopic surgery</article-title>
<source>Ann Surg</source>
<year>2004</year>
<volume>240</volume>
<fpage>518</fpage>
<lpage>25</lpage>
<comment>discussion 25–8</comment>
<pub-id pub-id-type="pmid">15319723</pub-id>
</element-citation>
</ref>
<ref id="CIT0007"><label>7</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kundhal</surname>
<given-names>PS</given-names>
</name>
<name><surname>Grantcharov</surname>
<given-names>TP</given-names>
</name>
</person-group>
<article-title>Psychomotor performance measured in a virtual environment correlates with technical skills in the operating room</article-title>
<source>Surg Endosc</source>
<year>2009</year>
<volume>23</volume>
<fpage>645</fpage>
<lpage>9</lpage>
<pub-id pub-id-type="pmid">18622548</pub-id>
</element-citation>
</ref>
<ref id="CIT0008"><label>8</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Langelotz</surname>
<given-names>C</given-names>
</name>
<name><surname>Kilian</surname>
<given-names>M</given-names>
</name>
<name><surname>Paul</surname>
<given-names>C</given-names>
</name>
<name><surname>Schwenk</surname>
<given-names>W</given-names>
</name>
</person-group>
<article-title>LapSim virtual reality laparoscopic simulator reflects clinical experience in German surgeons</article-title>
<source>Langenbecks Arch Surg</source>
<year>2005</year>
<volume>390</volume>
<fpage>534</fpage>
<lpage>7</lpage>
<pub-id pub-id-type="pmid">16052369</pub-id>
</element-citation>
</ref>
<ref id="CIT0009"><label>9</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>McCluney</surname>
<given-names>AL</given-names>
</name>
<name><surname>Vassiliou</surname>
<given-names>MC</given-names>
</name>
<name><surname>Kaneva</surname>
<given-names>PA</given-names>
</name>
<name><surname>Cao</surname>
<given-names>J</given-names>
</name>
<name><surname>Stanbridge</surname>
<given-names>DD</given-names>
</name>
<name><surname>Feldman</surname>
<given-names>LS</given-names>
</name>
<etal></etal>
</person-group>
<article-title>FLS simulator performance predicts intraoperative laparoscopic skill</article-title>
<source>Surg Endosc</source>
<year>2007</year>
<volume>21</volume>
<fpage>1991</fpage>
<lpage>5</lpage>
<pub-id pub-id-type="pmid">17593434</pub-id>
</element-citation>
</ref>
<ref id="CIT0010"><label>10</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Grantcharov</surname>
<given-names>TP</given-names>
</name>
<name><surname>Rosenberg</surname>
<given-names>J</given-names>
</name>
<name><surname>Pahle</surname>
<given-names>E</given-names>
</name>
<name><surname>Funch-Jensen</surname>
<given-names>P</given-names>
</name>
</person-group>
<article-title>Virtual reality computer simulation</article-title>
<source>Surg Endosc</source>
<year>2001</year>
<volume>15</volume>
<fpage>242</fpage>
<lpage>4</lpage>
<pub-id pub-id-type="pmid">11344422</pub-id>
</element-citation>
</ref>
<ref id="CIT0011"><label>11</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gallagher</surname>
<given-names>AG</given-names>
</name>
<name><surname>Satava</surname>
<given-names>RM</given-names>
</name>
</person-group>
<article-title>Virtual reality as a metric for the assessment of laparoscopic psychomotor skills. Learning curves and reliability measures</article-title>
<source>Surg Endosc</source>
<year>2002</year>
<volume>16</volume>
<fpage>1746</fpage>
<lpage>52</lpage>
<pub-id pub-id-type="pmid">12140641</pub-id>
</element-citation>
</ref>
<ref id="CIT0012"><label>12</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gallagher</surname>
<given-names>AG</given-names>
</name>
<name><surname>Lederman</surname>
<given-names>AB</given-names>
</name>
<name><surname>McGlade</surname>
<given-names>K</given-names>
</name>
<name><surname>Satava</surname>
<given-names>RM</given-names>
</name>
<name><surname>Smith</surname>
<given-names>CD</given-names>
</name>
</person-group>
<article-title>Discriminative validity of the Minimally Invasive Surgical Trainer in Virtual Reality (MIST-VR) using criteria levels based on expert performance</article-title>
<source>Surg Endosc</source>
<year>2004</year>
<volume>18</volume>
<fpage>660</fpage>
<lpage>5</lpage>
<pub-id pub-id-type="pmid">15026925</pub-id>
</element-citation>
</ref>
<ref id="CIT0013"><label>13</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gallagher</surname>
<given-names>AG</given-names>
</name>
<name><surname>Richie</surname>
<given-names>K</given-names>
</name>
<name><surname>McClure</surname>
<given-names>N</given-names>
</name>
<name><surname>McGuigan</surname>
<given-names>J</given-names>
</name>
</person-group>
<article-title>Objective psychomotor skills assessment of experienced, junior, and novice laparoscopists with virtual reality</article-title>
<source>World J Surg</source>
<year>2001</year>
<volume>25</volume>
<fpage>1478</fpage>
<lpage>83</lpage>
<pub-id pub-id-type="pmid">11760752</pub-id>
</element-citation>
</ref>
<ref id="CIT0014"><label>14</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Vassiliou</surname>
<given-names>MC</given-names>
</name>
<name><surname>Feldman</surname>
<given-names>LS</given-names>
</name>
</person-group>
<article-title>Objective assessment, selection, and certification in surgery</article-title>
<source>Surg Oncol</source>
<year>2011</year>
<volume>20</volume>
<fpage>140</fpage>
<lpage>5</lpage>
<pub-id pub-id-type="pmid">21071209</pub-id>
</element-citation>
</ref>
<ref id="CIT0015"><label>15</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Fraser</surname>
<given-names>SA</given-names>
</name>
<name><surname>Klassen</surname>
<given-names>DR</given-names>
</name>
<name><surname>Feldman</surname>
<given-names>LS</given-names>
</name>
<name><surname>Ghitulescu</surname>
<given-names>GA</given-names>
</name>
<name><surname>Stanbridge</surname>
<given-names>D</given-names>
</name>
<name><surname>Fried</surname>
<given-names>GM</given-names>
</name>
</person-group>
<article-title>Evaluating laparoscopic skills: setting the pass/fail score for the MISTELS system</article-title>
<source>Surg Endosc</source>
<year>2003</year>
<volume>17</volume>
<fpage>964</fpage>
<lpage>7</lpage>
<pub-id pub-id-type="pmid">12658417</pub-id>
</element-citation>
</ref>
<ref id="CIT0016"><label>16</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Feldman</surname>
<given-names>LS</given-names>
</name>
<name><surname>Hagarty</surname>
<given-names>SE</given-names>
</name>
<name><surname>Ghitulescu</surname>
<given-names>G</given-names>
</name>
<name><surname>Stanbridge</surname>
<given-names>D</given-names>
</name>
<name><surname>Fried</surname>
<given-names>GM</given-names>
</name>
</person-group>
<article-title>Relationship between objective assessment of technical skills and subjective in-training evaluations in surgical residents</article-title>
<source>J Am Coll Surg</source>
<year>2004</year>
<volume>198</volume>
<fpage>105</fpage>
<lpage>10</lpage>
<pub-id pub-id-type="pmid">14698317</pub-id>
</element-citation>
</ref>
<ref id="CIT0017"><label>17</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Aggarwal</surname>
<given-names>R</given-names>
</name>
<name><surname>Grantcharov</surname>
<given-names>T</given-names>
</name>
<name><surname>Moorthy</surname>
<given-names>K</given-names>
</name>
<name><surname>Milland</surname>
<given-names>T</given-names>
</name>
<name><surname>Papasavas</surname>
<given-names>P</given-names>
</name>
<name><surname>Dosis</surname>
<given-names>A</given-names>
</name>
<etal></etal>
</person-group>
<article-title>An evaluation of the feasibility, validity, and reliability of laparoscopic skills assessment in the operating room</article-title>
<source>Ann Surg</source>
<year>2007</year>
<volume>245</volume>
<fpage>992</fpage>
<lpage>9</lpage>
<pub-id pub-id-type="pmid">17522527</pub-id>
</element-citation>
</ref>
<ref id="CIT0018"><label>18</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Hamilton</surname>
<given-names>EC</given-names>
</name>
<name><surname>Scott</surname>
<given-names>DJ</given-names>
</name>
<name><surname>Fleming</surname>
<given-names>JB</given-names>
</name>
<name><surname>Rege</surname>
<given-names>RV</given-names>
</name>
<name><surname>Laycock</surname>
<given-names>R</given-names>
</name>
<name><surname>Bergen</surname>
<given-names>PC</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Comparison of video trainer and virtual reality training systems on acquisition of laparoscopic skills</article-title>
<source>Surg Endosc</source>
<year>2002</year>
<volume>16</volume>
<fpage>406</fpage>
<lpage>11</lpage>
<pub-id pub-id-type="pmid">11928017</pub-id>
</element-citation>
</ref>
<ref id="CIT0019"><label>19</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Feldman</surname>
<given-names>LS</given-names>
</name>
<name><surname>Sherman</surname>
<given-names>V</given-names>
</name>
<name><surname>Fried</surname>
<given-names>GM</given-names>
</name>
</person-group>
<article-title>Using simulators to assess laparoscopic competence: ready for widespread use?</article-title>
<source>Surgery</source>
<year>2004</year>
<volume>135</volume>
<fpage>28</fpage>
<lpage>42</lpage>
<pub-id pub-id-type="pmid">14694298</pub-id>
</element-citation>
</ref>
<ref id="CIT0020"><label>20</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Rassweiler</surname>
<given-names>J</given-names>
</name>
<name><surname>Klein</surname>
<given-names>J</given-names>
</name>
<name><surname>Teber</surname>
<given-names>D</given-names>
</name>
<name><surname>Schulze</surname>
<given-names>M</given-names>
</name>
<name><surname>Frede</surname>
<given-names>T</given-names>
</name>
</person-group>
<article-title>Mechanical simulators for training for laparoscopic surgery in urology</article-title>
<source>J Endourol</source>
<year>2007</year>
<volume>21</volume>
<fpage>252</fpage>
<lpage>62</lpage>
<pub-id pub-id-type="pmid">17444768</pub-id>
</element-citation>
</ref>
<ref id="CIT0021"><label>21</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Vassiliou</surname>
<given-names>MC</given-names>
</name>
<name><surname>Fowler</surname>
<given-names>DL</given-names>
</name>
<name><surname>Hogle</surname>
<given-names>NJ</given-names>
</name>
<name><surname>Andrew</surname>
<given-names>CG</given-names>
</name>
<name><surname>Vergis</surname>
<given-names>A</given-names>
</name>
<name><surname>Klassen</surname>
<given-names>DR</given-names>
</name>
<etal></etal>
</person-group>
<article-title>External validation of the Global Operative Assessment of Laparoscopic Skills (GOALS)</article-title>
<source>Surg Endosc</source>
<year>2006</year>
<volume>20</volume>
<fpage>S343</fpage>
</element-citation>
</ref>
<ref id="CIT0022"><label>22</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Steigerwald</surname>
<given-names>SN</given-names>
</name>
<name><surname>Park</surname>
<given-names>J</given-names>
</name>
<name><surname>Hardy</surname>
<given-names>KM</given-names>
</name>
<name><surname>Gillman</surname>
<given-names>L</given-names>
</name>
<name><surname>Vergis</surname>
<given-names>AS</given-names>
</name>
</person-group>
<article-title>Establishing the concurrent validity of general and technique-specific skills assessments in surgical education</article-title>
<source>Am J Surg</source>
<year>2015</year>
<comment>pii: S0002-9610(15)00406-7. doi: <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1016/j.amjsurg.2015.04.024">http://dx.doi.org/10.1016/j.amjsurg.2015.04.024</ext-link>
</comment>
</element-citation>
</ref>
<ref id="CIT0023"><label>23</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Iwata</surname>
<given-names>N</given-names>
</name>
<name><surname>Fujiwara</surname>
<given-names>M</given-names>
</name>
<name><surname>Kodera</surname>
<given-names>Y</given-names>
</name>
<name><surname>Tanaka</surname>
<given-names>C</given-names>
</name>
<name><surname>Ohashi</surname>
<given-names>N</given-names>
</name>
<name><surname>Nakayama</surname>
<given-names>G</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Construct validity of the LapVR virtual-reality surgical simulator</article-title>
<source>Surg Endosc</source>
<year>2011</year>
<volume>25</volume>
<fpage>423</fpage>
<lpage>8</lpage>
<pub-id pub-id-type="pmid">20585960</pub-id>
</element-citation>
</ref>
<ref id="CIT0024"><label>24</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Vassiliou</surname>
<given-names>MC</given-names>
</name>
<name><surname>Feldman</surname>
<given-names>LS</given-names>
</name>
<name><surname>Andrew</surname>
<given-names>CG</given-names>
</name>
<name><surname>Bergman</surname>
<given-names>S</given-names>
</name>
<name><surname>Leffondre</surname>
<given-names>K</given-names>
</name>
<name><surname>Stanbridge</surname>
<given-names>D</given-names>
</name>
<etal></etal>
</person-group>
<article-title>A global assessment tool for evaluation of intraoperative laparoscopic skills</article-title>
<source>Am J Surg</source>
<year>2005</year>
<volume>190</volume>
<fpage>107</fpage>
<lpage>13</lpage>
<pub-id pub-id-type="pmid">15972181</pub-id>
</element-citation>
</ref>
<ref id="CIT0025"><label>25</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Araujo</surname>
<given-names>SE</given-names>
</name>
<name><surname>Seid</surname>
<given-names>VE</given-names>
</name>
<name><surname>Bertoncini</surname>
<given-names>AB</given-names>
</name>
<name><surname>Horcel</surname>
<given-names>LA</given-names>
</name>
<name><surname>Nahas</surname>
<given-names>SC</given-names>
</name>
<name><surname>Cecconello</surname>
<given-names>I</given-names>
</name>
</person-group>
<article-title>Single-session baseline virtual reality simulator scores predict technical performance for laparoscopic colectomy: a study in the swine model</article-title>
<source>J Surgical Educ</source>
<year>2014</year>
<volume>71</volume>
<fpage>883</fpage>
<lpage>91</lpage>
</element-citation>
</ref>
<ref id="CIT0026"><label>26</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Rivard</surname>
<given-names>JD</given-names>
</name>
<name><surname>Vergis</surname>
<given-names>AS</given-names>
</name>
<name><surname>Unger</surname>
<given-names>BJ</given-names>
</name>
<name><surname>Hardy</surname>
<given-names>KM</given-names>
</name>
<name><surname>Andrew</surname>
<given-names>CG</given-names>
</name>
<name><surname>Gillman</surname>
<given-names>LM</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Construct validity of individual and summary performance metrics associated with a computer-based laparoscopic simulator</article-title>
<source>Surg Endosc</source>
<year>2014</year>
<volume>28</volume>
<fpage>1921</fpage>
<lpage>8</lpage>
<pub-id pub-id-type="pmid">24442685</pub-id>
</element-citation>
</ref>
</ref-list>
</back>
</pmc>
</record>
Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/HapticV1/Data/Pmc/Curation
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000251 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Pmc/Curation/biblio.hfd -nk 000251 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien |wiki= Ticri/CIDE |area= HapticV1 |flux= Pmc |étape= Curation |type= RBID |clé= PMC:4671314 |texte= The Fundamentals of Laparoscopic Surgery and LapVR evaluation metrics may not correlate with operative performance in a novice cohort }}
Pour générer des pages wiki
HfdIndexSelect -h $EXPLOR_AREA/Data/Pmc/Curation/RBID.i -Sk "pubmed:26641071" \ | HfdSelect -Kh $EXPLOR_AREA/Data/Pmc/Curation/biblio.hfd \ | NlmPubMed2Wicri -a HapticV1
![]() | This area was generated with Dilib version V0.6.23. | ![]() |