The learning effect of intraoperative video-enhanced surgical procedure training
Identifieur interne : 000891 ( Pmc/Curation ); précédent : 000890; suivant : 000892The learning effect of intraoperative video-enhanced surgical procedure training
Auteurs : M. J. Van Det [Pays-Bas] ; W. J. H. J. Meijerink [Pays-Bas] ; C. Hoff [Pays-Bas] ; L. J. Middel [Pays-Bas] ; S. A. Koopal [Pays-Bas] ; J. P. E. N. Pierie [Pays-Bas]Source :
- Surgical Endoscopy [ 0930-2794 ] ; 2011.
Abstract
The transition from basic skills training in a skills lab to procedure training in the operating theater using the traditional master-apprentice model (MAM) lacks uniformity and efficiency. When the supervising surgeon performs parts of a procedure, training opportunities are lost. To minimize this intervention by the supervisor and maximize the actual operating time for the trainee, we created a new training method called INtraoperative Video-Enhanced Surgical Training (INVEST).
Ten surgical residents were trained in laparoscopic cholecystectomy either by the MAM or with INVEST. Each trainee performed six cholecystectomies that were objectively evaluated on an Objective Structured Assessment of Technical Skills (OSATS) global rating scale. Absolute and relative improvements during the training curriculum were compared between the groups. A questionnaire evaluated the trainee’s opinion on this new training method.
Skill improvement on the OSATS global rating scale was significantly greater for the trainees in the INVEST curriculum compared to the MAM, with mean absolute improvement 32.6 versus 14.0 points and mean relative improvement 59.1 versus 34.6% (
INVEST significantly enhances technical and procedural skill development during the early learning curve for laparoscopic cholecystectomy. Trainees were positive about the content and the idea of the curriculum.
Url:
DOI: 10.1007/s00464-010-1545-5
PubMed: 21359903
PubMed Central: 3116121
Links toward previous steps (curation, corpus...)
- to stream Pmc, to step Corpus: Pour aller vers cette notice dans l'étape Curation :000891
Links to Exploration step
PMC:3116121Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">The learning effect of intraoperative video-enhanced surgical procedure training</title>
<author><name sortKey="Van Det, M J" sort="Van Det, M J" uniqKey="Van Det M" first="M. J." last="Van Det">M. J. Van Det</name>
<affiliation wicri:level="1"><nlm:aff id="Aff1">Department of Surgery, Medical Center Leeuwarden, Leeuwarden, The Netherlands</nlm:aff>
<country xml:lang="fr">Pays-Bas</country>
<wicri:regionArea>Department of Surgery, Medical Center Leeuwarden, Leeuwarden</wicri:regionArea>
</affiliation>
<affiliation wicri:level="1"><nlm:aff id="Aff2">Department of Surgery, University Medical Center Groningen, P. O. Box 30001, 9700 Groningen, The Netherlands</nlm:aff>
<country xml:lang="fr">Pays-Bas</country>
<wicri:regionArea>Department of Surgery, University Medical Center Groningen, P. O. Box 30001, 9700 Groningen</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Meijerink, W J H J" sort="Meijerink, W J H J" uniqKey="Meijerink W" first="W. J. H. J." last="Meijerink">W. J. H. J. Meijerink</name>
<affiliation wicri:level="1"><nlm:aff id="Aff3">Department of Gastro Intestinal Surgery, Free University Medical Center, Amsterdam, The Netherlands</nlm:aff>
<country xml:lang="fr">Pays-Bas</country>
<wicri:regionArea>Department of Gastro Intestinal Surgery, Free University Medical Center, Amsterdam</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Hoff, C" sort="Hoff, C" uniqKey="Hoff C" first="C." last="Hoff">C. Hoff</name>
<affiliation wicri:level="1"><nlm:aff id="Aff1">Department of Surgery, Medical Center Leeuwarden, Leeuwarden, The Netherlands</nlm:aff>
<country xml:lang="fr">Pays-Bas</country>
<wicri:regionArea>Department of Surgery, Medical Center Leeuwarden, Leeuwarden</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Middel, L J" sort="Middel, L J" uniqKey="Middel L" first="L. J." last="Middel">L. J. Middel</name>
<affiliation wicri:level="1"><nlm:aff id="Aff4">Department of Health Sciences, University of Groningen, Groningen, The Netherlands</nlm:aff>
<country xml:lang="fr">Pays-Bas</country>
<wicri:regionArea>Department of Health Sciences, University of Groningen, Groningen</wicri:regionArea>
</affiliation>
<affiliation wicri:level="1"><nlm:aff id="Aff5">Department of Oral Health and Clinical Epidemiology, University of Groningen, Groningen, The Netherlands</nlm:aff>
<country xml:lang="fr">Pays-Bas</country>
<wicri:regionArea>Department of Oral Health and Clinical Epidemiology, University of Groningen, Groningen</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Koopal, S A" sort="Koopal, S A" uniqKey="Koopal S" first="S. A." last="Koopal">S. A. Koopal</name>
<affiliation wicri:level="1"><nlm:aff id="Aff1">Department of Surgery, Medical Center Leeuwarden, Leeuwarden, The Netherlands</nlm:aff>
<country xml:lang="fr">Pays-Bas</country>
<wicri:regionArea>Department of Surgery, Medical Center Leeuwarden, Leeuwarden</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Pierie, J P E N" sort="Pierie, J P E N" uniqKey="Pierie J" first="J. P. E. N." last="Pierie">J. P. E. N. Pierie</name>
<affiliation wicri:level="1"><nlm:aff id="Aff1">Department of Surgery, Medical Center Leeuwarden, Leeuwarden, The Netherlands</nlm:aff>
<country xml:lang="fr">Pays-Bas</country>
<wicri:regionArea>Department of Surgery, Medical Center Leeuwarden, Leeuwarden</wicri:regionArea>
</affiliation>
</author>
</titleStmt>
<publicationStmt><idno type="wicri:source">PMC</idno>
<idno type="pmid">21359903</idno>
<idno type="pmc">3116121</idno>
<idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3116121</idno>
<idno type="RBID">PMC:3116121</idno>
<idno type="doi">10.1007/s00464-010-1545-5</idno>
<date when="2011">2011</date>
<idno type="wicri:Area/Pmc/Corpus">000891</idno>
<idno type="wicri:Area/Pmc/Curation">000891</idno>
</publicationStmt>
<sourceDesc><biblStruct><analytic><title xml:lang="en" level="a" type="main">The learning effect of intraoperative video-enhanced surgical procedure training</title>
<author><name sortKey="Van Det, M J" sort="Van Det, M J" uniqKey="Van Det M" first="M. J." last="Van Det">M. J. Van Det</name>
<affiliation wicri:level="1"><nlm:aff id="Aff1">Department of Surgery, Medical Center Leeuwarden, Leeuwarden, The Netherlands</nlm:aff>
<country xml:lang="fr">Pays-Bas</country>
<wicri:regionArea>Department of Surgery, Medical Center Leeuwarden, Leeuwarden</wicri:regionArea>
</affiliation>
<affiliation wicri:level="1"><nlm:aff id="Aff2">Department of Surgery, University Medical Center Groningen, P. O. Box 30001, 9700 Groningen, The Netherlands</nlm:aff>
<country xml:lang="fr">Pays-Bas</country>
<wicri:regionArea>Department of Surgery, University Medical Center Groningen, P. O. Box 30001, 9700 Groningen</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Meijerink, W J H J" sort="Meijerink, W J H J" uniqKey="Meijerink W" first="W. J. H. J." last="Meijerink">W. J. H. J. Meijerink</name>
<affiliation wicri:level="1"><nlm:aff id="Aff3">Department of Gastro Intestinal Surgery, Free University Medical Center, Amsterdam, The Netherlands</nlm:aff>
<country xml:lang="fr">Pays-Bas</country>
<wicri:regionArea>Department of Gastro Intestinal Surgery, Free University Medical Center, Amsterdam</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Hoff, C" sort="Hoff, C" uniqKey="Hoff C" first="C." last="Hoff">C. Hoff</name>
<affiliation wicri:level="1"><nlm:aff id="Aff1">Department of Surgery, Medical Center Leeuwarden, Leeuwarden, The Netherlands</nlm:aff>
<country xml:lang="fr">Pays-Bas</country>
<wicri:regionArea>Department of Surgery, Medical Center Leeuwarden, Leeuwarden</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Middel, L J" sort="Middel, L J" uniqKey="Middel L" first="L. J." last="Middel">L. J. Middel</name>
<affiliation wicri:level="1"><nlm:aff id="Aff4">Department of Health Sciences, University of Groningen, Groningen, The Netherlands</nlm:aff>
<country xml:lang="fr">Pays-Bas</country>
<wicri:regionArea>Department of Health Sciences, University of Groningen, Groningen</wicri:regionArea>
</affiliation>
<affiliation wicri:level="1"><nlm:aff id="Aff5">Department of Oral Health and Clinical Epidemiology, University of Groningen, Groningen, The Netherlands</nlm:aff>
<country xml:lang="fr">Pays-Bas</country>
<wicri:regionArea>Department of Oral Health and Clinical Epidemiology, University of Groningen, Groningen</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Koopal, S A" sort="Koopal, S A" uniqKey="Koopal S" first="S. A." last="Koopal">S. A. Koopal</name>
<affiliation wicri:level="1"><nlm:aff id="Aff1">Department of Surgery, Medical Center Leeuwarden, Leeuwarden, The Netherlands</nlm:aff>
<country xml:lang="fr">Pays-Bas</country>
<wicri:regionArea>Department of Surgery, Medical Center Leeuwarden, Leeuwarden</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Pierie, J P E N" sort="Pierie, J P E N" uniqKey="Pierie J" first="J. P. E. N." last="Pierie">J. P. E. N. Pierie</name>
<affiliation wicri:level="1"><nlm:aff id="Aff1">Department of Surgery, Medical Center Leeuwarden, Leeuwarden, The Netherlands</nlm:aff>
<country xml:lang="fr">Pays-Bas</country>
<wicri:regionArea>Department of Surgery, Medical Center Leeuwarden, Leeuwarden</wicri:regionArea>
</affiliation>
</author>
</analytic>
<series><title level="j">Surgical Endoscopy</title>
<idno type="ISSN">0930-2794</idno>
<idno type="eISSN">1432-2218</idno>
<imprint><date when="2011">2011</date>
</imprint>
</series>
</biblStruct>
</sourceDesc>
</fileDesc>
<profileDesc><textClass></textClass>
</profileDesc>
</teiHeader>
<front><div type="abstract" xml:lang="en"><sec><title>Background</title>
<p>The transition from basic skills training in a skills lab to procedure training in the operating theater using the traditional master-apprentice model (MAM) lacks uniformity and efficiency. When the supervising surgeon performs parts of a procedure, training opportunities are lost. To minimize this intervention by the supervisor and maximize the actual operating time for the trainee, we created a new training method called INtraoperative Video-Enhanced Surgical Training (INVEST).</p>
</sec>
<sec><title>Methods</title>
<p>Ten surgical residents were trained in laparoscopic cholecystectomy either by the MAM or with INVEST. Each trainee performed six cholecystectomies that were objectively evaluated on an Objective Structured Assessment of Technical Skills (OSATS) global rating scale. Absolute and relative improvements during the training curriculum were compared between the groups. A questionnaire evaluated the trainee’s opinion on this new training method.</p>
</sec>
<sec><title>Results</title>
<p>Skill improvement on the OSATS global rating scale was significantly greater for the trainees in the INVEST curriculum compared to the MAM, with mean absolute improvement 32.6 versus 14.0 points and mean relative improvement 59.1 versus 34.6% (<italic>P</italic>
= 0.02).</p>
</sec>
<sec><title>Conclusion</title>
<p>INVEST significantly enhances technical and procedural skill development during the early learning curve for laparoscopic cholecystectomy. Trainees were positive about the content and the idea of the curriculum.</p>
</sec>
</div>
</front>
<back><div1 type="bibliography"><listBibl><biblStruct><analytic><author><name sortKey="Berguer, R" uniqKey="Berguer R">R Berguer</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Gallagher, Ag" uniqKey="Gallagher A">AG Gallagher</name>
</author>
<author><name sortKey="Mcclure, N" uniqKey="Mcclure N">N McClure</name>
</author>
<author><name sortKey="Mcguigan, J" uniqKey="Mcguigan J">J McGuigan</name>
</author>
<author><name sortKey="Ritchie, K" uniqKey="Ritchie K">K Ritchie</name>
</author>
<author><name sortKey="Sheehy, Np" uniqKey="Sheehy N">NP Sheehy</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Det, Mj" uniqKey="Det M">MJ Det</name>
</author>
<author><name sortKey="Meijerink, Wjhj" uniqKey="Meijerink W">WJHJ Meijerink</name>
</author>
<author><name sortKey="Hoff, C" uniqKey="Hoff C">C Hoff</name>
</author>
<author><name sortKey="Veelen, Ma" uniqKey="Veelen M">MA Veelen</name>
</author>
<author><name sortKey="Pierie, Jpen" uniqKey="Pierie J">JPEN Pierie</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Det, Mj" uniqKey="Det M">MJ Det</name>
</author>
<author><name sortKey="Meijerink, Wjhj" uniqKey="Meijerink W">WJHJ Meijerink</name>
</author>
<author><name sortKey="Hoff, C" uniqKey="Hoff C">C Hoff</name>
</author>
<author><name sortKey="Totte, Er" uniqKey="Totte E">ER Totte</name>
</author>
<author><name sortKey="Pierie, Jpen" uniqKey="Pierie J">JPEN Pierie</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Aggarwal, R" uniqKey="Aggarwal R">R Aggarwal</name>
</author>
<author><name sortKey="Darzi, A" uniqKey="Darzi A">A Darzi</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Wentink, M" uniqKey="Wentink M">M Wentink</name>
</author>
<author><name sortKey="Stassen, Lp" uniqKey="Stassen L">LP Stassen</name>
</author>
<author><name sortKey="Alwayn, I" uniqKey="Alwayn I">I Alwayn</name>
</author>
<author><name sortKey="Hosman, Rj" uniqKey="Hosman R">RJ Hosman</name>
</author>
<author><name sortKey="Stassen, Hg" uniqKey="Stassen H">HG Stassen</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Larsen, Cr" uniqKey="Larsen C">CR Larsen</name>
</author>
<author><name sortKey="Soerensen, Jl" uniqKey="Soerensen J">JL Soerensen</name>
</author>
<author><name sortKey="Grantcharov, Tp" uniqKey="Grantcharov T">TP Grantcharov</name>
</author>
<author><name sortKey="Dalsgaard, T" uniqKey="Dalsgaard T">T Dalsgaard</name>
</author>
<author><name sortKey="Schouenborg, L" uniqKey="Schouenborg L">L Schouenborg</name>
</author>
<author><name sortKey="Ottosen, C" uniqKey="Ottosen C">C Ottosen</name>
</author>
<author><name sortKey="Schroeder, Tv" uniqKey="Schroeder T">TV Schroeder</name>
</author>
<author><name sortKey="Ottesen, Bs" uniqKey="Ottesen B">BS Ottesen</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Dongen, Kw" uniqKey="Dongen K">KW Dongen</name>
</author>
<author><name sortKey="Wal, Wa" uniqKey="Wal W">WA Wal</name>
</author>
<author><name sortKey="Rinkes, Ih" uniqKey="Rinkes I">IH Rinkes</name>
</author>
<author><name sortKey="Schijven, Mp" uniqKey="Schijven M">MP Schijven</name>
</author>
<author><name sortKey="Broeders, Ia" uniqKey="Broeders I">IA Broeders</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Grantcharov, Tp" uniqKey="Grantcharov T">TP Grantcharov</name>
</author>
<author><name sortKey="Kristiansen, Vb" uniqKey="Kristiansen V">VB Kristiansen</name>
</author>
<author><name sortKey="Bendix, J" uniqKey="Bendix J">J Bendix</name>
</author>
<author><name sortKey="Bardram, L" uniqKey="Bardram L">L Bardram</name>
</author>
<author><name sortKey="Rosenberg, J" uniqKey="Rosenberg J">J Rosenberg</name>
</author>
<author><name sortKey="Funch Jensen, P" uniqKey="Funch Jensen P">P Funch-Jensen</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Gurusamy, Ks" uniqKey="Gurusamy K">KS Gurusamy</name>
</author>
<author><name sortKey="Aggarwal, R" uniqKey="Aggarwal R">R Aggarwal</name>
</author>
<author><name sortKey="Palanivelu, L" uniqKey="Palanivelu L">L Palanivelu</name>
</author>
<author><name sortKey="Davidson, Br" uniqKey="Davidson B">BR Davidson</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Panait, L" uniqKey="Panait L">L Panait</name>
</author>
<author><name sortKey="Akkary, E" uniqKey="Akkary E">E Akkary</name>
</author>
<author><name sortKey="Bell, Rl" uniqKey="Bell R">RL Bell</name>
</author>
<author><name sortKey="Roberts, Ke" uniqKey="Roberts K">KE Roberts</name>
</author>
<author><name sortKey="Dudrick, Sj" uniqKey="Dudrick S">SJ Dudrick</name>
</author>
<author><name sortKey="Duffy, Aj" uniqKey="Duffy A">AJ Duffy</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Furnee, Ej" uniqKey="Furnee E">EJ Furnee</name>
</author>
<author><name sortKey="Empel, Pj" uniqKey="Empel P">PJ Empel</name>
</author>
<author><name sortKey="Mahdavian Delavary, B" uniqKey="Mahdavian Delavary B">B Mahdavian Delavary</name>
</author>
<author><name sortKey="Peet, Dl" uniqKey="Peet D">DL Peet</name>
</author>
<author><name sortKey="Cuesta, Ma" uniqKey="Cuesta M">MA Cuesta</name>
</author>
<author><name sortKey="Meijerink, Wjhj" uniqKey="Meijerink W">WJHJ Meijerink</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Akl, Mn" uniqKey="Akl M">MN Akl</name>
</author>
<author><name sortKey="Giles, Dl" uniqKey="Giles D">DL Giles</name>
</author>
<author><name sortKey="Long, Jb" uniqKey="Long J">JB Long</name>
</author>
<author><name sortKey="Magrina, Jf" uniqKey="Magrina J">JF Magrina</name>
</author>
<author><name sortKey="Kho, Rm" uniqKey="Kho R">RM Kho</name>
</author>
</analytic>
</biblStruct>
<biblStruct></biblStruct>
<biblStruct><analytic><author><name sortKey="Strasberg, Sm" uniqKey="Strasberg S">SM Strasberg</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Verdaasdonk, Eg" uniqKey="Verdaasdonk E">EG Verdaasdonk</name>
</author>
<author><name sortKey="Stassen, Lp" uniqKey="Stassen L">LP Stassen</name>
</author>
<author><name sortKey="Schijven, Mp" uniqKey="Schijven M">MP Schijven</name>
</author>
<author><name sortKey="Dankelman, J" uniqKey="Dankelman J">J Dankelman</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Verdaasdonk, Eg" uniqKey="Verdaasdonk E">EG Verdaasdonk</name>
</author>
<author><name sortKey="Dankelman, J" uniqKey="Dankelman J">J Dankelman</name>
</author>
<author><name sortKey="Lange, Jf" uniqKey="Lange J">JF Lange</name>
</author>
<author><name sortKey="Stassen, Lp" uniqKey="Stassen L">LP Stassen</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Martin, Ja" uniqKey="Martin J">JA Martin</name>
</author>
<author><name sortKey="Regehr, G" uniqKey="Regehr G">G Regehr</name>
</author>
<author><name sortKey="Reznick, R" uniqKey="Reznick R">R Reznick</name>
</author>
<author><name sortKey="Macrae, H" uniqKey="Macrae H">H MacRae</name>
</author>
<author><name sortKey="Murnaghan, J" uniqKey="Murnaghan J">J Murnaghan</name>
</author>
<author><name sortKey="Hutchison, C" uniqKey="Hutchison C">C Hutchison</name>
</author>
<author><name sortKey="Brown, M" uniqKey="Brown M">M Brown</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Nunnally, Jc" uniqKey="Nunnally J">JC Nunnally</name>
</author>
<author><name sortKey="Bernstein, Ih" uniqKey="Bernstein I">IH Bernstein</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Clark, La" uniqKey="Clark L">LA Clark</name>
</author>
<author><name sortKey="Watson, D" uniqKey="Watson D">D Watson</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Cortina, Jm" uniqKey="Cortina J">JM Cortina</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Briggs, Sr" uniqKey="Briggs S">SR Briggs</name>
</author>
<author><name sortKey="Cheek, Jm" uniqKey="Cheek J">JM Cheek</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Taylor, Gj" uniqKey="Taylor G">GJ Taylor</name>
</author>
<author><name sortKey="Bagby, Rm" uniqKey="Bagby R">RM Bagby</name>
</author>
<author><name sortKey="Parker, Jda" uniqKey="Parker J">JDA Parker</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Cohen, J" uniqKey="Cohen J">J Cohen</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Madan, Ak" uniqKey="Madan A">AK Madan</name>
</author>
<author><name sortKey="Frantzides, Ct" uniqKey="Frantzides C">CT Frantzides</name>
</author>
</analytic>
</biblStruct>
</listBibl>
</div1>
</back>
</TEI>
<pmc article-type="research-article"><pmc-dir>properties open_access</pmc-dir>
<front><journal-meta><journal-id journal-id-type="nlm-ta">Surg Endosc</journal-id>
<journal-title-group><journal-title>Surgical Endoscopy</journal-title>
</journal-title-group>
<issn pub-type="ppub">0930-2794</issn>
<issn pub-type="epub">1432-2218</issn>
<publisher><publisher-name>Springer-Verlag</publisher-name>
<publisher-loc>New York</publisher-loc>
</publisher>
</journal-meta>
<article-meta><article-id pub-id-type="pmid">21359903</article-id>
<article-id pub-id-type="pmc">3116121</article-id>
<article-id pub-id-type="publisher-id">1545</article-id>
<article-id pub-id-type="doi">10.1007/s00464-010-1545-5</article-id>
<article-categories><subj-group subj-group-type="heading"><subject>Article</subject>
</subj-group>
</article-categories>
<title-group><article-title>The learning effect of intraoperative video-enhanced surgical procedure training</article-title>
</title-group>
<contrib-group><contrib contrib-type="author" corresp="yes"><name><surname>van Det</surname>
<given-names>M. J.</given-names>
</name>
<address><email>mjvandet@gmail.com</email>
</address>
<xref ref-type="aff" rid="Aff1">1</xref>
<xref ref-type="aff" rid="Aff2">2</xref>
</contrib>
<contrib contrib-type="author"><name><surname>Meijerink</surname>
<given-names>W. J. H. J.</given-names>
</name>
<xref ref-type="aff" rid="Aff3">3</xref>
</contrib>
<contrib contrib-type="author"><name><surname>Hoff</surname>
<given-names>C.</given-names>
</name>
<xref ref-type="aff" rid="Aff1">1</xref>
</contrib>
<contrib contrib-type="author"><name><surname>Middel</surname>
<given-names>L. J.</given-names>
</name>
<xref ref-type="aff" rid="Aff4">4</xref>
<xref ref-type="aff" rid="Aff5">5</xref>
</contrib>
<contrib contrib-type="author"><name><surname>Koopal</surname>
<given-names>S. A.</given-names>
</name>
<xref ref-type="aff" rid="Aff1">1</xref>
</contrib>
<contrib contrib-type="author"><name><surname>Pierie</surname>
<given-names>J. P. E. N.</given-names>
</name>
<xref ref-type="aff" rid="Aff1">1</xref>
</contrib>
<aff id="Aff1"><label>1</label>
Department of Surgery, Medical Center Leeuwarden, Leeuwarden, The Netherlands</aff>
<aff id="Aff2"><label>2</label>
Department of Surgery, University Medical Center Groningen, P. O. Box 30001, 9700 Groningen, The Netherlands</aff>
<aff id="Aff3"><label>3</label>
Department of Gastro Intestinal Surgery, Free University Medical Center, Amsterdam, The Netherlands</aff>
<aff id="Aff4"><label>4</label>
Department of Health Sciences, University of Groningen, Groningen, The Netherlands</aff>
<aff id="Aff5"><label>5</label>
Department of Oral Health and Clinical Epidemiology, University of Groningen, Groningen, The Netherlands</aff>
</contrib-group>
<pub-date pub-type="epub"><day>27</day>
<month>2</month>
<year>2011</year>
</pub-date>
<pub-date pub-type="pmc-release"><day>27</day>
<month>2</month>
<year>2011</year>
</pub-date>
<pub-date pub-type="ppub"><month>7</month>
<year>2011</year>
</pub-date>
<volume>25</volume>
<issue>7</issue>
<fpage>2261</fpage>
<lpage>2267</lpage>
<history><date date-type="received"><day>20</day>
<month>6</month>
<year>2010</year>
</date>
<date date-type="accepted"><day>30</day>
<month>11</month>
<year>2010</year>
</date>
</history>
<permissions><copyright-statement>© The Author(s) 2011</copyright-statement>
</permissions>
<abstract id="Abs1"><sec><title>Background</title>
<p>The transition from basic skills training in a skills lab to procedure training in the operating theater using the traditional master-apprentice model (MAM) lacks uniformity and efficiency. When the supervising surgeon performs parts of a procedure, training opportunities are lost. To minimize this intervention by the supervisor and maximize the actual operating time for the trainee, we created a new training method called INtraoperative Video-Enhanced Surgical Training (INVEST).</p>
</sec>
<sec><title>Methods</title>
<p>Ten surgical residents were trained in laparoscopic cholecystectomy either by the MAM or with INVEST. Each trainee performed six cholecystectomies that were objectively evaluated on an Objective Structured Assessment of Technical Skills (OSATS) global rating scale. Absolute and relative improvements during the training curriculum were compared between the groups. A questionnaire evaluated the trainee’s opinion on this new training method.</p>
</sec>
<sec><title>Results</title>
<p>Skill improvement on the OSATS global rating scale was significantly greater for the trainees in the INVEST curriculum compared to the MAM, with mean absolute improvement 32.6 versus 14.0 points and mean relative improvement 59.1 versus 34.6% (<italic>P</italic>
= 0.02).</p>
</sec>
<sec><title>Conclusion</title>
<p>INVEST significantly enhances technical and procedural skill development during the early learning curve for laparoscopic cholecystectomy. Trainees were positive about the content and the idea of the curriculum.</p>
</sec>
</abstract>
<kwd-group><title>Keywords</title>
<kwd>Training</kwd>
<kwd>Minimally invasive surgery</kwd>
<kwd>Video</kwd>
<kwd>INVEST</kwd>
<kwd>Operating theater</kwd>
<kwd>Cholecystectomy</kwd>
</kwd-group>
<custom-meta-group><custom-meta><meta-name>issue-copyright-statement</meta-name>
<meta-value>© Springer Science+Business Media, LLC 2011</meta-value>
</custom-meta>
</custom-meta-group>
</article-meta>
</front>
<body><p>Laparoscopic surgery requires complex techniques and skills that are not employed in open surgery. The instruments provide limited haptic feedback, lack degrees of freedom, and move inverted inside the abdomen [<xref ref-type="bibr" rid="CR1">1</xref>
, <xref ref-type="bibr" rid="CR2">2</xref>
]. Furthermore, video monitors that provide a 2-dimensional projection of the operating field impair depth perception and are moved away from the patient [<xref ref-type="bibr" rid="CR3">3</xref>
, <xref ref-type="bibr" rid="CR4">4</xref>
]. Surgeons and residents in surgery have to master these technical skills and challenges before they can perform any laparoscopic procedure appropriately and safely.</p>
<p>How to teach laparoscopic surgery to residents in a safe and efficient way is the topic of many debates, conventions, and research projects [<xref ref-type="bibr" rid="CR5">5</xref>
]. Rasmussen’s model of human behavior in laparoscopic training, as described by Wentink at al. [<xref ref-type="bibr" rid="CR6">6</xref>
], identified three levels of behavior that have to be trained, namely, skill-based behavior, rule-based behavior, and knowledge-based behavior. Skill-based behavior in laparoscopy is best described as the set of technical skills that are needed in every procedure and comprises motor movements that are continuously regulated by feedback systems. Rule-based behavior is more complex and comprises specific sets of procedural steps that are performed according to stored rules. A sign serves to activate or trigger a stored rule. For example, having applied ligation clips on the cystic duct and artery in a laparoscopic cholecystectomy is the sign that triggers the rule that these structures can be transected next. Knowledge-based behavior is encountered when no rules are available, for instance, when a complication or an unexpected anatomical variation is encountered. Different plans of behavior are evaluated against the anticipated goal.</p>
<p>Traditionally, surgery has been taught following the master-apprentice model (MAM). In this model the surgical trainee learns to perform surgical procedures under the supervision of a qualified surgeon. The supervising surgeon instructs the trainee and, when necessary, he temporarily takes over the procedure to show a difficult step. Nowadays, it is no longer accepted that a novice learns skill-based behavior on patients as there are validated training platforms available for practicing basic skills for both conventional and laparoscopic surgery that avoid patients being exposed to early learning curves [<xref ref-type="bibr" rid="CR7">7</xref>
, <xref ref-type="bibr" rid="CR8">8</xref>
]. Basic laparoscopic motor skills can be practiced repeatedly on box trainers, virtual reality (VR) trainers, and augmented reality (AR) trainers [<xref ref-type="bibr" rid="CR9">9</xref>
, <xref ref-type="bibr" rid="CR10">10</xref>
]. VR trainers allow repeated practice of various exercises and record parameters such as instrument path length, collisions, and time to objectively score the trainee’s performance on these exercises. Some VR trainers are compact and use “plug and play” technology so they can be taken home for practice. However, a disadvantage of most VR trainers is the lack of haptic feedback for instrument and tissue handling [<xref ref-type="bibr" rid="CR11">11</xref>
]. Box trainers, on the other hand, provide haptic feedback and can be used for both basic skills and for procedure training using cadaver organs, but they require the use of surgical instruments and disposable materials [<xref ref-type="bibr" rid="CR12">12</xref>
].</p>
<p>Besides technical skills, a trainee has to acquire knowledge of the procedure itself, knowledge of the pitfalls of the procedure, and coping strategies when a problem presents itself, skills defined by Rasmussen as rule-based and knowledge-based behaviors [<xref ref-type="bibr" rid="CR6">6</xref>
]. In general, teaching these types of behavior is more complex and costly than teaching skill-based behavior. Animal model training and cadaver training are very helpful, but also resource intensive and not available on demand. Books, internet courses, and instruction videos can provide important fundamental knowledge of an illness and its surgical treatment [<xref ref-type="bibr" rid="CR13">13</xref>
]. However, the most important element in training a specific surgical procedure remains the hands-on training on a real patient with an experienced surgeon at the trainee’s side.</p>
<p>At the beginning of a trainee’s learning curve, it is likely that the supervising surgeon frequently takes over the procedure to demonstrate case-specific rule-based and knowledge-based behavior. A major disadvantage of this training model is that steps can be performed only once per procedure by either the trainee or the supervising surgeon. When the supervisor takes over, that part is lost to the trainee who has to wait for the next operation to perform the step himself. To minimize the frequency of this intervention by the supervisor and maximize the actual operating time for the trainee, we created a new training method called INtraoperative Video-Enhanced Surgical Training (INVEST). This method implements instruction videos to train rule-based and knowledge-based behaviors by demonstrating key elements and essential tips and tricks of the procedure step-by-step and on-demand without the need for the supervisor to demonstrate them by taking over. Therefore, these steps are preserved and can be performed by the trainee.</p>
<p>In the current study we investigated the effect of INVEST on the early learning curve in surgical procedure training inside the operating theater by showing short intraoperative instruction videos to surgical trainees.</p>
<sec id="Sec1" sec-type="methods"><title>Methods</title>
<sec id="Sec2"><title>Study design</title>
<p>This study was a randomized controlled trial with repeated measurements among trainees who were randomly assigned to a series of laparoscopic cholecystectomies utilizing either INVEST or the usual MAM. Intraindividual improvement of surgical skills was evaluated across students trained in either group. We preferred a baseline follow-up study design as it rules out a large number of confounding factors that are likely to occur when comparing separate outcomes between independent groups. Furthermore, we controlled for equal levels of surgical skills at baseline in order to avoid differences in outcome that are due to initial differences among participants.</p>
</sec>
<sec id="Sec3"><title>Procedure</title>
<p>The INVEST instruction video was created in conformity with the guidelines for laparoscopic cholecystectomy as formulated by the Association of Surgeons of the Netherlands [<xref ref-type="bibr" rid="CR14">14</xref>
]. These guidelines are similar to the guidelines formulated by SAGES and EAES, with the addition of the importance of the Critical View of Safety (CVS) [<xref ref-type="bibr" rid="CR15">15</xref>
]. Chronologically, all the separate steps of the procedure that are described in the guidelines were clustered into seven clearly identifiable stages: (1) open introduction of the first trocar, (2) accessory trocar placement, (3) opening of peritoneal envelope, (4) creating the CVS, (5) clipping and division of cystic duct and artery, (6) retrograde cholecystectomy, and (7) gallbladder removal and closure. For each of the seven stages a 1-min video clip was created, demonstrating anatomical landmarks, key elements, and operative techniques essential to that particular phase of the procedure. Video clips were displayed on demand on a second screen next to the operative screen when the trainee was ready for the next step of the procedure. For safety reasons, neither the trainee nor the supervising surgeon was allowed to continue the procedure while the instruction video was playing. After completion of each video clip, a written summary appeared and was displayed on the accessory screen while the trainee performed the next step.</p>
</sec>
<sec id="Sec4"><title>Trainee selection</title>
<p>Ten trainees were included in this study. All trainees were registered residents in surgery, were in the early phase of their training, and resided at the department of surgery at Leeuwarden Medical Center. Criteria for inclusion were at least 6 months of experience in open surgical techniques and the successful completion of a training course in basic surgical skills. Exclusion criteria were any hands-on experience with laparoscopic cholecystectomies and a cumulative experience of more than five cases in other laparoscopic procedures.</p>
</sec>
<sec id="Sec5"><title>Trainee preparation</title>
<p>Since the trainees had no previous experience in laparoscopic techniques, they also had no practical experience with the basic motor skills that are unique to laparoscopic procedures. These skills have to be mastered before anyone can be safely and efficiently trained in a specific laparoscopic procedure. Therefore, before randomization, all residents scheduled for this study developed their basic laparoscopic skills on the SIMENDO laparoscopy trainer (Simendo, Rotterdam, The Netherlands). This validated VR simulator has a variety of exercises and is supplied with a proficiency-based technical skills training curriculum [<xref ref-type="bibr" rid="CR16">16</xref>
]. Successful completion of the SIMENDO curriculum indicates an adequate level of proficiency in basic laparoscopic technical skills to allow safe participation in laparoscopic procedures on humans [<xref ref-type="bibr" rid="CR17">17</xref>
]. As an additional result of the curriculum, the technical skills of all the trainees were calibrated at an equal level.</p>
<p>After completing the SIMENDO curriculum, residents were randomly assigned to one of the two arms of this study by drawing a sealed envelope. In both groups, each resident performed six laparoscopic cholecystectomies within 2 weeks. Residents prepared themselves for these procedures in standard fashion using textbooks, anatomy books, and online information. During the procedure itself, the control group was trained using MAM. The experimental group, in addition to being supervised by a qualified surgeon, was trained with INVEST.</p>
</sec>
<sec id="Sec6"><title>Patient selection and supervision</title>
<p>Patients with uncomplicated symptomatic gallstone disease were selected for this study. All patients were asked to give informed consent that a resident would perform the procedure under the supervision of a qualified surgeon. Since the procedure itself did not differ between the experimental and control groups, informed consent was not needed for using INVEST.</p>
<p>Three dedicated laparoscopic surgeons were randomly assigned to supervise the procedures in both groups. They were conversant with the latest guidelines and approved the content of the instruction video. The supervising surgeons were not informed of the progression of the trainee in the course of the six cholecystectomies nor were they informed of previous scores. The surgeons guarded the safety and the flow of the procedure, they gave verbal instructions, and, when necessary, they temporarily took over the procedure. The time and reason for temporarily taking over the procedure was decided on the supervising surgeon’s professional autonomy.</p>
</sec>
<sec id="Sec7"><title>Operating theater setup</title>
<p>All procedures were performed in dedicated minimally invasive surgery (MIS) suites. An MIS suite is a fully integrated operating room (OR) in which laparoscopic equipment and multiple flat-screen monitors are permanently installed to be operational on demand. In the INVEST setting, two monitors were facing the operator and the supervisor, providing an ergonomically safe posture. One monitor displayed the operative image and the other was used for the instruction video. A third monitor displayed the operative image for the scrub nurse. A research fellow who was present during the procedure played the instruction video on demand from a computer that was linked to the designated flat-screen monitor.</p>
</sec>
<sec id="Sec8"><title>Objective Structured Assessment of Technical Skill (OSATS)</title>
<p>After each procedure, the supervising surgeon evaluated the skills of the trainee on a modified and translated version of the seven-question global rating scale that is used as part of the objective structured assessment of technical skill (OSATS) as described by Martin et al. [<xref ref-type="bibr" rid="CR18">18</xref>
] This modified OSATS global rating scale is used nationwide and is part of the mandatory digital portfolio for every resident in surgery in The Netherlands. Using a 10-point scale, it grades the trainee on seven important elements of any operation, concerning a combination of skill-based, rule-based, and knowledge-based behaviors: (1) respect for tissue, (2) time and motion, (3) instrument handling, (4) knowledge of instruments, (5) use of assistants, (6) flow of operation, and (7) knowledge of the procedure.</p>
</sec>
<sec id="Sec9"><title>Trainee’s opinion questionnaire</title>
<p>After completion of the six cholecystectomies, the trainees in the INVEST group were invited to give their opinion of the training method via a brief questionnaire. To assess the attitude toward INVEST among participants who were not acquainted with it in practice, the instruction video was also shown to the trainees in the MAM group. These trainees were also invited to fill out this questionnaire. The questionnaire comprised seven statements that had to be rated on a 5-point Likert scale where 1 = totally disagree, 2 = disagree, 3 = neutral, 4 = agree, and 5 = totally agree.</p>
</sec>
<sec id="Sec10"><title>Statistical methods</title>
<p>To evaluate the effect of INVEST, we were interested in the improvement of skills during the training curriculum. The individual OSATS scores for each procedure are snapshots and do not represent a learning curve. Therefore, we used the OSATS score of the first procedure as a baseline and calculated the improvement from the baseline during the following procedures. For each trainee, the absolute improvement on the OSATS score was calculated for each of the seven individual items and for the complete OSATS scale. In addition, we calculated the relative improvement on the OSATS scale that estimates the maximum score each trainee was able to achieve. With this relative improvement we estimated the percentage that each trainee improved from the first OSATS score (procedure 1) toward the maximum OSATS score at follow-up (procedure 6). Relative improvement in the seven OSATS skills and overall OSATS scale was calculated as follows:<disp-formula id="Equa"><alternatives><tex-math id="M1">\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$ {\frac{{{\text{Final \,OSATS \,score\, (procedure 6)}} - {\text{initial \,OSATS \,score\,(procedure 1)}}}}{{{ \max } . {\text{achievable \,OSATS \,score}} - {\text{initial\, OSATS \,score\, (procedure 1)}} }}} \times 100\% $$\end{document}</tex-math>
<graphic xlink:href="464_2010_1545_Article_Equa.gif" position="anchor"></graphic>
</alternatives>
</disp-formula>
</p>
</sec>
<sec id="Sec11"><title>Reliability</title>
<p>The reliability of the seven-item modified OSATS scale was examined with the internal consistency coefficient Cronbach’s alpha [<xref ref-type="bibr" rid="CR19">19</xref>
]. Since Cronbach’s alpha is dependent on the number of items in the scale and on the mean inter-item correlation (MIIC), one can achieve a high reliability estimate by having either many items or highly intercorrelated items (or a combination of the two) [<xref ref-type="bibr" rid="CR20">20</xref>
, <xref ref-type="bibr" rid="CR21">21</xref>
]. According to the guidelines by Briggs and Cheek [<xref ref-type="bibr" rid="CR22">22</xref>
], the MIIC should fall in an optimal range between 0.20 and 0.50 but should not be less than 0.15 [<xref ref-type="bibr" rid="CR20">20</xref>
, <xref ref-type="bibr" rid="CR22">22</xref>
, <xref ref-type="bibr" rid="CR23">23</xref>
]. Therefore, taking the upper value of the range, an MIIC ≥ 0.25 seems reasonable. For the seven-item OSATS global rating scale in this study, a Cronbach’s alpha coefficient of 0.70 was minimally acceptable.</p>
<p>Given the small sample size, the differences in absolute and relative improvements in skills between the INVEST group and the master-apprentice group were compared with the nonparametric Wilcoxon Mann–Whitney test for ordinal data. Effect sizes were calculated only for statistically significant differences, as it makes no sense to estimate clinical relevance of a result that is based on random variation. Cohen’s effect size (ES) for independent samples was used to estimate the magnitude of these differences [<xref ref-type="bibr" rid="CR24">24</xref>
]. According to Cohen’s thresholds, an ES < 0.20 indicates a trivial difference, 0.20–0.50 a small difference, 0.50–0.80 a moderate difference, and >0.80 a large difference.</p>
</sec>
</sec>
<sec id="Sec12"><title>Results</title>
<p>Ten trainees were randomly assigned to the two arms of the study, with no dropout after inclusion. Each trainee successfully completed the basic skills training curriculum on the SIMENDO to the preset level of proficiency before randomization. There were no differences between the groups with respect to training time to acquire the proficiency level. Each resident performed six laparoscopic cholecystectomies within the set period of 2 weeks. Each procedure was evaluated by the supervising surgeon using an OSATS global rating scale. There were no technical problems with displaying the instruction video in the INVEST group.</p>
<p>Reliability of the OSATS global rating scale was determined. The OSATS consists of seven items, and summed scores of these items indicate the extent of performance of technical skills. A lower overall score means a poor performance while a higher score indicates good to excellent performance. The internal consistency of the seven-item OSATS overall performance scale was good and yielded a Cronbach’s alpha of 0.88.</p>
<p>The OSATS scores for the first procedure were not statistically different between the groups. Analysis of the absolute and relative improvements in the seven separate skills on the OSATS global rating scale indicated a statistically significant (<italic>P</italic>
< 0.05) and clinically relevant (ES > 0.80) difference in skills acquisition in favor of the INVEST group for the following skills: time and motion, use of assistants, flow of operation, and knowledge of the procedure (Table <xref rid="Tab1" ref-type="table">1</xref>
). The absolute and relative skill improvements on the complete OSATS global rating scale were also significantly higher in the INVEST group (Table <xref rid="Tab1" ref-type="table">1</xref>
). The relative improvement during the six procedures is graphically displayed in Fig. <xref rid="Fig1" ref-type="fig">1</xref>
.<table-wrap id="Tab1"><label>Table 1</label>
<caption><p>Absolute and relative improvements on the seven-item OSATS global rating scale for the separate items and the sum score in the INVEST group and the MAM group</p>
</caption>
<table frame="hsides" rules="groups"><thead><tr><th align="left" rowspan="2">OSATS</th>
<th align="left" colspan="2">INVEST</th>
<th align="left" colspan="2">Master-apprentice model</th>
<th align="left" rowspan="2">ES</th>
<th align="left" rowspan="2"><italic>z/P</italic>
</th>
</tr>
<tr><th align="left">Absolute improvement (mean ± SD)</th>
<th align="left">Relative improvement [mean (%) ± SD]</th>
<th align="left">Absolute improvement (mean ± SD)</th>
<th align="left">Relative improvement [mean (%) ± SD]</th>
</tr>
</thead>
<tbody><tr><td align="left">Respect for tissue</td>
<td char="±" align="char">3.2 ± 2.2</td>
<td char="±" align="char">45.0 ± 26.5</td>
<td char="±" align="char">2.0 ± 1.3</td>
<td char="±" align="char">27.9 ± 14.5</td>
<td align="left"></td>
<td char="−" align="char">−1.2/0.25.</td>
</tr>
<tr><td align="left">Time and motion</td>
<td char="±" align="char">3.8 ± 1.1</td>
<td char="±" align="char">49.2 ± 9.4</td>
<td char="±" align="char">2.0 ± 0.0</td>
<td char="±" align="char">28.3 ± 4.6</td>
<td char="." align="char">2.82</td>
<td char="−" align="char">−2.5/0.02</td>
</tr>
<tr><td align="left">Instrument handling</td>
<td char="±" align="char">5.4 ± 1.3</td>
<td char="±" align="char">64.0 ± 12.9</td>
<td char="±" align="char">2.8 ± 1.9</td>
<td char="±" align="char">39.2 ± 24.2</td>
<td align="left"></td>
<td char="−" align="char">−1.8/0.07</td>
</tr>
<tr><td align="left">Knowledge of instruments</td>
<td char="±" align="char">4.6 ± 1.9</td>
<td char="±" align="char">57.1 ± 16.6</td>
<td char="±" align="char">3.2 ± 1.8</td>
<td char="±" align="char">48.1 ± 27.8</td>
<td align="left"></td>
<td char="−" align="char">−0.53/0.60</td>
</tr>
<tr><td align="left">Use of assistants</td>
<td char="±" align="char">5.0 ± 1.0</td>
<td char="±" align="char">60.6 ± 15.0</td>
<td char="±" align="char">1.2 ± 2.2</td>
<td char="±" align="char">21.2 ± 18.5</td>
<td char="." align="char">2.34</td>
<td char="−" align="char">−2.3/0.02</td>
</tr>
<tr><td align="left">Flow of operation</td>
<td char="±" align="char">5.4 ± 1.3</td>
<td char="±" align="char">62.8 ± 14.9</td>
<td char="±" align="char">1.6 ± 2.5</td>
<td char="±" align="char">27.5 ± 20.2</td>
<td char="." align="char">1.99</td>
<td char="−" align="char">−2.2/0.03</td>
</tr>
<tr><td align="left">Knowledge of the procedure</td>
<td char="±" align="char">5.2 ± 1.3</td>
<td char="±" align="char">69.5 ± 7.6</td>
<td char="±" align="char">1.2 ± 2.5</td>
<td char="±" align="char">31.0 ± 26.5</td>
<td char="." align="char">1.97</td>
<td char="−" align="char">−2.2/0.03</td>
</tr>
<tr><td align="left">Sum score OSATS</td>
<td char="±" align="char">32.6 ± 6.5</td>
<td char="±" align="char">59.1 ± 9.8</td>
<td char="±" align="char">16.4 ± 6.1</td>
<td char="±" align="char">34.6 ± 10.8</td>
<td char="." align="char">2.38</td>
<td char="−" align="char">−2.4/0.02</td>
</tr>
</tbody>
</table>
</table-wrap>
<fig id="Fig1"><label>Fig. 1</label>
<caption><p>Relative improvement for the INVEST and MAM group during the curriculum. * indicates statistical significance</p>
</caption>
<graphic xlink:href="464_2010_1545_Fig1_HTML" id="MO2"></graphic>
</fig>
</p>
<p>The trainees in the INVEST group totally agreed with the statements that intraoperative video training is fun, it has a positive effect on the learning curve, and it is a uniform means of learning laparoscopic cholecystectomy. They agreed on the statements that they were allowed to do more steps of the procedure, the supervisor had to intervene less frequently during the procedure, and they would also like to have this type of training for other procedures. They were neutral on the statement that INVEST would be useful after six procedures. The answers in the MAM group were similar and not statistically different (Table <xref rid="Tab2" ref-type="table">2</xref>
).<table-wrap id="Tab2"><label>Table 2</label>
<caption><p>Trainees’ opinion (mean) on the INVEST curriculum</p>
</caption>
<table frame="hsides" rules="groups"><thead><tr><th align="left"></th>
<th align="left">INVEST</th>
<th align="left">MAM</th>
<th align="left"><italic>P</italic>
</th>
</tr>
</thead>
<tbody><tr><td align="left">INVEST is fun</td>
<td char="." align="char">4.6</td>
<td char="." align="char">4.2</td>
<td char="." align="char">0.42</td>
</tr>
<tr><td align="left">With INVEST I can do more</td>
<td char="." align="char">3.8</td>
<td char="." align="char">3.6</td>
<td char="." align="char">0.91</td>
</tr>
<tr><td align="left">INVEST causes less supervisor interruptions</td>
<td char="." align="char">3.8</td>
<td char="." align="char">3.2</td>
<td char="." align="char">0.32</td>
</tr>
<tr><td align="left">INVEST improves my learning curve</td>
<td char="." align="char">4.6</td>
<td char="." align="char">4.0</td>
<td char="." align="char">0.17</td>
</tr>
<tr><td align="left">INVEST is a uniform training method</td>
<td char="." align="char">4.8</td>
<td char="." align="char">4.8</td>
<td char="." align="char">1.00</td>
</tr>
<tr><td align="left">INVEST is useful after six times</td>
<td char="." align="char">2.8</td>
<td char="." align="char">1.6</td>
<td char="." align="char">0.13</td>
</tr>
<tr><td align="left">I would like INVEST for other procedures</td>
<td char="." align="char">4.2</td>
<td char="." align="char">4.2</td>
<td char="." align="char">0.74</td>
</tr>
</tbody>
</table>
<table-wrap-foot><p>Statements were evaluated on a 5-point Likert scale: 1 = fully disagree, 2 = disagree, 3 = neutral, 4 = agree, 5 = fully agree</p>
</table-wrap-foot>
</table-wrap>
</p>
</sec>
<sec id="Sec13"><title>Conclusions and discussion</title>
<p>This study was conducted to explore the potential benefit and the trainee acceptance of intraoperative video-enhanced surgical procedure training for laparoscopic surgery. The INVEST curriculum significantly enhanced skill development during the early learning curve for laparoscopic cholecystectomy. Trainees indicated being positive about the content and the idea of the curriculum.</p>
<p>In our opinion, INVEST should not be seen as a stand-alone training curriculum. It should be an integrated part of a complete laparoscopic curriculum that teaches all aspects of skill-based, rule-based, and knowledge-based behavior. Therefore, a balanced training program commences with essential basic skills training on VR and/or AR simulators. Elements of procedures should be practiced in box trainers with cadaver models [<xref ref-type="bibr" rid="CR25">25</xref>
]. Ideally, trainees should attend courses that use live animal models or human cadavers to perform specific procedures on healthy organs before they go to the operating theater to perform their first procedures on real patients with INVEST.</p>
<p>This study did not demonstrate a significant difference in skill acquisition for three of the seven items on the OSATS global rating scale: (1) respect for tissue, (3) instrument handling, and (4) knowledge of instruments. In our opinion, respect for tissue is part of knowledge-based behavior and cannot be trained with a video. Appreciation of tissue is individually determined and comes with experience. Instrument handling cannot be trained with a video. The SIMENDO training curriculum provided the initial training in instrument handling. Further acquisition of instrument handling skills comes with experience. Knowledge of laparoscopic instruments was not part of the INVEST video and therefore we were not surprised with these results. We are exploring the possibilities of adding this skill to the video. All the other items on the OSATS scale that did significantly improve with the INVEST curriculum were part of the training video.</p>
<p>A possible weakness of this study is the small group size, which makes it vulnerable for type I error. While designing this study, measures were taken to minimize this risk. First, the level of surgical and laparoscopic experience among the trainees had to be very uniform on admission. None of them had noteworthy laparoscopic experience and, before randomization, each trainee was identically prepared with the SIMENDO basic laparoscopic skills curriculum. Second, we tried to score the performance of the trainees as uniformly as possible. The OSATS global rating scale is a validated tool for evaluating technical skills in a reliable and reproducible manner [<xref ref-type="bibr" rid="CR18">18</xref>
]. Data derived from the OSATS global rating scale in this study proved to be internally consistent. In addition to comparing OSATS scores between the groups after completion of the curriculum, we calculated and compared the individual improvement in skills for each trainee from the initial to the final procedure in the curriculum. When we compare improvement, each trainee has his or her own baseline and completion scores that translate into a more reliable outcome than just comparing the completion scores between the groups.</p>
<p>Finally, we tried to minimize bias caused by the supervising surgeon who also evaluated the procedure and filled out the OSATS global rating scale. By using three different surgeons in random order, the surgeons were not aware of a trainee’s performance on previous procedures. The supervising surgeons could obviously not be blinded for the different arms of the study. Furthermore, comparing absolute and relative skill improvements instead of OSATS scores also corrected for potential bias caused by supervisors overrating trainees in the INVEST group. A possible way to avoid this observer bias would be the employment blinded and independent surgeons who perform the assessment postoperatively by means of procedure videos. However, to our knowledge there is no validated tool for scoring surgical skills on procedure videos. For future analyses, we are exploring the possibility of scoring procedure videos by means other than OSATS.</p>
<p>The outcome of this study in exploring the feasibility and potential benefit of INVEST for procedure training inside the OR is very promising. Future developments within the laparoscopic cholecystectomy video will comprise the inclusion of instrument handling and knowledge of instruments, since these skills were not addressed in the present video. In addition, we are considering employing INVEST for more advanced laparoscopic procedures.</p>
<p>In conclusion, we recommend INVEST for procedure training inside the OR, providing a uniform, efficient, and stimulating training environment that also appreciates patient safety. INVEST supports supervising surgeons in coaching trainees in their early learning curve after the transition from skills lab to the procedure training operating theater. It improves the early learning curve, it is easy to use in daily practice, and it costs very little extra time.</p>
</sec>
</body>
<back><ack><p>The authors thank J. M. P. Collins for reviewing the text. They also thank the supervising surgeons and participating residents for their contribution.</p>
<p><bold>Disclosures</bold>
Marc van Det, Jeroen Meijerink, Christiaan Hoff, Berrie Middel, Sietze Koopal, and Jean Pierre Pierie have no conflicts of interest or financial ties to disclose.</p>
<p><bold>Open Access</bold>
This article is distributed under the terms of the Creative Commons Attribution Noncommercial License which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.</p>
</ack>
<ref-list id="Bib1"><title>References</title>
<ref id="CR1"><label>1.</label>
<mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Berguer</surname>
<given-names>R</given-names>
</name>
</person-group>
<article-title>Surgical technology and the ergonomics of laparoscopic instruments</article-title>
<source>Surg Endosc</source>
<year>1998</year>
<volume>12</volume>
<fpage>458</fpage>
<lpage>462</lpage>
<pub-id pub-id-type="doi">10.1007/s004649900705</pub-id>
<pub-id pub-id-type="pmid">9569372</pub-id>
</mixed-citation>
</ref>
<ref id="CR2"><label>2.</label>
<mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gallagher</surname>
<given-names>AG</given-names>
</name>
<name><surname>McClure</surname>
<given-names>N</given-names>
</name>
<name><surname>McGuigan</surname>
<given-names>J</given-names>
</name>
<name><surname>Ritchie</surname>
<given-names>K</given-names>
</name>
<name><surname>Sheehy</surname>
<given-names>NP</given-names>
</name>
</person-group>
<article-title>An ergonomic analysis of the fulcrum effect in the acquisition of endoscopic skills</article-title>
<source>Endoscopy</source>
<year>1998</year>
<volume>30</volume>
<fpage>617</fpage>
<lpage>620</lpage>
<pub-id pub-id-type="doi">10.1055/s-2007-1001366</pub-id>
<pub-id pub-id-type="pmid">9826140</pub-id>
</mixed-citation>
</ref>
<ref id="CR3"><label>3.</label>
<mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Det</surname>
<given-names>MJ</given-names>
</name>
<name><surname>Meijerink</surname>
<given-names>WJHJ</given-names>
</name>
<name><surname>Hoff</surname>
<given-names>C</given-names>
</name>
<name><surname>Veelen</surname>
<given-names>MA</given-names>
</name>
<name><surname>Pierie</surname>
<given-names>JPEN</given-names>
</name>
</person-group>
<article-title>Ergonomic assessment of neck posture in the minimally invasive surgery suite during laparoscopic cholecystectomy</article-title>
<source>Surg Endosc</source>
<year>2008</year>
<volume>22</volume>
<fpage>2421</fpage>
<lpage>2427</lpage>
<pub-id pub-id-type="doi">10.1007/s00464-008-0042-6</pub-id>
<pub-id pub-id-type="pmid">18622549</pub-id>
</mixed-citation>
</ref>
<ref id="CR4"><label>4.</label>
<mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Det</surname>
<given-names>MJ</given-names>
</name>
<name><surname>Meijerink</surname>
<given-names>WJHJ</given-names>
</name>
<name><surname>Hoff</surname>
<given-names>C</given-names>
</name>
<name><surname>Totte</surname>
<given-names>ER</given-names>
</name>
<name><surname>Pierie</surname>
<given-names>JPEN</given-names>
</name>
</person-group>
<article-title>Optimal ergonomics for laparoscopic surgery in minimally invasive surgery suites: a review and guidelines</article-title>
<source>Surg Endosc</source>
<year>2009</year>
<volume>23</volume>
<fpage>1279</fpage>
<lpage>1285</lpage>
<pub-id pub-id-type="doi">10.1007/s00464-008-0148-x</pub-id>
<pub-id pub-id-type="pmid">18830751</pub-id>
</mixed-citation>
</ref>
<ref id="CR5"><label>5.</label>
<mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Aggarwal</surname>
<given-names>R</given-names>
</name>
<name><surname>Darzi</surname>
<given-names>A</given-names>
</name>
</person-group>
<article-title>Technical-skills training in the 21st century</article-title>
<source>N Engl J Med</source>
<year>2006</year>
<volume>355</volume>
<fpage>2695</fpage>
<lpage>2696</lpage>
<pub-id pub-id-type="doi">10.1056/NEJMe068179</pub-id>
<pub-id pub-id-type="pmid">17182997</pub-id>
</mixed-citation>
</ref>
<ref id="CR6"><label>6.</label>
<mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Wentink</surname>
<given-names>M</given-names>
</name>
<name><surname>Stassen</surname>
<given-names>LP</given-names>
</name>
<name><surname>Alwayn</surname>
<given-names>I</given-names>
</name>
<name><surname>Hosman</surname>
<given-names>RJ</given-names>
</name>
<name><surname>Stassen</surname>
<given-names>HG</given-names>
</name>
</person-group>
<article-title>Rasmussen’s model of human behavior in laparoscopy training</article-title>
<source>Surg Endosc</source>
<year>2003</year>
<volume>17</volume>
<fpage>1241</fpage>
<lpage>1246</lpage>
<pub-id pub-id-type="doi">10.1007/s00464-002-9140-z</pub-id>
<pub-id pub-id-type="pmid">12799883</pub-id>
</mixed-citation>
</ref>
<ref id="CR7"><label>7.</label>
<mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Larsen</surname>
<given-names>CR</given-names>
</name>
<name><surname>Soerensen</surname>
<given-names>JL</given-names>
</name>
<name><surname>Grantcharov</surname>
<given-names>TP</given-names>
</name>
<name><surname>Dalsgaard</surname>
<given-names>T</given-names>
</name>
<name><surname>Schouenborg</surname>
<given-names>L</given-names>
</name>
<name><surname>Ottosen</surname>
<given-names>C</given-names>
</name>
<name><surname>Schroeder</surname>
<given-names>TV</given-names>
</name>
<name><surname>Ottesen</surname>
<given-names>BS</given-names>
</name>
</person-group>
<article-title>Effect of virtual reality training on laparoscopic surgery: randomised controlled trial</article-title>
<source>BMJ</source>
<year>2009</year>
<volume>338</volume>
<fpage>b1802</fpage>
<pub-id pub-id-type="doi">10.1136/bmj.b1802</pub-id>
<pub-id pub-id-type="pmid">19443914</pub-id>
</mixed-citation>
</ref>
<ref id="CR8"><label>8.</label>
<mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Dongen</surname>
<given-names>KW</given-names>
</name>
<name><surname>Wal</surname>
<given-names>WA</given-names>
</name>
<name><surname>Rinkes</surname>
<given-names>IH</given-names>
</name>
<name><surname>Schijven</surname>
<given-names>MP</given-names>
</name>
<name><surname>Broeders</surname>
<given-names>IA</given-names>
</name>
</person-group>
<article-title>Virtual reality training for endoscopic surgery: voluntary or obligatory?</article-title>
<source>Surg Endosc</source>
<year>2008</year>
<volume>22</volume>
<fpage>664</fpage>
<lpage>667</lpage>
<pub-id pub-id-type="doi">10.1007/s00464-007-9456-9</pub-id>
<pub-id pub-id-type="pmid">17704889</pub-id>
</mixed-citation>
</ref>
<ref id="CR9"><label>9.</label>
<mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Grantcharov</surname>
<given-names>TP</given-names>
</name>
<name><surname>Kristiansen</surname>
<given-names>VB</given-names>
</name>
<name><surname>Bendix</surname>
<given-names>J</given-names>
</name>
<name><surname>Bardram</surname>
<given-names>L</given-names>
</name>
<name><surname>Rosenberg</surname>
<given-names>J</given-names>
</name>
<name><surname>Funch-Jensen</surname>
<given-names>P</given-names>
</name>
</person-group>
<article-title>Randomized clinical trial of virtual reality simulation for laparoscopic skills training</article-title>
<source>Br J Surg</source>
<year>2004</year>
<volume>91</volume>
<fpage>146</fpage>
<lpage>150</lpage>
<pub-id pub-id-type="doi">10.1002/bjs.4407</pub-id>
<pub-id pub-id-type="pmid">14760660</pub-id>
</mixed-citation>
</ref>
<ref id="CR10"><label>10.</label>
<mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gurusamy</surname>
<given-names>KS</given-names>
</name>
<name><surname>Aggarwal</surname>
<given-names>R</given-names>
</name>
<name><surname>Palanivelu</surname>
<given-names>L</given-names>
</name>
<name><surname>Davidson</surname>
<given-names>BR</given-names>
</name>
</person-group>
<article-title>Virtual reality training for surgical trainees in laparoscopic surgery</article-title>
<source>Cochrane Database Syst Rev</source>
<year>2009</year>
<volume>1</volume>
<fpage>CD006575</fpage>
<pub-id pub-id-type="pmid">19160288</pub-id>
</mixed-citation>
</ref>
<ref id="CR11"><label>11.</label>
<mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Panait</surname>
<given-names>L</given-names>
</name>
<name><surname>Akkary</surname>
<given-names>E</given-names>
</name>
<name><surname>Bell</surname>
<given-names>RL</given-names>
</name>
<name><surname>Roberts</surname>
<given-names>KE</given-names>
</name>
<name><surname>Dudrick</surname>
<given-names>SJ</given-names>
</name>
<name><surname>Duffy</surname>
<given-names>AJ</given-names>
</name>
</person-group>
<article-title>The role of haptic feedback in laparoscopic simulation training</article-title>
<source>J Surg Res</source>
<year>2009</year>
<volume>156</volume>
<fpage>312</fpage>
<lpage>316</lpage>
<pub-id pub-id-type="doi">10.1016/j.jss.2009.04.018</pub-id>
<pub-id pub-id-type="pmid">19631336</pub-id>
</mixed-citation>
</ref>
<ref id="CR12"><label>12.</label>
<mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Furnee</surname>
<given-names>EJ</given-names>
</name>
<name><surname>Empel</surname>
<given-names>PJ</given-names>
</name>
<name><surname>Mahdavian Delavary</surname>
<given-names>B</given-names>
</name>
<name><surname>Peet</surname>
<given-names>DL</given-names>
</name>
<name><surname>Cuesta</surname>
<given-names>MA</given-names>
</name>
<name><surname>Meijerink</surname>
<given-names>WJHJ</given-names>
</name>
</person-group>
<article-title>Evaluation of a technical skills training program in surgical residents</article-title>
<source>J Laparoendosc Adv Surg Tech A</source>
<year>2009</year>
<volume>19</volume>
<fpage>615</fpage>
<lpage>621</lpage>
<pub-id pub-id-type="doi">10.1089/lap.2009.0074</pub-id>
<pub-id pub-id-type="pmid">19845454</pub-id>
</mixed-citation>
</ref>
<ref id="CR13"><label>13.</label>
<mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Akl</surname>
<given-names>MN</given-names>
</name>
<name><surname>Giles</surname>
<given-names>DL</given-names>
</name>
<name><surname>Long</surname>
<given-names>JB</given-names>
</name>
<name><surname>Magrina</surname>
<given-names>JF</given-names>
</name>
<name><surname>Kho</surname>
<given-names>RM</given-names>
</name>
</person-group>
<article-title>The efficacy of viewing an educational video as a method for the acquisition of basic laparoscopic suturing skills</article-title>
<source>J Minim Invasive Gynecol</source>
<year>2008</year>
<volume>15</volume>
<fpage>410</fpage>
<lpage>413</lpage>
<pub-id pub-id-type="doi">10.1016/j.jmig.2008.03.012</pub-id>
<pub-id pub-id-type="pmid">18539092</pub-id>
</mixed-citation>
</ref>
<ref id="CR14"><label>14.</label>
<mixed-citation publication-type="other">Association of Surgeons of The Netherlands (2007) Guideline galsteenlijden, appendix D: ‘Best Practice’: de techniek van de laparoscopische cholecystectomie (‘Critical View of Safety’). Available at <ext-link ext-link-type="uri" xlink:href="http://nvvh.artsennet.nl/richtlijnen/Bestaande-richtlijnen.htm">http://nvvh.artsennet.nl/richtlijnen/Bestaande-richtlijnen.htm</ext-link>
. Accessed 17 October 2008</mixed-citation>
</ref>
<ref id="CR15"><label>15.</label>
<mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Strasberg</surname>
<given-names>SM</given-names>
</name>
</person-group>
<article-title>Avoidance of biliary injury during laparoscopic cholecystectomy</article-title>
<source>J Hepatobiliary Pancreat Surg</source>
<year>2002</year>
<volume>9</volume>
<fpage>543</fpage>
<lpage>547</lpage>
<pub-id pub-id-type="doi">10.1007/s005340200071</pub-id>
<pub-id pub-id-type="pmid">12541037</pub-id>
</mixed-citation>
</ref>
<ref id="CR16"><label>16.</label>
<mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Verdaasdonk</surname>
<given-names>EG</given-names>
</name>
<name><surname>Stassen</surname>
<given-names>LP</given-names>
</name>
<name><surname>Schijven</surname>
<given-names>MP</given-names>
</name>
<name><surname>Dankelman</surname>
<given-names>J</given-names>
</name>
</person-group>
<article-title>Construct validity and assessment of the learning curve for the SIMENDO endoscopic simulator</article-title>
<source>Surg Endosc</source>
<year>2007</year>
<volume>21</volume>
<fpage>1406</fpage>
<lpage>1412</lpage>
<pub-id pub-id-type="doi">10.1007/s00464-006-9177-5</pub-id>
<pub-id pub-id-type="pmid">17653815</pub-id>
</mixed-citation>
</ref>
<ref id="CR17"><label>17.</label>
<mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Verdaasdonk</surname>
<given-names>EG</given-names>
</name>
<name><surname>Dankelman</surname>
<given-names>J</given-names>
</name>
<name><surname>Lange</surname>
<given-names>JF</given-names>
</name>
<name><surname>Stassen</surname>
<given-names>LP</given-names>
</name>
</person-group>
<article-title>Incorporation of proficiency criteria for basic laparoscopic skills training: how does it work?</article-title>
<source>Surg Endosc</source>
<year>2008</year>
<volume>22</volume>
<fpage>2609</fpage>
<lpage>2615</lpage>
<pub-id pub-id-type="doi">10.1007/s00464-008-9849-4</pub-id>
<pub-id pub-id-type="pmid">18389319</pub-id>
</mixed-citation>
</ref>
<ref id="CR18"><label>18.</label>
<mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Martin</surname>
<given-names>JA</given-names>
</name>
<name><surname>Regehr</surname>
<given-names>G</given-names>
</name>
<name><surname>Reznick</surname>
<given-names>R</given-names>
</name>
<name><surname>MacRae</surname>
<given-names>H</given-names>
</name>
<name><surname>Murnaghan</surname>
<given-names>J</given-names>
</name>
<name><surname>Hutchison</surname>
<given-names>C</given-names>
</name>
<name><surname>Brown</surname>
<given-names>M</given-names>
</name>
</person-group>
<article-title>Objective structured assessment of technical skill (OSATS) for surgical residents</article-title>
<source>Br J Surg</source>
<year>1997</year>
<volume>84</volume>
<fpage>273</fpage>
<lpage>278</lpage>
<pub-id pub-id-type="doi">10.1002/bjs.1800840237</pub-id>
<pub-id pub-id-type="pmid">9052454</pub-id>
</mixed-citation>
</ref>
<ref id="CR19"><label>19.</label>
<mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Nunnally</surname>
<given-names>JC</given-names>
</name>
<name><surname>Bernstein</surname>
<given-names>IH</given-names>
</name>
</person-group>
<source>Psychometric theory</source>
<year>1994</year>
<edition>3</edition>
<publisher-loc>New York</publisher-loc>
<publisher-name>McGraw-Hill</publisher-name>
</mixed-citation>
</ref>
<ref id="CR20"><label>20.</label>
<mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Clark</surname>
<given-names>LA</given-names>
</name>
<name><surname>Watson</surname>
<given-names>D</given-names>
</name>
</person-group>
<article-title>Constructing validity: basic issues in objective scale development</article-title>
<source>Psychol Assess</source>
<year>1995</year>
<volume>7</volume>
<fpage>309</fpage>
<lpage>319</lpage>
<pub-id pub-id-type="doi">10.1037/1040-3590.7.3.309</pub-id>
</mixed-citation>
</ref>
<ref id="CR21"><label>21.</label>
<mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Cortina</surname>
<given-names>JM</given-names>
</name>
</person-group>
<article-title>What is coefficient alpha—an examination of theory and applications</article-title>
<source>J Appl Psychol</source>
<year>1993</year>
<volume>78</volume>
<fpage>98</fpage>
<lpage>104</lpage>
<pub-id pub-id-type="doi">10.1037/0021-9010.78.1.98</pub-id>
</mixed-citation>
</ref>
<ref id="CR22"><label>22.</label>
<mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Briggs</surname>
<given-names>SR</given-names>
</name>
<name><surname>Cheek</surname>
<given-names>JM</given-names>
</name>
</person-group>
<article-title>The role of factor-analysis in the development and evaluation of personality-scales</article-title>
<source>J Personal</source>
<year>1986</year>
<volume>54</volume>
<fpage>106</fpage>
<lpage>148</lpage>
<pub-id pub-id-type="doi">10.1111/j.1467-6494.1986.tb00391.x</pub-id>
</mixed-citation>
</ref>
<ref id="CR23"><label>23.</label>
<mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Taylor</surname>
<given-names>GJ</given-names>
</name>
<name><surname>Bagby</surname>
<given-names>RM</given-names>
</name>
<name><surname>Parker</surname>
<given-names>JDA</given-names>
</name>
</person-group>
<article-title>The 20-Item Toronto Alexithymia scale—IV. Reliability and factorial validity in different languages and cultures</article-title>
<source>J Psychosom Res</source>
<year>2003</year>
<volume>55</volume>
<fpage>277</fpage>
<lpage>283</lpage>
<pub-id pub-id-type="doi">10.1016/S0022-3999(02)00601-3</pub-id>
<pub-id pub-id-type="pmid">12932803</pub-id>
</mixed-citation>
</ref>
<ref id="CR24"><label>24.</label>
<mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Cohen</surname>
<given-names>J</given-names>
</name>
</person-group>
<source>The t test for means. Statistical power analysis for the behavioural sciences</source>
<year>1988</year>
<edition>2</edition>
<publisher-loc>Hillsdale</publisher-loc>
<publisher-name>Lawrence Erlbaum Associates</publisher-name>
<fpage>19</fpage>
<lpage>74</lpage>
</mixed-citation>
</ref>
<ref id="CR25"><label>25.</label>
<mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Madan</surname>
<given-names>AK</given-names>
</name>
<name><surname>Frantzides</surname>
<given-names>CT</given-names>
</name>
</person-group>
<article-title>Prospective randomized controlled trial of laparoscopic trainers for basic laparoscopic skills acquisition</article-title>
<source>Surg Endosc</source>
<year>2007</year>
<volume>21</volume>
<fpage>209</fpage>
<lpage>213</lpage>
<pub-id pub-id-type="doi">10.1007/s00464-006-0149-6</pub-id>
<pub-id pub-id-type="pmid">17122975</pub-id>
</mixed-citation>
</ref>
</ref-list>
</back>
</pmc>
</record>
Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/HapticV1/Data/Pmc/Curation
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000891 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Pmc/Curation/biblio.hfd -nk 000891 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien |wiki= Ticri/CIDE |area= HapticV1 |flux= Pmc |étape= Curation |type= RBID |clé= PMC:3116121 |texte= The learning effect of intraoperative video-enhanced surgical procedure training }}
Pour générer des pages wiki
HfdIndexSelect -h $EXPLOR_AREA/Data/Pmc/Curation/RBID.i -Sk "pubmed:21359903" \ | HfdSelect -Kh $EXPLOR_AREA/Data/Pmc/Curation/biblio.hfd \ | NlmPubMed2Wicri -a HapticV1
![]() | This area was generated with Dilib version V0.6.23. | ![]() |