The McGill simulator for endoscopic sinus surgery (MSESS): a validation study
Identifieur interne : 000857 ( Pmc/Curation ); précédent : 000856; suivant : 000858The McGill simulator for endoscopic sinus surgery (MSESS): a validation study
Auteurs : Rickul Varshney [Canada] ; Saul Frenkiel [Canada] ; Lily Hp Nguyen [Canada] ; Meredith Young [Canada] ; Rolando Del Maestro [Canada] ; Anthony Zeitouni [Canada] ; Elias Saad [Canada] ; W Robert J. Funnell [Canada] ; Marc A. Tewfik [Canada]Source :
- Journal of Otolaryngology - Head & Neck Surgery [ 1916-0208 ] ; 2014.
Abstract
Endoscopic sinus surgery (ESS) is a technically challenging procedure, associated with a significant risk of complications. Virtual reality simulation has demonstrated benefit in many disciplines as an important educational tool for surgical training. Within the field of rhinology, there is a lack of ESS simulators with appropriate validity evidence supporting their integration into residency education. The objectives of this study are to evaluate the acceptability, perceived realism and benefit of the McGill Simulator for Endoscopic Sinus Surgery (MSESS) among medical students, otolaryngology residents and faculty, and to present evidence supporting its ability to differentiate users based on their level of training through the performance metrics.
10 medical students, 10 junior residents, 10 senior residents and 3 expert sinus surgeons performed anterior ethmoidectomies, posterior ethmoidectomies and wide sphenoidotomies on the MSESS. Performance metrics related to quality (e.g. percentage of tissue removed), efficiency (e.g. time, path length, bimanual dexterity, etc.) and safety (e.g. contact with no-go zones, maximum applied force, etc.) were calculated. All users completed a post-simulation questionnaire related to realism, usefulness and perceived benefits of training on the MSESS.
The MSESS was found to be realistic and useful for training surgical skills with scores of 7.97 ± 0.29 and 8.57 ± 0.69, respectively on a 10-point rating scale. Most students and residents (29/30) believed that it should be incorporated into their curriculum. There were significant differences between novice surgeons (10 medical students and 10 junior residents) and senior surgeons (10 senior residents and 3 sinus surgeons) in performance metrics related to quality (
The MSESS demonstrated initial evidence supporting its use for residency education. This simulator may be a potential resource to help fill the void in endoscopic sinus surgery training.
Url:
DOI: 10.1186/s40463-014-0040-8
PubMed: 25927463
PubMed Central: 4210497
Links toward previous steps (curation, corpus...)
- to stream Pmc, to step Corpus: Pour aller vers cette notice dans l'étape Curation :000857
Links to Exploration step
PMC:4210497Curation
No country items
Rickul Varshney<affiliation><nlm:aff id="Aff7">Royal Victoria Hospital, 687 Ave Des Pins O., Rm E4.41, Montreal, Quebec H3A 1A1 Canada</nlm:aff><wicri:noCountry code="subfield">Quebec H3A 1A1 Canada</wicri:noCountry></affiliation>Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">The McGill simulator for endoscopic sinus surgery (MSESS): a validation study</title><author><name sortKey="Varshney, Rickul" sort="Varshney, Rickul" uniqKey="Varshney R" first="Rickul" last="Varshney">Rickul Varshney</name><affiliation wicri:level="1"><nlm:aff id="Aff1">Department of Otolaryngology, Head and Neck Surgery, McGill University, Montreal, Canada</nlm:aff><country xml:lang="fr">Canada</country><wicri:regionArea>Department of Otolaryngology, Head and Neck Surgery, McGill University, Montreal</wicri:regionArea></affiliation><affiliation><nlm:aff id="Aff7">Royal Victoria Hospital, 687 Ave Des Pins O., Rm E4.41, Montreal, Quebec H3A 1A1 Canada</nlm:aff><wicri:noCountry code="subfield">Quebec H3A 1A1 Canada</wicri:noCountry></affiliation></author><author><name sortKey="Frenkiel, Saul" sort="Frenkiel, Saul" uniqKey="Frenkiel S" first="Saul" last="Frenkiel">Saul Frenkiel</name><affiliation wicri:level="1"><nlm:aff id="Aff1">Department of Otolaryngology, Head and Neck Surgery, McGill University, Montreal, Canada</nlm:aff><country xml:lang="fr">Canada</country><wicri:regionArea>Department of Otolaryngology, Head and Neck Surgery, McGill University, Montreal</wicri:regionArea></affiliation></author><author><name sortKey="Nguyen, Lily Hp" sort="Nguyen, Lily Hp" uniqKey="Nguyen L" first="Lily Hp" last="Nguyen">Lily Hp Nguyen</name><affiliation wicri:level="1"><nlm:aff id="Aff1">Department of Otolaryngology, Head and Neck Surgery, McGill University, Montreal, Canada</nlm:aff><country xml:lang="fr">Canada</country><wicri:regionArea>Department of Otolaryngology, Head and Neck Surgery, McGill University, Montreal</wicri:regionArea></affiliation><affiliation wicri:level="1"><nlm:aff id="Aff2">Centre for Medical Education, McGill University, Montreal, Canada</nlm:aff><country xml:lang="fr">Canada</country><wicri:regionArea>Centre for Medical Education, McGill University, Montreal</wicri:regionArea></affiliation></author><author><name sortKey="Young, Meredith" sort="Young, Meredith" uniqKey="Young M" first="Meredith" last="Young">Meredith Young</name><affiliation wicri:level="1"><nlm:aff id="Aff2">Centre for Medical Education, McGill University, Montreal, Canada</nlm:aff><country xml:lang="fr">Canada</country><wicri:regionArea>Centre for Medical Education, McGill University, Montreal</wicri:regionArea></affiliation><affiliation wicri:level="1"><nlm:aff id="Aff3">Department of Medicine, McGill University, Montreal, Canada</nlm:aff><country xml:lang="fr">Canada</country><wicri:regionArea>Department of Medicine, McGill University, Montreal</wicri:regionArea></affiliation></author><author><name sortKey="Del Maestro, Rolando" sort="Del Maestro, Rolando" uniqKey="Del Maestro R" first="Rolando" last="Del Maestro">Rolando Del Maestro</name><affiliation wicri:level="1"><nlm:aff id="Aff4">Neurosurgical Simulation Research Center, McGill University, Montreal, Canada</nlm:aff><country xml:lang="fr">Canada</country><wicri:regionArea>Neurosurgical Simulation Research Center, McGill University, Montreal</wicri:regionArea></affiliation></author><author><name sortKey="Zeitouni, Anthony" sort="Zeitouni, Anthony" uniqKey="Zeitouni A" first="Anthony" last="Zeitouni">Anthony Zeitouni</name><affiliation wicri:level="1"><nlm:aff id="Aff1">Department of Otolaryngology, Head and Neck Surgery, McGill University, Montreal, Canada</nlm:aff><country xml:lang="fr">Canada</country><wicri:regionArea>Department of Otolaryngology, Head and Neck Surgery, McGill University, Montreal</wicri:regionArea></affiliation></author><author><name sortKey="Saad, Elias" sort="Saad, Elias" uniqKey="Saad E" first="Elias" last="Saad">Elias Saad</name><affiliation wicri:level="1"><nlm:aff id="Aff5">Department of BioMedical Engineering, McGill University, Montreal, Canada</nlm:aff><country xml:lang="fr">Canada</country><wicri:regionArea>Department of BioMedical Engineering, McGill University, Montreal</wicri:regionArea></affiliation></author><author><name sortKey="Funnell, W Robert J" sort="Funnell, W Robert J" uniqKey="Funnell W" first="W Robert J" last="Funnell">W Robert J. Funnell</name><affiliation wicri:level="1"><nlm:aff id="Aff1">Department of Otolaryngology, Head and Neck Surgery, McGill University, Montreal, Canada</nlm:aff><country xml:lang="fr">Canada</country><wicri:regionArea>Department of Otolaryngology, Head and Neck Surgery, McGill University, Montreal</wicri:regionArea></affiliation><affiliation wicri:level="1"><nlm:aff id="Aff5">Department of BioMedical Engineering, McGill University, Montreal, Canada</nlm:aff><country xml:lang="fr">Canada</country><wicri:regionArea>Department of BioMedical Engineering, McGill University, Montreal</wicri:regionArea></affiliation></author><author><name sortKey="Tewfik, Marc A" sort="Tewfik, Marc A" uniqKey="Tewfik M" first="Marc A" last="Tewfik">Marc A. Tewfik</name><affiliation wicri:level="1"><nlm:aff id="Aff1">Department of Otolaryngology, Head and Neck Surgery, McGill University, Montreal, Canada</nlm:aff><country xml:lang="fr">Canada</country><wicri:regionArea>Department of Otolaryngology, Head and Neck Surgery, McGill University, Montreal</wicri:regionArea></affiliation></author></titleStmt><publicationStmt><idno type="wicri:source">PMC</idno><idno type="pmid">25927463</idno><idno type="pmc">4210497</idno><idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4210497</idno><idno type="RBID">PMC:4210497</idno><idno type="doi">10.1186/s40463-014-0040-8</idno><date when="2014">2014</date><idno type="wicri:Area/Pmc/Corpus">000857</idno><idno type="wicri:Area/Pmc/Curation">000857</idno></publicationStmt><sourceDesc><biblStruct><analytic><title xml:lang="en" level="a" type="main">The McGill simulator for endoscopic sinus surgery (MSESS): a validation study</title><author><name sortKey="Varshney, Rickul" sort="Varshney, Rickul" uniqKey="Varshney R" first="Rickul" last="Varshney">Rickul Varshney</name><affiliation wicri:level="1"><nlm:aff id="Aff1">Department of Otolaryngology, Head and Neck Surgery, McGill University, Montreal, Canada</nlm:aff><country xml:lang="fr">Canada</country><wicri:regionArea>Department of Otolaryngology, Head and Neck Surgery, McGill University, Montreal</wicri:regionArea></affiliation><affiliation><nlm:aff id="Aff7">Royal Victoria Hospital, 687 Ave Des Pins O., Rm E4.41, Montreal, Quebec H3A 1A1 Canada</nlm:aff><wicri:noCountry code="subfield">Quebec H3A 1A1 Canada</wicri:noCountry></affiliation></author><author><name sortKey="Frenkiel, Saul" sort="Frenkiel, Saul" uniqKey="Frenkiel S" first="Saul" last="Frenkiel">Saul Frenkiel</name><affiliation wicri:level="1"><nlm:aff id="Aff1">Department of Otolaryngology, Head and Neck Surgery, McGill University, Montreal, Canada</nlm:aff><country xml:lang="fr">Canada</country><wicri:regionArea>Department of Otolaryngology, Head and Neck Surgery, McGill University, Montreal</wicri:regionArea></affiliation></author><author><name sortKey="Nguyen, Lily Hp" sort="Nguyen, Lily Hp" uniqKey="Nguyen L" first="Lily Hp" last="Nguyen">Lily Hp Nguyen</name><affiliation wicri:level="1"><nlm:aff id="Aff1">Department of Otolaryngology, Head and Neck Surgery, McGill University, Montreal, Canada</nlm:aff><country xml:lang="fr">Canada</country><wicri:regionArea>Department of Otolaryngology, Head and Neck Surgery, McGill University, Montreal</wicri:regionArea></affiliation><affiliation wicri:level="1"><nlm:aff id="Aff2">Centre for Medical Education, McGill University, Montreal, Canada</nlm:aff><country xml:lang="fr">Canada</country><wicri:regionArea>Centre for Medical Education, McGill University, Montreal</wicri:regionArea></affiliation></author><author><name sortKey="Young, Meredith" sort="Young, Meredith" uniqKey="Young M" first="Meredith" last="Young">Meredith Young</name><affiliation wicri:level="1"><nlm:aff id="Aff2">Centre for Medical Education, McGill University, Montreal, Canada</nlm:aff><country xml:lang="fr">Canada</country><wicri:regionArea>Centre for Medical Education, McGill University, Montreal</wicri:regionArea></affiliation><affiliation wicri:level="1"><nlm:aff id="Aff3">Department of Medicine, McGill University, Montreal, Canada</nlm:aff><country xml:lang="fr">Canada</country><wicri:regionArea>Department of Medicine, McGill University, Montreal</wicri:regionArea></affiliation></author><author><name sortKey="Del Maestro, Rolando" sort="Del Maestro, Rolando" uniqKey="Del Maestro R" first="Rolando" last="Del Maestro">Rolando Del Maestro</name><affiliation wicri:level="1"><nlm:aff id="Aff4">Neurosurgical Simulation Research Center, McGill University, Montreal, Canada</nlm:aff><country xml:lang="fr">Canada</country><wicri:regionArea>Neurosurgical Simulation Research Center, McGill University, Montreal</wicri:regionArea></affiliation></author><author><name sortKey="Zeitouni, Anthony" sort="Zeitouni, Anthony" uniqKey="Zeitouni A" first="Anthony" last="Zeitouni">Anthony Zeitouni</name><affiliation wicri:level="1"><nlm:aff id="Aff1">Department of Otolaryngology, Head and Neck Surgery, McGill University, Montreal, Canada</nlm:aff><country xml:lang="fr">Canada</country><wicri:regionArea>Department of Otolaryngology, Head and Neck Surgery, McGill University, Montreal</wicri:regionArea></affiliation></author><author><name sortKey="Saad, Elias" sort="Saad, Elias" uniqKey="Saad E" first="Elias" last="Saad">Elias Saad</name><affiliation wicri:level="1"><nlm:aff id="Aff5">Department of BioMedical Engineering, McGill University, Montreal, Canada</nlm:aff><country xml:lang="fr">Canada</country><wicri:regionArea>Department of BioMedical Engineering, McGill University, Montreal</wicri:regionArea></affiliation></author><author><name sortKey="Funnell, W Robert J" sort="Funnell, W Robert J" uniqKey="Funnell W" first="W Robert J" last="Funnell">W Robert J. Funnell</name><affiliation wicri:level="1"><nlm:aff id="Aff1">Department of Otolaryngology, Head and Neck Surgery, McGill University, Montreal, Canada</nlm:aff><country xml:lang="fr">Canada</country><wicri:regionArea>Department of Otolaryngology, Head and Neck Surgery, McGill University, Montreal</wicri:regionArea></affiliation><affiliation wicri:level="1"><nlm:aff id="Aff5">Department of BioMedical Engineering, McGill University, Montreal, Canada</nlm:aff><country xml:lang="fr">Canada</country><wicri:regionArea>Department of BioMedical Engineering, McGill University, Montreal</wicri:regionArea></affiliation></author><author><name sortKey="Tewfik, Marc A" sort="Tewfik, Marc A" uniqKey="Tewfik M" first="Marc A" last="Tewfik">Marc A. Tewfik</name><affiliation wicri:level="1"><nlm:aff id="Aff1">Department of Otolaryngology, Head and Neck Surgery, McGill University, Montreal, Canada</nlm:aff><country xml:lang="fr">Canada</country><wicri:regionArea>Department of Otolaryngology, Head and Neck Surgery, McGill University, Montreal</wicri:regionArea></affiliation></author></analytic><series><title level="j">Journal of Otolaryngology - Head & Neck Surgery</title><idno type="ISSN">1916-0208</idno><idno type="eISSN">1916-0216</idno><imprint><date when="2014">2014</date></imprint></series></biblStruct></sourceDesc></fileDesc><profileDesc><textClass></textClass></profileDesc></teiHeader><front><div type="abstract" xml:lang="en"><sec><title>Background</title><p>Endoscopic sinus surgery (ESS) is a technically challenging procedure, associated with a significant risk of complications. Virtual reality simulation has demonstrated benefit in many disciplines as an important educational tool for surgical training. Within the field of rhinology, there is a lack of ESS simulators with appropriate validity evidence supporting their integration into residency education. The objectives of this study are to evaluate the acceptability, perceived realism and benefit of the McGill Simulator for Endoscopic Sinus Surgery (MSESS) among medical students, otolaryngology residents and faculty, and to present evidence supporting its ability to differentiate users based on their level of training through the performance metrics.</p></sec><sec><title>Methods</title><p>10 medical students, 10 junior residents, 10 senior residents and 3 expert sinus surgeons performed anterior ethmoidectomies, posterior ethmoidectomies and wide sphenoidotomies on the MSESS. Performance metrics related to quality (e.g. percentage of tissue removed), efficiency (e.g. time, path length, bimanual dexterity, etc.) and safety (e.g. contact with no-go zones, maximum applied force, etc.) were calculated. All users completed a post-simulation questionnaire related to realism, usefulness and perceived benefits of training on the MSESS.</p></sec><sec><title>Results</title><p>The MSESS was found to be realistic and useful for training surgical skills with scores of 7.97 ± 0.29 and 8.57 ± 0.69, respectively on a 10-point rating scale. Most students and residents (29/30) believed that it should be incorporated into their curriculum. There were significant differences between novice surgeons (10 medical students and 10 junior residents) and senior surgeons (10 senior residents and 3 sinus surgeons) in performance metrics related to quality (<italic>p</italic> < 0.05), efficiency (<italic>p</italic> < 0.01) and safety (<italic>p</italic> < 0.05).</p></sec><sec><title>Conclusion</title><p>The MSESS demonstrated initial evidence supporting its use for residency education. This simulator may be a potential resource to help fill the void in endoscopic sinus surgery training.</p></sec></div></front><back><div1 type="bibliography"><listBibl><biblStruct><analytic><author><name sortKey="Arora, H" uniqKey="Arora H">H Arora</name></author><author><name sortKey="Uribe, J" uniqKey="Uribe J">J Uribe</name></author><author><name sortKey="Ralph, W" uniqKey="Ralph W">W Ralph</name></author><author><name sortKey="Zeltsan, M" uniqKey="Zeltsan M">M Zeltsan</name></author><author><name sortKey="Cuellar, H" uniqKey="Cuellar H">H Cuellar</name></author><author><name sortKey="Gallagher, A" uniqKey="Gallagher A">A Gallagher</name></author><author><name sortKey="Fried, Mp" uniqKey="Fried M">MP Fried</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Fried, Mp" uniqKey="Fried M">MP Fried</name></author><author><name sortKey="Satava, R" uniqKey="Satava R">R Satava</name></author><author><name sortKey="Weghorst, S" uniqKey="Weghorst S">S Weghorst</name></author><author><name sortKey="Gallagher, Ag" uniqKey="Gallagher A">AG Gallagher</name></author><author><name sortKey="Sasaki, C" uniqKey="Sasaki C">C Sasaki</name></author><author><name sortKey="Ross, D" uniqKey="Ross D">D Ross</name></author><author><name sortKey="Sinanan, M" uniqKey="Sinanan M">M Sinanan</name></author><author><name sortKey="Uribe, Ji" uniqKey="Uribe J">JI Uribe</name></author><author><name sortKey="Zeltsan, M" uniqKey="Zeltsan M">M Zeltsan</name></author><author><name sortKey="Arora, H" uniqKey="Arora H">H Arora</name></author><author><name sortKey="Cuellar, H" uniqKey="Cuellar H">H Cuellar</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Fried, Mp" uniqKey="Fried M">MP Fried</name></author><author><name sortKey="Sadoughi, B" uniqKey="Sadoughi B">B Sadoughi</name></author><author><name sortKey="Gibber, Mj" uniqKey="Gibber M">MJ Gibber</name></author><author><name sortKey="Jacobs, Jb" uniqKey="Jacobs J">JB Jacobs</name></author><author><name sortKey="Lebowitz, Ra" uniqKey="Lebowitz R">RA Lebowitz</name></author><author><name sortKey="Ross, Da" uniqKey="Ross D">DA Ross</name></author><author><name sortKey="Bent, Jp" uniqKey="Bent J">JP Bent</name></author><author><name sortKey="Parikh, Sr" uniqKey="Parikh S">SR Parikh</name></author><author><name sortKey="Sasaki, Ct" uniqKey="Sasaki C">CT Sasaki</name></author><author><name sortKey="Schaefer, Sd" uniqKey="Schaefer S">SD Schaefer</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Gross, Rd" uniqKey="Gross R">RD Gross</name></author><author><name sortKey="Sheridan, Mf" uniqKey="Sheridan M">MF Sheridan</name></author><author><name sortKey="Burgess, Lp" uniqKey="Burgess L">LP Burgess</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Neubauer, A" uniqKey="Neubauer A">A Neubauer</name></author><author><name sortKey="Wolfsberger, S" uniqKey="Wolfsberger S">S Wolfsberger</name></author><author><name sortKey="Forster, Mt" uniqKey="Forster M">MT Forster</name></author><author><name sortKey="Mroz, L" uniqKey="Mroz L">L Mroz</name></author><author><name sortKey="Wegenkittl, R" uniqKey="Wegenkittl R">R Wegenkittl</name></author><author><name sortKey="Buhler, K" uniqKey="Buhler K">K Buhler</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Joice, P" uniqKey="Joice P">P Joice</name></author><author><name sortKey="Ross, Pd" uniqKey="Ross P">PD Ross</name></author><author><name sortKey="Wang, D" uniqKey="Wang D">D Wang</name></author><author><name sortKey="Abel, Ew" uniqKey="Abel E">EW Abel</name></author><author><name sortKey="White, Ps" uniqKey="White P">PS White</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Zhao, Yc" uniqKey="Zhao Y">YC Zhao</name></author><author><name sortKey="Kennedy, G" uniqKey="Kennedy G">G Kennedy</name></author><author><name sortKey="Yukawa, K" uniqKey="Yukawa K">K Yukawa</name></author><author><name sortKey="Pyman, B" uniqKey="Pyman B">B Pyman</name></author><author><name sortKey="O Leary, S" uniqKey="O Leary S">S O'Leary</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Hogle, Nj" uniqKey="Hogle N">NJ Hogle</name></author><author><name sortKey="Widmann, Wd" uniqKey="Widmann W">WD Widmann</name></author><author><name sortKey="Ude, Ao" uniqKey="Ude A">AO Ude</name></author><author><name sortKey="Hardy, Ma" uniqKey="Hardy M">MA Hardy</name></author><author><name sortKey="Fowler, Dl" uniqKey="Fowler D">DL Fowler</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Fried, Mp" uniqKey="Fried M">MP Fried</name></author><author><name sortKey="Sadoughi, B" uniqKey="Sadoughi B">B Sadoughi</name></author><author><name sortKey="Weghorst, Sj" uniqKey="Weghorst S">SJ Weghorst</name></author><author><name sortKey="Zeltsan, M" uniqKey="Zeltsan M">M Zeltsan</name></author><author><name sortKey="Cuellar, H" uniqKey="Cuellar H">H Cuellar</name></author><author><name sortKey="Uribe, Ji" uniqKey="Uribe J">JI Uribe</name></author><author><name sortKey="Sasaki, Ct" uniqKey="Sasaki C">CT Sasaki</name></author><author><name sortKey="Ross, Da" uniqKey="Ross D">DA Ross</name></author><author><name sortKey="Jacobs, Jb" uniqKey="Jacobs J">JB Jacobs</name></author><author><name sortKey="Lebowitz, Ra" uniqKey="Lebowitz R">RA Lebowitz</name></author><author><name sortKey="Satava, Rm" uniqKey="Satava R">RM Satava</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Beyer, L" uniqKey="Beyer L">L Beyer</name></author><author><name sortKey="Troyer, Jd" uniqKey="Troyer J">JD Troyer</name></author><author><name sortKey="Mancini, J" uniqKey="Mancini J">J Mancini</name></author><author><name sortKey="Bladou, F" uniqKey="Bladou F">F Bladou</name></author><author><name sortKey="Berdah, Sv" uniqKey="Berdah S">SV Berdah</name></author><author><name sortKey="Karsenty, G" uniqKey="Karsenty G">G Karsenty</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Seymour, Ne" uniqKey="Seymour N">NE Seymour</name></author><author><name sortKey="Gallagher, Ag" uniqKey="Gallagher A">AG Gallagher</name></author><author><name sortKey="Roman, Sa" uniqKey="Roman S">SA Roman</name></author><author><name sortKey="O Brien, Mk" uniqKey="O Brien M">MK O'Brien</name></author><author><name sortKey="Bansal, Vk" uniqKey="Bansal V">VK Bansal</name></author><author><name sortKey="Andersen, Dk" uniqKey="Andersen D">DK Andersen</name></author><author><name sortKey="Satava, Rm" uniqKey="Satava R">RM Satava</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Park, J" uniqKey="Park J">J Park</name></author><author><name sortKey="Macrae, H" uniqKey="Macrae H">H MacRae</name></author><author><name sortKey="Musselman, Lj" uniqKey="Musselman L">LJ Musselman</name></author><author><name sortKey="Rossos, P" uniqKey="Rossos P">P Rossos</name></author><author><name sortKey="Hamstra, Sj" uniqKey="Hamstra S">SJ Hamstra</name></author><author><name sortKey="Wolman, S" uniqKey="Wolman S">S Wolman</name></author><author><name sortKey="Reznick, Rk" uniqKey="Reznick R">RK Reznick</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Francis, Hw" uniqKey="Francis H">HW Francis</name></author><author><name sortKey="Malik, Mu" uniqKey="Malik M">MU Malik</name></author><author><name sortKey="Diaz Voss Varela, Da" uniqKey="Diaz Voss Varela D">DA Diaz Voss Varela</name></author><author><name sortKey="Barffour, Ma" uniqKey="Barffour M">MA Barffour</name></author><author><name sortKey="Chien, Ww" uniqKey="Chien W">WW Chien</name></author><author><name sortKey="Carey, Jp" uniqKey="Carey J">JP Carey</name></author><author><name sortKey="Niparko, Jk" uniqKey="Niparko J">JK Niparko</name></author><author><name sortKey="Bhatti, Ni" uniqKey="Bhatti N">NI Bhatti</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Zhao, Yc" uniqKey="Zhao Y">YC Zhao</name></author><author><name sortKey="Kennedy, G" uniqKey="Kennedy G">G Kennedy</name></author><author><name sortKey="Yukawa, K" uniqKey="Yukawa K">K Yukawa</name></author><author><name sortKey="Pyman, B" uniqKey="Pyman B">B Pyman</name></author><author><name sortKey="O Leary, S" uniqKey="O Leary S">S O'Leary</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Wiet, Gj" uniqKey="Wiet G">GJ Wiet</name></author><author><name sortKey="Stredney, D" uniqKey="Stredney D">D Stredney</name></author><author><name sortKey="Wan, D" uniqKey="Wan D">D Wan</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Caversaccio, M" uniqKey="Caversaccio M">M Caversaccio</name></author><author><name sortKey="Eichenberger, A" uniqKey="Eichenberger A">A Eichenberger</name></author><author><name sortKey="Hausler, R" uniqKey="Hausler R">R Hausler</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Tolsdorff, B" uniqKey="Tolsdorff B">B Tolsdorff</name></author><author><name sortKey="Pommert, A" uniqKey="Pommert A">A Pommert</name></author><author><name sortKey="Hohne, Kh" uniqKey="Hohne K">KH Hohne</name></author><author><name sortKey="Petersik, A" uniqKey="Petersik A">A Petersik</name></author><author><name sortKey="Pflesser, B" uniqKey="Pflesser B">B Pflesser</name></author><author><name sortKey="Tiede, U" uniqKey="Tiede U">U Tiede</name></author><author><name sortKey="Leuwer, R" uniqKey="Leuwer R">R Leuwer</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Delorme, S" uniqKey="Delorme S">S Delorme</name></author><author><name sortKey="Laroche, D" uniqKey="Laroche D">D Laroche</name></author><author><name sortKey="Diraddo, R" uniqKey="Diraddo R">R DiRaddo</name></author><author><name sortKey="Del Maestro, Rf" uniqKey="Del Maestro R">RF Del Maestro</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Rosseau, G" uniqKey="Rosseau G">G Rosseau</name></author><author><name sortKey="Bailes, J" uniqKey="Bailes J">J Bailes</name></author><author><name sortKey="Del Maestro, R" uniqKey="Del Maestro R">R del Maestro</name></author><author><name sortKey="Cabral, A" uniqKey="Cabral A">A Cabral</name></author><author><name sortKey="Choudhury, N" uniqKey="Choudhury N">N Choudhury</name></author><author><name sortKey="Comas, O" uniqKey="Comas O">O Comas</name></author><author><name sortKey="Debergue, P" uniqKey="Debergue P">P Debergue</name></author><author><name sortKey="De Luca, G" uniqKey="De Luca G">G De Luca</name></author><author><name sortKey="Hovdebo, J" uniqKey="Hovdebo J">J Hovdebo</name></author><author><name sortKey="Jiang, D" uniqKey="Jiang D">D Jiang</name></author><author><name sortKey="Laroche, D" uniqKey="Laroche D">D Laroche</name></author><author><name sortKey="Neubauer, A" uniqKey="Neubauer A">A Neubauer</name></author><author><name sortKey="Pazos, V" uniqKey="Pazos V">V Pazos</name></author><author><name sortKey="Thibault, F" uniqKey="Thibault F">F Thibault</name></author><author><name sortKey="Diraddo, R" uniqKey="Diraddo R">R Diraddo</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Gelinas Phaneuf, N" uniqKey="Gelinas Phaneuf N">N Gelinas-Phaneuf</name></author><author><name sortKey="Choudhury, N" uniqKey="Choudhury N">N Choudhury</name></author><author><name sortKey="Al Habib, Ar" uniqKey="Al Habib A">AR Al-Habib</name></author><author><name sortKey="Cabral, A" uniqKey="Cabral A">A Cabral</name></author><author><name sortKey="Nadeau, E" uniqKey="Nadeau E">E Nadeau</name></author><author><name sortKey="Mora, V" uniqKey="Mora V">V Mora</name></author><author><name sortKey="Pazos, V" uniqKey="Pazos V">V Pazos</name></author><author><name sortKey="Debergue, P" uniqKey="Debergue P">P Debergue</name></author><author><name sortKey="Diraddo, R" uniqKey="Diraddo R">R Diraddo</name></author><author><name sortKey="Del Maestro, Rf" uniqKey="Del Maestro R">RF Del Maestro</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Stankiewicz, J" uniqKey="Stankiewicz J">J Stankiewicz</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Hofstad, Ef" uniqKey="Hofstad E">EF Hofstad</name></author><author><name sortKey="Vapenstad, C" uniqKey="Vapenstad C">C Vapenstad</name></author><author><name sortKey="Chmarra, Mk" uniqKey="Chmarra M">MK Chmarra</name></author><author><name sortKey="Lango, T" uniqKey="Lango T">T Lango</name></author><author><name sortKey="Kuhry, E" uniqKey="Kuhry E">E Kuhry</name></author><author><name sortKey="Marvik, R" uniqKey="Marvik R">R Marvik</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Pellen, Mg" uniqKey="Pellen M">MG Pellen</name></author><author><name sortKey="Horgan, Lf" uniqKey="Horgan L">LF Horgan</name></author><author><name sortKey="Barton, Jr" uniqKey="Barton J">JR Barton</name></author><author><name sortKey="Attwood, Se" uniqKey="Attwood S">SE Attwood</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Edmond, Cv" uniqKey="Edmond C">CV Edmond</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Bakker, Nh" uniqKey="Bakker N">NH Bakker</name></author><author><name sortKey="Fokkens, Wj" uniqKey="Fokkens W">WJ Fokkens</name></author><author><name sortKey="Grimbergen, Ca" uniqKey="Grimbergen C">CA Grimbergen</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Hung, Aj" uniqKey="Hung A">AJ Hung</name></author><author><name sortKey="Ng, Ck" uniqKey="Ng C">CK Ng</name></author><author><name sortKey="Patil, Mb" uniqKey="Patil M">MB Patil</name></author><author><name sortKey="Zehnder, P" uniqKey="Zehnder P">P Zehnder</name></author><author><name sortKey="Huang, E" uniqKey="Huang E">E Huang</name></author><author><name sortKey="Aron, M" uniqKey="Aron M">M Aron</name></author><author><name sortKey="Gill, Is" uniqKey="Gill I">IS Gill</name></author><author><name sortKey="Desai, Mm" uniqKey="Desai M">MM Desai</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Narazaki, K" uniqKey="Narazaki K">K Narazaki</name></author><author><name sortKey="Oleynikov, D" uniqKey="Oleynikov D">D Oleynikov</name></author><author><name sortKey="Stergiou, N" uniqKey="Stergiou N">N Stergiou</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Downing, Sm" uniqKey="Downing S">SM Downing</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Rivard, Jd" uniqKey="Rivard J">JD Rivard</name></author><author><name sortKey="Vergis, As" uniqKey="Vergis A">AS Vergis</name></author><author><name sortKey="Unger, Bj" uniqKey="Unger B">BJ Unger</name></author><author><name sortKey="Hardy, Km" uniqKey="Hardy K">KM Hardy</name></author><author><name sortKey="Andrew, Cg" uniqKey="Andrew C">CG Andrew</name></author><author><name sortKey="Gillman, Lm" uniqKey="Gillman L">LM Gillman</name></author><author><name sortKey="Park, J" uniqKey="Park J">J Park</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Lin, Y" uniqKey="Lin Y">Y Lin</name></author><author><name sortKey="Wang, X" uniqKey="Wang X">X Wang</name></author><author><name sortKey="Wu, F" uniqKey="Wu F">F Wu</name></author><author><name sortKey="Chen, X" uniqKey="Chen X">X Chen</name></author><author><name sortKey="Wang, C" uniqKey="Wang C">C Wang</name></author><author><name sortKey="Shen, G" uniqKey="Shen G">G Shen</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Steehler, Mk" uniqKey="Steehler M">MK Steehler</name></author><author><name sortKey="Pfisterer, Mj" uniqKey="Pfisterer M">MJ Pfisterer</name></author><author><name sortKey="Na, H" uniqKey="Na H">H Na</name></author><author><name sortKey="Hesham, Hn" uniqKey="Hesham H">HN Hesham</name></author><author><name sortKey="Pehlivanova, M" uniqKey="Pehlivanova M">M Pehlivanova</name></author><author><name sortKey="Malekzadeh, S" uniqKey="Malekzadeh S">S Malekzadeh</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Jensen, Uj" uniqKey="Jensen U">UJ Jensen</name></author><author><name sortKey="Jensen, J" uniqKey="Jensen J">J Jensen</name></author><author><name sortKey="Olivecrona, Gk" uniqKey="Olivecrona G">GK Olivecrona</name></author><author><name sortKey="Ahlberg, G" uniqKey="Ahlberg G">G Ahlberg</name></author><author><name sortKey="Tornvall, P" uniqKey="Tornvall P">P Tornvall</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Burden, C" uniqKey="Burden C">C Burden</name></author><author><name sortKey="Preshaw, J" uniqKey="Preshaw J">J Preshaw</name></author><author><name sortKey="White, P" uniqKey="White P">P White</name></author><author><name sortKey="Draycott, Tj" uniqKey="Draycott T">TJ Draycott</name></author><author><name sortKey="Grant, S" uniqKey="Grant S">S Grant</name></author><author><name sortKey="Fox, R" uniqKey="Fox R">R Fox</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Plooy, Am" uniqKey="Plooy A">AM Plooy</name></author><author><name sortKey="Hill, A" uniqKey="Hill A">A Hill</name></author><author><name sortKey="Horswill, Ms" uniqKey="Horswill M">MS Horswill</name></author><author><name sortKey="Cresp, As" uniqKey="Cresp A">AS Cresp</name></author><author><name sortKey="Watson, Mo" uniqKey="Watson M">MO Watson</name></author><author><name sortKey="Ooi, Sy" uniqKey="Ooi S">SY Ooi</name></author><author><name sortKey="Riek, S" uniqKey="Riek S">S Riek</name></author><author><name sortKey="Wallis, Gm" uniqKey="Wallis G">GM Wallis</name></author><author><name sortKey="Burgess Limerick, R" uniqKey="Burgess Limerick R">R Burgess-Limerick</name></author><author><name sortKey="Hewett, Dg" uniqKey="Hewett D">DG Hewett</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Schaefer, Jj" uniqKey="Schaefer J">JJ Schaefer</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Philibert, I" uniqKey="Philibert I">I Philibert</name></author><author><name sortKey="Friedmann, P" uniqKey="Friedmann P">P Friedmann</name></author><author><name sortKey="Williams, Wt" uniqKey="Williams W">WT Williams</name></author></analytic></biblStruct></listBibl></div1></back></TEI><pmc article-type="research-article"><pmc-dir>properties open_access</pmc-dir>
<front><journal-meta><journal-id journal-id-type="nlm-ta">J Otolaryngol Head Neck Surg</journal-id><journal-id journal-id-type="iso-abbrev">J Otolaryngol Head Neck Surg</journal-id><journal-title-group><journal-title>Journal of Otolaryngology - Head & Neck Surgery</journal-title></journal-title-group><issn pub-type="ppub">1916-0208</issn><issn pub-type="epub">1916-0216</issn><publisher><publisher-name>BioMed Central</publisher-name><publisher-loc>London</publisher-loc></publisher></journal-meta><article-meta><article-id pub-id-type="pmid">25927463</article-id><article-id pub-id-type="pmc">4210497</article-id><article-id pub-id-type="publisher-id">40</article-id><article-id pub-id-type="doi">10.1186/s40463-014-0040-8</article-id><article-categories><subj-group subj-group-type="heading"><subject>Original Research Article</subject></subj-group></article-categories><title-group><article-title>The McGill simulator for endoscopic sinus surgery (MSESS): a validation study</article-title></title-group><contrib-group><contrib contrib-type="author" corresp="yes"><name><surname>Varshney</surname><given-names>Rickul</given-names></name><address><email>rickul.varshney@gmail.com</email></address><xref ref-type="aff" rid="Aff1"></xref><xref ref-type="aff" rid="Aff7"></xref></contrib><contrib contrib-type="author"><name><surname>Frenkiel</surname><given-names>Saul</given-names></name><address><email>sfrenkie@jgh.mcgill.ca</email></address><xref ref-type="aff" rid="Aff1"></xref></contrib><contrib contrib-type="author"><name><surname>Nguyen</surname><given-names>Lily HP</given-names></name><address><email>lily.hp.nguyen@gmail.com</email></address><xref ref-type="aff" rid="Aff1"></xref><xref ref-type="aff" rid="Aff2"></xref></contrib><contrib contrib-type="author"><name><surname>Young</surname><given-names>Meredith</given-names></name><address><email>meredith.young@mcgill.ca</email></address><xref ref-type="aff" rid="Aff2"></xref><xref ref-type="aff" rid="Aff3"></xref></contrib><contrib contrib-type="author"><name><surname>Del Maestro</surname><given-names>Rolando</given-names></name><address><email>rolando.del_maestro@mcgill.ca</email></address><xref ref-type="aff" rid="Aff4"></xref></contrib><contrib contrib-type="author"><name><surname>Zeitouni</surname><given-names>Anthony</given-names></name><address><email>anthony.zeitouni@mcgill.ca</email></address><xref ref-type="aff" rid="Aff1"></xref></contrib><contrib contrib-type="author"><name><surname>Saad</surname><given-names>Elias</given-names></name><address><email>elias.saad@mail.mcgill.ca</email></address><xref ref-type="aff" rid="Aff5"></xref></contrib><contrib contrib-type="author"><name><surname>Funnell</surname><given-names>W Robert J</given-names></name><address><email>robert.funnell@mcgill.ca</email></address><xref ref-type="aff" rid="Aff1"></xref><xref ref-type="aff" rid="Aff5"></xref></contrib><contrib contrib-type="author"><collab>National Research Council Canada</collab><address><email>Robert.Diraddo@cnrc-nrc.gc.ca</email></address><xref ref-type="aff" rid="Aff6"></xref></contrib><contrib contrib-type="author"><name><surname>Tewfik</surname><given-names>Marc A</given-names></name><address><email>marc.tewfik@mcgill.ca</email></address><xref ref-type="aff" rid="Aff1"></xref></contrib><aff id="Aff1"><label></label>Department of Otolaryngology, Head and Neck Surgery, McGill University, Montreal, Canada</aff><aff id="Aff2"><label></label>Centre for Medical Education, McGill University, Montreal, Canada</aff><aff id="Aff3"><label></label>Department of Medicine, McGill University, Montreal, Canada</aff><aff id="Aff4"><label></label>Neurosurgical Simulation Research Center, McGill University, Montreal, Canada</aff><aff id="Aff5"><label></label>Department of BioMedical Engineering, McGill University, Montreal, Canada</aff><aff id="Aff6"><label></label>National Research Council Canada, Boucherville, Canada</aff><aff id="Aff7"><label></label>Royal Victoria Hospital, 687 Ave Des Pins O., Rm E4.41, Montreal, Quebec H3A 1A1 Canada</aff></contrib-group><pub-date pub-type="epub"><day>24</day><month>10</month><year>2014</year></pub-date><pub-date pub-type="pmc-release"><day>24</day><month>10</month><year>2014</year></pub-date><pub-date pub-type="collection"><year>2014</year></pub-date><volume>43</volume><issue>1</issue><elocation-id>40</elocation-id><history><date date-type="received"><day>25</day><month>6</month><year>2014</year></date><date date-type="accepted"><day>15</day><month>10</month><year>2014</year></date></history><permissions><copyright-statement>© Varshney et al.; licensee BioMed Central Ltd. 2014</copyright-statement><license license-type="open-access"><license-p>This is an Open Access article distributed under the terms of the Creative Commons Attribution License (<ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/licenses/by/4.0">http://creativecommons.org/licenses/by/4.0</ext-link>), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (<ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/publicdomain/zero/1.0/">http://creativecommons.org/publicdomain/zero/1.0/</ext-link>) applies to the data made available in this article, unless otherwise stated.</license-p></license></permissions><abstract id="Abs1"><sec><title>Background</title><p>Endoscopic sinus surgery (ESS) is a technically challenging procedure, associated with a significant risk of complications. Virtual reality simulation has demonstrated benefit in many disciplines as an important educational tool for surgical training. Within the field of rhinology, there is a lack of ESS simulators with appropriate validity evidence supporting their integration into residency education. The objectives of this study are to evaluate the acceptability, perceived realism and benefit of the McGill Simulator for Endoscopic Sinus Surgery (MSESS) among medical students, otolaryngology residents and faculty, and to present evidence supporting its ability to differentiate users based on their level of training through the performance metrics.</p></sec><sec><title>Methods</title><p>10 medical students, 10 junior residents, 10 senior residents and 3 expert sinus surgeons performed anterior ethmoidectomies, posterior ethmoidectomies and wide sphenoidotomies on the MSESS. Performance metrics related to quality (e.g. percentage of tissue removed), efficiency (e.g. time, path length, bimanual dexterity, etc.) and safety (e.g. contact with no-go zones, maximum applied force, etc.) were calculated. All users completed a post-simulation questionnaire related to realism, usefulness and perceived benefits of training on the MSESS.</p></sec><sec><title>Results</title><p>The MSESS was found to be realistic and useful for training surgical skills with scores of 7.97 ± 0.29 and 8.57 ± 0.69, respectively on a 10-point rating scale. Most students and residents (29/30) believed that it should be incorporated into their curriculum. There were significant differences between novice surgeons (10 medical students and 10 junior residents) and senior surgeons (10 senior residents and 3 sinus surgeons) in performance metrics related to quality (<italic>p</italic> < 0.05), efficiency (<italic>p</italic> < 0.01) and safety (<italic>p</italic> < 0.05).</p></sec><sec><title>Conclusion</title><p>The MSESS demonstrated initial evidence supporting its use for residency education. This simulator may be a potential resource to help fill the void in endoscopic sinus surgery training.</p></sec></abstract><kwd-group xml:lang="en"><title>Keywords</title><kwd>Rhinology</kwd><kwd>Endoscopic sinus surgery</kwd><kwd>Training</kwd><kwd>Education</kwd><kwd>Simulation</kwd><kwd>Virtual reality</kwd><kwd>Resident</kwd><kwd>Minimally invasive surgery</kwd><kwd>Haptic</kwd><kwd>Technical abilities</kwd><kwd>Performance metrics</kwd><kwd>Nasal model</kwd></kwd-group><custom-meta-group><custom-meta><meta-name>issue-copyright-statement</meta-name><meta-value>© The Author(s) 2014</meta-value></custom-meta></custom-meta-group></article-meta></front><body><sec id="Sec1" sec-type="introduction"><title>Introduction</title><p>Endoscopic sinus surgery (ESS) requires specialized technical skills involving complex spatial, perceptual and psychomotor performances [<xref ref-type="bibr" rid="CR1">1</xref>]. Expertise in this minimally invasive surgery necessitates bimanual dexterity within a small 3-dimensional space [<xref ref-type="bibr" rid="CR1">1</xref>], avoidance of key vital structures (i.e. orbits, brain and carotid artery), thorough applied knowledge of the intricate anatomy, and proficiency in maneuvering with the indirect visual aid of a 2-dimensional monitor [<xref ref-type="bibr" rid="CR2">2</xref>]. Given the proximity of the paranasal sinuses to critical structures such as the orbits and skull base, it can be understood why ESS is the most frequent reason for otolaryngic surgical litigation in the United States [<xref ref-type="bibr" rid="CR3">3</xref>], and why the rate of complications during ESS is higher in trainees when compared to attending physicians [<xref ref-type="bibr" rid="CR4">4</xref>].</p><p>Those teaching ESS have found alternative modalities to the traditional apprenticeship training model such as cadaveric dissections and 3D silicone models [<xref ref-type="bibr" rid="CR1">1</xref>]. However, the latter have substantial limitations with regards to the complex needs of ESS training, such as the lack of tissue mobility of rigid silicone models [<xref ref-type="bibr" rid="CR5">5</xref>] and the inadequate representation of tissue strength in cadavers [<xref ref-type="bibr" rid="CR6">6</xref>]. Virtual reality (VR) simulators solve these deficiencies, as well as offer a standardized environment for a trainee to repeat a procedure multiple times until proficiency is achieved [<xref ref-type="bibr" rid="CR7">7</xref>]. Additional benefits of VR simulation documented in other surgical domains include the ability to objectively assess surgical skills without the need of a tutor [<xref ref-type="bibr" rid="CR8">8</xref>], reduction of patient risk, and the standardization of residency training regardless of a particular institution’s practice profile or access to a cadaver laboratory [<xref ref-type="bibr" rid="CR9">9</xref>]. VR simulation has been demonstrated to be beneficial in many surgical disciplines [<xref ref-type="bibr" rid="CR2">2</xref>,<xref ref-type="bibr" rid="CR10">10</xref>-<xref ref-type="bibr" rid="CR12">12</xref>], including otolaryngology [<xref ref-type="bibr" rid="CR13">13</xref>,<xref ref-type="bibr" rid="CR14">14</xref>].</p><p>In the field of ESS, the first VR sinus surgery simulator, the ES3, was developed between 1995 and 1998 [<xref ref-type="bibr" rid="CR15">15</xref>]. To date, rigorous published validation studies supporting use of ESS simulators in resident training derive uniquely from the ES3 [<xref ref-type="bibr" rid="CR1">1</xref>,<xref ref-type="bibr" rid="CR3">3</xref>]. However, it is no longer commercially available and there are only a few devices in existence [<xref ref-type="bibr" rid="CR15">15</xref>]. Other simulators, such as the Dextroscope endoscopic sinus simulator [<xref ref-type="bibr" rid="CR16">16</xref>] and the VOXEL-MAN [<xref ref-type="bibr" rid="CR17">17</xref>], have yet to demonstrate evidence to support their use for training. Thus, there is an obvious need for a VR simulator with evidence of acceptability and validity to fill the void in ESS training.</p><p>The McGill Simulator for Endoscopic Sinus Surgery (MSESS) is a VR simulator that aims to address this issue. The objectives of this study were to assess the feasibility, usability, perceived value, and initial evidence supporting the validity of the simulator.</p></sec><sec id="Sec2" sec-type="materials|methods"><title>Methods</title><sec id="Sec3"><title>Description of the participants</title><p>Ethical approval was obtained from the Institutional Review Board at McGill University. Between May and October 2013, the following participants were recruited into the study: senior medical students (third or fourth year) and otolaryngology residents. The residents were divided into two groups: junior residents (PGY1-3 s) and senior residents (PGY4-5). The junior residents were grouped together as they had limited or no operative experience in ESS with less than 5 cases, whereas the senior residents had more than 5 cases. Furthermore, in order to have performance metrics from expert surgeons, 3 attending staff proficient in ESS (fellowship trained in rhinology or that perform an average of one day of ESS or skull base procedures every week) were also recruited.</p><p>Each user was given a brief tutorial concerning the functionality of the tools, as well as a video demonstrating the tasks to be performed and the danger zones within the nasal cavity. They were also given a 5-minute period to familiarize themselves with the movement and haptic feedback of the tools and the use of the pedals prior to beginning the simulated tasks.</p></sec><sec id="Sec4"><title>Description of the MSESS</title><p>The MSESS was created by the Department of Otolaryngology – Head and Neck Surgery at McGill University and the National Research Council of Canada. It was developed upon the NeuroTouch platform, which is a neurosurgery simulator made by the National Research Council of Canada [<xref ref-type="bibr" rid="CR18">18</xref>,<xref ref-type="bibr" rid="CR19">19</xref>]. Validity of the neurosurgery simulator as a training tool has previously been described [<xref ref-type="bibr" rid="CR20">20</xref>]. The simulated 3D nasal model was rendered using a single patient’s CT scan. Each anatomic structure within the simulated 3D nasal model was coded separately as to allow specific measurements of performance at each point within the nasal cavity.</p><p>By providing a 0-degree endoscope in the non-dominant hand and a microdebrider in the dominant hand, the MSESS allowed the user to perform basic ESS tasks while viewing a virtual representation of the nasal cavity and the instrument tip on a flat panel display (Figure <xref rid="Fig1" ref-type="fig">1</xref>). A10-member panel of sinus surgeons and education experts opted to develop a microdebrider as the first simulated tool as it is commonly used in ESS, can perform a variety of tasks, and has a potential for serious complications [<xref ref-type="bibr" rid="CR21">21</xref>]. The user received haptic feedback from the instruments, such as resistance from the contact of nasal tissues and vibration from the microdebrider activation.<fig id="Fig1"><label>Figure 1</label><caption><p><bold>Hardware of the MSESS.</bold> View of the endoscope and the microdebrider handles (above) with VR view seen on the display monitor (below).</p></caption><graphic xlink:href="40463_2014_40_Fig1_HTML" id="MO1"></graphic></fig></p><p>A novel feature of the MSESS was its ability to simulate visual field blurring caused by soiling of the tip of the endoscope with nasal tissue contact. In this instance, the user had to activate an endonasal wash function via a foot pedal in order to regain clear visualization.</p></sec><sec id="Sec5"><title>Simulation tasks</title><p>The tasks chosen to be evaluated on the MSESS included: 1) passing the endoscope from the nasal vestibule to the nasopharynx, 2) anterior ethmoidectomy, 3) posterior ethmoidectomy and 4) wide sphenoidotomy (Figure <xref rid="Fig2" ref-type="fig">2</xref>). The four tasks were chosen by the panel because they represented increasing levels of difficulty, and mimicked the step-wise approach found in sinus surgery where the surgeon typically addresses first the maxillary sinus, then the ethmoids, and finally the sphenoid sinus. The uncinectomy and maxillary antrostomy were not assessed since it cannot be safely performed with a microdebrider and other instruments have not yet been simulated.<fig id="Fig2"><label>Figure 2</label><caption><p><bold>VR representation of sinonasal cavity.</bold> Views of an ethmoidectomy (left) and sphenoidotomy (right) using the microdebrider.</p></caption><graphic xlink:href="40463_2014_40_Fig2_HTML" id="MO2"></graphic></fig></p></sec><sec id="Sec6"><title>Performance metrics</title><p>Dimensions of quantitative data generated include constructs of <italic>quality</italic>, <italic>efficiency</italic>, and <italic>safety.</italic> Many of the metrics used to compare groups have previously been validated on the NeuroTouch platform [<xref ref-type="bibr" rid="CR20">20</xref>]. A list of the metrics and their definitions can be found in Table <xref rid="Tab1" ref-type="table">1</xref>.<table-wrap id="Tab1"><label>Table 1</label><caption><p><bold>Description of the performance metrics</bold></p></caption><table frame="hsides" rules="groups"><thead><tr valign="top"><th><bold>Metric sphere</bold></th><th><bold>Definition</bold></th><th><bold>Metric</bold></th><th><bold>Units</bold></th></tr></thead><tbody><tr valign="top"><td rowspan="3">Quality</td><td rowspan="3">Completeness of targeted tissue removal</td><td>Amount of anterior ethmoids removed</td><td>Percentage (amount removed/total amount of relevant tissue)</td></tr><tr valign="top"><td>Amount of posterior ethmoids removed</td><td>Percentage</td></tr><tr valign="top"><td>Amount of sphenoid face removed</td><td>Percentage</td></tr><tr valign="top"><td rowspan="6">Efficiency</td><td rowspan="6">Task performance with the least amount of unnecessary maneuvers</td><td>Time to complete tasks</td><td>Seconds</td></tr><tr valign="top"><td>Path length (endoscope)</td><td>Millimeters</td></tr><tr valign="top"><td>Path length (microdebrider)</td><td>Millimeters</td></tr><tr valign="top"><td>Fluctuation in distance between tips of endoscope & microdebrider (calculated by interquartile range)</td><td>Millimeters</td></tr><tr valign="top"><td>Frequency of microdebrider pedal activation</td><td>Number</td></tr><tr valign="top"><td>Amount of endonasal washes</td><td>Number</td></tr><tr valign="top"><td rowspan="2">Safety</td><td rowspan="2">Amount of collateral damage</td><td>Amount of normal tissue removed, namely tissue over three critical “no-go” zones (lamina papyracea, skull base and optico-carotid recess)</td><td>Percentage</td></tr><tr valign="top"><td>Maximal force applied on skull base and lamina papyracea</td><td>Newtons</td></tr></tbody></table></table-wrap></p></sec><sec id="Sec7"><title>Post-simulation questionnaire</title><p>After their simulation session, participants answered a questionnaire regarding their perceptions of simulator realism, potential educational benefits and skills practiced. Responses were collected via both a 10-point rating scale, anchored as appropriate for the question, and open-ended questions. Prior to implementation, this questionnaire had been sent to 5 faculty members on the research team to ensure that it was appropriate, intelligible, unambiguous, unbiased, complete, appropriately coded and aligned with our constructs of interest. Thereafter, a panel of 5 otolaryngologists and education experts assessed the questionnaire independently to validate it. Finally, residents and physicians were recruited to perform the initial pilot testing including assessment of intra-rater reliability for a final review of the post-simulation questionnaire.</p></sec><sec id="Sec8"><title>Data analysis</title><p>An average for each metric was calculated per group of participants (medical students, junior residents, senior residents, attending faculty), and used for comparison across participant groups.</p><p>Differences between groups’ performance metrics were first investigated using the analysis of variance - Kruskal Wallis Test. All metrics that showed a difference between groups were then sub-analyzed using the Mann-Whitney test to demonstrate which groups showed a difference (<italic>p</italic> < 0.05 was considered significant). Descriptive statistics were used to analyze the quantitative portion of the questionnaire, while content analysis and thematic description was applied to qualitative data.</p></sec></sec><sec id="Sec9" sec-type="results"><title>Results</title><sec id="Sec10"><title>Participants</title><p>10 medical students, 10 junior residents, 10 senior residents and 3 attending staff agreed to participate in the study. All the participants completed the required simulation tasks, as well as the post-simulation questionnaire.</p></sec><sec id="Sec11"><title>Post-simulation questionnaire</title><p>Data relating to the assessment of perceived realism and educational value of the MSESS are presented in Tables <xref rid="Tab2" ref-type="table">2</xref> and <xref rid="Tab3" ref-type="table">3</xref>, respectively. Participants across all groups, on average, rated items related to the realism of the MSESS at least 7 on a 10 point-rating scale, corresponding to the anchor “realistic” (Mean =7.97 ± 0.29). Similarly, participants across all groups rated items related to the perceived educational value of the MSESS at least 7 on a 10, corresponding to “useful” (Mean =8.57 ± 0.69).<table-wrap id="Tab2"><label>Table 2</label><caption><p><bold>Perceived assessment of the realism of the MSESS</bold></p></caption><table frame="hsides" rules="groups"><thead><tr valign="top"><th rowspan="2"></th><th rowspan="2"></th><th><bold>Medical students</bold></th><th><bold>Junior residents</bold></th><th><bold>Senior residents</bold></th><th><bold>Attending faculty</bold></th></tr><tr valign="top"><th><bold>Mean score (SD)</bold></th><th><bold>Mean score (SD)</bold></th><th><bold>Mean score (SD)</bold></th><th><bold>Mean score (SD)</bold></th></tr></thead><tbody><tr valign="top"><td rowspan="3"><bold>Appearance of VR nasal model</bold></td><td>Nasal cavity</td><td>8.0 (0.67)</td><td>7.6 (1.83)</td><td>8.11 (1.53)</td><td>7.67 (0.57)</td></tr><tr valign="top"><td>Sinuses</td><td>7.9 (0.73)</td><td>7.7 (1.83)</td><td>8.11 (1.45)</td><td>7.67 (0.57)</td></tr><tr valign="top"><td>Medialization of turbinate</td><td>8.3 (0.82)</td><td>7.3 (1.88)</td><td>8.0 (1.58)</td><td>7.33 (0.57)</td></tr><tr valign="top"><td rowspan="5"><bold>Appearance and functionality of tools</bold></td><td>Microdebrider</td><td>8.4 (0.84)</td><td>7.7 (1.63)</td><td>8.33 (1.11)</td><td>7.33 (0.57)</td></tr><tr valign="top"><td>Suction on microdebrider</td><td>7.7 (0.82)</td><td>7.6 (1.83)</td><td>8.11 (1.26)</td><td>8.33 (0.57)</td></tr><tr valign="top"><td>Physical tool handles</td><td>8.5 (1.18)</td><td>7.4 (1.83)</td><td>7.89 (1.45)</td><td>8.33 (0.57)</td></tr><tr valign="top"><td>Haptic feedback</td><td>7.2 (1.22)</td><td>7.8 (1.75)</td><td>7.89 (1.16)</td><td>7.67(0.57)</td></tr><tr valign="top"><td>Endonasal wash</td><td>8.6 (1.07)</td><td>7.3 (1.57)</td><td>8.11 (0.93)</td><td>8.66 (0.57)</td></tr><tr valign="top"><td rowspan="3"><bold>Ability to simulate surgical steps</bold></td><td>Anterior ethmoidectomy</td><td>8.5 (0.53)</td><td>7.9 (1.63)</td><td>8.22 (0.83)</td><td>8.33 (0.57)</td></tr><tr valign="top"><td>Posterior ethmoidectomy</td><td>8.5 (0.53)</td><td>7.7 (1.63)</td><td>8.22 (0.97)</td><td>8.0 (0)</td></tr><tr valign="top"><td>Sphenoidotomy</td><td>8.5 (0.71)</td><td>7.5 (1.84)</td><td>8.22 (0.97)</td><td>8.33 (0.57)</td></tr></tbody></table><table-wrap-foot><p>Scores were on a 10-point rating scale. The anchors to the scale were 1 = No resemblance at all, 4 = Some resemblance, 7 = Realistic, 10 = Real-Life.</p></table-wrap-foot></table-wrap><table-wrap id="Tab3"><label>Table 3</label><caption><p><bold>Perceived educational value of the MSESS</bold></p></caption><table frame="hsides" rules="groups"><thead><tr valign="top"><th rowspan="2"></th><th rowspan="2"></th><th><bold>Medical students</bold></th><th><bold>Junior residents</bold></th><th><bold>Senior residents</bold></th><th><bold>Attending faculty</bold></th></tr><tr valign="top"><th><bold>Mean score (SD)</bold></th><th><bold>Mean score (SD)</bold></th><th><bold>Mean score (SD)</bold></th><th><bold>Mean score (SD)</bold></th></tr></thead><tbody><tr valign="top"><td rowspan="4"><bold>Learn theory</bold></td><td>Anatomy</td><td>9.4 (0.84)</td><td>8.3 (2.0)</td><td>9.0 (1.0)</td><td>8.67 (0.57)</td></tr><tr valign="top"><td>Steps - anterior ethmoidectomy</td><td>9.7 (0.67)</td><td>8.2 (1.93)</td><td>8.78 (1.09)</td><td>7.67 (0.57)</td></tr><tr valign="top"><td>Steps - posterior ethmoidectomy</td><td>9.7 (0.67)</td><td>8.4 (1.89)</td><td>8.78 (1.09)</td><td>7.66 (1.15)</td></tr><tr valign="top"><td>Steps - sphenoidotomy</td><td>9.6 (0.69)</td><td>8.2 (1.75)</td><td>8.45 (1.23)</td><td>7.0 (1.0)</td></tr><tr valign="top"><td rowspan="3"><bold>Practice technical skills</bold></td><td>Hand-eye coordination</td><td>9.5 (0.84)</td><td>8.1 (2.18)</td><td>9.0 (1.32)</td><td>7.67 (1.41)</td></tr><tr valign="top"><td>Bimanual dexterity</td><td>9.5 (0.84)</td><td>8.1 (2.28)</td><td>8.89 (1.36)</td><td>8.0 (0)</td></tr><tr valign="top"><td>Efficiency</td><td>9.6 (0.69)</td><td>7.9 (1.75)</td><td>8.44 (1.23)</td><td>7.33 (2.08)</td></tr><tr valign="top"><td rowspan="2"><bold>Safety</bold></td><td>Identify</td><td rowspan="2">9.4 (0.84)</td><td rowspan="2">8.7 (1.94)</td><td rowspan="2">8.0 (1.64)</td><td rowspan="2">9.0 (1.0)</td></tr><tr valign="top"><td>No-go zones<sup>1</sup></td></tr></tbody></table><table-wrap-foot><p>Scores were on a 10-point rating scale. The anchors to the scale were 1 = Not at all useful, 3 = Minimally useful, 5 = Adequate, 7 = Useful, 10 = Extremely useful.</p><p><sup>1</sup>No-go zones referred to the lamina papyracea, orbital fat, skull base and optico-carotid recess.</p></table-wrap-foot></table-wrap></p><p>All medical students (<italic>n</italic> = 10/10) felt that the MSESS would be useful for their level of training, as compared to 80% of junior residents (<italic>n</italic> = 8/10) and 80% (<italic>n</italic> = 8/10) of senior residents. Similarly, 100% of medical students (<italic>n</italic> = 10/10) stated that the MSESS would be a useful adjunct to their surgical curriculum, as did 80% of junior residents (<italic>n</italic> = 8/10) and 80% of senior residents (<italic>n</italic> = 8/10). Finally, when asked if the MSESS should be readily available for their rhinology surgical education, 29/30 students and residents responded yes.</p><p>The responses to open-ended questions for strengths of the simulator were grouped into three main themes: the realism of the VR model, the ability to practice bimanual technical skills and the necessity for such simulators to complement traditional teaching modalities. Weaknesses related to perceived imprecision of fine tool movements and the lack of bleeding in the VR model.</p></sec><sec id="Sec12"><title>Performance metrics</title><sec id="Sec13"><title>Quality</title><p>There was no statistically significant difference (Figure <xref rid="Fig3" ref-type="fig">3</xref>) between all 4 groups with respect to the surgical completeness of the anterior ethmoidectomy, posterior ethmoidectomy and wide sphenoidotomy (<italic>p</italic> > 0.05). However, when combining the groups into novices (medical students and junior residents) and senior surgeons (senior residents and attending faculty), there was a significant tendency towards making a wider sphenoidotomy with increasing level of expertise (<italic>p</italic> = 0.01).<fig id="Fig3"><label>Figure 3</label><caption><p><bold>Percentage of tissue removed during simulation tasks.</bold> The graph represents means +/- SD. There was no statistically significant difference (<italic>p</italic> > 0.05) between all 4 groups for all three surgical tasks. When combining the groups into novices (students and junior residents) and senior surgeons (senior residents and attending faculty), there was a statistically significant difference for the wide sphenoidotomy (<italic>p</italic> = 0.01).</p></caption><graphic xlink:href="40463_2014_40_Fig3_HTML" id="MO3"></graphic></fig></p></sec><sec id="Sec14"><title>Efficiency</title><p>Time required to complete the tasks is presented in Figure <xref rid="Fig4" ref-type="fig">4</xref>. The only significant difference was between the junior residents group and the senior residents (<italic>p</italic> < 0.005). With regards to path lengths for the endoscope and the microdebrider (Figure <xref rid="Fig5" ref-type="fig">5</xref>), both metrics demonstrated a statistically significant difference between junior residents and senior residents (<italic>p</italic> < 0.001).<fig id="Fig4"><label>Figure 4</label><caption><p><bold>Time to complete the simulation tasks.</bold> The graph represents means +/- SD. Statistically significant difference (<italic>p</italic> < 0.005) between junior residents and senior residents. No difference between medical students and junior residents, nor between senior residents and attending faculty.</p></caption><graphic xlink:href="40463_2014_40_Fig4_HTML" id="MO4"></graphic></fig><fig id="Fig5"><label>Figure 5</label><caption><p><bold>Path length (Distance travelled within nasal cavity).</bold> The graph represents means +/- SD. Statistically significant difference between junior residents and senior resident for both the endoscope (<italic>p</italic> < 0.001) and the microdebrider (<italic>p</italic> < 0.001). No difference between medical students and junior residents, nor between senior residents and attending faculty.</p></caption><graphic xlink:href="40463_2014_40_Fig5_HTML" id="MO5"></graphic></fig></p><p>The average fluctuation in distance between the tips of the endoscope and the microdebrider for the medical students, junior residents, senior residents and attending faculty were 12.64 ± 3.04 mm, 12.23 ± 3.91 mm, 9.91 ± 2.45 mm and 6.98 ± 2.39 mm, respectively. There was a statistically significant difference between junior residents and senior residents (<italic>p</italic> < 0.01). A graphical illustration of distance between tool tips for users of different levels of expertise is presented in Figure <xref rid="Fig6" ref-type="fig">6</xref>.<fig id="Fig6"><label>Figure 6</label><caption><p><bold>Distance between tool tips through the simulation tasks.</bold> The senior residents and attending faculty demonstrate far less fluctuation than medical students and junior residents.</p></caption><graphic xlink:href="40463_2014_40_Fig6_HTML" id="MO6"></graphic></fig></p><p>The frequencies of activation of the microdebrider pedal for medical students, junior residents, senior residents and attending faculty were 188 ± 65, 173 ± 64, 87 ± 37 and 104 ± 17 times, respectively. There was a significant difference between junior residents and senior residents (<italic>p</italic> < 0.001). With regards to the frequency of use of the endonasal wash, there was a tendency towards less use with increased training: 17 ± 12, 12 ± 10, 7 ± 3 and 2 ± 2 times, respectively. Again, there was a statistically significant difference between junior residents and senior residents (<italic>p</italic> < 0.01) for these metrics.</p><p>All the metrics related to efficiency showed a difference between junior residents and senior residents. However, there were no significant differences between medical students and junior residents, nor between senior residents and attending faculty.</p></sec><sec id="Sec15"><title>Safety</title><p>With regards to violation of the no-go zones (Figure <xref rid="Fig7" ref-type="fig">7</xref>), there was a significant difference between junior residents and senior residents with regards to the percentage of lamina papyracea mucosa removed (<italic>p</italic> < 0.005). With respect to the skull base, all four groups removed a minute amount of tissue (<0.25%), with no significant difference (<italic>p</italic> > 0.05). Medical students and junior residents removed 0.02% and 0.08% of the mucosa surrounding the optico-carotid recess, whereas seniors and attending faculty had no contact with that region.<fig id="Fig7"><label>Figure 7</label><caption><p><bold>Percentage of no-go zones removed.</bold> The graph represents means. Statistically significant difference between junior residents and senior residents for the percentage of lamina papyracea removed (<italic>p</italic> < 0.005). No difference between medical students and junior residents, nor between senior residents and attending faculty. No statistical difference for other no-go zones.</p></caption><graphic xlink:href="40463_2014_40_Fig7_HTML" id="MO7"></graphic></fig></p><p>Medical students and junior residents applied a maximal force of 0.75 ± 0.67 N and 0.15 ± 0.31 N on the lamina papyracea, respectively. The senior residents and attending faculty applied a negligible force on the lamina. The maximal force applied on the skull base was 0.93 ± 0.54 N, 0.53 ± 0.68 N, 0.24 ± 0.49 N and 0 N, respectively, with increasing level of training. The only significant differences were between junior residents and senior residents (<italic>p</italic> < 0.05).</p></sec></sec></sec><sec id="Sec16" sec-type="discussion"><title>Discussion</title><p>Attributes available on the MSESS include increasing task difficulties, blurring of the camera field with tissue contact, an endonasal wash function, a microdebrider, and mobility of the nasal tissues. Compared to previous sinus simulators, we believe that a combination of these attributes allow the user to experience a more realistic, higher fidelity physical and visual environment. Furthermore, measurement of performance metrics from both hands independently, including measures of bimanual dexterity, as well as the ability to identify contact with danger zones allow a more elaborate performance assessment.</p><p>Given the lack of available ESS simulators with enough data supporting validity as a training tool, the current initial validation study of the MSESS is the first step towards filling this void. In fact, we demonstrated that participants from all levels of training found the simulator to be realistic in terms of visual appearance and content. They also responded that the simulator allowed them to practice the technical skills required for ESS. Furthermore, through analysis of the performance metrics, not unexpectedly, novices fared significantly worse than senior surgeons in measures of operative efficiency, which echoes previous reports in studies of surgical simulators [<xref ref-type="bibr" rid="CR22">22</xref>,<xref ref-type="bibr" rid="CR23">23</xref>]. Similarly, within the field of ESS simulation, Edmond showed that novice surgeons without ESS experience performed worse on simulation training [<xref ref-type="bibr" rid="CR24">24</xref>].</p><p>The inability of the performance metrics to differentiate medical students from junior residents is likely related to the fact that residents do not routinely perform ESS until their senior years. Moreover, the lack of difference between senior residents and attending faculty on the performance metrics may be related to the small number of attending faculty (n = 3), as some metrics, namely those related to efficiency, demonstrated a tendency towards improved performance by the attending faculty compared to senior residents. Nevertheless, these findings may indicate that the learning curve for performing simple ESS tasks is relatively steep and that the MSESS may be most valuable for junior residents prior to direct patient contact.</p><p>Research has demonstrated that recognition of anatomy with an endoscopic view is one of the more challenging parts of ESS [<xref ref-type="bibr" rid="CR25">25</xref>]. In fact, authors have reported that a strong familiarity with intranasal 3D relationships and spatial boundaries are more vital for operative success than the technical skills of sinus surgery [<xref ref-type="bibr" rid="CR1">1</xref>,<xref ref-type="bibr" rid="CR24">24</xref>] Thus, one of the main focuses during the development of the MSESS was to develop a simulated nasal model that was as realistic as possible, reflected by the participants’ high assessment scores on the questionnaire.</p><p>Furthermore, the MSESS was tailored to help train users on complex technical skills, such as bimanual dexterity and hand-eye coordination, which are prerequisite skills for ESS [<xref ref-type="bibr" rid="CR2">2</xref>]. The fact that there was decreasing fluctuation in the distance between the two tool tips with increasing degree of experience suggests that there is a notable learning curve for bimanual dexterity, which has previously been shown to vary with level of expertise [<xref ref-type="bibr" rid="CR26">26</xref>]. In fact, Narazaki et al. demonstrated that experts outperformed novices in terms of bimanual dexterity skills significantly on a laparoscopic surgery simulator and advocated for its’ testing as a means to objectively assess the proficiency of a surgeon [<xref ref-type="bibr" rid="CR27">27</xref>].</p><p>In order to demonstrate validity as an educational tool, many studies on simulators have aimed to show a difference between users of different degrees of experience [<xref ref-type="bibr" rid="CR28">28</xref>]. The latter shows that the simulator actually measures the technical skills that are intended to be measured [<xref ref-type="bibr" rid="CR2">2</xref>]. Previous simulators have demonstrated this metric in support of “construct validity”, including simulators for surgical skills in laparoscopic surgery [<xref ref-type="bibr" rid="CR29">29</xref>], bone sawing skills [<xref ref-type="bibr" rid="CR30">30</xref>], neurosurgery [<xref ref-type="bibr" rid="CR20">20</xref>] and ESS [<xref ref-type="bibr" rid="CR9">9</xref>,<xref ref-type="bibr" rid="CR31">31</xref>], as well as diagnostic skills such as coronary angiography [<xref ref-type="bibr" rid="CR32">32</xref>], obstetrical ultrasonography [<xref ref-type="bibr" rid="CR33">33</xref>] and colonoscopy [<xref ref-type="bibr" rid="CR34">34</xref>].</p><p>The performance metrics recorded by the MSESS – divided into measures of quality, efficiency and safety – allowed us to test this form of validity. With regards to quality, users across all groups removed similar percentages of the anterior and posterior ethmoids. This is not surprising as removing tissue is not a difficult task in and of itself, but doing so efficiently and safely differentiates a novice from an experienced surgeon. Furthermore, a notable tendency was observed towards increasing extent of the sphenoidotomy with advancing level of expertise, most likely explained by the fact that more experienced surgeons had a heightened awareness of what is safe to remove in the sphenoid sinus and what are danger zones for injury to critical structures such as the optic nerve and carotid artery. In contrast, junior surgeons are more apprehensive in this region and thus elect to be more conservative.</p><p>Moreover, despite this suspected apprehensiveness demonstrated by juniors, users in the medical students and junior residents groups made contact with “no-go” zones such as the lamina papyracea and optico-carotid recess more commonly. Edmond demonstrated that the most discriminating performance factor during the novice mode on a previous ESS simulator was the ability to avoid hazards [<xref ref-type="bibr" rid="CR24">24</xref>], which is a skill that senior surgeons learn with experience and thorough anatomy knowledge. Through recognition of these errors, novice surgeons may learn to avoid trauma to collateral tissue. In fact, decreased tissue injury during technical skills assessments after training on VR simulators has previously been demonstrated [<xref ref-type="bibr" rid="CR7">7</xref>].</p><p>Endoscopic sinus surgeons are cognizant of the fact that the lamina papyracea and skull base are sensitive areas due to their fragility as well as the structures that they protect, thus it is important to be able to measure the amount of force that is applied upon them by our tools. Our study demonstrated that there was a significant difference in the maximal force applied between novice surgeons and more senior surgeons. The importance of force measurements also highlights a pitfall of training on cadaveric tissues, which do not adequately estimate the force necessary to perform endoscopic sinus procedures [<xref ref-type="bibr" rid="CR6">6</xref>] and thus, do not show trainees the acceptable force allowed during ESS. Although novice surgeons applied more force in our study, the next step would be to determine the critical amount of force that would be needed to cause damage and assess whether the increased force applied by junior surgeons is truly clinically dangerous.</p><p>The benefits of simulation training are highlighted by the difference in efficiency between junior and senior surgeons. Simulation training allows residents to be more efficient, thus saving time in the operating room, where time is limited and expensive [<xref ref-type="bibr" rid="CR35">35</xref>]. The premise of training on the MSESS is that if a junior can practice ESS on the simulator, he begins hands-on training at an earlier stage, prior to direct patient contact [<xref ref-type="bibr" rid="CR24">24</xref>] and thus is better prepared when in the operating room. Furthermore, with decreased resident working hours [<xref ref-type="bibr" rid="CR36">36</xref>], it is even more essential to have alternative methods for junior surgeons to practice their technical skills.</p></sec><sec id="Sec17" sec-type="conclusion"><title>Conclusion</title><p>The MSESS demonstrated initial evidence supporting its use for residency education with regards to being a realistic and useful training tool. The performance metrics relating to quality, efficiency and safety also demonstrated a dichotomy between novice and senior surgeons. The next step in this validation process will be to compare the MSESS to other teaching modalities, including cadaveric dissection which is currently the gold standard of ESS training; to assess the predictive validity of the MSESS; and to demonstrate translation of technical skills in the setting of live patient interactions.</p></sec></body><back><fn-group><fn><p><bold>Competing interests</bold></p><p>The National Research Council of Canada has property rights to the MSESS. The senior author and the Department of Otolaryngology – Head and Neck Surgery of McGill University have no financial competing interests with this study.</p></fn><fn><p><bold>Authors’ contributions</bold></p><p>RV: Study design, creation and development of the MSESS, data collection, data analysis, manuscript preparation. SF: Study design, creation and development of the MSESS, manuscript preparation. LHPN: Study design, data analysis and interpretation, manuscript preparation. RDM: Study design, creation and development of the performance metrics, study coordination. AZ: Creation and development of the MSESS, data analysis, manuscript preparation. ES: Data analysis, creation of software to analyze the raw data into meaningful data, analysis of performance metrics. WRJF: Data analysis, creation of software to analyze the raw data into meaningful data, analysis of performance metrics. NRC: Creation and development of the MSESS, creation of performance metrics. MAT: Study design, creation and development of the MSESS, data collection, data analysis and interpretation, manuscript preparation. All authors read and approved the final manuscript.</p></fn></fn-group><ack><title>Acknowledgements</title><p>We would like to thank The National Research Council of Canada Engineering team (J. Hovdebo, N. Choudhury, P. Debergue, G. DeLuca, D. Jiang, V. Pazos, O. Comas, A. Neubauer, A. Cabral, D. Laroche, F. Thibault and R. DiRaddo) for their significant contribution in the development of the high fidelity simulator and performance metrics.</p><sec id="d30e1488"><title>Funding sources</title><p>This work was supported by the Franco Di Giovanni Foundation, the B-Strong Foundation, the Tony Colannino Foundation, the English Montreal School Board, the Montreal Neurological Institute and Hospital, and the McGill Head & Neck Cancer Fund.</p></sec></ack><ref-list id="Bib1"><title>References</title><ref id="CR1"><label>1.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Arora</surname><given-names>H</given-names></name><name><surname>Uribe</surname><given-names>J</given-names></name><name><surname>Ralph</surname><given-names>W</given-names></name><name><surname>Zeltsan</surname><given-names>M</given-names></name><name><surname>Cuellar</surname><given-names>H</given-names></name><name><surname>Gallagher</surname><given-names>A</given-names></name><name><surname>Fried</surname><given-names>MP</given-names></name></person-group><article-title>Assessment of construct validity of the endoscopic sinus surgery simulator</article-title><source>Arch Otolaryngol Head Neck Surg</source><year>2005</year><volume>131</volume><fpage>217</fpage><lpage>221</lpage><pub-id pub-id-type="doi">10.1001/archotol.131.3.217</pub-id><pub-id pub-id-type="pmid">15781761</pub-id></element-citation></ref><ref id="CR2"><label>2.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Fried</surname><given-names>MP</given-names></name><name><surname>Satava</surname><given-names>R</given-names></name><name><surname>Weghorst</surname><given-names>S</given-names></name><name><surname>Gallagher</surname><given-names>AG</given-names></name><name><surname>Sasaki</surname><given-names>C</given-names></name><name><surname>Ross</surname><given-names>D</given-names></name><name><surname>Sinanan</surname><given-names>M</given-names></name><name><surname>Uribe</surname><given-names>JI</given-names></name><name><surname>Zeltsan</surname><given-names>M</given-names></name><name><surname>Arora</surname><given-names>H</given-names></name><name><surname>Cuellar</surname><given-names>H</given-names></name></person-group><article-title>Identifying and reducing errors with surgical simulation</article-title><source>Qual Saf Health Care</source><year>2004</year><volume>13</volume><issue>Suppl 1</issue><fpage>i19</fpage><lpage>i26</lpage><pub-id pub-id-type="doi">10.1136/qshc.2004.009969</pub-id><pub-id pub-id-type="pmid">15465950</pub-id></element-citation></ref><ref id="CR3"><label>3.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Fried</surname><given-names>MP</given-names></name><name><surname>Sadoughi</surname><given-names>B</given-names></name><name><surname>Gibber</surname><given-names>MJ</given-names></name><name><surname>Jacobs</surname><given-names>JB</given-names></name><name><surname>Lebowitz</surname><given-names>RA</given-names></name><name><surname>Ross</surname><given-names>DA</given-names></name><name><surname>Bent</surname><given-names>JP</given-names><suffix>3rd</suffix></name><name><surname>Parikh</surname><given-names>SR</given-names></name><name><surname>Sasaki</surname><given-names>CT</given-names></name><name><surname>Schaefer</surname><given-names>SD</given-names></name></person-group><article-title>From virtual reality to the operating room: the endoscopic sinus surgery simulator experiment</article-title><source>Otolaryngol Head Neck Surg</source><year>2010</year><volume>142</volume><fpage>202</fpage><lpage>207</lpage><pub-id pub-id-type="doi">10.1016/j.otohns.2009.11.023</pub-id><pub-id pub-id-type="pmid">20115975</pub-id></element-citation></ref><ref id="CR4"><label>4.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gross</surname><given-names>RD</given-names></name><name><surname>Sheridan</surname><given-names>MF</given-names></name><name><surname>Burgess</surname><given-names>LP</given-names></name></person-group><article-title>Endoscopic sinus surgery complications in residency</article-title><source>Laryngoscope</source><year>1997</year><volume>107</volume><fpage>1080</fpage><lpage>1085</lpage><pub-id pub-id-type="doi">10.1097/00005537-199708000-00014</pub-id><pub-id pub-id-type="pmid">9261012</pub-id></element-citation></ref><ref id="CR5"><label>5.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Neubauer</surname><given-names>A</given-names></name><name><surname>Wolfsberger</surname><given-names>S</given-names></name><name><surname>Forster</surname><given-names>MT</given-names></name><name><surname>Mroz</surname><given-names>L</given-names></name><name><surname>Wegenkittl</surname><given-names>R</given-names></name><name><surname>Buhler</surname><given-names>K</given-names></name></person-group><article-title>Advanced virtual endoscopic pituitary surgery</article-title><source>IEEE Trans Vis Comput Graph</source><year>2005</year><volume>11</volume><fpage>497</fpage><lpage>507</lpage><pub-id pub-id-type="doi">10.1109/TVCG.2005.70</pub-id><pub-id pub-id-type="pmid">16144247</pub-id></element-citation></ref><ref id="CR6"><label>6.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Joice</surname><given-names>P</given-names></name><name><surname>Ross</surname><given-names>PD</given-names></name><name><surname>Wang</surname><given-names>D</given-names></name><name><surname>Abel</surname><given-names>EW</given-names></name><name><surname>White</surname><given-names>PS</given-names></name></person-group><article-title>Measurement of osteotomy force during endoscopic sinus surgery</article-title><source>Allergy Rhinol</source><year>2012</year><volume>3</volume><fpage>e61</fpage><lpage>e65</lpage><pub-id pub-id-type="doi">10.2500/ar.2012.3.0032</pub-id></element-citation></ref><ref id="CR7"><label>7.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Zhao</surname><given-names>YC</given-names></name><name><surname>Kennedy</surname><given-names>G</given-names></name><name><surname>Yukawa</surname><given-names>K</given-names></name><name><surname>Pyman</surname><given-names>B</given-names></name><name><surname>O'Leary</surname><given-names>S</given-names></name></person-group><article-title>Can virtual reality simulator be used as a training aid to improve cadaver temporal bone dissection? Results of a randomized blinded control trial</article-title><source>Laryngoscope</source><year>2011</year><volume>121</volume><fpage>831</fpage><lpage>837</lpage><pub-id pub-id-type="doi">10.1002/lary.21287</pub-id><pub-id pub-id-type="pmid">21433021</pub-id></element-citation></ref><ref id="CR8"><label>8.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Hogle</surname><given-names>NJ</given-names></name><name><surname>Widmann</surname><given-names>WD</given-names></name><name><surname>Ude</surname><given-names>AO</given-names></name><name><surname>Hardy</surname><given-names>MA</given-names></name><name><surname>Fowler</surname><given-names>DL</given-names></name></person-group><article-title>Does training novices to criteria and does rapid acquisition of skills on laparoscopic simulators have predictive validity or are we just playing video games?</article-title><source>J Surg Educ</source><year>2008</year><volume>65</volume><fpage>431</fpage><lpage>435</lpage><pub-id pub-id-type="doi">10.1016/j.jsurg.2008.05.008</pub-id><pub-id pub-id-type="pmid">19059173</pub-id></element-citation></ref><ref id="CR9"><label>9.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Fried</surname><given-names>MP</given-names></name><name><surname>Sadoughi</surname><given-names>B</given-names></name><name><surname>Weghorst</surname><given-names>SJ</given-names></name><name><surname>Zeltsan</surname><given-names>M</given-names></name><name><surname>Cuellar</surname><given-names>H</given-names></name><name><surname>Uribe</surname><given-names>JI</given-names></name><name><surname>Sasaki</surname><given-names>CT</given-names></name><name><surname>Ross</surname><given-names>DA</given-names></name><name><surname>Jacobs</surname><given-names>JB</given-names></name><name><surname>Lebowitz</surname><given-names>RA</given-names></name><name><surname>Satava</surname><given-names>RM</given-names></name></person-group><article-title>Construct validity of the endoscopic sinus surgery simulator: II. Assessment of discriminant validity and expert benchmarking</article-title><source>Arch Otolaryngol Head Neck Surg</source><year>2007</year><volume>133</volume><fpage>350</fpage><lpage>357</lpage><pub-id pub-id-type="doi">10.1001/archotol.133.4.350</pub-id><pub-id pub-id-type="pmid">17438249</pub-id></element-citation></ref><ref id="CR10"><label>10.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Beyer</surname><given-names>L</given-names></name><name><surname>Troyer</surname><given-names>JD</given-names></name><name><surname>Mancini</surname><given-names>J</given-names></name><name><surname>Bladou</surname><given-names>F</given-names></name><name><surname>Berdah</surname><given-names>SV</given-names></name><name><surname>Karsenty</surname><given-names>G</given-names></name></person-group><article-title>Impact of laparoscopy simulator training on the technical skills of future surgeons in the operating room: a prospective study</article-title><source>Am J Surg</source><year>2011</year><volume>202</volume><fpage>265</fpage><lpage>272</lpage><pub-id pub-id-type="doi">10.1016/j.amjsurg.2010.11.008</pub-id><pub-id pub-id-type="pmid">21658672</pub-id></element-citation></ref><ref id="CR11"><label>11.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Seymour</surname><given-names>NE</given-names></name><name><surname>Gallagher</surname><given-names>AG</given-names></name><name><surname>Roman</surname><given-names>SA</given-names></name><name><surname>O'Brien</surname><given-names>MK</given-names></name><name><surname>Bansal</surname><given-names>VK</given-names></name><name><surname>Andersen</surname><given-names>DK</given-names></name><name><surname>Satava</surname><given-names>RM</given-names></name></person-group><article-title>Virtual reality training improves operating room performance: results of a randomized, double-blinded study</article-title><source>Ann Surg</source><year>2002</year><volume>236</volume><fpage>458</fpage><lpage>463</lpage><pub-id pub-id-type="doi">10.1097/00000658-200210000-00008</pub-id><pub-id pub-id-type="pmid">12368674</pub-id></element-citation></ref><ref id="CR12"><label>12.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Park</surname><given-names>J</given-names></name><name><surname>MacRae</surname><given-names>H</given-names></name><name><surname>Musselman</surname><given-names>LJ</given-names></name><name><surname>Rossos</surname><given-names>P</given-names></name><name><surname>Hamstra</surname><given-names>SJ</given-names></name><name><surname>Wolman</surname><given-names>S</given-names></name><name><surname>Reznick</surname><given-names>RK</given-names></name></person-group><article-title>Randomized controlled trial of virtual reality simulator training: transfer to live patients</article-title><source>Am J Surg</source><year>2007</year><volume>194</volume><fpage>205</fpage><lpage>211</lpage><pub-id pub-id-type="doi">10.1016/j.amjsurg.2006.11.032</pub-id><pub-id pub-id-type="pmid">17618805</pub-id></element-citation></ref><ref id="CR13"><label>13.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Francis</surname><given-names>HW</given-names></name><name><surname>Malik</surname><given-names>MU</given-names></name><name><surname>Diaz Voss Varela</surname><given-names>DA</given-names></name><name><surname>Barffour</surname><given-names>MA</given-names></name><name><surname>Chien</surname><given-names>WW</given-names></name><name><surname>Carey</surname><given-names>JP</given-names></name><name><surname>Niparko</surname><given-names>JK</given-names></name><name><surname>Bhatti</surname><given-names>NI</given-names></name></person-group><article-title>Technical skills improve after practice on virtual-reality temporal bone simulator</article-title><source>Laryngoscope</source><year>2012</year><volume>122</volume><fpage>1385</fpage><lpage>1391</lpage><pub-id pub-id-type="doi">10.1002/lary.22378</pub-id><pub-id pub-id-type="pmid">22487895</pub-id></element-citation></ref><ref id="CR14"><label>14.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Zhao</surname><given-names>YC</given-names></name><name><surname>Kennedy</surname><given-names>G</given-names></name><name><surname>Yukawa</surname><given-names>K</given-names></name><name><surname>Pyman</surname><given-names>B</given-names></name><name><surname>O'Leary</surname><given-names>S</given-names></name></person-group><article-title>Improving temporal bone dissection using self-directed virtual reality simulation: results of a randomized blinded control trial</article-title><source>Otolaryngol Head Neck Surg</source><year>2011</year><volume>144</volume><fpage>357</fpage><lpage>364</lpage><pub-id pub-id-type="doi">10.1177/0194599810391624</pub-id><pub-id pub-id-type="pmid">21493196</pub-id></element-citation></ref><ref id="CR15"><label>15.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Wiet</surname><given-names>GJ</given-names></name><name><surname>Stredney</surname><given-names>D</given-names></name><name><surname>Wan</surname><given-names>D</given-names></name></person-group><article-title>Training and simulation in otolaryngology</article-title><source>Otolaryngol Clin North Am</source><year>2011</year><volume>44</volume><fpage>1333</fpage><lpage>1350</lpage><pub-id pub-id-type="doi">10.1016/j.otc.2011.08.009</pub-id><pub-id pub-id-type="pmid">22032486</pub-id></element-citation></ref><ref id="CR16"><label>16.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Caversaccio</surname><given-names>M</given-names></name><name><surname>Eichenberger</surname><given-names>A</given-names></name><name><surname>Hausler</surname><given-names>R</given-names></name></person-group><article-title>Virtual simulator as a training tool for endonasal surgery</article-title><source>Am J Rhinol</source><year>2003</year><volume>17</volume><fpage>283</fpage><lpage>290</lpage><pub-id pub-id-type="pmid">14599132</pub-id></element-citation></ref><ref id="CR17"><label>17.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Tolsdorff</surname><given-names>B</given-names></name><name><surname>Pommert</surname><given-names>A</given-names></name><name><surname>Hohne</surname><given-names>KH</given-names></name><name><surname>Petersik</surname><given-names>A</given-names></name><name><surname>Pflesser</surname><given-names>B</given-names></name><name><surname>Tiede</surname><given-names>U</given-names></name><name><surname>Leuwer</surname><given-names>R</given-names></name></person-group><article-title>Virtual reality: a new paranasal sinus surgery simulator</article-title><source>Laryngoscope</source><year>2010</year><volume>120</volume><fpage>420</fpage><lpage>426</lpage><pub-id pub-id-type="pmid">20013851</pub-id></element-citation></ref><ref id="CR18"><label>18.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Delorme</surname><given-names>S</given-names></name><name><surname>Laroche</surname><given-names>D</given-names></name><name><surname>DiRaddo</surname><given-names>R</given-names></name><name><surname>Del Maestro</surname><given-names>RF</given-names></name></person-group><article-title>NeuroTouch: a physics-based virtual simulator for cranial microneurosurgery training</article-title><source>Neurosurgery</source><year>2012</year><volume>71</volume><fpage>32</fpage><lpage>42</lpage><pub-id pub-id-type="doi">10.1227/NEU.0b013e318249c744</pub-id><pub-id pub-id-type="pmid">22233921</pub-id></element-citation></ref><ref id="CR19"><label>19.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Rosseau</surname><given-names>G</given-names></name><name><surname>Bailes</surname><given-names>J</given-names></name><name><surname>del Maestro</surname><given-names>R</given-names></name><name><surname>Cabral</surname><given-names>A</given-names></name><name><surname>Choudhury</surname><given-names>N</given-names></name><name><surname>Comas</surname><given-names>O</given-names></name><name><surname>Debergue</surname><given-names>P</given-names></name><name><surname>De Luca</surname><given-names>G</given-names></name><name><surname>Hovdebo</surname><given-names>J</given-names></name><name><surname>Jiang</surname><given-names>D</given-names></name><name><surname>Laroche</surname><given-names>D</given-names></name><name><surname>Neubauer</surname><given-names>A</given-names></name><name><surname>Pazos</surname><given-names>V</given-names></name><name><surname>Thibault</surname><given-names>F</given-names></name><name><surname>Diraddo</surname><given-names>R</given-names></name></person-group><article-title>The development of a virtual simulator for training neurosurgeons to perform and perfect endoscopic endonasal transsphenoidal surgery</article-title><source>Neurosurgery</source><year>2013</year><volume>73</volume><issue>Suppl 1</issue><fpage>85</fpage><lpage>93</lpage><pub-id pub-id-type="doi">10.1227/NEU.0000000000000112</pub-id><pub-id pub-id-type="pmid">24051889</pub-id></element-citation></ref><ref id="CR20"><label>20.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gelinas-Phaneuf</surname><given-names>N</given-names></name><name><surname>Choudhury</surname><given-names>N</given-names></name><name><surname>Al-Habib</surname><given-names>AR</given-names></name><name><surname>Cabral</surname><given-names>A</given-names></name><name><surname>Nadeau</surname><given-names>E</given-names></name><name><surname>Mora</surname><given-names>V</given-names></name><name><surname>Pazos</surname><given-names>V</given-names></name><name><surname>Debergue</surname><given-names>P</given-names></name><name><surname>Diraddo</surname><given-names>R</given-names></name><name><surname>Del Maestro</surname><given-names>RF</given-names></name></person-group><article-title>Assessing performance in brain tumor resection using a novel virtual reality simulator</article-title><source>Int J Comput Assist Radiol Surg</source><year>2013</year><volume>9</volume><issue>1</issue><fpage>1</fpage><lpage>9</lpage><pub-id pub-id-type="doi">10.1007/s11548-013-0905-8</pub-id><pub-id pub-id-type="pmid">23784222</pub-id></element-citation></ref><ref id="CR21"><label>21.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Stankiewicz</surname><given-names>J</given-names></name></person-group><article-title>Complications of microdebriders in endoscopic nasal and sinus surgery</article-title><source>Curr Opin Otolaryngol Head Neck Surg</source><year>2002</year><volume>10</volume><fpage>26</fpage><lpage>28</lpage><pub-id pub-id-type="doi">10.1097/00020840-200202000-00007</pub-id></element-citation></ref><ref id="CR22"><label>22.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Hofstad</surname><given-names>EF</given-names></name><name><surname>Vapenstad</surname><given-names>C</given-names></name><name><surname>Chmarra</surname><given-names>MK</given-names></name><name><surname>Lango</surname><given-names>T</given-names></name><name><surname>Kuhry</surname><given-names>E</given-names></name><name><surname>Marvik</surname><given-names>R</given-names></name></person-group><article-title>A study of psychomotor skills in minimally invasive surgery: what differentiates expert and nonexpert performance</article-title><source>Surg Endosc</source><year>2013</year><volume>27</volume><fpage>854</fpage><lpage>863</lpage><pub-id pub-id-type="doi">10.1007/s00464-012-2524-9</pub-id><pub-id pub-id-type="pmid">23052505</pub-id></element-citation></ref><ref id="CR23"><label>23.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Pellen</surname><given-names>MG</given-names></name><name><surname>Horgan</surname><given-names>LF</given-names></name><name><surname>Barton</surname><given-names>JR</given-names></name><name><surname>Attwood</surname><given-names>SE</given-names></name></person-group><article-title>Construct validity of the ProMIS laparoscopic simulator</article-title><source>Surg Endosc</source><year>2009</year><volume>23</volume><fpage>130</fpage><lpage>139</lpage><pub-id pub-id-type="doi">10.1007/s00464-008-0066-y</pub-id><pub-id pub-id-type="pmid">18648875</pub-id></element-citation></ref><ref id="CR24"><label>24.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Edmond</surname><given-names>CV</given-names><suffix>Jr</suffix></name></person-group><article-title>Impact of the endoscopic sinus surgical simulator on operating room performance</article-title><source>Laryngoscope</source><year>2002</year><volume>112</volume><fpage>1148</fpage><lpage>1158</lpage><pub-id pub-id-type="doi">10.1097/00005537-200207000-00002</pub-id><pub-id pub-id-type="pmid">12169890</pub-id></element-citation></ref><ref id="CR25"><label>25.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bakker</surname><given-names>NH</given-names></name><name><surname>Fokkens</surname><given-names>WJ</given-names></name><name><surname>Grimbergen</surname><given-names>CA</given-names></name></person-group><article-title>Investigation of training needs for functional endoscopic sinus surgery (FESS)</article-title><source>Rhinology</source><year>2005</year><volume>43</volume><fpage>104</fpage><lpage>108</lpage><pub-id pub-id-type="pmid">16008064</pub-id></element-citation></ref><ref id="CR26"><label>26.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Hung</surname><given-names>AJ</given-names></name><name><surname>Ng</surname><given-names>CK</given-names></name><name><surname>Patil</surname><given-names>MB</given-names></name><name><surname>Zehnder</surname><given-names>P</given-names></name><name><surname>Huang</surname><given-names>E</given-names></name><name><surname>Aron</surname><given-names>M</given-names></name><name><surname>Gill</surname><given-names>IS</given-names></name><name><surname>Desai</surname><given-names>MM</given-names></name></person-group><article-title>Validation of a novel robotic-assisted partial nephrectomy surgical training model</article-title><source>BJU Int</source><year>2012</year><volume>110</volume><fpage>870</fpage><lpage>874</lpage><pub-id pub-id-type="doi">10.1111/j.1464-410X.2012.10953.x</pub-id><pub-id pub-id-type="pmid">22313582</pub-id></element-citation></ref><ref id="CR27"><label>27.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Narazaki</surname><given-names>K</given-names></name><name><surname>Oleynikov</surname><given-names>D</given-names></name><name><surname>Stergiou</surname><given-names>N</given-names></name></person-group><article-title>Objective assessment of proficiency with bimanual inanimate tasks in robotic laparoscopy</article-title><source>J Laparoendosc Adv Surg Tech A</source><year>2007</year><volume>17</volume><fpage>47</fpage><lpage>52</lpage><pub-id pub-id-type="doi">10.1089/lap.2006.05101</pub-id><pub-id pub-id-type="pmid">17362179</pub-id></element-citation></ref><ref id="CR28"><label>28.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Downing</surname><given-names>SM</given-names></name></person-group><article-title>Validity: on meaningful interpretation of assessment data</article-title><source>Med Educ</source><year>2003</year><volume>37</volume><fpage>830</fpage><lpage>837</lpage><pub-id pub-id-type="doi">10.1046/j.1365-2923.2003.01594.x</pub-id><pub-id pub-id-type="pmid">14506816</pub-id></element-citation></ref><ref id="CR29"><label>29.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Rivard</surname><given-names>JD</given-names></name><name><surname>Vergis</surname><given-names>AS</given-names></name><name><surname>Unger</surname><given-names>BJ</given-names></name><name><surname>Hardy</surname><given-names>KM</given-names></name><name><surname>Andrew</surname><given-names>CG</given-names></name><name><surname>Gillman</surname><given-names>LM</given-names></name><name><surname>Park</surname><given-names>J</given-names></name></person-group><article-title>Construct validity of individual and summary performance metrics associated with a computer-based laparoscopic simulator</article-title><source>Surg Endosc</source><year>2014</year><volume>28</volume><issue>6</issue><fpage>1921</fpage><lpage>1928</lpage><pub-id pub-id-type="doi">10.1007/s00464-013-3414-5</pub-id><pub-id pub-id-type="pmid">24442685</pub-id></element-citation></ref><ref id="CR30"><label>30.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Lin</surname><given-names>Y</given-names></name><name><surname>Wang</surname><given-names>X</given-names></name><name><surname>Wu</surname><given-names>F</given-names></name><name><surname>Chen</surname><given-names>X</given-names></name><name><surname>Wang</surname><given-names>C</given-names></name><name><surname>Shen</surname><given-names>G</given-names></name></person-group><article-title>Development and validation of a surgical training simulator with haptic feedback for learning bone-sawing skill</article-title><source>J Biomed Inform</source><year>2013</year><volume>48</volume><fpage>122</fpage><lpage>129</lpage><pub-id pub-id-type="doi">10.1016/j.jbi.2013.12.010</pub-id><pub-id pub-id-type="pmid">24380817</pub-id></element-citation></ref><ref id="CR31"><label>31.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Steehler</surname><given-names>MK</given-names></name><name><surname>Pfisterer</surname><given-names>MJ</given-names></name><name><surname>Na</surname><given-names>H</given-names></name><name><surname>Hesham</surname><given-names>HN</given-names></name><name><surname>Pehlivanova</surname><given-names>M</given-names></name><name><surname>Malekzadeh</surname><given-names>S</given-names></name></person-group><article-title>Face, content, and construct validity of a low-cost sinus surgery task trainer</article-title><source>Otolaryngol Head Neck Surg</source><year>2012</year><volume>146</volume><fpage>504</fpage><lpage>509</lpage><pub-id pub-id-type="doi">10.1177/0194599811430187</pub-id><pub-id pub-id-type="pmid">22114312</pub-id></element-citation></ref><ref id="CR32"><label>32.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Jensen</surname><given-names>UJ</given-names></name><name><surname>Jensen</surname><given-names>J</given-names></name><name><surname>Olivecrona</surname><given-names>GK</given-names></name><name><surname>Ahlberg</surname><given-names>G</given-names></name><name><surname>Tornvall</surname><given-names>P</given-names></name></person-group><article-title>Technical skills assessment in a coronary angiography simulator for construct validation</article-title><source>Simul Healthc</source><year>2013</year><volume>8</volume><fpage>324</fpage><lpage>328</lpage><pub-id pub-id-type="doi">10.1097/SIH.0b013e31828fdedc</pub-id><pub-id pub-id-type="pmid">23598862</pub-id></element-citation></ref><ref id="CR33"><label>33.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Burden</surname><given-names>C</given-names></name><name><surname>Preshaw</surname><given-names>J</given-names></name><name><surname>White</surname><given-names>P</given-names></name><name><surname>Draycott</surname><given-names>TJ</given-names></name><name><surname>Grant</surname><given-names>S</given-names></name><name><surname>Fox</surname><given-names>R</given-names></name></person-group><article-title>Validation of virtual reality simulation for obstetric ultrasonography: a prospective cross-sectional study</article-title><source>Simul Healthc</source><year>2012</year><volume>7</volume><fpage>269</fpage><lpage>273</lpage><pub-id pub-id-type="doi">10.1097/SIH.0b013e3182611844</pub-id><pub-id pub-id-type="pmid">22878584</pub-id></element-citation></ref><ref id="CR34"><label>34.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Plooy</surname><given-names>AM</given-names></name><name><surname>Hill</surname><given-names>A</given-names></name><name><surname>Horswill</surname><given-names>MS</given-names></name><name><surname>Cresp</surname><given-names>AS</given-names></name><name><surname>Watson</surname><given-names>MO</given-names></name><name><surname>Ooi</surname><given-names>SY</given-names></name><name><surname>Riek</surname><given-names>S</given-names></name><name><surname>Wallis</surname><given-names>GM</given-names></name><name><surname>Burgess-Limerick</surname><given-names>R</given-names></name><name><surname>Hewett</surname><given-names>DG</given-names></name></person-group><article-title>Construct validation of a physical model colonoscopy simulator</article-title><source>Gastrointest Endosc</source><year>2012</year><volume>76</volume><fpage>144</fpage><lpage>150</lpage><pub-id pub-id-type="doi">10.1016/j.gie.2012.03.246</pub-id><pub-id pub-id-type="pmid">22726473</pub-id></element-citation></ref><ref id="CR35"><label>35.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Schaefer</surname><given-names>JJ</given-names><suffix>3rd</suffix></name></person-group><article-title>Simulators and difficult airway management skills</article-title><source>Paediatr Anaesth</source><year>2004</year><volume>14</volume><fpage>28</fpage><lpage>37</lpage><pub-id pub-id-type="doi">10.1046/j.1460-9592.2003.01204.x</pub-id><pub-id pub-id-type="pmid">14717871</pub-id></element-citation></ref><ref id="CR36"><label>36.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Philibert</surname><given-names>I</given-names></name><name><surname>Friedmann</surname><given-names>P</given-names></name><name><surname>Williams</surname><given-names>WT</given-names></name><collab>Education AWGoRDHACfGM</collab></person-group><article-title>New requirements for resident duty hours</article-title><source>JAMA</source><year>2002</year><volume>288</volume><fpage>1112</fpage><lpage>1114</lpage><pub-id pub-id-type="doi">10.1001/jama.288.9.1112</pub-id><pub-id pub-id-type="pmid">12204081</pub-id></element-citation></ref></ref-list></back></pmc></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/HapticV1/Data/Pmc/Curation
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000857 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Pmc/Curation/biblio.hfd -nk 000857 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Ticri/CIDE
|area= HapticV1
|flux= Pmc
|étape= Curation
|type= RBID
|clé= PMC:4210497
|texte= The McGill simulator for endoscopic sinus surgery (MSESS): a validation study
}}
Pour générer des pages wiki
HfdIndexSelect -h $EXPLOR_AREA/Data/Pmc/Curation/RBID.i -Sk "pubmed:25927463" \
| HfdSelect -Kh $EXPLOR_AREA/Data/Pmc/Curation/biblio.hfd \
| NlmPubMed2Wicri -a HapticV1
| This area was generated with Dilib version V0.6.23. |  |