Automatic Scoring of Virtual Mastoidectomies Using Expert Examples
Identifieur interne : 001807 ( Pmc/Curation ); précédent : 001806; suivant : 001808Automatic Scoring of Virtual Mastoidectomies Using Expert Examples
Auteurs : Thomas Kerwin ; Gregory Wiet ; Don Stredney ; Han-Wei ShenSource :
- International Journal of Computer Assisted Radiology and Surgery [ 1861-6410 ] ; 2011.
Abstract
Automatic scoring of resident performance on a virtual mastoidectomy simulation system is needed to achieve consistent and efficient evaluations. By not requiring immediate expert intervention, the system provides a completely objective assessment of performance as well as a self-driven user assessment mechanism.
An iconic temporal bone with surgically important regions defined into a fully partitioned segmented dataset was created. Comparisons between expert-drilled bones and student-drilled bones were computed based on gradations with both Euclidean and Earth Mover’s Distance. Using the features derived from these comparisons, a decision tree was constructed. This decision tree was used to determine scores of resident surgical performance. The algorithm was applied on multiple expert comparison bones and the scores averaged to provide reliability metric.
The reliability metrics for the multi-grade scoring system are better in some cases than previously reported binary classification metrics. The two scoring methods given provide a trade-off between accuracy and speed.
Comparison of virtually drilled bones with expert examples on a voxel level provides sufficient information to score them and provide several specific quality metrics. By merging scores from different expert examples, two related metrics were developed; one is slightly faster and less accurate, while a second is more accurate but takes more processing time.
Url:
DOI: 10.1007/s11548-011-0566-4
PubMed: 21538158
PubMed Central: 3403744
Links toward previous steps (curation, corpus...)
- to stream Pmc, to step Corpus: Pour aller vers cette notice dans l'étape Curation :001807
Links to Exploration step
PMC:3403744Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">Automatic Scoring of Virtual Mastoidectomies Using Expert Examples</title>
<author><name sortKey="Kerwin, Thomas" sort="Kerwin, Thomas" uniqKey="Kerwin T" first="Thomas" last="Kerwin">Thomas Kerwin</name>
</author>
<author><name sortKey="Wiet, Gregory" sort="Wiet, Gregory" uniqKey="Wiet G" first="Gregory" last="Wiet">Gregory Wiet</name>
</author>
<author><name sortKey="Stredney, Don" sort="Stredney, Don" uniqKey="Stredney D" first="Don" last="Stredney">Don Stredney</name>
</author>
<author><name sortKey="Shen, Han Wei" sort="Shen, Han Wei" uniqKey="Shen H" first="Han-Wei" last="Shen">Han-Wei Shen</name>
</author>
</titleStmt>
<publicationStmt><idno type="wicri:source">PMC</idno>
<idno type="pmid">21538158</idno>
<idno type="pmc">3403744</idno>
<idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3403744</idno>
<idno type="RBID">PMC:3403744</idno>
<idno type="doi">10.1007/s11548-011-0566-4</idno>
<date when="2011">2011</date>
<idno type="wicri:Area/Pmc/Corpus">001807</idno>
<idno type="wicri:Area/Pmc/Curation">001807</idno>
</publicationStmt>
<sourceDesc><biblStruct><analytic><title xml:lang="en" level="a" type="main">Automatic Scoring of Virtual Mastoidectomies Using Expert Examples</title>
<author><name sortKey="Kerwin, Thomas" sort="Kerwin, Thomas" uniqKey="Kerwin T" first="Thomas" last="Kerwin">Thomas Kerwin</name>
</author>
<author><name sortKey="Wiet, Gregory" sort="Wiet, Gregory" uniqKey="Wiet G" first="Gregory" last="Wiet">Gregory Wiet</name>
</author>
<author><name sortKey="Stredney, Don" sort="Stredney, Don" uniqKey="Stredney D" first="Don" last="Stredney">Don Stredney</name>
</author>
<author><name sortKey="Shen, Han Wei" sort="Shen, Han Wei" uniqKey="Shen H" first="Han-Wei" last="Shen">Han-Wei Shen</name>
</author>
</analytic>
<series><title level="j">International Journal of Computer Assisted Radiology and Surgery</title>
<idno type="ISSN">1861-6410</idno>
<idno type="eISSN">1861-6429</idno>
<imprint><date when="2011">2011</date>
</imprint>
</series>
</biblStruct>
</sourceDesc>
</fileDesc>
<profileDesc><textClass></textClass>
</profileDesc>
</teiHeader>
<front><div type="abstract" xml:lang="en"><sec id="S1"><title>Purpose</title>
<p id="P1">Automatic scoring of resident performance on a virtual mastoidectomy simulation system is needed to achieve consistent and efficient evaluations. By not requiring immediate expert intervention, the system provides a completely objective assessment of performance as well as a self-driven user assessment mechanism.</p>
</sec>
<sec id="S2"><title>Methods</title>
<p id="P2">An iconic temporal bone with surgically important regions defined into a fully partitioned segmented dataset was created. Comparisons between expert-drilled bones and student-drilled bones were computed based on gradations with both Euclidean and Earth Mover’s Distance. Using the features derived from these comparisons, a decision tree was constructed. This decision tree was used to determine scores of resident surgical performance. The algorithm was applied on multiple expert comparison bones and the scores averaged to provide reliability metric.</p>
</sec>
<sec id="S3"><title>Results</title>
<p id="P3">The reliability metrics for the multi-grade scoring system are better in some cases than previously reported binary classification metrics. The two scoring methods given provide a trade-off between accuracy and speed.</p>
</sec>
<sec id="S4"><title>Conclusions</title>
<p id="P4">Comparison of virtually drilled bones with expert examples on a voxel level provides sufficient information to score them and provide several specific quality metrics. By merging scores from different expert examples, two related metrics were developed; one is slightly faster and less accurate, while a second is more accurate but takes more processing time.</p>
</sec>
</div>
</front>
</TEI>
<pmc article-type="research-article"><pmc-comment>The publisher of this article does not allow downloading of the full text in XML form.</pmc-comment>
<pmc-dir>properties manuscript</pmc-dir>
<front><journal-meta><journal-id journal-id-type="nlm-journal-id">101499225</journal-id>
<journal-id journal-id-type="pubmed-jr-id">36351</journal-id>
<journal-id journal-id-type="nlm-ta">Int J Comput Assist Radiol Surg</journal-id>
<journal-id journal-id-type="iso-abbrev">Int J Comput Assist Radiol Surg</journal-id>
<journal-title-group><journal-title>International Journal of Computer Assisted Radiology and Surgery</journal-title>
</journal-title-group>
<issn pub-type="ppub">1861-6410</issn>
<issn pub-type="epub">1861-6429</issn>
</journal-meta>
<article-meta><article-id pub-id-type="pmid">21538158</article-id>
<article-id pub-id-type="pmc">3403744</article-id>
<article-id pub-id-type="doi">10.1007/s11548-011-0566-4</article-id>
<article-id pub-id-type="manuscript">NIHMS390657</article-id>
<article-categories><subj-group subj-group-type="heading"><subject>Article</subject>
</subj-group>
</article-categories>
<title-group><article-title>Automatic Scoring of Virtual Mastoidectomies Using Expert Examples</article-title>
</title-group>
<contrib-group><contrib contrib-type="author"><name><surname>Kerwin</surname>
<given-names>Thomas</given-names>
</name>
<email>kerwin@osc.edu</email>
<email>kerwin@cse.ohio-state.edu</email>
<aff id="A1">Ohio Supercomputer Center, Columbus, Ohio, USA . Department of Computer Science and Engineering, Ohio State University, Columbus, Ohio, USA</aff>
</contrib>
<contrib contrib-type="author"><name><surname>Wiet</surname>
<given-names>Gregory</given-names>
</name>
<aff id="A2">Department of Otolaryngology and Biomedical Informatics, Nationwide Children’s Hospital, Columbus, Ohio, USA. The Ohio State University Medical Center, Columbus, Ohio, USA</aff>
<email>gregory.wiet@nationwidechildrens.org</email>
</contrib>
<contrib contrib-type="author"><name><surname>Stredney</surname>
<given-names>Don</given-names>
</name>
<aff id="A3">Ohio Supercomputer Center, Columbus, Ohio, USA</aff>
<email>don@osc.edu</email>
</contrib>
<contrib contrib-type="author"><name><surname>Shen</surname>
<given-names>Han-Wei</given-names>
</name>
<aff id="A4">Department of Computer Science and Engineering, Ohio State University, Columbus, Ohio, USA</aff>
<email>hwshen@cse.ohio-state.edu</email>
</contrib>
</contrib-group>
<pub-date pub-type="nihms-submitted"><day>12</day>
<month>7</month>
<year>2012</year>
</pub-date>
<pub-date pub-type="epub"><day>03</day>
<month>5</month>
<year>2011</year>
</pub-date>
<pub-date pub-type="ppub"><month>1</month>
<year>2012</year>
</pub-date>
<pub-date pub-type="pmc-release"><day>01</day>
<month>1</month>
<year>2013</year>
</pub-date>
<volume>7</volume>
<issue>1</issue>
<fpage>1</fpage>
<lpage>11</lpage>
<abstract><sec id="S1"><title>Purpose</title>
<p id="P1">Automatic scoring of resident performance on a virtual mastoidectomy simulation system is needed to achieve consistent and efficient evaluations. By not requiring immediate expert intervention, the system provides a completely objective assessment of performance as well as a self-driven user assessment mechanism.</p>
</sec>
<sec id="S2"><title>Methods</title>
<p id="P2">An iconic temporal bone with surgically important regions defined into a fully partitioned segmented dataset was created. Comparisons between expert-drilled bones and student-drilled bones were computed based on gradations with both Euclidean and Earth Mover’s Distance. Using the features derived from these comparisons, a decision tree was constructed. This decision tree was used to determine scores of resident surgical performance. The algorithm was applied on multiple expert comparison bones and the scores averaged to provide reliability metric.</p>
</sec>
<sec id="S3"><title>Results</title>
<p id="P3">The reliability metrics for the multi-grade scoring system are better in some cases than previously reported binary classification metrics. The two scoring methods given provide a trade-off between accuracy and speed.</p>
</sec>
<sec id="S4"><title>Conclusions</title>
<p id="P4">Comparison of virtually drilled bones with expert examples on a voxel level provides sufficient information to score them and provide several specific quality metrics. By merging scores from different expert examples, two related metrics were developed; one is slightly faster and less accurate, while a second is more accurate but takes more processing time.</p>
</sec>
</abstract>
<kwd-group><kwd>Automatic evaluation</kwd>
<kwd>Objective assessment</kwd>
<kwd>Mastoidectomy</kwd>
<kwd>Surgical simulation</kwd>
<kwd>Temporal bone</kwd>
</kwd-group>
<funding-group><award-group><funding-source country="United States">National Institute on Deafness and Other Communication Disorders : NIDCD</funding-source>
<award-id>R01 DC011321 || DC</award-id>
</award-group>
</funding-group>
</article-meta>
</front>
</pmc>
</record>
Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/HapticV1/Data/Pmc/Curation
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 001807 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Pmc/Curation/biblio.hfd -nk 001807 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien |wiki= Ticri/CIDE |area= HapticV1 |flux= Pmc |étape= Curation |type= RBID |clé= PMC:3403744 |texte= Automatic Scoring of Virtual Mastoidectomies Using Expert Examples }}
Pour générer des pages wiki
HfdIndexSelect -h $EXPLOR_AREA/Data/Pmc/Curation/RBID.i -Sk "pubmed:21538158" \ | HfdSelect -Kh $EXPLOR_AREA/Data/Pmc/Curation/biblio.hfd \ | NlmPubMed2Wicri -a HapticV1
![]() | This area was generated with Dilib version V0.6.23. | ![]() |