A novel augmented reality system for displaying inferior alveolar nerve bundles in maxillofacial surgery
Identifieur interne : 000372 ( Main/Exploration ); précédent : 000371; suivant : 000373A novel augmented reality system for displaying inferior alveolar nerve bundles in maxillofacial surgery
Auteurs : Ming Zhu ; Fei Liu ; Gang Chai ; Jun J. Pan [République populaire de Chine] ; Taoran Jiang ; Li Lin ; Yu Xin ; Yan Zhang ; Qingfeng LiSource :
- Scientific Reports [ 2045-2322 ] ; 2017.
Abstract
Augmented reality systems can combine virtual images with a real environment to ensure accurate surgery with lower risk. This study aimed to develop a novel registration and tracking technique to establish a navigation system based on augmented reality for maxillofacial surgery. Specifically, a virtual image is reconstructed from CT data using 3D software. The real environment is tracked by the augmented reality (AR) software. The novel registration strategy that we created uses an occlusal splint compounded with a fiducial marker (OSM) to establish a relationship between the virtual image and the real object. After the fiducial marker is recognized, the virtual image is superimposed onto the real environment, forming the “integrated image” on semi-transparent glass. Via the registration process, the integral image, which combines the virtual image with the real scene, is successfully presented on the semi-transparent helmet. The position error of this navigation system is 0.96 ± 0.51 mm. This augmented reality system was applied in the clinic and good surgical outcomes were obtained. The augmented reality system that we established for maxillofacial surgery has the advantages of easy manipulation and high accuracy, which can improve surgical outcomes. Thus, this system exhibits significant potential in clinical applications.
Url:
DOI: 10.1038/srep42365
PubMed: 28198442
PubMed Central: 5309766
Affiliations:
Links toward previous steps (curation, corpus...)
- to stream Pmc, to step Corpus: 000843
- to stream Pmc, to step Curation: 000843
- to stream Pmc, to step Checkpoint: 000345
- to stream Ncbi, to step Merge: 006E05
- to stream Ncbi, to step Curation: 006E05
- to stream Ncbi, to step Checkpoint: 006E05
- to stream Main, to step Merge: 000372
- to stream Main, to step Curation: 000372
Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">A novel augmented reality system for displaying inferior alveolar nerve bundles in maxillofacial surgery</title><author><name sortKey="Zhu, Ming" sort="Zhu, Ming" uniqKey="Zhu M" first="Ming" last="Zhu">Ming Zhu</name><affiliation><nlm:aff id="a1"><institution>Shanghai Ninth People’s Hospital affiliated to Shanghai Jiao Tong University</institution>, Shanghai,<country>China.</country></nlm:aff><wicri:noCountry code="nlm country">China.</wicri:noCountry></affiliation></author><author><name sortKey="Liu, Fei" sort="Liu, Fei" uniqKey="Liu F" first="Fei" last="Liu">Fei Liu</name><affiliation><nlm:aff id="a1"><institution>Shanghai Ninth People’s Hospital affiliated to Shanghai Jiao Tong University</institution>, Shanghai,<country>China.</country></nlm:aff><wicri:noCountry code="nlm country">China.</wicri:noCountry></affiliation></author><author><name sortKey="Chai, Gang" sort="Chai, Gang" uniqKey="Chai G" first="Gang" last="Chai">Gang Chai</name><affiliation><nlm:aff id="a1"><institution>Shanghai Ninth People’s Hospital affiliated to Shanghai Jiao Tong University</institution>, Shanghai,<country>China.</country></nlm:aff><wicri:noCountry code="nlm country">China.</wicri:noCountry></affiliation></author><author><name sortKey="Pan, Jun J" sort="Pan, Jun J" uniqKey="Pan J" first="Jun J." last="Pan">Jun J. Pan</name><affiliation wicri:level="1"><nlm:aff id="a2"><institution>State Key Laboratory of Virtual Reality Technology and Systems Beihang University</institution>, Beijing,<country>China</country></nlm:aff><country xml:lang="fr">République populaire de Chine</country><wicri:regionArea># see nlm:aff country strict</wicri:regionArea></affiliation></author><author><name sortKey="Jiang, Taoran" sort="Jiang, Taoran" uniqKey="Jiang T" first="Taoran" last="Jiang">Taoran Jiang</name><affiliation><nlm:aff id="a1"><institution>Shanghai Ninth People’s Hospital affiliated to Shanghai Jiao Tong University</institution>, Shanghai,<country>China.</country></nlm:aff><wicri:noCountry code="nlm country">China.</wicri:noCountry></affiliation></author><author><name sortKey="Lin, Li" sort="Lin, Li" uniqKey="Lin L" first="Li" last="Lin">Li Lin</name><affiliation><nlm:aff id="a1"><institution>Shanghai Ninth People’s Hospital affiliated to Shanghai Jiao Tong University</institution>, Shanghai,<country>China.</country></nlm:aff><wicri:noCountry code="nlm country">China.</wicri:noCountry></affiliation></author><author><name sortKey="Xin, Yu" sort="Xin, Yu" uniqKey="Xin Y" first="Yu" last="Xin">Yu Xin</name><affiliation><nlm:aff id="a1"><institution>Shanghai Ninth People’s Hospital affiliated to Shanghai Jiao Tong University</institution>, Shanghai,<country>China.</country></nlm:aff><wicri:noCountry code="nlm country">China.</wicri:noCountry></affiliation></author><author><name sortKey="Zhang, Yan" sort="Zhang, Yan" uniqKey="Zhang Y" first="Yan" last="Zhang">Yan Zhang</name><affiliation><nlm:aff id="a1"><institution>Shanghai Ninth People’s Hospital affiliated to Shanghai Jiao Tong University</institution>, Shanghai,<country>China.</country></nlm:aff><wicri:noCountry code="nlm country">China.</wicri:noCountry></affiliation></author><author><name sortKey="Li, Qingfeng" sort="Li, Qingfeng" uniqKey="Li Q" first="Qingfeng" last="Li">Qingfeng Li</name><affiliation><nlm:aff id="a1"><institution>Shanghai Ninth People’s Hospital affiliated to Shanghai Jiao Tong University</institution>, Shanghai,<country>China.</country></nlm:aff><wicri:noCountry code="nlm country">China.</wicri:noCountry></affiliation></author></titleStmt><publicationStmt><idno type="wicri:source">PMC</idno><idno type="pmid">28198442</idno><idno type="pmc">5309766</idno><idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC5309766</idno><idno type="RBID">PMC:5309766</idno><idno type="doi">10.1038/srep42365</idno><date when="2017">2017</date><idno type="wicri:Area/Pmc/Corpus">000843</idno><idno type="wicri:explorRef" wicri:stream="Pmc" wicri:step="Corpus" wicri:corpus="PMC">000843</idno><idno type="wicri:Area/Pmc/Curation">000843</idno><idno type="wicri:explorRef" wicri:stream="Pmc" wicri:step="Curation">000843</idno><idno type="wicri:Area/Pmc/Checkpoint">000345</idno><idno type="wicri:explorRef" wicri:stream="Pmc" wicri:step="Checkpoint">000345</idno><idno type="wicri:Area/Ncbi/Merge">006E05</idno><idno type="wicri:Area/Ncbi/Curation">006E05</idno><idno type="wicri:Area/Ncbi/Checkpoint">006E05</idno><idno type="wicri:Area/Main/Merge">000372</idno><idno type="wicri:Area/Main/Curation">000372</idno><idno type="wicri:Area/Main/Exploration">000372</idno></publicationStmt><sourceDesc><biblStruct><analytic><title xml:lang="en" level="a" type="main">A novel augmented reality system for displaying inferior alveolar nerve bundles in maxillofacial surgery</title><author><name sortKey="Zhu, Ming" sort="Zhu, Ming" uniqKey="Zhu M" first="Ming" last="Zhu">Ming Zhu</name><affiliation><nlm:aff id="a1"><institution>Shanghai Ninth People’s Hospital affiliated to Shanghai Jiao Tong University</institution>, Shanghai,<country>China.</country></nlm:aff><wicri:noCountry code="nlm country">China.</wicri:noCountry></affiliation></author><author><name sortKey="Liu, Fei" sort="Liu, Fei" uniqKey="Liu F" first="Fei" last="Liu">Fei Liu</name><affiliation><nlm:aff id="a1"><institution>Shanghai Ninth People’s Hospital affiliated to Shanghai Jiao Tong University</institution>, Shanghai,<country>China.</country></nlm:aff><wicri:noCountry code="nlm country">China.</wicri:noCountry></affiliation></author><author><name sortKey="Chai, Gang" sort="Chai, Gang" uniqKey="Chai G" first="Gang" last="Chai">Gang Chai</name><affiliation><nlm:aff id="a1"><institution>Shanghai Ninth People’s Hospital affiliated to Shanghai Jiao Tong University</institution>, Shanghai,<country>China.</country></nlm:aff><wicri:noCountry code="nlm country">China.</wicri:noCountry></affiliation></author><author><name sortKey="Pan, Jun J" sort="Pan, Jun J" uniqKey="Pan J" first="Jun J." last="Pan">Jun J. Pan</name><affiliation wicri:level="1"><nlm:aff id="a2"><institution>State Key Laboratory of Virtual Reality Technology and Systems Beihang University</institution>, Beijing,<country>China</country></nlm:aff><country xml:lang="fr">République populaire de Chine</country><wicri:regionArea># see nlm:aff country strict</wicri:regionArea></affiliation></author><author><name sortKey="Jiang, Taoran" sort="Jiang, Taoran" uniqKey="Jiang T" first="Taoran" last="Jiang">Taoran Jiang</name><affiliation><nlm:aff id="a1"><institution>Shanghai Ninth People’s Hospital affiliated to Shanghai Jiao Tong University</institution>, Shanghai,<country>China.</country></nlm:aff><wicri:noCountry code="nlm country">China.</wicri:noCountry></affiliation></author><author><name sortKey="Lin, Li" sort="Lin, Li" uniqKey="Lin L" first="Li" last="Lin">Li Lin</name><affiliation><nlm:aff id="a1"><institution>Shanghai Ninth People’s Hospital affiliated to Shanghai Jiao Tong University</institution>, Shanghai,<country>China.</country></nlm:aff><wicri:noCountry code="nlm country">China.</wicri:noCountry></affiliation></author><author><name sortKey="Xin, Yu" sort="Xin, Yu" uniqKey="Xin Y" first="Yu" last="Xin">Yu Xin</name><affiliation><nlm:aff id="a1"><institution>Shanghai Ninth People’s Hospital affiliated to Shanghai Jiao Tong University</institution>, Shanghai,<country>China.</country></nlm:aff><wicri:noCountry code="nlm country">China.</wicri:noCountry></affiliation></author><author><name sortKey="Zhang, Yan" sort="Zhang, Yan" uniqKey="Zhang Y" first="Yan" last="Zhang">Yan Zhang</name><affiliation><nlm:aff id="a1"><institution>Shanghai Ninth People’s Hospital affiliated to Shanghai Jiao Tong University</institution>, Shanghai,<country>China.</country></nlm:aff><wicri:noCountry code="nlm country">China.</wicri:noCountry></affiliation></author><author><name sortKey="Li, Qingfeng" sort="Li, Qingfeng" uniqKey="Li Q" first="Qingfeng" last="Li">Qingfeng Li</name><affiliation><nlm:aff id="a1"><institution>Shanghai Ninth People’s Hospital affiliated to Shanghai Jiao Tong University</institution>, Shanghai,<country>China.</country></nlm:aff><wicri:noCountry code="nlm country">China.</wicri:noCountry></affiliation></author></analytic><series><title level="j">Scientific Reports</title><idno type="eISSN">2045-2322</idno><imprint><date when="2017">2017</date></imprint></series></biblStruct></sourceDesc></fileDesc><profileDesc><textClass></textClass></profileDesc></teiHeader><front><div type="abstract" xml:lang="en"><p>Augmented reality systems can combine virtual images with a real environment to ensure accurate surgery with lower risk. This study aimed to develop a novel registration and tracking technique to establish a navigation system based on augmented reality for maxillofacial surgery. Specifically, a virtual image is reconstructed from CT data using 3D software. The real environment is tracked by the augmented reality (AR) software. The novel registration strategy that we created uses an occlusal splint compounded with a fiducial marker (OSM) to establish a relationship between the virtual image and the real object. After the fiducial marker is recognized, the virtual image is superimposed onto the real environment, forming the “integrated image” on semi-transparent glass. Via the registration process, the integral image, which combines the virtual image with the real scene, is successfully presented on the semi-transparent helmet. The position error of this navigation system is 0.96 ± 0.51 mm. This augmented reality system was applied in the clinic and good surgical outcomes were obtained. The augmented reality system that we established for maxillofacial surgery has the advantages of easy manipulation and high accuracy, which can improve surgical outcomes. Thus, this system exhibits significant potential in clinical applications.</p></div></front><back><div1 type="bibliography"><listBibl><biblStruct><analytic><author><name sortKey="Freg, M" uniqKey="Freg M">M. Freg</name></author><author><name sortKey="Giovanoli, P" uniqKey="Giovanoli P">P. Giovanoli</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Adams, W M" uniqKey="Adams W">W. M. ADAMS</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Okamoto, T" uniqKey="Okamoto T">T. Okamoto</name></author><author><name sortKey="Orida, S" uniqKey="Orida S">S. Orida</name></author><author><name sortKey="Yanaga, K" uniqKey="Yanaga K">K. Yanaga</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Gerbers, J G" uniqKey="Gerbers J">J. G. Gerbers</name></author><author><name sortKey="Stevens, M" uniqKey="Stevens M">M. Stevens</name></author><author><name sortKey="Ploegmakers, J J" uniqKey="Ploegmakers J">J. J. Ploegmakers</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Suderi, G R" uniqKey="Suderi G">G. R. Suderi</name></author><author><name sortKey="Fallaha, M" uniqKey="Fallaha M">M. Fallaha</name></author><author><name sortKey="Masse, V" uniqKey="Masse V">V. Masse</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Ponce, B A" uniqKey="Ponce B">B. A. Ponce</name></author><author><name sortKey="Jennings, J K" uniqKey="Jennings J">J. K. Jennings</name></author><author><name sortKey="Clay, T B" uniqKey="Clay T">T. B. Clay</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Abe, Y" uniqKey="Abe Y">Y. Abe</name></author><author><name sortKey="Sato, S" uniqKey="Sato S">S. Sato</name></author><author><name sortKey="Kato, K" uniqKey="Kato K">K. Kato</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Schneider, A" uniqKey="Schneider A">A. Schneider</name></author><author><name sortKey="Pezold, S" uniqKey="Pezold S">S. Pezold</name></author><author><name sortKey="Saner, A" uniqKey="Saner A">A. Saner</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Masutani, Y" uniqKey="Masutani Y">Y. Masutani</name></author><author><name sortKey="Dohi, T" uniqKey="Dohi T">T. Dohi</name></author><author><name sortKey="Yamane, F" uniqKey="Yamane F">F. Yamane</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Kramers, M" uniqKey="Kramers M">M. Kramers</name></author><author><name sortKey="Armstrong, R" uniqKey="Armstrong R">R. Armstrong</name></author><author><name sortKey="Bakhshmand, S M" uniqKey="Bakhshmand S">S. M. Bakhshmand</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="State, A" uniqKey="State A">A. State</name></author><author><name sortKey="Keller, K" uniqKey="Keller K">K. Keller</name></author><author><name sortKey="Rosenthal, M" uniqKey="Rosenthal M">M. Rosenthal</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Cheng, I" uniqKey="Cheng I">I. Cheng</name></author><author><name sortKey="Shen, R" uniqKey="Shen R">R. Shen</name></author><author><name sortKey="Moreau, R" uniqKey="Moreau R">R. Moreau</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Zinser, M J" uniqKey="Zinser M">M. J. Zinser</name></author><author><name sortKey="Mischkowski, R A" uniqKey="Mischkowski R">R. A. Mischkowski</name></author><author><name sortKey="Dreiseidler, T" uniqKey="Dreiseidler T">T. Dreiseidler</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Ewers, R" uniqKey="Ewers R">R. Ewers</name></author><author><name sortKey="Schicho, K" uniqKey="Schicho K">K. Schicho</name></author><author><name sortKey="Wagner, A" uniqKey="Wagner A">A. Wagner</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Eggers, G" uniqKey="Eggers G">G. Eggers</name></author><author><name sortKey="Salb, T" uniqKey="Salb T">T. Salb</name></author><author><name sortKey="Hoppe, H" uniqKey="Hoppe H">H. Hoppe</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Tran, H H" uniqKey="Tran H">H. H. Tran</name></author><author><name sortKey="Suenaga, H" uniqKey="Suenaga H">H. Suenaga</name></author><author><name sortKey="Kuwana, K" uniqKey="Kuwana K">K. Kuwana</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Katic, D" uniqKey="Katic D">D. Katic</name></author><author><name sortKey="Wekerle, A L" uniqKey="Wekerle A">A. L. Wekerle</name></author><author><name sortKey="Gortler, J" uniqKey="Gortler J">J. Gortler</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Ming, Z" uniqKey="Ming Z">Z. Ming</name></author><author><name sortKey="Gang, C" uniqKey="Gang C">C. Gang</name></author><author><name sortKey="Yan, Z" uniqKey="Yan Z">Z. Yan</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Suzuki, N" uniqKey="Suzuki N">N. Suzuki</name></author><author><name sortKey="Hattori, A" uniqKey="Hattori A">A. Hattori</name></author><author><name sortKey="Iimura, J" uniqKey="Iimura J">J. Iimura</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Luebbers, H T" uniqKey="Luebbers H">H. T. Luebbers</name></author><author><name sortKey="Messmer, P" uniqKey="Messmer P">P. Messmer</name></author><author><name sortKey="Obwegeser, J A" uniqKey="Obwegeser J">J. A. Obwegeser</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Metzger, M C" uniqKey="Metzger M">M. C. Metzger</name></author><author><name sortKey="Rafii, A" uniqKey="Rafii A">A. Rafii</name></author><author><name sortKey="Holhweg Majert, B" uniqKey="Holhweg Majert B">B. Holhweg-Majert</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Nijmeh, A D" uniqKey="Nijmeh A">A. D. Nijmeh</name></author><author><name sortKey="Goodger, N M" uniqKey="Goodger N">N. M. Goodger</name></author><author><name sortKey="Hawkes, D" uniqKey="Hawkes D">D. Hawkes</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Lin, Y K" uniqKey="Lin Y">Y. K. Lin</name></author><author><name sortKey="Yau, H T" uniqKey="Yau H">H. T. Yau</name></author><author><name sortKey="Wang, I C" uniqKey="Wang I">I. C. Wang</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Aichert, A" uniqKey="Aichert A">A. Aichert</name></author><author><name sortKey="Wein, W" uniqKey="Wein W">W. Wein</name></author><author><name sortKey="Ladikos, A" uniqKey="Ladikos A">A. Ladikos</name></author></analytic></biblStruct></listBibl></div1></back></TEI><affiliations><list><country><li>République populaire de Chine</li></country></list><tree><noCountry><name sortKey="Chai, Gang" sort="Chai, Gang" uniqKey="Chai G" first="Gang" last="Chai">Gang Chai</name><name sortKey="Jiang, Taoran" sort="Jiang, Taoran" uniqKey="Jiang T" first="Taoran" last="Jiang">Taoran Jiang</name><name sortKey="Li, Qingfeng" sort="Li, Qingfeng" uniqKey="Li Q" first="Qingfeng" last="Li">Qingfeng Li</name><name sortKey="Lin, Li" sort="Lin, Li" uniqKey="Lin L" first="Li" last="Lin">Li Lin</name><name sortKey="Liu, Fei" sort="Liu, Fei" uniqKey="Liu F" first="Fei" last="Liu">Fei Liu</name><name sortKey="Xin, Yu" sort="Xin, Yu" uniqKey="Xin Y" first="Yu" last="Xin">Yu Xin</name><name sortKey="Zhang, Yan" sort="Zhang, Yan" uniqKey="Zhang Y" first="Yan" last="Zhang">Yan Zhang</name><name sortKey="Zhu, Ming" sort="Zhu, Ming" uniqKey="Zhu M" first="Ming" last="Zhu">Ming Zhu</name></noCountry><country name="République populaire de Chine"><noRegion><name sortKey="Pan, Jun J" sort="Pan, Jun J" uniqKey="Pan J" first="Jun J." last="Pan">Jun J. Pan</name></noRegion></country></tree></affiliations></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Wicri/Santé/explor/EdenteV2/Data/Main/Exploration
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000372 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Main/Exploration/biblio.hfd -nk 000372 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Wicri/Santé
|area= EdenteV2
|flux= Main
|étape= Exploration
|type= RBID
|clé= PMC:5309766
|texte= A novel augmented reality system for displaying inferior alveolar nerve bundles in maxillofacial surgery
}}
Pour générer des pages wiki
HfdIndexSelect -h $EXPLOR_AREA/Data/Main/Exploration/RBID.i -Sk "pubmed:28198442" \
| HfdSelect -Kh $EXPLOR_AREA/Data/Main/Exploration/biblio.hfd \
| NlmPubMed2Wicri -a EdenteV2
| This area was generated with Dilib version V0.6.32. |  |