Serveur d'exploration Stress et Covid

Attention, ce site est en cours de développement !
Attention, site généré par des moyens informatiques à partir de corpus bruts.
Les informations ne sont donc pas validées.

Case Detection Algorithms

Identifieur interne : 000237 ( Pmc/Corpus ); précédent : 000236; suivant : 000238

Case Detection Algorithms

Auteurs : Fu-Chiang Tsui ; Michael M. Wagner ; Jeremy Espino

Source :

RBID : PMC:7150155
Url:
DOI: 10.1016/B978-012369378-5/50015-6
PubMed: NONE
PubMed Central: 7150155

Links to Exploration step

PMC:7150155

Le document en format XML

<record>
<TEI>
<teiHeader>
<fileDesc>
<titleStmt>
<title xml:lang="en">Case Detection Algorithms</title>
<author>
<name sortKey="Tsui, Fu Chiang" sort="Tsui, Fu Chiang" uniqKey="Tsui F" first="Fu-Chiang" last="Tsui">Fu-Chiang Tsui</name>
</author>
<author>
<name sortKey="Wagner, Michael M" sort="Wagner, Michael M" uniqKey="Wagner M" first="Michael M." last="Wagner">Michael M. Wagner</name>
</author>
<author>
<name sortKey="Espino, Jeremy" sort="Espino, Jeremy" uniqKey="Espino J" first="Jeremy" last="Espino">Jeremy Espino</name>
</author>
</titleStmt>
<publicationStmt>
<idno type="wicri:source">PMC</idno>
<idno type="pmc">7150155</idno>
<idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC7150155</idno>
<idno type="RBID">PMC:7150155</idno>
<idno type="doi">10.1016/B978-012369378-5/50015-6</idno>
<idno type="pmid">NONE</idno>
<date when="2006">2006</date>
<idno type="wicri:Area/Pmc/Corpus">000237</idno>
<idno type="wicri:explorRef" wicri:stream="Pmc" wicri:step="Corpus" wicri:corpus="PMC">000237</idno>
</publicationStmt>
<sourceDesc>
<biblStruct>
<analytic>
<title xml:lang="en" level="a" type="main">Case Detection Algorithms</title>
<author>
<name sortKey="Tsui, Fu Chiang" sort="Tsui, Fu Chiang" uniqKey="Tsui F" first="Fu-Chiang" last="Tsui">Fu-Chiang Tsui</name>
</author>
<author>
<name sortKey="Wagner, Michael M" sort="Wagner, Michael M" uniqKey="Wagner M" first="Michael M." last="Wagner">Michael M. Wagner</name>
</author>
<author>
<name sortKey="Espino, Jeremy" sort="Espino, Jeremy" uniqKey="Espino J" first="Jeremy" last="Espino">Jeremy Espino</name>
</author>
</analytic>
<series>
<title level="j">Handbook of Biosurveillance</title>
<imprint>
<date when="2006">2006</date>
</imprint>
</series>
</biblStruct>
</sourceDesc>
</fileDesc>
<profileDesc>
<textClass></textClass>
</profileDesc>
</teiHeader>
<back>
<div1 type="bibliography">
<listBibl>
<biblStruct>
<analytic>
<author>
<name sortKey="Adams, I D" uniqKey="Adams I">I.D. Adams</name>
</author>
<author>
<name sortKey="Chan, M" uniqKey="Chan M">M. Chan</name>
</author>
<author>
<name sortKey="Clifford, P C" uniqKey="Clifford P">P.C. Clifford</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="American College Of Emergency Physicians" uniqKey="American College Of Emergency Physicians">American College of Emergency Physicians</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Aronsky, D" uniqKey="Aronsky D">D. Aronsky</name>
</author>
<author>
<name sortKey="Fiszman, M" uniqKey="Fiszman M">M. Fiszman</name>
</author>
<author>
<name sortKey="Chapman, W W" uniqKey="Chapman W">W.W. Chapman</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Boxwala, A A" uniqKey="Boxwala A">A.A. Boxwala</name>
</author>
<author>
<name sortKey="Peleg, M" uniqKey="Peleg M">M. Peleg</name>
</author>
<author>
<name sortKey="Tu, S" uniqKey="Tu S">S. Tu</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Buchanan, B G" uniqKey="Buchanan B">B.G. Buchanan</name>
</author>
<author>
<name sortKey="Shortliffe, E H" uniqKey="Shortliffe E">E.H. Shortliffe</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Burnside, E S" uniqKey="Burnside E">E.S. Burnside</name>
</author>
<author>
<name sortKey="Rubin, D L" uniqKey="Rubin D">D.L. Rubin</name>
</author>
<author>
<name sortKey="Shachter, R D" uniqKey="Shachter R">R.D. Shachter</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Chung, S" uniqKey="Chung S">S. Chung</name>
</author>
<author>
<name sortKey="Mandl, K D" uniqKey="Mandl K">K.D. Mandl</name>
</author>
<author>
<name sortKey="Shannon, M" uniqKey="Shannon M">M. Shannon</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Ciccarese, P" uniqKey="Ciccarese P">P. Ciccarese</name>
</author>
<author>
<name sortKey="Caffi, E" uniqKey="Caffi E">E. Caffi</name>
</author>
<author>
<name sortKey="Boiocchi, L" uniqKey="Boiocchi L">L. Boiocchi</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Cundick, R" uniqKey="Cundick R">R. Cundick</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="De Clercq, P A" uniqKey="De Clercq P">P.A. de Clercq</name>
</author>
<author>
<name sortKey="Blom, J A" uniqKey="Blom J">J.A. Blom</name>
</author>
<author>
<name sortKey="Korsten, H H" uniqKey="Korsten H">H.H. Korsten</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="De Dombal, F" uniqKey="De Dombal F">F. de Dombal</name>
</author>
<author>
<name sortKey="De Baere, H" uniqKey="De Baere H">H. de Baere</name>
</author>
<author>
<name sortKey="Van Elk, P" uniqKey="Van Elk P">P. van Elk</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="De Dombal, F" uniqKey="De Dombal F">F. de Dombal</name>
</author>
<author>
<name sortKey="Leaper, D" uniqKey="Leaper D">D. Leaper</name>
</author>
<author>
<name sortKey="Staniland, J" uniqKey="Staniland J">J. Staniland</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="De, Dombalf T" uniqKey="De D">DombalF.T. de</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="De Dombal, F T" uniqKey="De Dombal F">F.T. de Dombal</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="De Dombal, F T" uniqKey="De Dombal F">F.T. de Dombal</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="De Dombal, F T" uniqKey="De Dombal F">F.T. de Dombal</name>
</author>
<author>
<name sortKey="Leaper, D J" uniqKey="Leaper D">D.J. Leaper</name>
</author>
<author>
<name sortKey="Horrocks, J G" uniqKey="Horrocks J">J.G. Horrocks</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Dexter, P R" uniqKey="Dexter P">P.R. Dexter</name>
</author>
<author>
<name sortKey="Perkins, S" uniqKey="Perkins S">S. Perkins</name>
</author>
<author>
<name sortKey="Overhage, J M" uniqKey="Overhage J">J.M. Overhage</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Elstein, A S" uniqKey="Elstein A">A.S. Elstein</name>
</author>
<author>
<name sortKey="Friedman, C P" uniqKey="Friedman C">C.P. Friedman</name>
</author>
<author>
<name sortKey="Wolf, F M" uniqKey="Wolf F">F.M. Wolf</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Espino, J" uniqKey="Espino J">J. Espino</name>
</author>
<author>
<name sortKey="Dara, J" uniqKey="Dara J">J. Dara</name>
</author>
<author>
<name sortKey="Dowling, J" uniqKey="Dowling J">J. Dowling</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Espino, J" uniqKey="Espino J">J. Espino</name>
</author>
<author>
<name sortKey="Tsui, F C" uniqKey="Tsui F">F.-C. Tsui</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Evans, R S" uniqKey="Evans R">R.S. Evans</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Feigenbaum, E A" uniqKey="Feigenbaum E">E.A. Feigenbaum</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Fox, J" uniqKey="Fox J">J. Fox</name>
</author>
<author>
<name sortKey="Johns, N" uniqKey="Johns N">N. Johns</name>
</author>
<author>
<name sortKey="Lyons, C" uniqKey="Lyons C">C. Lyons</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Friedman, C P" uniqKey="Friedman C">C.P. Friedman</name>
</author>
<author>
<name sortKey="Elstein, A S" uniqKey="Elstein A">A.S. Elstein</name>
</author>
<author>
<name sortKey="Wolf, F M" uniqKey="Wolf F">F.M. Wolf</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Gardner, R M" uniqKey="Gardner R">R.M. Gardner</name>
</author>
<author>
<name sortKey="Pryor, T A" uniqKey="Pryor T">T.A. Pryor</name>
</author>
<author>
<name sortKey="Warner, H R" uniqKey="Warner H">H.R. Warner</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Gerberding, J L" uniqKey="Gerberding J">J.L. Gerberding</name>
</author>
<author>
<name sortKey="Hughes, J M" uniqKey="Hughes J">J.M. Hughes</name>
</author>
<author>
<name sortKey="Koplan, J P" uniqKey="Koplan J">J.P. Koplan</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Graber, M A" uniqKey="Graber M">M.A. Graber</name>
</author>
<author>
<name sortKey="Vanscoy, D" uniqKey="Vanscoy D">D. VanScoy</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Haynes, R B" uniqKey="Haynes R">R.B. Haynes</name>
</author>
<author>
<name sortKey="Davis, D A" uniqKey="Davis D">D.A. Davis</name>
</author>
<author>
<name sortKey="Mckibbon, A" uniqKey="Mckibbon A">A. McKibbon</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Heckerman, D E" uniqKey="Heckerman D">D.E. Heckerman</name>
</author>
<author>
<name sortKey="Horvitz, E J" uniqKey="Horvitz E">E.J. Horvitz</name>
</author>
<author>
<name sortKey="Nathwani, B N" uniqKey="Nathwani B">B.N. Nathwani</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Hripcsak, G" uniqKey="Hripcsak G">G. Hripcsak</name>
</author>
<author>
<name sortKey="Knirsch, G" uniqKey="Knirsch G">G. Knirsch</name>
</author>
<author>
<name sortKey="Jain, N" uniqKey="Jain N">N. Jain</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Hripcsak, G" uniqKey="Hripcsak G">G. Hripcsak</name>
</author>
<author>
<name sortKey="Knirsch, C A" uniqKey="Knirsch C">C.A. Knirsch</name>
</author>
<author>
<name sortKey="Jain, N L" uniqKey="Jain N">N.L. Jain</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Hughes, J M" uniqKey="Hughes J">J.M. Hughes</name>
</author>
<author>
<name sortKey="Gerberding, J L" uniqKey="Gerberding J">J.L. Gerberding</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Johnson, P" uniqKey="Johnson P">P. Johnson</name>
</author>
<author>
<name sortKey="Tu, S" uniqKey="Tu S">S. Tu</name>
</author>
<author>
<name sortKey="Jones, N" uniqKey="Jones N">N. Jones</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Kahn, M G" uniqKey="Kahn M">M.G. Kahn</name>
</author>
<author>
<name sortKey="Bailey, T C" uniqKey="Bailey T">T.C. Bailey</name>
</author>
<author>
<name sortKey="Steib, S A" uniqKey="Steib S">S.A. Steib</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Kahn, M G" uniqKey="Kahn M">M.G. Kahn</name>
</author>
<author>
<name sortKey="Steib, S A" uniqKey="Steib S">S.A. Steib</name>
</author>
<author>
<name sortKey="Dunagan, W C" uniqKey="Dunagan W">W.C. Dunagan</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Kahn, M G" uniqKey="Kahn M">M.G. Kahn</name>
</author>
<author>
<name sortKey="Steib, S A" uniqKey="Steib S">S.A. Steib</name>
</author>
<author>
<name sortKey="Fraser, V J" uniqKey="Fraser V">V.J. Fraser</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Kohn, L T" uniqKey="Kohn L">L.T. Kohn</name>
</author>
<author>
<name sortKey="Corrigan, J" uniqKey="Corrigan J">J. Corrigan</name>
</author>
<author>
<name sortKey="Donaldson, M S" uniqKey="Donaldson M">M.S. Donaldson</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Kolata, G" uniqKey="Kolata G">G. Kolata</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Leavitt, M" uniqKey="Leavitt M">M. Leavitt</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Ledley, R S" uniqKey="Ledley R">R.S. Ledley</name>
</author>
<author>
<name sortKey="Lusted, L B" uniqKey="Lusted L">L.B. Lusted</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Leist, J C" uniqKey="Leist J">J.C. Leist</name>
</author>
<author>
<name sortKey="Kristofco, R E" uniqKey="Kristofco R">R.E. Kristofco</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="London, S" uniqKey="London S">S. London</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Mcadam, W A" uniqKey="Mcadam W">W.A. McAdam</name>
</author>
<author>
<name sortKey="Brock, B M" uniqKey="Brock B">B.M. Brock</name>
</author>
<author>
<name sortKey="Armitage, T" uniqKey="Armitage T">T. Armitage</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Mcdonald, C" uniqKey="Mcdonald C">C. McDonald</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Mcdonald, C" uniqKey="Mcdonald C">C. McDonald</name>
</author>
<author>
<name sortKey="Tierney, W" uniqKey="Tierney W">W. Tierney</name>
</author>
<author>
<name sortKey="Overhage, J" uniqKey="Overhage J">J. Overhage</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Mcdonald, C" uniqKey="Mcdonald C">C. McDonald</name>
</author>
<author>
<name sortKey="Tierney, W" uniqKey="Tierney W">W. Tierney</name>
</author>
<author>
<name sortKey="Overhage, J" uniqKey="Overhage J">J. Overhage</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Mcdonald, C J" uniqKey="Mcdonald C">C.J. McDonald</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Mcdonald, C J" uniqKey="Mcdonald C">C.J. McDonald</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Mcdonald, C J" uniqKey="Mcdonald C">C.J. McDonald</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Mcdonald, C J" uniqKey="Mcdonald C">C.J. McDonald</name>
</author>
<author>
<name sortKey="Hui, S L" uniqKey="Hui S">S.L. Hui</name>
</author>
<author>
<name sortKey="Tierney, W M" uniqKey="Tierney W">W.M. Tierney</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Miller, P L" uniqKey="Miller P">P.L. Miller</name>
</author>
<author>
<name sortKey="Frawley, S J" uniqKey="Frawley S">S.J. Frawley</name>
</author>
<author>
<name sortKey="Sayward, F G" uniqKey="Sayward F">F.G. Sayward</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Miller, R" uniqKey="Miller R">R. Miller</name>
</author>
<author>
<name sortKey="Masarie, F E" uniqKey="Masarie F">F.E. Masarie</name>
</author>
<author>
<name sortKey="Myers, J D" uniqKey="Myers J">J.D. Myers</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Murphy, G C" uniqKey="Murphy G">G.C. Murphy</name>
</author>
<author>
<name sortKey="Friedman, C P" uniqKey="Friedman C">C.P. Friedman</name>
</author>
<author>
<name sortKey="Elstein, A S" uniqKey="Elstein A">A.S. Elstein</name>
</author>
</analytic>
</biblStruct>
<biblStruct></biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Neapolitan, R" uniqKey="Neapolitan R">R. Neapolitan</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Overhage, J M" uniqKey="Overhage J">J.M. Overhage</name>
</author>
<author>
<name sortKey="Tierney, W M" uniqKey="Tierney W">W.M. Tierney</name>
</author>
<author>
<name sortKey="Mcdonald, C J" uniqKey="Mcdonald C">C.J. McDonald</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Parker, C G" uniqKey="Parker C">C.G. Parker</name>
</author>
<author>
<name sortKey="Rocha, R A" uniqKey="Rocha R">R.A. Rocha</name>
</author>
<author>
<name sortKey="Campbell, J R" uniqKey="Campbell J">J.R. Campbell</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Peleg, M" uniqKey="Peleg M">M. Peleg</name>
</author>
<author>
<name sortKey="Tu, S" uniqKey="Tu S">S. Tu</name>
</author>
<author>
<name sortKey="Bury, J" uniqKey="Bury J">J. Bury</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Pynsent, P B" uniqKey="Pynsent P">P.B. Pynsent</name>
</author>
<author>
<name sortKey="Fairbank, J C" uniqKey="Fairbank J">J.C. Fairbank</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Rind, D M" uniqKey="Rind D">D.M. Rind</name>
</author>
<author>
<name sortKey="Davis, R" uniqKey="Davis R">R. Davis</name>
</author>
<author>
<name sortKey="Safran, C" uniqKey="Safran C">C. Safran</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Rind, D M" uniqKey="Rind D">D.M. Rind</name>
</author>
<author>
<name sortKey="Safran, C" uniqKey="Safran C">C. Safran</name>
</author>
<author>
<name sortKey="Russell, S P" uniqKey="Russell S">S.P. Russell</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Seyfang, A" uniqKey="Seyfang A">A. Seyfang</name>
</author>
<author>
<name sortKey="Miksch, S" uniqKey="Miksch S">S. Miksch</name>
</author>
<author>
<name sortKey="Marcos, M" uniqKey="Marcos M">M. Marcos</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Shannon, M" uniqKey="Shannon M">M. Shannon</name>
</author>
<author>
<name sortKey="Burstein, J" uniqKey="Burstein J">J. Burstein</name>
</author>
<author>
<name sortKey="Mandl, K" uniqKey="Mandl K">K Mandl</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Shephard, R" uniqKey="Shephard R">R. Shephard</name>
</author>
<author>
<name sortKey="Cameron, A" uniqKey="Cameron A">A. Cameron</name>
</author>
<author>
<name sortKey="Toribio, J" uniqKey="Toribio J">J. Toribio</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Shiffman, R N" uniqKey="Shiffman R">R.N. Shiffman</name>
</author>
<author>
<name sortKey="Michel, G" uniqKey="Michel G">G. Michel</name>
</author>
<author>
<name sortKey="Essaihi, A" uniqKey="Essaihi A">A. Essaihi</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Shwe, M A" uniqKey="Shwe M">M.A. Shwe</name>
</author>
<author>
<name sortKey="Middleton, B" uniqKey="Middleton B">B. Middleton</name>
</author>
<author>
<name sortKey="Heckerman, D E" uniqKey="Heckerman D">D.E. Heckerman</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Sorenson, D" uniqKey="Sorenson D">D. Sorenson</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Terenziani, P" uniqKey="Terenziani P">P. Terenziani</name>
</author>
<author>
<name sortKey="Montani, S" uniqKey="Montani S">S. Montani</name>
</author>
<author>
<name sortKey="Torchio, M" uniqKey="Torchio M">M. Torchio</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Tierney, W M" uniqKey="Tierney W">W.M. Tierney</name>
</author>
<author>
<name sortKey="Miller, M E" uniqKey="Miller M">M.E. Miller</name>
</author>
<author>
<name sortKey="Overhage, J M" uniqKey="Overhage J">J.M. Overhage</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Travis, J" uniqKey="Travis J">J. Travis</name>
</author>
<author>
<name sortKey="Latin, R" uniqKey="Latin R">R. Latin</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Tu, S W" uniqKey="Tu S">S.W. Tu</name>
</author>
<author>
<name sortKey="Musen, M A" uniqKey="Musen M">M.A. Musen</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Turner, S" uniqKey="Turner S">S. Turner</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Wagner, M M" uniqKey="Wagner M">M.M. Wagner</name>
</author>
<author>
<name sortKey="Pankaskie, M" uniqKey="Pankaskie M">M. Pankaskie</name>
</author>
<author>
<name sortKey="Hogan, W" uniqKey="Hogan W">W. Hogan</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Wald, J S" uniqKey="Wald J">J.S. Wald</name>
</author>
<author>
<name sortKey="Rind, D" uniqKey="Rind D">D. Rind</name>
</author>
<author>
<name sortKey="Safran, C" uniqKey="Safran C">C. Safran</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Wang, D" uniqKey="Wang D">D. Wang</name>
</author>
<author>
<name sortKey="Peleg, M" uniqKey="Peleg M">M. Peleg</name>
</author>
<author>
<name sortKey="Bu, D" uniqKey="Bu D">D. Bu</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Warner, H" uniqKey="Warner H">H. Warner</name>
</author>
<author>
<name sortKey="Blue, S R" uniqKey="Blue S">S.R. Blue</name>
</author>
<author>
<name sortKey="Sorenson, D" uniqKey="Sorenson D">D. Sorenson</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Warner, H R" uniqKey="Warner H">H.R. Warner</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Warner, H R" uniqKey="Warner H">H.R. Warner</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Warner, H R" uniqKey="Warner H">H.R. Warner</name>
</author>
<author>
<name sortKey="Bouhaddou, O" uniqKey="Bouhaddou O">O. Bouhaddou</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Warner, H R" uniqKey="Warner H">H.R. Warner</name>
</author>
<author>
<name sortKey="Toronto, A F" uniqKey="Toronto A">A.F. Toronto</name>
</author>
<author>
<name sortKey="Veasey, G" uniqKey="Veasey G">G. Veasey</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Warner, H R" uniqKey="Warner H">H.R. Warner</name>
</author>
<author>
<name sortKey="Toronto, A F" uniqKey="Toronto A">A.F. Toronto</name>
</author>
<author>
<name sortKey="Veasey, G" uniqKey="Veasey G">G. Veasey</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Weinstein, M C" uniqKey="Weinstein M">M.C. Weinstein</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Williamson, J W" uniqKey="Williamson J">J.W. Williamson</name>
</author>
<author>
<name sortKey="German, P S" uniqKey="German P">P.S. German</name>
</author>
<author>
<name sortKey="Weiss, R" uniqKey="Weiss R">R. Weiss</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Wilson, D H" uniqKey="Wilson D">D.H. Wilson</name>
</author>
<author>
<name sortKey="Wilson, P D" uniqKey="Wilson P">P.D. Wilson</name>
</author>
<author>
<name sortKey="Walmsley, R G" uniqKey="Walmsley R">R.G. Walmsley</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Wilson, P D" uniqKey="Wilson P">P.D. Wilson</name>
</author>
<author>
<name sortKey="Horrocks, J C" uniqKey="Horrocks J">J.C. Horrocks</name>
</author>
<author>
<name sortKey="Lyndon, P J" uniqKey="Lyndon P">P.J. Lyndon</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Yasnoff, W A" uniqKey="Yasnoff W">W.A. Yasnoff</name>
</author>
<author>
<name sortKey="Humphreys, B L" uniqKey="Humphreys B">B.L. Humphreys</name>
</author>
<author>
<name sortKey="Overhage, J M" uniqKey="Overhage J">J.M. Overhage</name>
</author>
</analytic>
</biblStruct>
</listBibl>
</div1>
</back>
</TEI>
<pmc article-type="chapter-article">
<pmc-dir>properties open_access</pmc-dir>
<front>
<journal-meta>
<journal-id journal-id-type="nlm-ta">Handbook of Biosurveillance</journal-id>
<journal-title-group>
<journal-title>Handbook of Biosurveillance</journal-title>
</journal-title-group>
</journal-meta>
<article-meta>
<article-id pub-id-type="pmc">7150155</article-id>
<article-id pub-id-type="publisher-id">B978-0-12-369378-5.50015-6</article-id>
<article-id pub-id-type="doi">10.1016/B978-012369378-5/50015-6</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Article</subject>
</subj-group>
</article-categories>
<title-group>
<article-title>Case Detection Algorithms</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" id="au1">
<name>
<surname>Tsui</surname>
<given-names>Fu-Chiang</given-names>
</name>
</contrib>
<contrib contrib-type="author" id="au2">
<name>
<surname>Wagner</surname>
<given-names>Michael M.</given-names>
</name>
</contrib>
<contrib contrib-type="author" id="au3">
<name>
<surname>Espino</surname>
<given-names>Jeremy</given-names>
</name>
</contrib>
</contrib-group>
<aff id="aff1">RODS Laboratory, Center for Biomedical Informatics, University of Pittsburgh, Pittsburg, Pennsylvania</aff>
<contrib-group>
<contrib contrib-type="author" id="au4">
<name>
<surname>Shephard</surname>
<given-names>Richard</given-names>
</name>
</contrib>
</contrib-group>
<aff id="aff2">Australian Biosecurity Cooperative Research Centre for Emerging Infectious Disease, Brisbane, Australia</aff>
<contrib-group>
<contrib contrib-type="editor">
<name>
<surname>Wagner</surname>
<given-names>Michael M.</given-names>
</name>
<degrees>M.D., Ph.D.</degrees>
</contrib>
</contrib-group>
<aff>REAL-TIME OUTBREAK AND DISEASE, SURVEILLANCE (RODS) LABORATORY, CENTER FOR BIOMEDICAL INFORMATICS, UNIVERSITY OF PITTSBURGH PITTSBURGH, PENNSYLVANIA</aff>
<contrib-group>
<contrib contrib-type="editor">
<name>
<surname>Moore</surname>
<given-names>Andrew W.</given-names>
</name>
<degrees>Ph.D.</degrees>
</contrib>
</contrib-group>
<aff>ROBOTICS AND COMPUTER SCIENCE, SCHOOL OF COMPUTER SCIENCE, CARNEGIE MELLON UNIVERSITY, PITTSBURGH, PENNSYLVANIA</aff>
<contrib-group>
<contrib contrib-type="editor">
<name>
<surname>Aryel</surname>
<given-names>Ron M.</given-names>
</name>
<degrees>M.D., MBA.</degrees>
</contrib>
</contrib-group>
<aff>DEL REY TECHNOLOGIES, LOS ANGELES, CALIFORNIA</aff>
<pub-date pub-type="pmc-release">
<day>2</day>
<month>9</month>
<year>2007</year>
</pub-date>
<pmc-comment> PMC Release delay is 0 months and 0 days and was based on .</pmc-comment>
<pub-date pub-type="ppub">
<year>2006</year>
</pub-date>
<pub-date pub-type="epub">
<day>2</day>
<month>9</month>
<year>2007</year>
</pub-date>
<fpage>199</fpage>
<lpage>216</lpage>
<permissions>
<copyright-statement>Copyright © 2006 Elsevier Inc. All rights reserved.</copyright-statement>
<copyright-year>2006</copyright-year>
<copyright-holder>Elsevier Inc.</copyright-holder>
<license>
<license-p>Since January 2020 Elsevier has created a COVID-19 resource centre with free information in English and Mandarin on the novel coronavirus COVID-19. The COVID-19 resource centre is hosted on Elsevier Connect, the company's public news and information website. Elsevier hereby grants permission to make all its COVID-19-related research that is available on the COVID-19 resource centre - including this research content - immediately available in PubMed Central and other publicly funded repositories, such as the WHO COVID database with rights for unrestricted research re-use and analyses in any form or by any means with acknowledgement of the original source. These permissions are granted for free by Elsevier for as long as the COVID-19 resource centre remains active.</license-p>
</license>
</permissions>
</article-meta>
</front>
<body>
<sec id="cesec1">
<label>1</label>
<title>INTRODUCTION</title>
<p id="para1">This chapter focuses on algorithmic methods for case detection. As we discussed in Chapter 3, the objective of case detection is to notice the existence of a single case of a disease. Case detection is a core activity of biosurveillance. Detection of an outbreak usually depends on detection of individual cases, although it is also possible to detect an outbreak from data other than case data (e.g., retail sales of thermometers or satellite imagery).</p>
<p id="para2">For most of the 20th century, governmental public health relied almost exclusively on the astute clinician and the clinical laboratory to detect and report cases via the notifiable disease system. Algorithms for case detection did not exist, with the possible exception of case definitions discussed in Chapter 3, which are algorithms in the sense that they are formal specifications that a clinician or epidemiologist can follow to classify an individual as a suspected or confirmed case.</p>
<p id="para3">Around the beginning of the 21st century, emerging diseases and the threat of bioterrorism began to stress the capabilities of the notifiable disease system. Health departments endeavored to improve it by creating web-based forms for disease reporting and electronic laboratory reporting. Their goal is to increase completeness of reporting and decrease time latencies inherent in paper-based reporting.</p>
<p id="para4">After the anthrax postal attacks of 2001, health departments redoubled their efforts to improve disease reporting by increasing the “astuteness” of clinicians through education and training (Gerberding et al., 2002,
<xref rid="bib32" ref-type="bibr">Hughes and Gerberding, 2002</xref>
). A specialist in infectious diseases had detected and reported the first case of inhalational anthrax (
<xref rid="bib38" ref-type="bibr">Kolata, 2001</xref>
); thus, the conventional wisdom was that the notifiable disease system worked. For the foreseeable future, increasing the ability of front-line physicians to diagnose rare diseases through better training was our best defense against bioterrorism. The conventional wisdom was correct insofar as case detection by clinicians is important in outbreak detection. However, it was overly sanguine about the ability of training to improve the existing capability.
<xref rid="fn1" ref-type="fn">1</xref>
</p>
<p id="para5">There is a limit to which additional training can improve a clinician's ability to detect and report rare diseases to a biosur-veillance organization. Humans are not perfectible in this manner, as noted first by Dr. Clem McDonald, who entitled his seminal paper on physician performance
<italic>Protocol-Based Computer Reminders, the Quality of Care and the Non-Perfectability of Man</italic>
(
<xref rid="bib47" ref-type="bibr">McDonald, 1976b</xref>
).
<xref rid="fn2" ref-type="fn">2</xref>
</p>
<p id="para6">His research, conducted in the early 1970s at the Regenstrief Institute in Indiana, demonstrated that even for common conditions, such as diabetes and hypertension, and for common preventive measures, such as immunizations, physicians often failed to deliver required services. However, when reminded by a computer system that monitored electronic patient data about the need to vaccinate a
<italic>specific patient</italic>
or order a needed test, physicians complied with standards of care at twice the rate as when not reminded. When the system stopped reminding the physicians, however, their compliance rates quickly returned to baseline; thus, any “education” or “training” that the system provided had no lasting effect on compliance.</p>
<p id="para7">McDonald's research spawned a new line of system-level thinking in medicine that continues to this day (Kohn et al., 2000,
<xref rid="bib39" ref-type="bibr">Leavitt, 2001</xref>
, Yasnoff et al., 2004). McDonald concluded this influential paper with the observation that, although man is not perfectible,
<italic>systems</italic>
of care are.</p>
</sec>
<sec id="cesec2">
<label>2</label>
<title>PERFECTING CASE DETECTION</title>
<p id="para8">The best case detection system imaginable would be one in which every individual in a community is examined every morning by the best diagnostician in the world. This diagnostician would have all the time in the world to interview and examine each person. Since she would be examining everyone every day, she would notice patterns (clusters) of early illness in a community. Her awareness of patterns would appropriately bias her diagnostic thinking (and treatment) of individual patients. Physicians are taught (and reminded incessantly) “when you hear hoof beats, don't think of zebras.” This adage is an informal statement that when the evidence available about a particular patient supports equally a diagnosis of either influenza or SARS (e.g., the patient has constitutional symptoms and no history of exposure to SARS), they should conclude that the diagnosis of influenza is far more likely than SARS. This diagnostician would also never fail to report immediately each fever, early syndromic presentation, or reportable disease to governmental public health.</p>
<p id="para9">This ideal scenario recognizes the importance of the knowledge, judgment, and skills that clinicians bring to bear on the diagnosis of disease. The importance of expert knowledge and judgment underlies the opinion, expressed by experts in public health after the anthrax letters in 2001, that there is no substitute for an astute clinician. This ideal scenario also recognizes that knowledge of the prevalence of disease in a population influences the diagnostic work up and management of individual patients.</p>
<p id="para10">Of course, such a system is not feasible due to the impossibility of having every person seen by the same diagnostician every day or the alternative of cloning the best diagnostician and ensuring that the clones could instantly share information about individuals they were seeing. Nevertheless, it represents a benchmark against which we can compare other schemes that are perhaps superior to current approaches.</p>
<p id="para11">In the next section, we discuss diagnostic expert systems, which are computer programs (algorithms) that embody the diagnostic knowledge and diagnostic skills of expert clinicians. Diagnostic expert systems are far less expensive than clinicians, never tire, and we can clone them at will. They make it reasonable to imagine a biosurveillance system in which a highly competent diagnostician examines thousands of individuals in a community every day with consistent diagnostic quality—reporting fevers, syndromes, and reportable diseases to a health department without fail and without delay. They make it possible to imagine a biosurveillance system in which the health department analyzes highly improved case data and communicates up-to-the-minute information about patterns of illness in the community back to the diagnosticians.</p>
</sec>
<sec id="cesec3">
<label>3</label>
<title>DIAGNOSTIC EXPERT SYSTEMS</title>
<p id="para12">Diagnostic expert systems are computer algorithms that automate the cognitive process of medical (or veterinary) diagnosis. Many readers will be surprised to learn that researchers in the fields of artificial intelligence and medical informatics have been developing and fielding such systems since the 1960s. The first fielded system, developed by Dr. Homer Warner in Salt Lake City, provided diagnostic assistance for children with congenital heart disease (Warner et al., 1961, Warner et al., 1964). Congenital heart diseases are severe birth defects of the valves and structure of the heart. In the 1960s, the exact nature of heart malformations was very difficult to diagnose without invasive and risky angiographic procedures. Dr. F. Timothy de Dombal developed a similar system for the differential diagnosis of the acute abdomen, another high-stakes diagnostic problem. A surgeon must differentiate between conditions that require emergency surgery, such as appendicitis, and conditions, such as pancreatitis, for which surgery is relatively contraindicated (de Dombal et al., 1972, de Dombal et al., 1974, Wilson et al., 1975, de Dombal, 1975, Wilson et al., 1977,
<xref rid="bib14" ref-type="bibr">de Dombal, 1984</xref>
,Adams et al., 1986, McAdam et al., 1990,
<xref rid="bib15" ref-type="bibr">de Dombal, 1990</xref>
, de Dombal et al., 1993,
<xref rid="bib2" ref-type="bibr">American College of Emergency Physicians, 1994</xref>
).</p>
<sec id="cesec4">
<label>3.1</label>
<title>How Diagnostic Expert Systems Work: Data Collection</title>
<p id="para13">We can perhaps best explain how a diagnostic expert system works by analogy to the process that a physician uses to diagnose a patient. Like a physician, a diagnostic expert system begins by collecting information about the patient's illness— symptoms, observations from physical examination, results from laboratory tests, risk factors for disease (e.g., travel to a foreign country) and pre-existing medical conditions (e.g., diabetes). We refer to this diagnostic information collectively as the findings. Of course, the computer usually does not interview the patient and (at present) never examines the patient. Rather, a physician interviews and examines the patient after which she or an assistant enters the findings into the program (e.g.,
<xref rid="bib79" ref-type="bibr">Warner and Bouhaddou, 1994</xref>
,
<xref rid="bib42" ref-type="bibr">London, 1998</xref>
,
<xref rid="bib5" ref-type="bibr">Buchanan and Shortliffe, 1984</xref>
, Miller et al., 1986, Shwe et al., 1991, Heckerman et al., 1992). Increasingly, diagnostic expert systems acquire findings automatically from clinical information systems (Aronsky et al., 2001, Burnside et al., 2004, McDonald et al., 1991). There are also examples of diagnostic expert systems that interview patients directly to obtain their medical histories (
<xref rid="bib59" ref-type="bibr">Pynsent and Fairbank, 1989</xref>
, Wald et al., 1995).</p>
</sec>
<sec id="cesec5">
<label>3.2</label>
<title>How Diagnostic Expert Systems Work: Knowledge Representation</title>
<p id="para14">Like the physician, the diagnostic expert system is a storehouse of medical knowledge. A diagnostic expert system stores its medical knowledge in tables of diseases and their findings. There are typically a table of prevalences for each disease (e.g.,
<xref rid="cetable1" ref-type="table">Table 13.1</xref>
) and tables with every finding of every disease that the system knows about (e.g.,
<xref rid="cetable2" ref-type="table">Table 13.2</xref>
). The latter tables usually represent the strength of association between diseases and findings as conditional probabilities.
<table-wrap position="float" id="cetable1">
<label>TABLE 13.1</label>
<caption>
<p>Prior Probabilities and Prior Odds of FMD and MCD</p>
</caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left">Disease</th>
<th align="center">P(Disease)</th>
<th align="center">Odds(Disease)</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left">FMD</td>
<td align="center">0.001</td>
<td align="center">0.001001</td>
</tr>
<tr>
<td align="left">MCD</td>
<td align="center">0.001</td>
<td align="center">0.001001</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn>
<p>
<italic>Notes:</italic>
The notation p(FMD) actually is shorthand for a probability of an event variable called FMD that can take the values true or false. So, p(FMD) actually stands for p(foot and mouth disease is present) or p(foot and mouth disease is not present). If we to write
<xref rid="cetable1" ref-type="table">Table 13.1</xref>
out in its full form, it would have four rows corresponding to p(FMD is present) = 0.001, p(FMD is absent) = 0.999, p(MCD is present) = 0.001, p(MCD is absent) = 0.999. The laws of probability require that the sum of the probabilities for all the event variable outcomes will be equal to 1 (e.g., p[FMD is present] + p[FMD is absent] = 1, because it is a certainty that something is either present or it is absent), so knowledge engineers usually save space by only writing one row per disease. FMD, foot and mouth disease; MCD, mad cow disease.</p>
</fn>
</table-wrap-foot>
</table-wrap>
<table-wrap position="float" id="cetable2">
<label>TABLE 13.2</label>
<caption>
<p>Conditional Probabilities for FMD and MCD</p>
</caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left">Finding</th>
<th align="left">Disease</th>
<th align="left">p(Finding|Disease)
<xref rid="cetablefn2" ref-type="table-fn">a</xref>
</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left">Drooling of saliva present Drooling of saliva present</td>
<td align="left">FMD present FMD absent</td>
<td align="left">0.95 (sensitivity) 0.05 (1 - specificity)</td>
</tr>
<tr>
<td align="left">Drooling of saliva present Drooling of saliva present</td>
<td align="left">MCD present MCD absent</td>
<td align="left">0.001 (sensitivity) 0.05 (1 - specificity)</td>
</tr>
<tr>
<td align="left">More than one animal affected More than one animal affected</td>
<td align="left">FMD present FMD absent</td>
<td align="left">0.95 (sensitivity) 0.2 (1 - specificity)</td>
</tr>
<tr>
<td align="left">More than one animal affected More than one animal affected</td>
<td align="left">MCD present MCD absent</td>
<td align="left">0.001 (sensitivity) 0.2 (1 - specificity)</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn id="cetablefn2">
<label>a</label>
<p id="cenotep2">Similar to the previous table, the knowledge engineers have left out half of the combinations because they can be derived from those listed listed by subtraction from 1. For example, p(drooling of saliva is not present|FMD is present)= 1 - p(drooling of saliva is present|FMD is present) = 1 − 0.95 = 0.05. FMD, foot and mouth disease; MCD, mad cow disease. Probabilities from BOVID, a cattle diagnostic program. Courtesy of Animal Information Management Pty. Ltd, Victoria, Australia, BOVID, a cattle diagnostic program.</p>
</fn>
</table-wrap-foot>
</table-wrap>
</p>
</sec>
<sec id="cesec6">
<label>3.3</label>
<title>How Diagnostic Expert Systems Work: Differential Diagnosis</title>
<p id="para15">Like the physician, the computer program generates a differential diagnosis for the sick individual. A differential diagnosis is a list of diseases that are most likely to account for the findings in a patient. The diagnostic expert system typically creates its differential diagnosis by computing the posterior probability for every disease given the findings. A disease's posterior probability is the chance that the patient has the disease, given the findings.</p>
<p id="para16">Diagnostic expert systems use Bayes rules to compute the differential diagnosis. The relevance of Bayes rules to medical diagnosis was first introduced theoretically by
<xref rid="bib40" ref-type="bibr">Ledley and Lusted (1959)</xref>
and first used in a diagnostic expert system by Homer Warner in 1962. Developers of diagnostic expert systems continue to use the same methods as did Homer Warner, as well as more complex Bayesian methods (but the original technique generally works well).</p>
</sec>
<sec id="cesec7">
<label>3.4</label>
<title>How Diagnostic Expert Systems Work: Question Generation</title>
<p id="para17">A differential diagnosis must be “resolved”; that is, the diseases in the list must be ruled in or ruled out. Like an expert physician, the diagnostic expert system engages in a cyclic process often referred to as “hypothesize and test” to resolve the differential diagnosis. A diagnostic expert system uses value-of-information calculations (
<xref rid="bib82" ref-type="bibr">Weinstein, 1980</xref>
) to recommend to the physician user additional findings that will resolve the differential diagnosis efficiently. Value-of-information calculations identify those findings, which, if known to be present or absent, optimally discriminate among the diseases in the differential diagnosis, where optimality takes into account not only the probability of a diagnosis, but cost-benefit considerations, such as whether a diagnosis is treatable.</p>
<p id="para18">As new findings become available (either as a result of following recommendations from the diagnostic expert system, consultants, or the physician's own judgment), the physician user can rerun the diagnostic expert system to recompute the differential diagnosis. The most likely diagnosis from the first run may become less or more likely as the new information acts to rule in or rule out each diagnosis. The user can rerun the program whenever new findings about the individual become available during the course of the diagnostic work-up. The net result of this cyclic process is the diagnostic certainty about the diagnoses in the differential increases over time (i.e., probabilities of the diagnoses in the differential move towards zero, indicating certainty that a disease is not present, or one, indicating certainty that a disease is present) (
<xref rid="f1" ref-type="fig">Figure 13.1</xref>
).
<fig id="f1">
<label>FIGURE 13.1</label>
<caption>
<p>The process of diagnosis. Like a physician, a diagnostic expert system analyzes patient data to generate a differential diagnosis. Based on the differential diagnosis and value of information calculations, the diagnostic expert system can suggest additional questions to ask the patient, additional physical observations to make about the patient, or additional tests to consider. A physician may accept the recommendations or not. As additional information about the patient's illness arrives over time (either as a result of tests or questions suggested by the computer; or by the physician; or simply the passage of time, this user can enter this new information and rerun the computer program to generate an updated differential diagnosis). This process of data collection and analysis can be repeated frequently until the diagnosis for a patient is established with sufficient certainty and diagnostic precision that further diagnostic evaluation is not necessary.</p>
</caption>
<graphic xlink:href="f13-01-9780123693785"></graphic>
</fig>
</p>
</sec>
</sec>
<sec id="cesec8">
<label>4</label>
<title>EXAMPLES OF DIAGNOSTIC EXPERT SYSTEMS: BOSSS AND ILIAD</title>
<p id="para19">As indicated in the previous discussion, researchers have developed many diagnostic expert systems that vary in both the underlying technology as well as the domain of application. In this section, we briefly describe two systems that illustrate the key characteristics of probabilistic diagnostic expert systems. These systems—Iliad and BOSSS—are diagnostic expert systems in the domains of diseases of humans and cattle, respectively.</p>
<sec id="cesec9">
<label>4.1</label>
<title>Iliad</title>
<p id="para20">Iliad was developed by Homer R. Warner, Jr. and colleagues at the University of Utah in the 1980s (
<xref rid="bib77" ref-type="bibr">Warner, 1989</xref>
, Sorenson et al., 1988, Cundick et al., 1989,
<xref rid="bib79" ref-type="bibr">Warner and Bouhaddou, 1994</xref>
,
<xref rid="bib78" ref-type="bibr">Warner, 1990</xref>
). Iliad is a stand-alone diagnostic expert system; that is, it requires a user (physician) to enter findings into the program. Iliad uses Bayes rules to compute a differential diagnosis for the patient's illness. It uses value-of-information calculations to recommend additional tests and observations.</p>
<p id="para21">Iliad performs differential diagnosis of human diseases in a variety of fields: internal medicine, sports medicine, pediatrics, dermatology, psychiatry, obstetrics/gynecology, urology, peripheral vascular diseases, and sleep disorders. Iliad covers more than 900 diseases and 1500 syndromes (which means that there are tables of information about diseases and findings for approximately 2400 diseases similar to those shown in
<xref rid="f1" ref-type="fig">Figures 13.1</xref>
and
<xref rid="f3" ref-type="fig">13.2</xref>
). Iliad computes a differential diagnosis for a patient and then displays the diseases and syndromes to the user in order of posterior probability as shown in
<xref rid="f3" ref-type="fig">Figure 13.2</xref>
. If the user asks Iliad to suggest additional tests or questions to ask the patient, the program performs value-of-information calculations to suggest findings that would discriminate among the diseases in the differential diagnosis (
<xref rid="f2" ref-type="fig">Figure 13.3</xref>
).
<fig id="f3">
<label>FIGURE 13.2</label>
<caption>
<p>Consultation mode of Iliad showing the patient findings that the physician entered (lower right panel), and the differential diagnosis (panel on left) that Iliad generated from those findings.</p>
</caption>
<graphic xlink:href="f13-02-9780123693785"></graphic>
<attrib>(Courtesy of LE Widman,
<ext-link ext-link-type="uri" xlink:href="http://www.informaticamedica.org.br/informaticamedica/n0105/widman.htm.)" id="interref1">
<italic>http://www.informaticamedica.org.br/informaticamedica/n0105/widman.htm.)</italic>
</ext-link>
</attrib>
</fig>
<fig id="f2">
<label>FIGURE 13.3</label>
<caption>
<p>Iliad screen requesting additional patient information.</p>
</caption>
<graphic xlink:href="f13-03-9780123693785"></graphic>
<attrib>(From Warner, H. R., Jr. (1989). Iliad: moving medical decision-making into new frontiers. Methods Inform Med 28:370–2, with permission.)</attrib>
<permissions>
<copyright-statement>© 2006 </copyright-statement>
<copyright-year>2006</copyright-year>
<license>
<license-p>Since January 2020 Elsevier has created a COVID-19 resource centre with free information in English and Mandarin on the novel coronavirus COVID-19. The COVID-19 resource centre is hosted on Elsevier Connect, the company's public news and information website. Elsevier hereby grants permission to make all its COVID-19-related research that is available on the COVID-19 resource centre - including this research content - immediately available in PubMed Central and other publicly funded repositories, such as the WHO COVID database with rights for unrestricted research re-use and analyses in any form or by any means with acknowledgement of the original source. These permissions are granted for free by Elsevier for as long as the COVID-19 resource centre remains active.</license-p>
</license>
</permissions>
</fig>
</p>
<p id="para22">Researchers have compared Iliad's diagnostic performance on real cases with that of expert physicians and found equivalent performance (
<xref rid="bib27" ref-type="bibr">Graber and VanScoy, 2003</xref>
, Friedman et al., 1999, Elstein et al., 1996, Murphy et al., 1996). Interestingly, Iliad did not achieve widespread acceptance in clinical practice because the entering of patient data was too time-consuming for busy clinicians and the program is no longer in use.</p>
</sec>
<sec id="cesec10">
<label>4.2</label>
<title>BOSSS</title>
<p id="para23">The Bovine Syndromic Surveillance System (BOSSS) is a web-based disease-reporting tool that incorporates a diagnostic expert system for diagnosis of diseases of cattle (
<xref rid="f4" ref-type="fig">Figure 13.4</xref>
) (Shephard et al., 2005). BOSSS requires a user (veterinarian or cattle herd worker) to enter findings into the program (
<xref rid="f5" ref-type="fig">Figure 13.5</xref>
). BOSSS uses Bayes rules to compute a differential diagnosis for the patient's illness. It also uses value-of-information calculations to recommend additional tests and observations.
<fig id="f4">
<label>FIGURE 13.4</label>
<caption>
<p>Log-in page of the web-based bovine syndromic surveillance system.</p>
</caption>
<graphic xlink:href="f13-04-9780123693785"></graphic>
</fig>
<fig id="f5">
<label>FIGURE 13.5</label>
<caption>
<p>A graphic user interface for entering findings of a sick animal.</p>
</caption>
<graphic xlink:href="f13-05-9780123693785"></graphic>
</fig>
</p>
<p id="para24">Shephard and colleagues developed BOSSS to meet a need to capture disease and syndrome observation data from field observations made by veterinarians, producers, and lay observers. These observations are important to population-based surveillance of cattle herds and to the business of cattle production, but are largely unrecorded and, therefore, unavailable for biosurveillance purposes. BOSSS encourages use by rewarding a user with diagnostic support in his efforts to determine the cause of illness or death in cattle.</p>
<p id="para25">Like Iliad, BOSSS contains information on the prevalence of diseases (for approximately 1000 diseases of cattle). It also contains the sensitivity and specificity of each finding for each disease. (We discuss sensitivity and specificity in Sect. 5.1.) The development team compiled this information from veterinary literature and the opinions of veterinary experts. Like Iliad, it uses Bayes rules to determine the posterior probability of each disease given the findings (
<xref rid="f6" ref-type="fig">Figure 13.6</xref>
). The program promotes the capture of extra information on each case through the use of an interrogation module that presents questions to the user (
<xref rid="f7" ref-type="fig">Figure 13.7</xref>
). These questions are key differentiating signs for the most likely diseases identified by the system that have not already been recorded by the user. Unlike Iliad, BOSSS has an explicit biosurveillance mission. The “syn-dromic-surveillance” component of BOSSS is illustrated by the mapping of cases shown in
<xref rid="f8" ref-type="fig">Figure 13.8</xref>
.
<fig id="f6">
<label>FIGURE 13.6</label>
<caption>
<p>Differential diagnosis results ranked by posterior probabilities.</p>
</caption>
<graphic xlink:href="f13-06-9780123693785"></graphic>
</fig>
<fig id="f7">
<label>FIGURE 13.7</label>
<caption>
<p>A graphic user interface for guided examination.</p>
</caption>
<graphic xlink:href="f13-07-9780123693785"></graphic>
</fig>
<fig id="f8">
<label>FIGURE 13.8</label>
<caption>
<p>A mapping tool that displays geographic locations of reported cases.</p>
</caption>
<graphic xlink:href="f13-08-9780123693785"></graphic>
</fig>
</p>
<p id="para26">The developers of BOSSS, learning lessons from Iliad and other diagnostic expert systems about the importance of fitting into the workflow of busy clinicians, are developing a palm-computer version of BOSSS. This portable version will fit into the practice patterns of cattle veterinarians, who spend their days at different locations and most definitely do not work in an office setting. A training manual is available for download at
<ext-link ext-link-type="uri" xlink:href="http://www.ausvet.com.au/bosss/resources/BOSSS_Manual.pdf" id="interref3">
<italic>http://www.ausvet.com.au/bosss/resources/BOSSS_Manual.pdf</italic>
</ext-link>
.</p>
</sec>
</sec>
<sec id="cesec11">
<label>5</label>
<title>KNOWLEDGE REPRESENTATION AND INFERENCE IN DIAGNOSTIC EXPERT SYSTEMS</title>
<p id="para27">As previously discussed, a diagnostic expert system contains an internal store of facts about diseases, including (1) the prevalence of each disease, (2) their findings, and (3) the statistical relationships between the findings and the diseases. We call this collection the knowledge base. In addition to the knowledge base, a diagnostic expert system contains an inference engine, which performs diagnostic reasoning (
<xref rid="f9" ref-type="fig">Figure 13.9</xref>
).
<fig id="f9">
<label>FIGURE 13.9</label>
<caption>
<p>Components and process flow in an expert system. The inference engine uses both patient data and medical knowledge to compute a differential diagnosis and to generate suggestions for additional collection of data. The inference engine obtains data from an inbound data-acquisition interface and it outputs the differential diagnosis and suggestions for additional data through an outbound results interface. In a freestanding diagnostic expert system such as Iliad or BOSSS, both the data-acquisition and results interfaces are screens that a physician interacts with. In an embedded system like Antibiotic Assistant, the data-acquisition interface is with hospital information systems (and to some extent with the user, but only for selected items of information that the user wishes to provide). The results interface could also be with another computer system such as a point-of-care system, which would present the differential diagnosis and suggestions through its own screens.</p>
</caption>
<graphic xlink:href="f13-09-9780123693785"></graphic>
</fig>
</p>
<p id="para28">To demonstrate how a diagnostic expert system uses Bayes rules to compute a differential diagnosis, we created mini-BOSSS, a tiny version of BOSSS. In particular, mini-BOSSS has a knowledge base with only two diseases and two findings. The diseases are foot and mouth disease (FMD) and mad cow disease (MCD). The findings are drooling saliva and whether there is more than one cow in the herd with this symptom.</p>
<sec id="cesec12">
<label>5.1</label>
<title>Probabilistic Knowledge Bases</title>
<p id="para29">We note that there are several kinds of expert systems, including the probabilistic diagnostic expert systems that we have been discussing, and rule-based expert systems. We discuss rule-based expert systems later in this chapter.</p>
<p id="para30">A probabilistic knowledge base uses probabilities to represent the prevalence of disease and the relationships between findings and diseases. A development team creates a knowledge base by a labor-intensive literature review supplemented by interviews with experts. Increasingly, developers use large data sets collected by hospital information systems (especially for disease prevalence) to develop knowledge bases. The process that developers use to elicit knowledge from experts and to convert information in the literature into a knowledge base is referred to as knowledge acquisition or knowledge engineering (
<xref rid="bib22" ref-type="bibr">Feigenbaum, 1977</xref>
).</p>
<sec id="cesec13">
<label>5.1.1</label>
<title>Prior Probabilities (Disease Prevalence)</title>
<p id="para31">The prior probability is the prevalence of disease in the population. We represent prior probabilities using the notation P(Disease). For example, P(FMD) represents the prior probability of foot and mouth disease.
<xref rid="cetable1" ref-type="table">Table 13.1</xref>
shows the prior probabilities of FMD and MCD that we use in our example.
<xref rid="cetable1" ref-type="table">Table 13.1</xref>
also shows the prior odds of the diseases in mini-BOSSS. Odds are a simple mathematical transform of probabilities, which are essentially equal to probabilities when probabilities are less than 0.1. The reason that we show odds in
<xref rid="cetable1" ref-type="table">Table 13.1</xref>
is that we use the odds-likelihood form of Bayes rules in our example. We will define odds and the odds-likelihood form of Bayes shortly.</p>
</sec>
<sec id="cesec14">
<label>5.1.2</label>
<title>Conditional Probabilities</title>
<p id="para32">A conditional probability is the chance of one event occurring given the occurrence of another event. In diagnostic expert systems, we use conditional probabilities to describe the probability of seeing a certain finding (one event) when a disease is present (another event). If the conditional probability is high, it means that the particular finding is often associated with the disease. The mathematical notation for the conditional probability of a finding, given a disease, is P(Finding|Disease). For example, P(drooling of saliva is present|FMD is present) is the probability of observing drooling of saliva in a cow with foot and mouth disease.
<xref rid="cetable2" ref-type="table">Table 13.2</xref>
lists the conditional probabilities for the findings and diseases in mini-BOSSS.</p>
<p id="para33">If you are familiar with the concepts of sensitivity and specificity (discussed in detail in Chapter 20), you may recognize that the conditional probability p(drooling of saliva is present |FMD is present) is the sensitivity of the symptom
<italic>drooling of saliva</italic>
for the disease
<italic>FMD</italic>
. Similarly, p(drooling of saliva is absent|FMD is absent) is the specificity of drooling of saliva for FMD. Many readers will be quite familiar and comfortable with the concept of sensitivity and specificity of laboratory tests, but perhaps not with the idea of sensitivity and specificity of other findings. In fact, symptoms, travel history, results of physical examination, and results of laboratory tests are all nothing more than observations that we make about an individual that may help us discriminate between individuals with disease and those without disease. It is possible to measure a sensitivity, specificity (or, alternatively, likelihood ratios) for any of these diagnostic observations. Consider the diseases presented in mini-BOSSS. Cattle affected with FMD develop very severe mouth vesicles and ulcers. This mouth pain results in excessive salivation; therefore, it causes drooling of saliva. Cattle affected with MCD do not develop mouth wounds; therefore, they are not likely to be observed drooling saliva. The conditional probabilities in
<xref rid="cetable2" ref-type="table">Table 13.2</xref>
reflect the observations above; P(drooling of saliva|FMD) is equal to 0.95 and p(drooling of saliva|MCD) is equal to 0.001.</p>
<p id="para34">If our knowledge base included laboratory tests for FMD and MCD, these conditional probabilities would be the sensitivities and specificities of the laboratory tests for FMD and MCD.</p>
<p id="para35">Researchers working in the field of diagnostic expert systems sometimes refer to conditional probabilities of findings for given diseases as textbook knowledge because these probabilities are often available in textbooks of medicine (human or veterinary). For example, a chapter in a textbook of veterinary medicine on FMD will contain many statements about the frequency with which different findings occur in animals with FMD. These frequencies are basic facts, highly relevant to diagnosis.</p>
</sec>
</sec>
<sec id="cesec15">
<label>5.2</label>
<title>Probabilistic Inference Engines</title>
<p id="para36">A probabilistic inference engine is an algorithm that computes a differential diagnosis for a sick individual. In particular, it computes the posterior probability of each disease in its knowledge base, given the findings for a sick individual. In our example, the algorithm will compute the posterior probability p(FMD is present|drooling of saliva is present, more than one animal is affected) and the posterior probability p(MCD is present|drooling of saliva is present, more than one animal is affected).</p>
<p id="para37">A probabilistic inference engine uses Bayes rules to compute the posterior probability from the prior probability (or prior odds) and the sensitivities and specificities of the observed findings. Once it has computed the posterior probability of every disease in its knowledge base, the inference engine outputs a differential diagnosis, that is, a list of all diseases in the knowledge base sorted from most probable to least probable.</p>
<p id="para38">Bayes rules are sometimes referred to as Bayesian inversion because it inverts the conditional probability that a given finding will be observed in an individual with disease (textbook knowledge) into the probability that an individual has the disease, given that we observe a finding in that individual (diagnostic knowledge). That is, it inverts p(drooling of saliva is present|FMD is present) to p(FMD is present|drooling of saliva is present), which is exactly what a veterinarian needs to know. A veterinarian needs to know the likelihood that the cow has FMD or MCD, given the findings.</p>
<p id="para39">A complete discussion of the various algorithms that a probabilistic inference engine can use to compute posterior probabilities using Bayes rules would fill a book, such as the excellent textbook by Richard
<xref rid="bib55" ref-type="bibr">Neapolitan (2003)</xref>
. For teaching purposes, we will use a simple form of Bayes rules called the
<italic>odds-likelihood form of Bayes rules</italic>
. This simplified form rests on an assumption that findings are independent, given the disease, which is why researchers called this formulation (and similar formulations)
<italic>naive Bayes</italic>
. This simple form of Bayes rules works surprisingly well in many diagnostic expert systems, including the systems developed by Homer Warner (congenital heart advisor) and Homer Warner Jr. (Iliad), as well as the BOSSS. We will use the odds-likelihood version of Bayes rules to illustrate how BOSSS computes a differential diagnosis for two diseases, given two findings about a sick cow.</p>
<sec id="cesec16">
<label>5.2.1</label>
<title>Definition of Odds</title>
<p id="para40">For clarity and convenient reference, we here provide the definition of
<italic>odds</italic>
:</p>
<p id="para41">
<disp-formula id="formula1">
<label>(1)</label>
<mml:math id="M1" altimg="si1.gif" overflow="scroll">
<mml:mrow>
<mml:mi>o</mml:mi>
<mml:mi>d</mml:mi>
<mml:mi>d</mml:mi>
<mml:mi>s</mml:mi>
<mml:mo>=</mml:mo>
<mml:mfrac>
<mml:mi>p</mml:mi>
<mml:mrow>
<mml:mn>1</mml:mn>
<mml:mo></mml:mo>
<mml:mi>p</mml:mi>
</mml:mrow>
</mml:mfrac>
</mml:mrow>
</mml:math>
</disp-formula>
</p>
<p id="para42">Odds are simply a rescaling of probability from a range of 0 to 1 to a range of 0 to infinity (which you can prove to yourself by substituting probabilities of zero and one into
<xref rid="formula1" ref-type="disp-formula">Eq. 1</xref>
). For probabilities less than 0.1, probabilities and odds are roughly equal. A probability of 0.1, for example, equals 0.1 an odds of
<inline-formula>
<mml:math id="M2" altimg="si2.gif" overflow="scroll">
<mml:mrow>
<mml:mfrac>
<mml:mrow>
<mml:mn>0.1</mml:mn>
</mml:mrow>
<mml:mrow>
<mml:mn>1</mml:mn>
<mml:mo></mml:mo>
<mml:mn>0.1</mml:mn>
</mml:mrow>
</mml:mfrac>
<mml:mo>=</mml:mo>
<mml:mn>0.11</mml:mn>
</mml:mrow>
</mml:math>
</inline-formula>
. You can safely think “probability” whenever we use the term “odds” and vice versa, as we will be dealing with small probabilities. Upon reading Appendix D, which contains the simplest probabilistic formulation of Bayes rules, you will see why we use the odds-likelihood form in this chapter—it is simpler to learn Bayes rules using this form, and more illuminating.</p>
</sec>
<sec id="cesec17">
<label>5.2.2</label>
<title>Odds-Likelihood Form of Bayes Rule</title>
<p id="para43">
<xref rid="formula2" ref-type="disp-formula">Equation 2</xref>
is the odds-likelihood form of Bayes rules when we have only one finding.</p>
<p id="para44">
<disp-formula id="formula2">
<label>(2)</label>
<mml:math id="M3" altimg="si3.gif" overflow="scroll">
<mml:mrow>
<mml:mi>O</mml:mi>
<mml:mi>d</mml:mi>
<mml:mi>d</mml:mi>
<mml:mi>s</mml:mi>
<mml:mo stretchy="false">(</mml:mo>
<mml:mi>D</mml:mi>
<mml:mo></mml:mo>
<mml:mi>f</mml:mi>
<mml:mo stretchy="false">)</mml:mo>
<mml:mo>=</mml:mo>
<mml:mi>L</mml:mi>
<mml:msub>
<mml:mi>R</mml:mi>
<mml:mrow>
<mml:mi>f</mml:mi>
<mml:mo></mml:mo>
<mml:mi>D</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>×</mml:mo>
<mml:mi>O</mml:mi>
<mml:mi>d</mml:mi>
<mml:mi>d</mml:mi>
<mml:mi>s</mml:mi>
<mml:mo stretchy="false">(</mml:mo>
<mml:mi>D</mml:mi>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</disp-formula>
</p>
<p id="para45">This equation says that if we know the prior odds
<italic>Odds(D)</italic>
(read prevalence) of a disease
<italic>D</italic>
and we observe one finding
<italic>f</italic>
of that disease in an individual, we can compute the posterior odds (read probability) by multiplying the prior odds times the likelihood ratio of that finding for that disease.</p>
<p id="para46">Likelihood ratios are nothing more than an alternative way of expressing the sensitivity and specificity of a test or observation for a disease. In fact, the likelihood ratio is defined in terms of sensitivities and specificities. The likelihood ratio positive (positive means that the finding
<italic>drooling saliva</italic>
is known to be present) of drooling saliva for the disease FMD follows:
<disp-formula id="formula3">
<label>(3)</label>
<mml:math id="M4" altimg="si4.gif" overflow="scroll">
<mml:mrow>
<mml:mi>L</mml:mi>
<mml:msubsup>
<mml:mi>R</mml:mi>
<mml:mrow>
<mml:mtext>drooling</mml:mtext>
<mml:mi></mml:mi>
<mml:mtext>saliva</mml:mtext>
<mml:mo>|</mml:mo>
<mml:mtext>FMD</mml:mtext>
</mml:mrow>
<mml:mo>+</mml:mo>
</mml:msubsup>
<mml:mo>=</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:mtext>p</mml:mtext>
<mml:mo stretchy="false">(</mml:mo>
<mml:mtext>drooling saliva prsent</mml:mtext>
<mml:mo>|</mml:mo>
<mml:mtext>FMD present</mml:mtext>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:mtext>p</mml:mtext>
<mml:mo stretchy="false">(</mml:mo>
<mml:mtext>drooling saliva present</mml:mtext>
<mml:mo>|</mml:mo>
<mml:mtext>FMD absent</mml:mtext>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:mfrac>
</mml:mrow>
</mml:math>
</disp-formula>
In
<xref rid="formula3" ref-type="disp-formula">Equation 3</xref>
, the numerator is sensitivity, and the denominator is the false positive rate (equal to 1 — specificity).</p>
<p id="para47">Note that the beauty of the likelihood ratio
<inline-formula>
<mml:math id="M5" altimg="si5.gif" overflow="scroll">
<mml:mrow>
<mml:mi>L</mml:mi>
<mml:msubsup>
<mml:mi>R</mml:mi>
<mml:mrow>
<mml:mtext>drooling</mml:mtext>
<mml:mi></mml:mi>
<mml:mtext>saliva</mml:mtext>
<mml:mo>|</mml:mo>
<mml:mtext>FMD</mml:mtext>
</mml:mrow>
<mml:mo>+</mml:mo>
</mml:msubsup>
</mml:mrow>
</mml:math>
</inline-formula>
is that it is a very direct measure of how well drooling saliva discriminates between animals with FMD and animals without FMD. If drooling of saliva occurs much more frequently in animals with FMD than animals without FMD,
<inline-formula>
<mml:math id="M6" altimg="si6.gif" overflow="scroll">
<mml:mrow>
<mml:mi>L</mml:mi>
<mml:msubsup>
<mml:mi>R</mml:mi>
<mml:mrow>
<mml:mtext>drooling</mml:mtext>
<mml:mi></mml:mi>
<mml:mtext>saliva</mml:mtext>
<mml:mo>|</mml:mo>
<mml:mtext>FMD</mml:mtext>
</mml:mrow>
<mml:mo>+</mml:mo>
</mml:msubsup>
</mml:mrow>
</mml:math>
</inline-formula>
will be a large number. For a finding that is pathognomic (meaning that the finding in itself is sufficient to diagnose a disease), the denominator will be zero and the LR
<sup>+</sup>
will be infinity, meaning that no matter how small the prior odds are, the posterior odds will be infinity (which converts to a probability of 1.0, and means that the individual has the disease with certainty). If, on the other hand, drooling of saliva occurs with equal frequency in animals with FMD and animals without FMD, the numerator and the denominator will be equal and the
<inline-formula>
<mml:math id="M7" altimg="si7.gif" overflow="scroll">
<mml:mrow>
<mml:mi>L</mml:mi>
<mml:msubsup>
<mml:mi>R</mml:mi>
<mml:mrow>
<mml:mtext>drooling</mml:mtext>
<mml:mi></mml:mi>
<mml:mtext>saliva</mml:mtext>
<mml:mo>|</mml:mo>
<mml:mtext>FMD</mml:mtext>
</mml:mrow>
<mml:mo>+</mml:mo>
</mml:msubsup>
</mml:mrow>
</mml:math>
</inline-formula>
will be equal to one, which when multiplied times the prior odds of FMD will result in a posterior odds that is equal to the prior odds. This result makes sense. If a finding cannot discriminate between animals with FMD and without FMD, it contains no diagnostic information for the disease FMD, and should not increase or decrease our belief that the animal has FMD.</p>
<p id="para48">The likelihood ratio negative (negative means that the finding
<italic>drooling saliva</italic>
is known to be absent) follows:
<disp-formula id="formula4">
<label>(4)</label>
<mml:math id="M8" altimg="si8.gif" overflow="scroll">
<mml:mrow>
<mml:mi>L</mml:mi>
<mml:msubsup>
<mml:mi>R</mml:mi>
<mml:mrow>
<mml:mtext>drooling</mml:mtext>
<mml:mi></mml:mi>
<mml:mtext>saliva</mml:mtext>
<mml:mo>|</mml:mo>
<mml:mtext>FMD</mml:mtext>
</mml:mrow>
<mml:mo></mml:mo>
</mml:msubsup>
<mml:mo>=</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:mtext>p</mml:mtext>
<mml:mo stretchy="false">(</mml:mo>
<mml:mtext>drooling saliva absent</mml:mtext>
<mml:mo>|</mml:mo>
<mml:mtext>FMD present</mml:mtext>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:mtext>p</mml:mtext>
<mml:mo stretchy="false">(</mml:mo>
<mml:mtext>drooling saliva absent</mml:mtext>
<mml:mo>|</mml:mo>
<mml:mtext>FMD absent</mml:mtext>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:mfrac>
</mml:mrow>
</mml:math>
</disp-formula>
In
<xref rid="formula4" ref-type="disp-formula">Eq. 4,</xref>
the numerator is the false negative rate (equal to 1 - sensitivity), and the denominator is specificity. In medicine, the absence of a finding that we expect to see if the patient actually has the disease in question is useful information. There is even a term for it—
<italic>significant negative finding.</italic>
A significant negative finding, such as a negative laboratory test, helps to rule out a diagnosis. A likelihood ratio negative is always a number that is less than one (but greater or equal to zero) for findings that we expect to see more often in individuals with the disease than in individuals without the disease.</p>
<p id="para49">
<xref rid="formula2" ref-type="disp-formula">Equation 2</xref>
expresses the essence of Bayes rules. Diagnosticians use Bayes rules to update their prior belief in a diagnosis in light of new information. When a diagnostician has no information whatsoever about an individual, her belief that the individual has a disease should be the prevalence of the disease. If she makes an observation (whether positive or negative), she should update her belief in the diagnosis by multiplying the likelihood ratio for the test or observation for that disease times the prior odds of the disease (think “prevalence”).</p>
<p id="para50">If we know nothing about a cow whatsoever, then our belief that the cow has FMD is simply the prevalence of FMD. If we subsequently observe that the cow is drooling saliva, Bayes rules instructs us to update our belief that the cow has FMD using the information in
<xref rid="cetable1" ref-type="table">Table 13.1</xref>
and
<xref rid="cetable2" ref-type="table">13.2</xref>
using the following calculation:
<disp-formula id="formula5">
<label>(5)</label>
<mml:math id="M9" altimg="si9.gif" overflow="scroll">
<mml:mtable columnalign="left">
<mml:mtr>
<mml:mtd>
<mml:mtext>Odds</mml:mtext>
<mml:mo stretchy="false">(</mml:mo>
<mml:mtext>FMD I drooling saliva</mml:mtext>
<mml:mo stretchy="false">)</mml:mo>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd>
<mml:mo>=</mml:mo>
<mml:mi>L</mml:mi>
<mml:msubsup>
<mml:mi>R</mml:mi>
<mml:mrow>
<mml:mtext>drooling</mml:mtext>
<mml:mi></mml:mi>
<mml:mtext>saliva</mml:mtext>
<mml:mo>|</mml:mo>
<mml:mtext>FMD</mml:mtext>
</mml:mrow>
<mml:mo>+</mml:mo>
</mml:msubsup>
<mml:mo>×</mml:mo>
<mml:mtext>Odds</mml:mtext>
<mml:mo stretchy="false">(</mml:mo>
<mml:mtext>FMD</mml:mtext>
<mml:mo stretchy="false">)</mml:mo>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd>
<mml:mo>=</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:mtext>p</mml:mtext>
<mml:mo stretchy="false">(</mml:mo>
<mml:mtext>drooling saliva</mml:mtext>
<mml:mo>|</mml:mo>
<mml:mtext>FMD present</mml:mtext>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:mtext>p</mml:mtext>
<mml:mo stretchy="false">(</mml:mo>
<mml:mtext>drooling saliva</mml:mtext>
<mml:mo>|</mml:mo>
<mml:mtext>FMD absent</mml:mtext>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:mfrac>
<mml:mo>×</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:mn>0.001</mml:mn>
</mml:mrow>
<mml:mrow>
<mml:mn>1</mml:mn>
<mml:mo></mml:mo>
<mml:mn>0.001</mml:mn>
</mml:mrow>
</mml:mfrac>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd>
<mml:mo>=</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:mn>0.95</mml:mn>
</mml:mrow>
<mml:mrow>
<mml:mn>0.05</mml:mn>
</mml:mrow>
</mml:mfrac>
<mml:mo>×</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:mn>0.001</mml:mn>
</mml:mrow>
<mml:mrow>
<mml:mn>0.999</mml:mn>
</mml:mrow>
</mml:mfrac>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd>
<mml:mo>=</mml:mo>
<mml:mn>0.019</mml:mn>
</mml:mtd>
</mml:mtr>
</mml:mtable>
</mml:math>
</disp-formula>
(If we observe that the cow is not drooling saliva, we would use the likelihood ratio negative in Bayes rules.)</p>
<p id="para51">If we subsequently observe that a second cow is sick, we can apply Bayes rules a second time. In effect, we are treating the posterior odds from the prior calculation as the new prior odds:</p>
<p id="para52">
<disp-formula id="formula6">
<label>(6)</label>
<mml:math id="M10" altimg="si10.gif" overflow="scroll">
<mml:mtable columnalign="left">
<mml:mtr>
<mml:mtd>
<mml:mo>=</mml:mo>
<mml:mi>L</mml:mi>
<mml:msubsup>
<mml:mi>R</mml:mi>
<mml:mrow>
<mml:mtext>more than one animal affected</mml:mtext>
<mml:mo>|</mml:mo>
<mml:mtext>FMD</mml:mtext>
</mml:mrow>
<mml:mo>+</mml:mo>
</mml:msubsup>
<mml:mo>×</mml:mo>
<mml:mtext>Odds</mml:mtext>
<mml:mo stretchy="false">(</mml:mo>
<mml:mtext>FMD</mml:mtext>
<mml:mo>|</mml:mo>
<mml:mtext>drooling saliva</mml:mtext>
<mml:mo stretchy="false">)</mml:mo>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd>
<mml:mo>=</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:mtext>p</mml:mtext>
<mml:mo stretchy="false">(</mml:mo>
<mml:mtext>more than one animal affected</mml:mtext>
<mml:mo>|</mml:mo>
<mml:mtext>FMD present</mml:mtext>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:mtext>p</mml:mtext>
<mml:mo stretchy="false">(</mml:mo>
<mml:mtext>more than one animal affected</mml:mtext>
<mml:mo>|</mml:mo>
<mml:mtext>FMD absent</mml:mtext>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:mfrac>
<mml:mo>×</mml:mo>
<mml:mn>0.0019</mml:mn>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd>
<mml:mo>=</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:mn>0.95</mml:mn>
</mml:mrow>
<mml:mrow>
<mml:mn>0.20</mml:mn>
</mml:mrow>
</mml:mfrac>
<mml:mo>×</mml:mo>
<mml:mn>0.019</mml:mn>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd>
<mml:mo>=</mml:mo>
<mml:mn>4.75</mml:mn>
<mml:mo>×</mml:mo>
<mml:mn>0.019</mml:mn>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd>
<mml:mo>=</mml:mo>
<mml:mn>0.09</mml:mn>
</mml:mtd>
</mml:mtr>
</mml:mtable>
</mml:math>
</disp-formula>
</p>
<p id="para53">In general, if we have N diagnostic facts about a cow (or person), the odds-likelihood form of Bayes rules has the following form:</p>
<p id="para54">
<disp-formula id="formula7">
<label>(7)</label>
<mml:math id="M11" altimg="si11.gif" overflow="scroll">
<mml:mrow>
<mml:mtext>Odds</mml:mtext>
<mml:mo stretchy="false">(</mml:mo>
<mml:mtext>D</mml:mtext>
<mml:mo>|</mml:mo>
<mml:msub>
<mml:mtext>f</mml:mtext>
<mml:mn>1</mml:mn>
</mml:msub>
<mml:mo>,</mml:mo>
<mml:msub>
<mml:mtext>f</mml:mtext>
<mml:mn>2</mml:mn>
</mml:msub>
<mml:mo>,</mml:mo>
<mml:mo></mml:mo>
<mml:mo>,</mml:mo>
<mml:msub>
<mml:mtext>f</mml:mtext>
<mml:mtext>n</mml:mtext>
</mml:msub>
<mml:mo stretchy="false">)</mml:mo>
<mml:mo>=</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mtext>LR</mml:mtext>
</mml:mrow>
<mml:mrow>
<mml:msub>
<mml:mtext>f</mml:mtext>
<mml:mn>1</mml:mn>
</mml:msub>
<mml:mo>|</mml:mo>
<mml:mtext>D</mml:mtext>
</mml:mrow>
</mml:msub>
<mml:mo>×</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mtext>LR</mml:mtext>
</mml:mrow>
<mml:mrow>
<mml:msub>
<mml:mtext>f</mml:mtext>
<mml:mtext>n</mml:mtext>
</mml:msub>
<mml:mo>|</mml:mo>
<mml:mtext>D</mml:mtext>
</mml:mrow>
</mml:msub>
<mml:mo>×</mml:mo>
<mml:mtext>Odds</mml:mtext>
<mml:mo stretchy="false">(</mml:mo>
<mml:mtext>D</mml:mtext>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</disp-formula>
</p>
<p id="para55">The result of
<xref rid="formula6" ref-type="disp-formula">Eq. 6,</xref>
Odds(FMD|drooling saliva, more than one animal affected) + 0.09, is the odds (think probability) that the cow has FMD given that we have observed drooling of saliva in this cow and at least one other cow. The probabilistic inference engine would repeat the same calculation for the disease MCD, using the prior odds of MCD and the likelihood ratios for the two findings for MCD. The result of this calculation (not shown) is 9.8 × 10-
<sup>8</sup>
. Cows with MCD stagger, but rarely drool saliva.</p>
</sec>
<sec id="cesec18">
<label>5.2.3</label>
<title>Differential Diagnosis</title>
<p id="para56">
<xref rid="cetable3" ref-type="table">Table 13.3</xref>
shows the differential diagnosis that our extremely simple diagnostic expert system would show to a user. The two diseases are sorted in order of posterior odds. Note that we converted the posterior odds back to posterior probabilities using the formula
<inline-formula>
<mml:math id="M12" altimg="si12.gif" overflow="scroll">
<mml:mrow>
<mml:mi>p</mml:mi>
<mml:mo>=</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:mi>o</mml:mi>
<mml:mi>d</mml:mi>
<mml:mi>d</mml:mi>
<mml:mi>s</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>1</mml:mn>
<mml:mo>+</mml:mo>
<mml:mi>o</mml:mi>
<mml:mi>d</mml:mi>
<mml:mi>d</mml:mi>
<mml:mi>s</mml:mi>
</mml:mrow>
</mml:mfrac>
</mml:mrow>
</mml:math>
</inline-formula>
, which we obtained by solving
<xref rid="formula2" ref-type="disp-formula">Eq. 2</xref>
for
<italic>p</italic>
.
<table-wrap position="float" id="cetable3">
<label>TABLE 13.3</label>
<caption>
<p>Differential Diagnosis for Cow Drooling Saliva in a Herd with At Least One Other Cow Drooling Saliva</p>
</caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left"></th>
<th align="center">Posterior Odds</th>
<th align="center">Posterior Probability</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left">FMD</td>
<td align="center">0.09</td>
<td align="center">0.083</td>
</tr>
<tr>
<td align="left">MCD</td>
<td align="center">9.8 × 10
<sup>−8</sup>
</td>
<td align="center">∼9.8 × 10
<sup>−8</sup>
</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn>
<p>FMD, foot and mouth disease; MCD, mad cow disease.</p>
</fn>
</table-wrap-foot>
</table-wrap>
</p>
<p id="para57">Note that the posterior odds (and probabilities) in this example are very low. The low posterior odds are also partly due to the low prior prevalence of FMD and MCD that we arbitrarily assign (note that zero prior probability is not acceptable for the likelihood ratio computation). Countries that are currently free from these diseases or within the final stage of a disease eradication program for the diseases use low prior prevalence for exotic diseases (e.g., FMD and MCD). The LR+s for these findings for the disease FMD are only 19 and 4.75, respectively. If we had a third finding, such as blisters on feet, the LR+ for this finding would be a third multiplier in the equation, possibly increasing the posterior odds for one or both diagnoses. If we had a positive result from a highly sensitive and specific test for FMD (very high LR+), the posterior odds for FMD might be quite high. The key question for biosurveillance systems is at what level of certainty of a diagnosis in a single individual or a set of individuals different response actions are warranted. The answer to this question depends on treatability and other cost-benefit considerations that we discuss in Part V of this book.</p>
</sec>
</sec>
<sec id="cesec19">
<label>5.3</label>
<title>Computing Posterior Probabilities Using Bayesian Networks</title>
<p id="para58">Readers should be aware that there are other forms of Bayes rules that do not rest on an assumption of conditional independence, given a diagnosis. A developer of a probabilistic expert system may choose to use these alternative forms to improve the diagnostic accuracy of a system. Although mathematically too complex to cover in a brief introductory tutorial to Bayesian inference, the differences among these more complex forms of Bayes rules are simple to explain using a graphical representation called a Bayesian network (
<xref rid="f10" ref-type="fig">Figure 13.10</xref>
). A Bayesian network comprises a set of nodes and arcs where each node represents a conditional probability distribution for the variable that the node represents, conditioned on its parents (the nodes from which directed arcs connect to the node). For the benefit of statisticians, a Bayesian network is a (compact) factorization of the complete joint probability distribution over all variables represented by the nodes (
<xref rid="bib55" ref-type="bibr">Neapolitan, 2003</xref>
). The arcs in a Bayesian network represent the statistical dependence and independence relationships among the variables in the model.
<xref rid="f10" ref-type="fig">Figure 13.10</xref>
is a Bayesian network diagram for our mini-BOSSS diagnostic expert system.
<fig id="f10">
<label>FIGURE 13.10</label>
<caption>
<p>A Bayesian network of mini-BOSSS.</p>
</caption>
<graphic xlink:href="f13-10-9780123693785"></graphic>
</fig>
</p>
<p id="para59">The fact that there is no arc between
<italic>drooling saliva</italic>
and
<italic>more than one animal affected</italic>
indicates that the probability of observing drooling of saliva in a cow, once we know whether the cow has FMD or MCD, is not affected by knowing that other animals have these symptoms and vice versa (knowing that other animals have drooling once we know that this cow has FMD does not change the probability that this animal is drooling). If
<italic>drooling saliva</italic>
and
<italic>more than one animal affected</italic>
were not independent, given that we know that the cow has FMD, then we could add an arc between them.</p>
<p id="para60">
<xref rid="f11" ref-type="fig">Figure 13.11</xref>
shows a portion of the Bayesian network that underlies the Pathfinder system, which is a diagnostic expert system for pathologists who are interpreting biopsies of lymph nodes (Heckerman et al., 1992). The arcs between findings indicate that they are not independent, given diagnoses. Note that the Pathfinder network is a more realistic illustration of the size and complexity of the models used in diagnostic expert systems. In chapter 18, we discuss Bayesian networks in the context of Bayesian biosurveillance. That chapter discusses a really big model.
<fig id="f11">
<label>FIGURE 13.11</label>
<caption>
<p>A portion of the Bayesian network in the Pathfinder expert system for pathology.</p>
</caption>
<graphic xlink:href="f13-11-9780123693785"></graphic>
<attrib>(From Stuart Turner, lecture notes, 2001, with permission.)</attrib>
<permissions>
<copyright-statement>© 2006 </copyright-statement>
<copyright-year>2006</copyright-year>
<license>
<license-p>Since January 2020 Elsevier has created a COVID-19 resource centre with free information in English and Mandarin on the novel coronavirus COVID-19. The COVID-19 resource centre is hosted on Elsevier Connect, the company's public news and information website. Elsevier hereby grants permission to make all its COVID-19-related research that is available on the COVID-19 resource centre - including this research content - immediately available in PubMed Central and other publicly funded repositories, such as the WHO COVID database with rights for unrestricted research re-use and analyses in any form or by any means with acknowledgement of the original source. These permissions are granted for free by Elsevier for as long as the COVID-19 resource centre remains active.</license-p>
</license>
</permissions>
</fig>
</p>
</sec>
</sec>
<sec id="cesec20">
<label>6</label>
<title>RULE-BASED EXPERT SYSTEMS</title>
<p id="para61">Rule-based expert systems may also find application in biosurveillance. A rule-based expert system (also known as a deterministic expert system) encodes medical knowledge in a set of
<italic>if–then</italic>
rules. Rule-based expert systems are simpler, conceptually, than probabilistic systems, but they are only appropriate for problems that do not involve reasoning under uncertainty. A rule-based formalism is appropriate when diagnostic or other knowledge can be represented as Boolean statements (e.g., if A and B then C). A hospital or biosurveillance organization can use a rule-based expert system to automate case detection when the findings are diagnostically precise (e.g., when case-detection is based on diagnostically precise data such as a positive tuberculosis culture [Miller et al., 1997]).</p>
<p id="para62">
<xref rid="f12" ref-type="fig">Figure 13.12</xref>
is an anthrax case detection rule from the Clinical Event Monitor, an embedded rule-based expert system developed by several of the authors (Wagner et al., 1997). This rule is in a format that can be interpreted by a rule-based inference engine called CLIPS (
<xref rid="bib54" ref-type="bibr">National</xref>
Aeronautics and Space Administration). The rule contains variables that represent findings of the disease anthrax. The part of the rule before the ≥ symbol is the IF part and the part after the symbol is the THEN part. If all the conditions defined in the IF segment are true—wide mediastinum is found in a chest radiograph report and gram positive rods are reported in laboratory results within 10 days of each other—then the rule will conclude that there is a possible anthrax case. A typical rule-based expert system contains hundreds of such rules.
<fig id="f12">
<label>FIGURE 13.12</label>
<caption>
<p>An anthrax-case detection rule in the Clinical Event Monitor, a rule-based expert system. The rule is written in CLIPS, a language and expert system shell developed by the
<xref rid="bib54" ref-type="bibr">National</xref>
Aeronautics and Space Administration.</p>
</caption>
<graphic xlink:href="f13-12-9780123693785"></graphic>
</fig>
</p>
</sec>
<sec id="cesec21">
<label>7</label>
<title>EMBEDDED EXPERT SYSTEMS</title>
<p id="para63">In medical applications, the requirement for manual input of data by busy clinicians is a significant barrier to the use of diagnostic expert systems (
<xref rid="bib27" ref-type="bibr">Graber and VanScoy, 2003</xref>
). In the 1970s, several research groups took this barrier seriously. They began to explore methods to embed diagnostic expert systems— providing diagnostic support and, more generally, decision support—to clinicians without asking them to enter patient findings. Their research demonstrated that it is possible to obtain needed findings directly from existing clinical information systems (
<xref rid="bib21" ref-type="bibr">Evans, 1991</xref>
, Gardner et al., 1999, Rind et al., 1993, Rind et al., 1995,
<xref rid="bib48" ref-type="bibr">McDonald, 1976c</xref>
, McDonald et al., 1992a,
<xref rid="bib47" ref-type="bibr">McDonald, 1976b</xref>
, McDonald et al., 1992b, Overhage et al., 1996, Wagner et al., 1997) and from alterations in work flow, such as replacing unstructured paper records with computer-generated encounter forms (from which findings can be optically scanned or manually extracted) (
<xref rid="bib44" ref-type="bibr">McDonald, 1976a</xref>
, McDonald et al., 1992a,
<xref rid="bib47" ref-type="bibr">McDonald, 1976b</xref>
, McDonald et al., 1992b). The research also demonstrated how diagnostic expert systems can be embedded in clinical information systems, such as physician order entry systems (Tierney et al., 1993, Dexter et al., 2001) and electronic medical records (Gardner et al., 1999, Warner et al., 1997). Several of these systems functioned in the domain of hospital infection control (Hripcsak et al., 1997, Hripcsak et al., 1999, Kahn et al., 1996a, Kahn et al., 1996b, Kahn et al., 1993).</p>
<p id="para64">The secret to successful deployment of a diagnostic or other expert system in medicine is designing a system in which the benefits to clinicians (from decision support and increases in efficiency) outweigh any additional effort required by clinicians to enter data by a considerable margin.</p>
</sec>
<sec id="cesec22">
<label>8</label>
<title>DIAGNOSTIC EXPERT SYSTEMS FOR BIOSURVEILLANCE</title>
<p id="para65">In addition to the diagnostic expert systems for hospital infection control just outlined, there are two other projects developing systems in the domain of biosurveillance. Shannon and colleagues at the Children's Hospital in Boston are developing a web-based diagnostic expert system to assist emergency room clinicians with diagnosis of approximately 20 diseases caused by biological agents known to have been weaponized or that are otherwise of concern as potential bioterrorist threats. The system has developed and evaluated on-line educational modules about the biological agents (Chung et al., 2004), and is intended to support the reporting of cases to local, state, and federal agencies (Shannon et al., 2002). Similar to stand-alone expert systems, the web-based tool requires clinicians to manually enter patient information.</p>
<p id="para66">The
<xref rid="bib54" ref-type="bibr">National</xref>
Library of Medicine has developed a system called WISER (Wireless Information System for Emergency Responders) to assist first responders when they arrive at a hazardous material (Hazmat) incident, such as a chemical spill (
<ext-link ext-link-type="uri" xlink:href="http://wiser.nlm.nih.gov/" id="interref4">http://wiser.nlm.nih.gov/</ext-link>
). WISER operates on a personal digital assistant (PDA) and can send and receive data with a central location and other PDAs running the WISER program through a wireless network. WISER contains a diagnostic expert system that provides assistance in identification of an unknown substance and, once the substance is identified, provides guidance on actions to save lives and protect the environment. The WISER framework could be expanded to include a diagnostic expert system for the analysis of patient or animal findings.</p>
</sec>
<sec id="cesec23">
<label>9</label>
<title>PERFECTING CASE AND OUTBREAK DETECTION</title>
<p id="para67">Recall that the best case detection system imaginable would be one in which every individual in a community is examined every morning by the best diagnostician in the world. Since she would be examining everyone every day, she would be aware of patterns of illness in a community and this awareness would appropriately influence her diagnostic thinking (and treatment) of individual patients.
<xref rid="fn3" ref-type="fn">3</xref>
This diagnostician would also never fail to report immediately each fever, early syn-dromic presentation, or reportable disease to governmental public health.</p>
<p id="para68">Diagnostic expert systems are the key to building such a system. The research we reviewed in this chapter has already solved most, if not all, of the technical problems. What is needed is the will to create such a system.</p>
<p id="para69">If and when diagnostic expert systems are embedded in the clinical information systems of every hospital (animal and human), long-term care facility, clinic, and laboratory in a region, they will be able to notify a health department or other biosurveillance organization of every fever, syndromic presentation, and reportable disease in individuals receiving medical or veterinary care. If diagnostic expert systems are made available to the public or to selected high-risk populations (e.g., postal employees or patients with preexisting conditions such as asthma or diabetes), case finding would be extended to an even larger fraction of the population, approximating the “every-patient-every-day” capabilities of an ideal case detection system.</p>
<p id="para70">If a biosurveillance system located in a region's health department were to receive the differential diagnosis for each individual in the region in real time (anonymously, of course, and perhaps selectively based on diseases and probability thresholds), it could compute the current incidences of these conditions. It could monitor the region for increases in incidence of findings, syndromes, and diseases of concern.</p>
<p id="para71">Note that the outputs of a probabilistic diagnostic expert system are posterior probabilities of diseases for one patient, so the central monitoring would be monitoring of the sums of the probabilities for all reported patients.
<xref rid="f13" ref-type="fig">Figure 13.13</xref>
illustrates this summation. It plots the daily sums of the posterior probabilities of “flu-like” illness of all patients seen in emergency departments on each day. If the diagnostic expert systems are well calibrated, the sums of the posterior probabilities should equal the actual number of patients with the disease in the population being evaluated by the system.
<fig id="f13">
<label>FIGURE 13.13</label>
<caption>
<p>Daily sum of syndrome probabilities produced by SyCO
<sup>2</sup>
. SyCO
<sup>2</sup>
computes the posterior probability that a patient has a flu-like illness from his chief complaint. SyCo2: A Bayesian Machine Learning Method for Extracting Symptoms from Chief Complaints And Combining Them Using Probabilistic Case Definitions. Pittsburgh, PA: Center for Biomedical Informatics, University of Pittsburgh, with permission.) An outbreak-detection system would sum the posterior probabilities of flu-like illness from all patients seen in 24-hour periods to form a time series of expected daily counts of patients with respiratory illness. Readers familiar with Bayesian statistics will recognize this sum as the expectation for the number of individuals with a given diagnosis.</p>
</caption>
<graphic xlink:href="f13-13-9780123693785"></graphic>
<attrib>(From Espino, J., Dara, J., Dowling J, et al. (2005).</attrib>
<permissions>
<copyright-statement>© 2006 </copyright-statement>
<copyright-year>2006</copyright-year>
<license>
<license-p>Since January 2020 Elsevier has created a COVID-19 resource centre with free information in English and Mandarin on the novel coronavirus COVID-19. The COVID-19 resource centre is hosted on Elsevier Connect, the company's public news and information website. Elsevier hereby grants permission to make all its COVID-19-related research that is available on the COVID-19 resource centre - including this research content - immediately available in PubMed Central and other publicly funded repositories, such as the WHO COVID database with rights for unrestricted research re-use and analyses in any form or by any means with acknowledgement of the original source. These permissions are granted for free by Elsevier for as long as the COVID-19 resource centre remains active.</license-p>
</license>
</permissions>
</fig>
</p>
<p id="para72">Finally, if the biosurveillance system would then communicate the current fever, syndrome, and disease incidences back to the diagnostic expert systems being used by clinicians and citizens, we would realize the “diagnosticians-are-aware-of-patterns-of-illness-in-the-community” capability of an ideal case detection system.</p>
<p id="para73">This ideal approach underlies the Bayesian approach to outbreak detection described in Chapter 18 Bayesian Methods for Diagnosing Outbreaks. PANDA (Population-wide ANomaly Detection and Assessment)—the research system described in that chapter—actually merges many individual diagnostic Bayesian networks into a very large network that also includes a subnetwork that draws inferences about the presence or absence of an outbreak. PANDA is pursuing this idea on a citywide scale. Conceptually, a PANDA network comprises millions of person-specific diagnostic Bayesian networks, each of whose probabilities of disease (e.g., anthrax) are being influenced by population-level observations (e.g., aggregate sales of over-the-counter medications) and population-level inferences (e.g., the likelihood that other individuals who may have inhalational anthrax are present in a population). PANDA also includes a prior probability distribution over outbreak diseases (e.g, the prior probability of inhalational anthrax, based on the
<xref rid="bib54" ref-type="bibr">national</xref>
terror alert level). By integrating person-specific diagnostic submodels into a population-wide super model, approaches like PANDA are able to make inferences about the probability of a disease outbreak in the population as a whole, as well as the probability of disease in individual people (or subgroups of people) within the population.</p>
</sec>
<sec id="cesec24">
<label>10</label>
<title>COMPUTER-INTERPRETABLE CASE DEFINITIONS</title>
<p id="para74">An ideal case detection system would also support case finding during outbreak investigations. Case definitions (described in Chapter 3) are the basis for case–control studies and investigations of emerging diseases. A computer-interpretable case definition is a prerequisite for providing computer-support to case finding during investigations. As discussed in Chapter 3, case definitions are Boolean (logical) statement of findings (
<xref rid="f14" ref-type="fig">Figure 13.14</xref>
).
<fig id="f14">
<label>FIGURE 13.14</label>
<caption>
<p>Excerpt from the CDC case definition for confirmed SARS-CoV disease (
<ext-link ext-link-type="uri" xlink:href="http://www.cdc.gov/ncidod/sars/guidance/b/app1.htm" id="interref2">
<italic>http://www.cdc.gov/ncidod/sars/guidance/b/app1.htm</italic>
</ext-link>
). Only the definitions relevant for classifying a patient as a probable case of SARS CoV are shown. (We omitted the definition of severe respiratory illness for clarity. The illness clause in the case definition for confirmed case of SARS-CoV disease is a disjunction, and all patients that satisfy the definitional criteria for severe disease also satisfy the criteria for mild to moderate respiratory illness.</p>
</caption>
<graphic xlink:href="f13-14-9780123693785"></graphic>
</fig>
</p>
<p id="para75">Case definitions, as currently written, are not well suited for automation. The authors of the SARS case definition intended it for use by physicians and epidemiologists, not computers. The clause “findings of lower respiratory illness (e.g., cough, shortness of breath, difficulty breathing)” does not enumerate all findings of lower respiratory illness. A computer requires a complete enumeration of all findings that it should count as evidence of
<italic>lower respiratory illness</italic>
(e.g., cough, shortness of breath, difficulty breathing, wheezing, cyanosis, tachypnea, dullness to percussion, fremitus, whispered pectoriloquy, rales, and rhonchi). The findings would also have to be described more precisely. For example, a physician or an epidemiologist would not count chronic cough or cough associated with asthma as a finding of lower respiratory illness when applying this case definition, but a computer would (unless told otherwise). Note that it is difficult, if not impossible, to enumerate all of the possible exceptions to the counting of a finding as evidence of a disease. This difficulty is the reason that diagnostic expert systems in medicine are probabilistic. They quantify the number of exceptions to a categorical statement about the relationship between findings and disease using probabilities. For example, 70% of patients with cough have an acute lower respiratory illness, but 30% (the exceptions) have some other cause. This observation suggests that computer-interpretable case definitions will employ Bayesian networks, as illustrated by
<xref rid="f15" ref-type="fig">Figure 13.15</xref>
.
<fig id="f15">
<label>FIGURE 13.15</label>
<caption>
<p>A Bayesian network “case definition” for anthrax. The network computes the posterior probability for a patient addmitted to the emergency department.
<italic>Cxr order</italic>
, electronic record of an order for a chest radiograph;
<italic>wide med</italic>
, chest radiograph finding of wide mediastinum;
<italic>Gpr</italic>
, gram-positive rods in blood or cerebrospinal fluid (CSF) smear;
<italic>micro order</italic>
, order for a blood or CSF culture.</p>
</caption>
<graphic xlink:href="f13-15-9780123693785"></graphic>
<attrib>(From Espino J., Tsui, F.-C. (2000). A Bayesian network for detecting inhalational anthrax outbreaks. Pittsburgh, PA: Center for Biomedical Informatics, University of Pittsburgh, with permission.)</attrib>
<permissions>
<copyright-statement>© 2006 </copyright-statement>
<copyright-year>2006</copyright-year>
<license>
<license-p>Since January 2020 Elsevier has created a COVID-19 resource centre with free information in English and Mandarin on the novel coronavirus COVID-19. The COVID-19 resource centre is hosted on Elsevier Connect, the company's public news and information website. Elsevier hereby grants permission to make all its COVID-19-related research that is available on the COVID-19 resource centre - including this research content - immediately available in PubMed Central and other publicly funded repositories, such as the WHO COVID database with rights for unrestricted research re-use and analyses in any form or by any means with acknowledgement of the original source. These permissions are granted for free by Elsevier for as long as the COVID-19 resource centre remains active.</license-p>
</license>
</permissions>
</fig>
</p>
<p id="para76">For readers interested in the topic of knowledge representations for computer-interpretable case definitions, there is literature from research on computer-interpretable patient care guidelines that is relevant to this topic (Shiffman et al., 2004,
<xref rid="bib71" ref-type="bibr">Tu and Musen, 2001</xref>
, Peleg et al., 2003, Boxwala et al., 2004, Wang et al., 2003, Seyfang et al., 2002, Fox et al., 1997, Terenziani et al., 2003, de Clercq et al., 2004, Johnson et al., 2001, Ciccarese et al., 2004, Parker et al., 2004).</p>
</sec>
<sec id="cesec25">
<label>11</label>
<title>SUMMARY</title>
<p id="para77">Despite the unfamiliarity of most readers with diagnostic expert systems, we chose to begin our discussion of algorithms for biosurveillance with this topic because case detection provides the case data needed for outbreak detection. Outbreak detection cannot function without case detection (unless the surveillance data are aggregated data, such as daily sales of over-the-counter thermometers).</p>
<p id="para78">Diagnostic expert systems have the potential to improve the quality and completeness of the case data available to analytic methods designed to detect and characterize outbreaks, which we discuss in the following chapters. They can profoundly improve the reporting of syndromes. Improvements in case detection will translate directly into improvements in the earliness of outbreak detection and characterization.</p>
<p id="para79">McDonald did not conclude in his seminal paper that the solution to the non-perfectibility of man was to admit only women to medical schools. Rather, he stated, “Thus, I conclude that though the individual physician is not perfectible, the system of care is, and that the computer will play a major part in the perfection of future care systems.” His point—that technology can be used to create a system (involving both humans and computers) that can then be perfected—also seems to apply to biosurveillance systems.</p>
</sec>
<sec id="cesec26">
<label>12</label>
<title>ADDITIONAL RESOURCES</title>
<sec id="cesec27">
<label>12.1</label>
<title>Expert Systems in Plant Pathology</title>
<p id="para80">For readers who are interested in diagnostic expert systems for diagnosing plant diseases,
<xref rid="bib70" ref-type="bibr">Travis and Latin (1991)</xref>
briefly reviewed several diagnostic expert systems in plant pathology, including PLANT/ed, Apple Pest and Disease Diagnosis, CALEX/Peaches, Muskmelon disorder management system, and Penn State Apple Orchard Consultant, in “Development, Implementation, and Adoption of Expert Systems in Plant Pathology.”</p>
</sec>
</sec>
<sec id="cesec28">
<label>13</label>
<title>ACKNOWLEDGMENTS</title>
<p id="para81">This work was supported in part by grants from the
<xref rid="bib54" ref-type="bibr">National</xref>
Science Foundation (IIS-0325581), the Defense Advanced Research Projects Agency (F30602-01–2-0550), and the Pennsylvania Department of Health (ME-01–737). We thank William Hogan and Gregory Cooper for helpful discussions and comments.</p>
</sec>
</body>
<back>
<ref-list id="fread1">
<title>REFERENCES</title>
<ref id="bib1">
<element-citation publication-type="journal" id="sbref1">
<person-group person-group-type="author">
<name>
<surname>Adams</surname>
<given-names>I.D.</given-names>
</name>
<name>
<surname>Chan</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Clifford</surname>
<given-names>P.C.</given-names>
</name>
</person-group>
<article-title>Computer aided diagnosis of acute abdominal pain: a multicentre study</article-title>
<source>BMJ</source>
<volume>293</volume>
<year>1986</year>
<fpage>800</fpage>
<lpage>804</lpage>
<comment>(Clin Res Ed)</comment>
<pub-id pub-id-type="pmid">3094664</pub-id>
</element-citation>
</ref>
<ref id="bib2">
<element-citation publication-type="journal" id="sbref2">
<person-group person-group-type="author">
<name>
<surname>American College of Emergency Physicians</surname>
</name>
</person-group>
<article-title>Clinical policy for the initial approach to patients presenting with a chief complaint of nontraumatic acute abdominal pain. American College of Emergency Physicians</article-title>
<source>Ann Emerg Med</source>
<volume>23</volume>
<year>1994</year>
<fpage>906</fpage>
<lpage>922</lpage>
<pub-id pub-id-type="pmid">8161073</pub-id>
</element-citation>
</ref>
<ref id="bib3">
<element-citation publication-type="book" id="sbref3">
<person-group person-group-type="author">
<name>
<surname>Aronsky</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Fiszman</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Chapman</surname>
<given-names>W.W.</given-names>
</name>
</person-group>
<chapter-title>Combining decision support methodologies to diagnose pneumonia</chapter-title>
<source>Proceedings of American Medical Informatics Association Annual Fall Symposium</source>
<year>2001</year>
<fpage>12</fpage>
<lpage>16</lpage>
</element-citation>
</ref>
<ref id="bib4">
<element-citation publication-type="journal" id="sbref4">
<person-group person-group-type="author">
<name>
<surname>Boxwala</surname>
<given-names>A.A.</given-names>
</name>
<name>
<surname>Peleg</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Tu</surname>
<given-names>S.</given-names>
</name>
</person-group>
<article-title>GLIF3: a representation format for sharable computer-interpretable clinical practice guidelines</article-title>
<source>J Biomed Inform</source>
<volume>37</volume>
<year>2004</year>
<fpage>147</fpage>
<lpage>161</lpage>
<pub-id pub-id-type="pmid">15196480</pub-id>
</element-citation>
</ref>
<ref id="bib5">
<element-citation publication-type="book" id="sbref5">
<person-group person-group-type="author">
<name>
<surname>Buchanan</surname>
<given-names>B.G.</given-names>
</name>
<name>
<surname>Shortliffe</surname>
<given-names>E.H.</given-names>
</name>
</person-group>
<chapter-title>Rule-based expert systems: the MYCIN experiments of the Stanford Heuristic Programming Project</chapter-title>
<year>1984</year>
<publisher-name>Addison-Wesley</publisher-name>
<publisher-loc>Reading, MA</publisher-loc>
</element-citation>
</ref>
<ref id="bib6">
<element-citation publication-type="journal" id="sbref6">
<person-group person-group-type="author">
<name>
<surname>Burnside</surname>
<given-names>E.S.</given-names>
</name>
<name>
<surname>Rubin</surname>
<given-names>D.L.</given-names>
</name>
<name>
<surname>Shachter</surname>
<given-names>R.D.</given-names>
</name>
</person-group>
<article-title>A probabilistic expert system that provides automated mammographic-histologic correlation: initial experience</article-title>
<source>AJR Am J Roentgenol</source>
<volume>182</volume>
<year>2004</year>
<fpage>481</fpage>
<lpage>488</lpage>
<pub-id pub-id-type="pmid">14736686</pub-id>
</element-citation>
</ref>
<ref id="bib7">
<element-citation publication-type="journal" id="sbref7">
<person-group person-group-type="author">
<name>
<surname>Chung</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Mandl</surname>
<given-names>K.D.</given-names>
</name>
<name>
<surname>Shannon</surname>
<given-names>M.</given-names>
</name>
</person-group>
<article-title>Efficacy of an educational web site for educating physicians about bioterrorism</article-title>
<source>Acad Emerg Med</source>
<volume>11</volume>
<year>2004</year>
<fpage>143</fpage>
<lpage>148</lpage>
<pub-id pub-id-type="pmid">14759955</pub-id>
</element-citation>
</ref>
<ref id="bib8">
<element-citation publication-type="journal" id="sbref8">
<person-group person-group-type="author">
<name>
<surname>Ciccarese</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Caffi</surname>
<given-names>E.</given-names>
</name>
<name>
<surname>Boiocchi</surname>
<given-names>L.</given-names>
</name>
</person-group>
<article-title>A guideline management system</article-title>
<source>Medinfo</source>
<volume>11</volume>
<year>2004</year>
<fpage>28</fpage>
<lpage>32</lpage>
</element-citation>
</ref>
<ref id="bib9">
<element-citation publication-type="book" id="sbref9">
<person-group person-group-type="author">
<name>
<surname>Cundick</surname>
<given-names>R.</given-names>
</name>
</person-group>
<chapter-title>Iliad as a patient care simulator to teach medical problem solving</chapter-title>
<source>Paper presented at 13th Symposium on Computer Applications in Medical Care</source>
<conf-name>Washington, DC</conf-name>
<year>1989</year>
<comment></comment>
</element-citation>
</ref>
<ref id="bib10">
<element-citation publication-type="journal" id="sbref10">
<person-group person-group-type="author">
<name>
<surname>de Clercq</surname>
<given-names>P.A.</given-names>
</name>
<name>
<surname>Blom</surname>
<given-names>J.A.</given-names>
</name>
<name>
<surname>Korsten</surname>
<given-names>H.H.</given-names>
</name>
</person-group>
<article-title>Approaches for creating computer-interpretable guidelines that facilitate decision support</article-title>
<source>Artif Intell Med</source>
<volume>31</volume>
<year>2004</year>
<fpage>1</fpage>
<lpage>27</lpage>
<pub-id pub-id-type="pmid">15182844</pub-id>
</element-citation>
</ref>
<ref id="bib11">
<element-citation publication-type="book" id="sbref11">
<person-group person-group-type="author">
<name>
<surname>de Dombal</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>de Baere</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>van Elk</surname>
<given-names>P.</given-names>
</name>
</person-group>
<chapter-title>Objective medical decision making: acute abdominal pain</chapter-title>
<person-group person-group-type="editor">
<name>
<surname>Beneken</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Thevenin</surname>
<given-names>V.</given-names>
</name>
</person-group>
<series>Advances in Biomedical Engineering: Results of the 4th EC Medical and Health Research Programme</series>
<volume>Vol. 7</volume>
<year>1993</year>
<publisher-name>IOS Press</publisher-name>
<publisher-loc>Burke, VA</publisher-loc>
<fpage>65</fpage>
<lpage>87</lpage>
<comment>of Studies in Health Technology and Informatics</comment>
</element-citation>
</ref>
<ref id="bib12">
<element-citation publication-type="journal" id="sbref12">
<person-group person-group-type="author">
<name>
<surname>de Dombal</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Leaper</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Staniland</surname>
<given-names>J.</given-names>
</name>
</person-group>
<article-title>Computer-aided diagnosis of acute abdominal pain</article-title>
<source>BMJ</source>
<volume>2</volume>
<year>1972</year>
<fpage>9</fpage>
<lpage>13</lpage>
<pub-id pub-id-type="pmid">4552594</pub-id>
</element-citation>
</ref>
<ref id="bib13">
<element-citation publication-type="journal" id="sbref13">
<person-group person-group-type="author">
<name>
<surname>de</surname>
<given-names>DombalF.T.</given-names>
</name>
</person-group>
<article-title>Computer-aided diagnosis and decisionmaking in the acute abdomen</article-title>
<source>J R Coll Physicians Lond</source>
<volume>9</volume>
<year>1975</year>
<fpage>211</fpage>
<lpage>218</lpage>
<pub-id pub-id-type="pmid">1095734</pub-id>
</element-citation>
</ref>
<ref id="bib14">
<element-citation publication-type="journal" id="sbref14">
<person-group person-group-type="author">
<name>
<surname>de Dombal</surname>
<given-names>F.T.</given-names>
</name>
</person-group>
<article-title>Computer-aided diagnosis of acute abdominal pain. The British experience</article-title>
<source>Rev Epidemiol Sante Publique</source>
<volume>32</volume>
<year>1984</year>
<fpage>50</fpage>
<lpage>56</lpage>
<pub-id pub-id-type="pmid">6371951</pub-id>
</element-citation>
</ref>
<ref id="bib15">
<element-citation publication-type="journal" id="sbref15">
<person-group person-group-type="author">
<name>
<surname>de Dombal</surname>
<given-names>F.T.</given-names>
</name>
</person-group>
<article-title>Computer-aided decision support in acute abdominal pain, with special reference to the EC concerted action</article-title>
<source>Int J Biomed Comput</source>
<volume>26</volume>
<year>1990</year>
<fpage>183</fpage>
<lpage>188</lpage>
<pub-id pub-id-type="pmid">2242936</pub-id>
</element-citation>
</ref>
<ref id="bib16">
<element-citation publication-type="journal" id="sbref16">
<person-group person-group-type="author">
<name>
<surname>de Dombal</surname>
<given-names>F.T.</given-names>
</name>
<name>
<surname>Leaper</surname>
<given-names>D.J.</given-names>
</name>
<name>
<surname>Horrocks</surname>
<given-names>J.G.</given-names>
</name>
</person-group>
<article-title>Human and computer-aided diagnosis of abdominal pain: further report with emphasis on performance of clinicians</article-title>
<source>BMJ</source>
<volume>1</volume>
<year>1974</year>
<fpage>376</fpage>
<lpage>380</lpage>
<pub-id pub-id-type="pmid">4594585</pub-id>
</element-citation>
</ref>
<ref id="bib17">
<element-citation publication-type="journal" id="sbref17">
<person-group person-group-type="author">
<name>
<surname>Dexter</surname>
<given-names>P.R.</given-names>
</name>
<name>
<surname>Perkins</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Overhage</surname>
<given-names>J.M.</given-names>
</name>
</person-group>
<article-title>A computerized reminder system to increase the use of preventive care for hospitalized patients</article-title>
<source>N Engl J Med</source>
<volume>345</volume>
<year>2001</year>
<fpage>965</fpage>
<lpage>970</lpage>
<pub-id pub-id-type="pmid">11575289</pub-id>
</element-citation>
</ref>
<ref id="bib18">
<element-citation publication-type="journal" id="sbref18">
<person-group person-group-type="author">
<name>
<surname>Elstein</surname>
<given-names>A.S.</given-names>
</name>
<name>
<surname>Friedman</surname>
<given-names>C.P.</given-names>
</name>
<name>
<surname>Wolf</surname>
<given-names>F.M.</given-names>
</name>
</person-group>
<article-title>Effects of a decision support system on the diagnostic accuracy of users: a preliminary report</article-title>
<source>J Am Med Inform Assoc</source>
<volume>3</volume>
<year>1996</year>
<fpage>422</fpage>
<lpage>428</lpage>
<pub-id pub-id-type="pmid">8930858</pub-id>
</element-citation>
</ref>
<ref id="bib19">
<element-citation publication-type="book" id="sbref19">
<person-group person-group-type="author">
<name>
<surname>Espino</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Dara</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Dowling</surname>
<given-names>J.</given-names>
</name>
</person-group>
<chapter-title>SyCo2: A Bayesian Machine Learning Method for Extracting Symptoms from Chief Complaints And Combining Them Using Probabilistic Case Definitions</chapter-title>
<year>2005</year>
<publisher-name>Center for Biomedical Informatics, University of Pittsburgh</publisher-name>
<publisher-loc>Pittsburgh, PA</publisher-loc>
</element-citation>
</ref>
<ref id="bib20">
<element-citation publication-type="book" id="sbref20">
<person-group person-group-type="author">
<name>
<surname>Espino</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Tsui</surname>
<given-names>F.-C.</given-names>
</name>
</person-group>
<chapter-title>A Bayesian network for detecting inhalational anthrax outbreaks</chapter-title>
<year>2000</year>
<publisher-name>Center for Biomedical Informatics, University of Pittsburgh</publisher-name>
<publisher-loc>Pittsburgh, PA</publisher-loc>
</element-citation>
</ref>
<ref id="bib21">
<element-citation publication-type="journal" id="sbref21">
<person-group person-group-type="author">
<name>
<surname>Evans</surname>
<given-names>R.S.</given-names>
</name>
</person-group>
<article-title>The HELP system: a review of clinical applications in infectious diseases and antibiotic use</article-title>
<source>MD Computing</source>
<volume>8</volume>
<year>1991</year>
<fpage>282</fpage>
<lpage>288</lpage>
<pub-id pub-id-type="pmid">1749338</pub-id>
</element-citation>
<element-citation publication-type="journal" id="sbref22">
<person-group person-group-type="author">
<name>
<surname>Evans</surname>
<given-names>R.S.</given-names>
</name>
</person-group>
<article-title>The HELP system: a review of clinical applications in infectious diseases and antibiotic use</article-title>
<source>MD Computing</source>
<volume>8</volume>
<year>1991</year>
<fpage>315</fpage>
</element-citation>
</ref>
<ref id="bib22">
<element-citation publication-type="book" id="sbref23">
<person-group person-group-type="author">
<name>
<surname>Feigenbaum</surname>
<given-names>E.A.</given-names>
</name>
</person-group>
<chapter-title>The Art of Artificial Intelligence: Themes and Case Studies of Knowledge Engineering</chapter-title>
<source>Paper presented at 5th International Joint Conference on Artificial Intelligence</source>
<year>1977</year>
</element-citation>
</ref>
<ref id="bib23">
<element-citation publication-type="journal" id="sbref24">
<person-group person-group-type="author">
<name>
<surname>Fox</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Johns</surname>
<given-names>N.</given-names>
</name>
<name>
<surname>Lyons</surname>
<given-names>C.</given-names>
</name>
</person-group>
<article-title>PROforma: a general technology for clinical decision support systems</article-title>
<source>Comput Methods Programs Biomed</source>
<volume>54</volume>
<year>1997</year>
<fpage>59</fpage>
<lpage>67</lpage>
<pub-id pub-id-type="pmid">9290920</pub-id>
</element-citation>
</ref>
<ref id="bib24">
<element-citation publication-type="journal" id="sbref25">
<person-group person-group-type="author">
<name>
<surname>Friedman</surname>
<given-names>C.P.</given-names>
</name>
<name>
<surname>Elstein</surname>
<given-names>A.S.</given-names>
</name>
<name>
<surname>Wolf</surname>
<given-names>F.M.</given-names>
</name>
</person-group>
<article-title>Enhancement of clinicians' diagnostic reasoning by computer-based consultation: a multisite study of 2 systems</article-title>
<source>JAMA</source>
<volume>282</volume>
<year>1999</year>
<fpage>1851</fpage>
<lpage>1856</lpage>
<pub-id pub-id-type="pmid">10573277</pub-id>
</element-citation>
</ref>
<ref id="bib25">
<element-citation publication-type="journal" id="sbref26">
<person-group person-group-type="author">
<name>
<surname>Gardner</surname>
<given-names>R.M.</given-names>
</name>
<name>
<surname>Pryor</surname>
<given-names>T.A.</given-names>
</name>
<name>
<surname>Warner</surname>
<given-names>H.R.</given-names>
</name>
</person-group>
<article-title>The HELP hospital information system: update 1998</article-title>
<source>Int J Med Inform</source>
<volume>54</volume>
<year>1999</year>
<fpage>169</fpage>
<lpage>182</lpage>
<pub-id pub-id-type="pmid">10405877</pub-id>
</element-citation>
</ref>
<ref id="bib26">
<element-citation publication-type="journal" id="sbref27">
<person-group person-group-type="author">
<name>
<surname>Gerberding</surname>
<given-names>J.L.</given-names>
</name>
<name>
<surname>Hughes</surname>
<given-names>J.M.</given-names>
</name>
<name>
<surname>Koplan</surname>
<given-names>J.P.</given-names>
</name>
</person-group>
<article-title>Bioterrorism preparedness and response: clinicians and public health agencies as essential partners</article-title>
<source>JAMA</source>
<volume>287</volume>
<year>2002</year>
<fpage>898</fpage>
<lpage>900</lpage>
<pub-id pub-id-type="pmid">11851584</pub-id>
</element-citation>
</ref>
<ref id="bib27">
<element-citation publication-type="journal" id="sbref28">
<person-group person-group-type="author">
<name>
<surname>Graber</surname>
<given-names>M.A.</given-names>
</name>
<name>
<surname>VanScoy</surname>
<given-names>D.</given-names>
</name>
</person-group>
<article-title>How well does decision support software perform in the emergency department?</article-title>
<source>Emerg Med J</source>
<volume>20</volume>
<year>2003</year>
<fpage>426</fpage>
<lpage>428</lpage>
<pub-id pub-id-type="pmid">12954680</pub-id>
</element-citation>
</ref>
<ref id="bib28">
<element-citation publication-type="journal" id="sbref29">
<person-group person-group-type="author">
<name>
<surname>Haynes</surname>
<given-names>R.B.</given-names>
</name>
<name>
<surname>Davis</surname>
<given-names>D.A.</given-names>
</name>
<name>
<surname>McKibbon</surname>
<given-names>A.</given-names>
</name>
</person-group>
<article-title>A critical appraisal of the efficacy of continuing medical education</article-title>
<source>JAMA</source>
<volume>251</volume>
<year>1984</year>
<fpage>61</fpage>
<lpage>64</lpage>
<pub-id pub-id-type="pmid">6690767</pub-id>
</element-citation>
</ref>
<ref id="bib29">
<element-citation publication-type="journal" id="sbref30">
<person-group person-group-type="author">
<name>
<surname>Heckerman</surname>
<given-names>D.E.</given-names>
</name>
<name>
<surname>Horvitz</surname>
<given-names>E.J.</given-names>
</name>
<name>
<surname>Nathwani</surname>
<given-names>B.N.</given-names>
</name>
</person-group>
<article-title>Toward normative expert systems. Part I. The Pathfinder project</article-title>
<source>Methods Inform Med</source>
<volume>31</volume>
<year>1992</year>
<fpage>90</fpage>
<lpage>105</lpage>
</element-citation>
</ref>
<ref id="bib30">
<element-citation publication-type="journal" id="sbref31">
<person-group person-group-type="author">
<name>
<surname>Hripcsak</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Knirsch</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Jain</surname>
<given-names>N.</given-names>
</name>
</person-group>
<article-title>A health Information network for managing innercity tuberculosis: bridging clinical care, public health, and home care</article-title>
<source>Computers Biomed Res</source>
<volume>32</volume>
<year>1999</year>
<fpage>67</fpage>
<lpage>76</lpage>
</element-citation>
</ref>
<ref id="bib31">
<element-citation publication-type="journal" id="sbref32">
<person-group person-group-type="author">
<name>
<surname>Hripcsak</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Knirsch</surname>
<given-names>C.A.</given-names>
</name>
<name>
<surname>Jain</surname>
<given-names>N.L.</given-names>
</name>
</person-group>
<article-title>Automated tuberculosis detection</article-title>
<source>J Am Med Inform Assoc</source>
<volume>4</volume>
<year>1997</year>
<fpage>376</fpage>
<lpage>381</lpage>
<pub-id pub-id-type="pmid">9292843</pub-id>
</element-citation>
</ref>
<ref id="bib32">
<element-citation publication-type="journal" id="sbref33">
<person-group person-group-type="author">
<name>
<surname>Hughes</surname>
<given-names>J.M.</given-names>
</name>
<name>
<surname>Gerberding</surname>
<given-names>J.L.</given-names>
</name>
</person-group>
<article-title>Anthrax bioterrorism: lessons learned and future directions</article-title>
<source>Emerg Infect Dis</source>
<volume>8</volume>
<year>2002</year>
<fpage>1013</fpage>
<lpage>1014</lpage>
<pub-id pub-id-type="pmid">12396907</pub-id>
</element-citation>
</ref>
<ref id="bib33">
<element-citation publication-type="journal" id="sbref34">
<person-group person-group-type="author">
<name>
<surname>Johnson</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Tu</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Jones</surname>
<given-names>N.</given-names>
</name>
</person-group>
<article-title>Achieving reuse of computable guideline systems</article-title>
<source>Medinfo</source>
<volume>10</volume>
<year>2001</year>
<fpage>99</fpage>
<lpage>103</lpage>
</element-citation>
</ref>
<ref id="bib34">
<element-citation publication-type="journal" id="sbref35">
<person-group person-group-type="author">
<name>
<surname>Kahn</surname>
<given-names>M.G.</given-names>
</name>
<name>
<surname>Bailey</surname>
<given-names>T.C.</given-names>
</name>
<name>
<surname>Steib</surname>
<given-names>S.A.</given-names>
</name>
</person-group>
<article-title>Statistical process control methods for expert system performance monitoring</article-title>
<source>J Am Med Inform Assoc</source>
<volume>3</volume>
<year>1996</year>
<fpage>258</fpage>
<lpage>269</lpage>
<pub-id pub-id-type="pmid">8816348</pub-id>
</element-citation>
</ref>
<ref id="bib35">
<element-citation publication-type="journal" id="sbref36">
<person-group person-group-type="author">
<name>
<surname>Kahn</surname>
<given-names>M.G.</given-names>
</name>
<name>
<surname>Steib</surname>
<given-names>S.A.</given-names>
</name>
<name>
<surname>Dunagan</surname>
<given-names>W.C.</given-names>
</name>
</person-group>
<article-title>Monitoring expert system performance using continuous user feedback</article-title>
<source>J Am Med Inform Assoc</source>
<volume>3</volume>
<year>1996</year>
<fpage>216</fpage>
<lpage>223</lpage>
<pub-id pub-id-type="pmid">8723612</pub-id>
</element-citation>
</ref>
<ref id="bib36">
<element-citation publication-type="book" id="sbref37">
<person-group person-group-type="author">
<name>
<surname>Kahn</surname>
<given-names>M.G.</given-names>
</name>
<name>
<surname>Steib</surname>
<given-names>S.A.</given-names>
</name>
<name>
<surname>Fraser</surname>
<given-names>V.J.</given-names>
</name>
</person-group>
<chapter-title>An expert system for culture-based infection control surveillance</chapter-title>
<source>Proceedings of Annual Symposium on Computer Applications in Medical Care</source>
<year>1993</year>
<fpage>171</fpage>
<lpage>175</lpage>
</element-citation>
</ref>
<ref id="bib37">
<element-citation publication-type="book" id="sbref38">
<person-group person-group-type="author">
<name>
<surname>Kohn</surname>
<given-names>L.T.</given-names>
</name>
<name>
<surname>Corrigan</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Donaldson</surname>
<given-names>M.S.</given-names>
</name>
</person-group>
<chapter-title>To Err Is Human: Building a Safer Health System</chapter-title>
<year>2000</year>
<publisher-name>National Academy Press</publisher-name>
<publisher-loc>Washington, DC</publisher-loc>
</element-citation>
</ref>
<ref id="bib38">
<element-citation publication-type="journal" id="sbref39">
<person-group person-group-type="author">
<name>
<surname>Kolata</surname>
<given-names>G.</given-names>
</name>
</person-group>
<article-title>Florida Man Is Hospitalized with Pulmonary Anthrax</article-title>
<source>New York Times</source>
<issue>October 5</issue>
<year>2001</year>
</element-citation>
</ref>
<ref id="bib39">
<element-citation publication-type="journal" id="sbref40">
<person-group person-group-type="author">
<name>
<surname>Leavitt</surname>
<given-names>M.</given-names>
</name>
</person-group>
<article-title>Medscape's response to the Institute of Medicine Report: crossing the quality chasm: a new health system for the 21st century</article-title>
<source>Med Gen Med</source>
<volume>3</volume>
<year>2001</year>
<fpage>2</fpage>
</element-citation>
</ref>
<ref id="bib40">
<element-citation publication-type="journal" id="sbref41">
<person-group person-group-type="author">
<name>
<surname>Ledley</surname>
<given-names>R.S.</given-names>
</name>
<name>
<surname>Lusted</surname>
<given-names>L.B.</given-names>
</name>
</person-group>
<article-title>Reasoning foundation of medical diagnosis: symbolic logic, probability, and value theory aid our understanding of how physicians reason</article-title>
<source>Science</source>
<volume>130</volume>
<year>1959</year>
<fpage>9</fpage>
<lpage>12</lpage>
<pub-id pub-id-type="pmid">13668531</pub-id>
</element-citation>
</ref>
<ref id="bib41">
<element-citation publication-type="journal" id="sbref42">
<person-group person-group-type="author">
<name>
<surname>Leist</surname>
<given-names>J.C.</given-names>
</name>
<name>
<surname>Kristofco</surname>
<given-names>R.E.</given-names>
</name>
</person-group>
<article-title>The changing paradigm for continuing medical education: impact of information on the teachable moment</article-title>
<source>Bull Med Libr Assoc</source>
<volume>78</volume>
<year>1990</year>
<fpage>173</fpage>
<lpage>179</lpage>
<pub-id pub-id-type="pmid">2328366</pub-id>
</element-citation>
</ref>
<ref id="bib42">
<element-citation publication-type="journal" id="sbref43">
<person-group person-group-type="author">
<name>
<surname>London</surname>
<given-names>S.</given-names>
</name>
</person-group>
<article-title>DXplain: a web-based diagnostic decision support system for medical students</article-title>
<source>Med Ref Serv Q</source>
<volume>17</volume>
<year>1998</year>
<fpage>17</fpage>
<lpage>28</lpage>
</element-citation>
</ref>
<ref id="bib43">
<element-citation publication-type="journal" id="sbref44">
<person-group person-group-type="author">
<name>
<surname>McAdam</surname>
<given-names>W.A.</given-names>
</name>
<name>
<surname>Brock</surname>
<given-names>B.M.</given-names>
</name>
<name>
<surname>Armitage</surname>
<given-names>T.</given-names>
</name>
</person-group>
<article-title>Twelve years' experience of computer-aided diagnosis in a district general hospital</article-title>
<source>Ann R Coll Surg Engl</source>
<volume>72</volume>
<year>1990</year>
<fpage>140</fpage>
<lpage>146</lpage>
<pub-id pub-id-type="pmid">2185682</pub-id>
</element-citation>
</ref>
<ref id="bib44">
<element-citation publication-type="journal" id="sbref45">
<person-group person-group-type="author">
<name>
<surname>McDonald</surname>
<given-names>C.</given-names>
</name>
</person-group>
<article-title>Use of a computer to detect and respond to clinical events: its effect on clinician behavior</article-title>
<source>Ann Intern Med</source>
<volume>84</volume>
<year>1976</year>
<fpage>162</fpage>
<lpage>167</lpage>
<pub-id pub-id-type="pmid">1252043</pub-id>
</element-citation>
</ref>
<ref id="bib45">
<element-citation publication-type="book" id="sbref46">
<person-group person-group-type="author">
<name>
<surname>McDonald</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Tierney</surname>
<given-names>W.</given-names>
</name>
<name>
<surname>Overhage</surname>
<given-names>J.</given-names>
</name>
</person-group>
<chapter-title>H.I.S. and the physician: direct inpatient order entry by physicians through medical gopher workstations—problems and promises</chapter-title>
<source>Proceedings IMIA Working Conference on Trends in Modern Hospital Informatics Systems, Gottingen</source>
<conf-name>Germany</conf-name>
<year>1991</year>
<fpage>71</fpage>
<lpage>80</lpage>
<comment></comment>
</element-citation>
</ref>
<ref id="bib46">
<element-citation publication-type="journal" id="sbref47">
<person-group person-group-type="author">
<name>
<surname>McDonald</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Tierney</surname>
<given-names>W.</given-names>
</name>
<name>
<surname>Overhage</surname>
<given-names>J.</given-names>
</name>
</person-group>
<article-title>Regenstrief Medical Record System: 20 years of experience in hospitals, clinics, and neighborhood health centers</article-title>
<source>MD Computing</source>
<volume>9</volume>
<year>1992</year>
<fpage>206</fpage>
<lpage>217</lpage>
<pub-id pub-id-type="pmid">1508033</pub-id>
</element-citation>
</ref>
<ref id="bib47">
<element-citation publication-type="journal" id="sbref48">
<person-group person-group-type="author">
<name>
<surname>McDonald</surname>
<given-names>C.J.</given-names>
</name>
</person-group>
<article-title>Protocol-based computer reminders, the quality of care and the non-perfectability of man</article-title>
<source>N Engl J Med</source>
<volume>295</volume>
<year>1976</year>
<fpage>1351</fpage>
<lpage>1355</lpage>
<pub-id pub-id-type="pmid">988482</pub-id>
</element-citation>
</ref>
<ref id="bib48">
<element-citation publication-type="journal" id="sbref49">
<person-group person-group-type="author">
<name>
<surname>McDonald</surname>
<given-names>C.J.</given-names>
</name>
</person-group>
<article-title>Use of a computer to detect and respond to clinical events: Its effect on clinician behavior</article-title>
<source>Ann Intern Med</source>
<volume>84</volume>
<year>1976</year>
<fpage>162</fpage>
<lpage>167</lpage>
<pub-id pub-id-type="pmid">1252043</pub-id>
</element-citation>
</ref>
<ref id="bib49">
<element-citation publication-type="journal" id="sbref50">
<person-group person-group-type="author">
<name>
<surname>McDonald</surname>
<given-names>C.J.</given-names>
</name>
</person-group>
<article-title>Computer technology and continuing medical education: a scenario for the future</article-title>
<source>Conn Med</source>
<volume>47</volume>
<year>1983</year>
<fpage>159</fpage>
<lpage>162</lpage>
<pub-id pub-id-type="pmid">6851551</pub-id>
</element-citation>
</ref>
<ref id="bib50">
<element-citation publication-type="journal" id="sbref51">
<person-group person-group-type="author">
<name>
<surname>McDonald</surname>
<given-names>C.J.</given-names>
</name>
<name>
<surname>Hui</surname>
<given-names>S.L.</given-names>
</name>
<name>
<surname>Tierney</surname>
<given-names>W.M.</given-names>
</name>
</person-group>
<article-title>Effects of computer reminders for influenza vaccination on morbidity during influenza epidemics</article-title>
<source>MD Computing</source>
<volume>9</volume>
<year>1992</year>
<fpage>304</fpage>
<lpage>312</lpage>
<pub-id pub-id-type="pmid">1522792</pub-id>
</element-citation>
</ref>
<ref id="bib51">
<element-citation publication-type="journal" id="sbref52">
<person-group person-group-type="author">
<name>
<surname>Miller</surname>
<given-names>P.L.</given-names>
</name>
<name>
<surname>Frawley</surname>
<given-names>S.J.</given-names>
</name>
<name>
<surname>Sayward</surname>
<given-names>F.G.</given-names>
</name>
</person-group>
<article-title>Combining tabular, rule-based, and procedural knowledge in computerbased guidelines for childhood immunization</article-title>
<source>Comput Biomed Res</source>
<volume>30</volume>
<issue>3</issue>
<year>1997</year>
<fpage>211</fpage>
<lpage>231</lpage>
<pub-id pub-id-type="pmid">9281329</pub-id>
</element-citation>
</ref>
<ref id="bib52">
<element-citation publication-type="journal" id="sbref53">
<person-group person-group-type="author">
<name>
<surname>Miller</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Masarie</surname>
<given-names>F.E.</given-names>
</name>
<name>
<surname>Myers</surname>
<given-names>J.D.</given-names>
</name>
</person-group>
<article-title>Quick medical reference (QMR) for diagnostic assistance</article-title>
<source>MD Computing</source>
<volume>3</volume>
<year>1986</year>
<fpage>34</fpage>
<lpage>48</lpage>
<pub-id pub-id-type="pmid">3537611</pub-id>
</element-citation>
</ref>
<ref id="bib53">
<element-citation publication-type="journal" id="sbref54">
<person-group person-group-type="author">
<name>
<surname>Murphy</surname>
<given-names>G.C.</given-names>
</name>
<name>
<surname>Friedman</surname>
<given-names>C.P.</given-names>
</name>
<name>
<surname>Elstein</surname>
<given-names>A.S.</given-names>
</name>
</person-group>
<article-title>The influence of a decision support system on the differential diagnosis of medical practitioners at three levels of training</article-title>
<source>Proceedings of American Medical Informatics Association Annual Fall Symposium</source>
<year>1996</year>
<fpage>219</fpage>
<lpage>223</lpage>
</element-citation>
</ref>
<ref id="bib54">
<mixed-citation publication-type="other" id="ceotherref1">National Aeronautics and Space Administration A.C. language integrated production system (CLIPS). http://www.www.ghg.net/clips/WhatlsCLIPShtml</mixed-citation>
</ref>
<ref id="bib55">
<element-citation publication-type="book" id="sbref55">
<person-group person-group-type="author">
<name>
<surname>Neapolitan</surname>
<given-names>R.</given-names>
</name>
</person-group>
<chapter-title>Learning Bayesian Networks</chapter-title>
<year>2003</year>
<publisher-name>Pearson Prentice Hall</publisher-name>
<publisher-loc>Upper Saddle River, NJ</publisher-loc>
</element-citation>
</ref>
<ref id="bib56">
<element-citation publication-type="journal" id="sbref56">
<person-group person-group-type="author">
<name>
<surname>Overhage</surname>
<given-names>J.M.</given-names>
</name>
<name>
<surname>Tierney</surname>
<given-names>W.M.</given-names>
</name>
<name>
<surname>McDonald</surname>
<given-names>C.J.</given-names>
</name>
</person-group>
<article-title>Computer reminders to implement preventive care guidelines for hospitalized patients</article-title>
<source>Arch Intern Med</source>
<volume>156</volume>
<year>1996</year>
<fpage>1551</fpage>
<lpage>1556</lpage>
<pub-id pub-id-type="pmid">8687263</pub-id>
</element-citation>
</ref>
<ref id="bib57">
<element-citation publication-type="journal" id="sbref57">
<person-group person-group-type="author">
<name>
<surname>Parker</surname>
<given-names>C.G.</given-names>
</name>
<name>
<surname>Rocha</surname>
<given-names>R.A.</given-names>
</name>
<name>
<surname>Campbell</surname>
<given-names>J.R.</given-names>
</name>
</person-group>
<article-title>Detailed clinical models for sharable, executable guidelines</article-title>
<source>Medinfo</source>
<volume>11</volume>
<year>2004</year>
<fpage>145</fpage>
<lpage>148</lpage>
</element-citation>
</ref>
<ref id="bib58">
<element-citation publication-type="journal" id="sbref58">
<person-group person-group-type="author">
<name>
<surname>Peleg</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Tu</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Bury</surname>
<given-names>J.</given-names>
</name>
</person-group>
<article-title>Comparing computerinterpretable guideline models: a case-study approach</article-title>
<source>J Am Med Inform Assoc</source>
<volume>10</volume>
<year>2003</year>
<fpage>52</fpage>
<lpage>68</lpage>
<pub-id pub-id-type="pmid">12509357</pub-id>
</element-citation>
</ref>
<ref id="bib59">
<element-citation publication-type="journal" id="sbref59">
<person-group person-group-type="author">
<name>
<surname>Pynsent</surname>
<given-names>P.B.</given-names>
</name>
<name>
<surname>Fairbank</surname>
<given-names>J.C.</given-names>
</name>
</person-group>
<article-title>Computer interview system for patients with back pain</article-title>
<source>J Biomed Eng</source>
<volume>11</volume>
<year>1989</year>
<fpage>25</fpage>
<lpage>29</lpage>
<pub-id pub-id-type="pmid">2522569</pub-id>
</element-citation>
</ref>
<ref id="bib60">
<element-citation publication-type="journal" id="sbref60">
<person-group person-group-type="author">
<name>
<surname>Rind</surname>
<given-names>D.M.</given-names>
</name>
<name>
<surname>Davis</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Safran</surname>
<given-names>C.</given-names>
</name>
</person-group>
<article-title>Designing studies of computer-based alerts and reminders</article-title>
<source>MD. Computing</source>
<volume>12</volume>
<year>1995</year>
<fpage>122</fpage>
<lpage>126</lpage>
<pub-id pub-id-type="pmid">7700124</pub-id>
</element-citation>
</ref>
<ref id="bib61">
<element-citation publication-type="book" id="sbref61">
<person-group person-group-type="author">
<name>
<surname>Rind</surname>
<given-names>D.M.</given-names>
</name>
<name>
<surname>Safran</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Russell</surname>
<given-names>S.P.</given-names>
</name>
</person-group>
<chapter-title>The effect of computer-based reminders on the management of hospitalized patients with worsening renal function</chapter-title>
<source>Proceedings of the 15th Annual Symposium on Computer Applications in Medical Care</source>
<conf-name>Washington, D.C.</conf-name>
<year>1993</year>
<fpage>28</fpage>
<lpage>32</lpage>
</element-citation>
</ref>
<ref id="bib62">
<element-citation publication-type="journal" id="sbref62">
<person-group person-group-type="author">
<name>
<surname>Seyfang</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Miksch</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Marcos</surname>
<given-names>M.</given-names>
</name>
</person-group>
<article-title>Combining diagnosis and treatment using ASBRU</article-title>
<source>Int J Med Inform</source>
<volume>68</volume>
<year>2002</year>
<fpage>49</fpage>
<lpage>57</lpage>
<pub-id pub-id-type="pmid">12467790</pub-id>
</element-citation>
</ref>
<ref id="bib63">
<element-citation publication-type="journal" id="sbref63">
<person-group person-group-type="author">
<name>
<surname>Shannon</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Burstein</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Mandl</surname>
<given-names>K</given-names>
</name>
</person-group>
<article-title>Usage of a web-based decision support tool for bioterrorism detection</article-title>
<source>Am J Emerg Med</source>
<volume>20</volume>
<year>2002</year>
<fpage>384</fpage>
<lpage>453</lpage>
<pub-id pub-id-type="pmid">12098202</pub-id>
</element-citation>
</ref>
<ref id="bib64">
<element-citation publication-type="book" id="sbref64">
<person-group person-group-type="author">
<name>
<surname>Shephard</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Cameron</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Toribio</surname>
<given-names>J.</given-names>
</name>
</person-group>
<chapter-title>Bovine syndromic surveillance system</chapter-title>
<year>2005</year>
<ext-link ext-link-type="uri" xlink:href="http://www.www.ausvet.com.au/bosss/" id="interref5">http://www.www.ausvet.com.au/bosss/</ext-link>
</element-citation>
</ref>
<ref id="bib65">
<element-citation publication-type="journal" id="sbref65">
<person-group person-group-type="author">
<name>
<surname>Shiffman</surname>
<given-names>R.N.</given-names>
</name>
<name>
<surname>Michel</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Essaihi</surname>
<given-names>A.</given-names>
</name>
</person-group>
<article-title>Bridging the guideline implementation gap: a systematic, document-centered approach to guideline implementation</article-title>
<source>J Am Med Inform Assoc</source>
<volume>11</volume>
<year>2004</year>
<fpage>418</fpage>
<lpage>426</lpage>
<pub-id pub-id-type="pmid">15187061</pub-id>
</element-citation>
</ref>
<ref id="bib66">
<element-citation publication-type="journal" id="sbref66">
<person-group person-group-type="author">
<name>
<surname>Shwe</surname>
<given-names>M.A.</given-names>
</name>
<name>
<surname>Middleton</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Heckerman</surname>
<given-names>D.E.</given-names>
</name>
</person-group>
<article-title>Probabilistic diagnosis using a reformulation of the INTERNIST-1/QMR knowledge base. I.The probabilistic model and inference algorithms</article-title>
<source>Methods Inform Med</source>
<volume>30</volume>
<year>1991</year>
<fpage>241</fpage>
<lpage>255</lpage>
</element-citation>
</ref>
<ref id="bib67">
<element-citation publication-type="book" id="sbref67">
<person-group person-group-type="author">
<name>
<surname>Sorenson</surname>
<given-names>D.</given-names>
</name>
</person-group>
<chapter-title>Generation and maintenance of ILIAD medical knowledge in a hypercard environment</chapter-title>
<source>Proceedings of 12th Symposium on Computer Applications in Medical Care</source>
<conf-name>Washington, D.C</conf-name>
<year>1988</year>
</element-citation>
</ref>
<ref id="bib68">
<element-citation publication-type="book" id="sbref68">
<person-group person-group-type="author">
<name>
<surname>Terenziani</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Montani</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Torchio</surname>
<given-names>M.</given-names>
</name>
</person-group>
<chapter-title>Temporal consistency checking in clinical guidelines acquisition and execution: the GLARE'S approach</chapter-title>
<source>Proceedings of American Medical Informatics Association Annual Symposium</source>
<year>2003</year>
<fpage>659</fpage>
<lpage>663</lpage>
</element-citation>
</ref>
<ref id="bib69">
<element-citation publication-type="journal" id="sbref69">
<person-group person-group-type="author">
<name>
<surname>Tierney</surname>
<given-names>W.M.</given-names>
</name>
<name>
<surname>Miller</surname>
<given-names>M.E.</given-names>
</name>
<name>
<surname>Overhage</surname>
<given-names>J.M.</given-names>
</name>
</person-group>
<article-title>Physician inpatient order writing on microcomputer workstations. Effects on resource utilization</article-title>
<source>JAMA</source>
<volume>269</volume>
<year>1993</year>
<fpage>379</fpage>
<lpage>383</lpage>
<pub-id pub-id-type="pmid">8418345</pub-id>
</element-citation>
</ref>
<ref id="bib70">
<element-citation publication-type="journal" id="sbref70">
<person-group person-group-type="author">
<name>
<surname>Travis</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Latin</surname>
<given-names>R.</given-names>
</name>
</person-group>
<article-title>Development, implementation, and adoption of expert systems in plant pathology</article-title>
<source>Ann Rev Phytopathol</source>
<volume>29</volume>
<year>1991</year>
<fpage>343</fpage>
<lpage>360</lpage>
</element-citation>
</ref>
<ref id="bib71">
<element-citation publication-type="journal" id="sbref71">
<person-group person-group-type="author">
<name>
<surname>Tu</surname>
<given-names>S.W.</given-names>
</name>
<name>
<surname>Musen</surname>
<given-names>M.A.</given-names>
</name>
</person-group>
<article-title>Modeling data and knowledge in the EON guideline architecture</article-title>
<source>Medinfo</source>
<volume>10</volume>
<year>2001</year>
<fpage>280</fpage>
<lpage>284</lpage>
</element-citation>
</ref>
<ref id="bib72">
<element-citation publication-type="book" id="sbref72">
<person-group person-group-type="author">
<name>
<surname>Turner</surname>
<given-names>S.</given-names>
</name>
</person-group>
<chapter-title>Bayesian Networks & More</chapter-title>
<year>2001</year>
<ext-link ext-link-type="uri" xlink:href="http://www.www.medInformatics.org/mdi207/lab3.html" id="interref6">http://www.www.medInformatics.org/mdi207/lab3.html.</ext-link>
</element-citation>
</ref>
<ref id="bib73">
<element-citation publication-type="book" id="sbref73">
<person-group person-group-type="author">
<name>
<surname>Wagner</surname>
<given-names>M.M.</given-names>
</name>
<name>
<surname>Pankaskie</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Hogan</surname>
<given-names>W.</given-names>
</name>
</person-group>
<chapter-title>Clinical Event Monitoring at the University of Pittsburgh</chapter-title>
<source>Proceedings of American Medical Informatics Association Annual Fall Symposium</source>
<year>1997</year>
<fpage>188</fpage>
<lpage>192</lpage>
</element-citation>
</ref>
<ref id="bib74">
<element-citation publication-type="book" id="sbref74">
<person-group person-group-type="author">
<name>
<surname>Wald</surname>
<given-names>J.S.</given-names>
</name>
<name>
<surname>Rind</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Safran</surname>
<given-names>C.</given-names>
</name>
</person-group>
<chapter-title>Patient entries in the electronic medical record: an interactive interview used in primary care</chapter-title>
<source>Proceedings of Annual Symposium on Computer Applications in Medical Care</source>
<year>1995</year>
<fpage>147</fpage>
<lpage>151</lpage>
</element-citation>
</ref>
<ref id="bib75">
<element-citation publication-type="book" id="sbref75">
<person-group person-group-type="author">
<name>
<surname>Wang</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Peleg</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Bu</surname>
<given-names>D.</given-names>
</name>
</person-group>
<chapter-title>GESDOR-a generic execution model for sharing of computer-interpretable clinical practice guidelines</chapter-title>
<source>American Medical Informatics Association Annual Symposium</source>
<year>2003</year>
<fpage>694</fpage>
<lpage>698</lpage>
</element-citation>
</ref>
<ref id="bib76">
<element-citation publication-type="book" id="sbref76">
<person-group person-group-type="author">
<name>
<surname>Warner</surname>
<given-names>H.</given-names>
<suffix>Jr.</suffix>
</name>
<name>
<surname>Blue</surname>
<given-names>S.R.</given-names>
</name>
<name>
<surname>Sorenson</surname>
<given-names>D.</given-names>
</name>
</person-group>
<chapter-title>New computer-based tools for empiric antibiotic decision support</chapter-title>
<source>Proceedings of American Medical Informatics Association Annual Symposium</source>
<year>1997</year>
<fpage>238</fpage>
<lpage>242</lpage>
</element-citation>
</ref>
<ref id="bib77">
<element-citation publication-type="journal" id="sbref77">
<person-group person-group-type="author">
<name>
<surname>Warner</surname>
<given-names>H.R.</given-names>
<suffix>Jr.</suffix>
</name>
</person-group>
<article-title>Iliad: moving medical decision-making into new frontiers</article-title>
<source>Methods Inform Med</source>
<volume>28</volume>
<year>1989</year>
<fpage>370</fpage>
<lpage>372</lpage>
<comment></comment>
</element-citation>
</ref>
<ref id="bib78">
<element-citation publication-type="journal" id="sbref78">
<person-group person-group-type="author">
<name>
<surname>Warner</surname>
<given-names>H.R.</given-names>
<suffix>Jr.</suffix>
</name>
</person-group>
<article-title>Iliad: diagnostic tools for general medicine</article-title>
<source>Healthcare Inform</source>
<volume>7</volume>
<year>1990</year>
<fpage>38</fpage>
</element-citation>
</ref>
<ref id="bib79">
<element-citation publication-type="journal" id="sbref79">
<person-group person-group-type="author">
<name>
<surname>Warner</surname>
<given-names>H.R.</given-names>
<suffix>Jr.</suffix>
</name>
<name>
<surname>Bouhaddou</surname>
<given-names>O.</given-names>
</name>
</person-group>
<article-title>Innovation review: Iliad—a medical diagnostic support program</article-title>
<source>Top Health Inform Manag</source>
<volume>14</volume>
<year>1994</year>
<fpage>51</fpage>
<lpage>58</lpage>
<comment>Interview by Bill W. Childs</comment>
</element-citation>
</ref>
<ref id="bib80">
<element-citation publication-type="journal" id="sbref80">
<person-group person-group-type="author">
<name>
<surname>Warner</surname>
<given-names>H.R.</given-names>
</name>
<name>
<surname>Toronto</surname>
<given-names>A.F.</given-names>
</name>
<name>
<surname>Veasey</surname>
<given-names>G.</given-names>
</name>
</person-group>
<article-title>Experience with Bayes theorem for computer analysis of congenital heart disease</article-title>
<source>Ann N Y Acad Sci</source>
<volume>115</volume>
<year>1964</year>
<fpage>558</fpage>
<lpage>567</lpage>
<pub-id pub-id-type="pmid">14214034</pub-id>
</element-citation>
</ref>
<ref id="bib81">
<element-citation publication-type="journal" id="sbref81">
<person-group person-group-type="author">
<name>
<surname>Warner</surname>
<given-names>H.R.</given-names>
</name>
<name>
<surname>Toronto</surname>
<given-names>A.F.</given-names>
</name>
<name>
<surname>Veasey</surname>
<given-names>G.</given-names>
</name>
</person-group>
<article-title>A mathematical approach to medical diagnosis: application to congenital heart disease</article-title>
<source>JAMA</source>
<volume>177</volume>
<year>1961</year>
<fpage>177</fpage>
<lpage>183</lpage>
<pub-id pub-id-type="pmid">13783190</pub-id>
</element-citation>
</ref>
<ref id="bib82">
<element-citation publication-type="book" id="sbref82">
<person-group person-group-type="author">
<name>
<surname>Weinstein</surname>
<given-names>M.C.</given-names>
</name>
</person-group>
<chapter-title>The value of information</chapter-title>
<source>Clinical Decision Analysis</source>
<year>1980</year>
<fpage>131</fpage>
<lpage>167</lpage>
<comment>Philadelphia, Saunders</comment>
</element-citation>
</ref>
<ref id="bib83">
<element-citation publication-type="journal" id="sbref83">
<person-group person-group-type="author">
<name>
<surname>Williamson</surname>
<given-names>J.W.</given-names>
</name>
<name>
<surname>German</surname>
<given-names>P.S.</given-names>
</name>
<name>
<surname>Weiss</surname>
<given-names>R.</given-names>
</name>
</person-group>
<article-title>Health science Information management and continuing education of physicians: a survey of U.S. primary care practitioners and their opinion leaders</article-title>
<source>Ann Intern Med</source>
<volume>110</volume>
<year>1989</year>
<fpage>151</fpage>
<lpage>160</lpage>
<pub-id pub-id-type="pmid">2909205</pub-id>
</element-citation>
</ref>
<ref id="bib84">
<element-citation publication-type="journal" id="sbref84">
<person-group person-group-type="author">
<name>
<surname>Wilson</surname>
<given-names>D.H.</given-names>
</name>
<name>
<surname>Wilson</surname>
<given-names>P.D.</given-names>
</name>
<name>
<surname>Walmsley</surname>
<given-names>R.G.</given-names>
</name>
</person-group>
<article-title>Diagnosis of acute abdominal pain in the accident and emergency department</article-title>
<source>Br J Surg</source>
<volume>64</volume>
<year>1977</year>
<fpage>250</fpage>
<lpage>254</lpage>
<pub-id pub-id-type="pmid">322788</pub-id>
</element-citation>
</ref>
<ref id="bib85">
<element-citation publication-type="journal" id="sbref85">
<person-group person-group-type="author">
<name>
<surname>Wilson</surname>
<given-names>P.D.</given-names>
</name>
<name>
<surname>Horrocks</surname>
<given-names>J.C.</given-names>
</name>
<name>
<surname>Lyndon</surname>
<given-names>P.J.</given-names>
</name>
</person-group>
<article-title>Simplified computer-aided diagnosis of acute abdominal pain</article-title>
<source>BMJ</source>
<volume>2</volume>
<year>1975</year>
<fpage>73</fpage>
<lpage>75</lpage>
<pub-id pub-id-type="pmid">1093613</pub-id>
</element-citation>
</ref>
<ref id="bib86">
<element-citation publication-type="journal" id="sbref86">
<person-group person-group-type="author">
<name>
<surname>Yasnoff</surname>
<given-names>W.A.</given-names>
</name>
<name>
<surname>Humphreys</surname>
<given-names>B.L.</given-names>
</name>
<name>
<surname>Overhage</surname>
<given-names>J.M.</given-names>
</name>
</person-group>
<article-title>A consensus action agenda for achieving the national health Information infrastructure</article-title>
<source>J Am Med Inform Assoc</source>
<volume>11</volume>
<year>2004</year>
<fpage>332</fpage>
<lpage>338</lpage>
<pub-id pub-id-type="pmid">15187075</pub-id>
</element-citation>
</ref>
</ref-list>
<fn-group>
<fn id="fn1">
<label>1</label>
<p id="cenotep4">Studies of continued medical education programs also suggest that the yield is low and the cost is high (Haynes et al., 1984,
<xref rid="bib41" ref-type="bibr">Leist and Kristofco, 1990</xref>
, Williamson et al., 1989,
<xref rid="bib49" ref-type="bibr">McDonald, 1983</xref>
). The one study of efficacy of training (of a web-based educational program) on physicians' knowledge about diagnosis and management diseases caused by known weaponized biological agent showed no retention of information (chung et al., 2004).</p>
</fn>
<fn id="fn2">
<label>2</label>
<p id="cenotep5">We do not know whether the always playful Dr. McDonald and the sophisticated editors of the New England Journal of Medicine misspelled the word
<italic>perfectibility</italic>
intentionally. Also reinforcing the main conclusion of his research, it took a computer's spell checker to bring this error to our attention.</p>
</fn>
<fn id="fn3">
<label>3</label>
<p id="cenotep6">Physicians are taught (and reminded incessantly) “when you hear hoof beats, don't think of zebras”. This adage is an informal statement that when the evidence available about a particular patient supports equally a diagnosis of either influenza or SARS (e.g., the patient has constitutional symptoms and no history of exposure to SARS), they should conclude that the diagnosis of influenza is far more likely than SARS.</p>
</fn>
</fn-group>
</back>
</pmc>
</record>

Pour manipuler ce document sous Unix (Dilib)

EXPLOR_STEP=$WICRI_ROOT/Sante/explor/StressCovidV1/Data/Pmc/Corpus
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000237 | SxmlIndent | more

Ou

HfdSelect -h $EXPLOR_AREA/Data/Pmc/Corpus/biblio.hfd -nk 000237 | SxmlIndent | more

Pour mettre un lien sur cette page dans le réseau Wicri

{{Explor lien
   |wiki=    Sante
   |area=    StressCovidV1
   |flux=    Pmc
   |étape=   Corpus
   |type=    RBID
   |clé=     PMC:7150155
   |texte=   Case Detection Algorithms
}}

Pour générer des pages wiki

HfdIndexSelect -h $EXPLOR_AREA/Data/Pmc/Corpus/RBID.i   -Sk "pubmed:NONE" \
       | HfdSelect -Kh $EXPLOR_AREA/Data/Pmc/Corpus/biblio.hfd   \
       | NlmPubMed2Wicri -a StressCovidV1 

Wicri

This area was generated with Dilib version V0.6.33.
Data generation: Wed May 6 16:44:09 2020. Site generation: Sun Mar 28 08:26:57 2021