Quality of EHR data extractions for studies of preterm birth in a tertiary care center: guidelines for obtaining reliable data
Identifieur interne : 000006 ( Main/Curation ); précédent : 000005; suivant : 000007Quality of EHR data extractions for studies of preterm birth in a tertiary care center: guidelines for obtaining reliable data
Auteurs : Lindsey A. Knake [États-Unis] ; Monika Ahuja [États-Unis] ; Erin L. Mcdonald [États-Unis] ; Kelli K. Ryckman [États-Unis] ; Nancy Weathers [États-Unis] ; Todd Burstain [États-Unis] ; John M. Dagle [États-Unis] ; Jeffrey C. Murray [États-Unis] ; Prakash Nadkarni [États-Unis]Source :
- BMC Pediatrics [ 1471-2431 ] ; 2016.
Abstract
The use of Electronic Health Records (EHR) has increased significantly in the past 15 years. This study compares electronic vs. manual data abstractions from an EHR for accuracy. While the dataset is limited to preterm birth data, our work is generally applicable. We enumerate challenges to reliable extraction, and state guidelines to maximize reliability.
An Epic™ EHR data extraction of structured data values from 1,772 neonatal records born between the years 2001–2011 was performed. The data were directly compared to a manually-abstracted database. Specific data values important to studies of perinatology were chosen to compare discrepancies between the two databases.
Discrepancy rates between the EHR extraction and the manual database were calculated for gestational age in weeks (2.6 %), birthweight (9.7 %), first white blood cell count (3.2 %), initial hemoglobin (11.9 %), peak total and direct bilirubin (11.4 % and 4.9 %), and patent ductus arteriosus (PDA) diagnosis (12.8 %). Using the discrepancies, errors were quantified in both datasets using chart review. The EHR extraction errors were significantly fewer than manual abstraction errors for PDA and laboratory values excluding neonates transferred from outside hospitals, but significantly greater for birth weight. Reasons for the observed errors are discussed.
We show that an EHR not modified specifically for research purposes had discrepancy ranges comparable to a manually created database. We offer guidelines to minimize EHR extraction errors in future study designs. As EHRs become more research-friendly, electronic chart extractions should be more efficient and have lower error rates compared to manual abstractions.
The online version of this article (doi:10.1186/s12887-016-0592-z) contains supplementary material, which is available to authorized users.
Url:
DOI: 10.1186/s12887-016-0592-z
PubMed: 27130217
PubMed Central: 4851819
Links toward previous steps (curation, corpus...)
- to stream Pmc, to step Corpus: Pour aller vers cette notice dans l'étape Curation :000037
- to stream Pmc, to step Curation: Pour aller vers cette notice dans l'étape Curation :000037
- to stream Pmc, to step Checkpoint: Pour aller vers cette notice dans l'étape Curation :000004
- to stream Ncbi, to step Merge: Pour aller vers cette notice dans l'étape Curation :000261
- to stream Ncbi, to step Curation: Pour aller vers cette notice dans l'étape Curation :000261
- to stream Ncbi, to step Checkpoint: Pour aller vers cette notice dans l'étape Curation :000261
- to stream Main, to step Merge: Pour aller vers cette notice dans l'étape Curation :000005
Links to Exploration step
PMC:4851819Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">Quality of EHR data extractions for studies of preterm birth in a tertiary care center: guidelines for obtaining reliable data</title><author><name sortKey="Knake, Lindsey A" sort="Knake, Lindsey A" uniqKey="Knake L" first="Lindsey A." last="Knake">Lindsey A. Knake</name><affiliation wicri:level="2"><nlm:aff id="Aff1">Department of Pediatrics, University of Iowa Hospitals and Clinics, 200 Hawkins Drive, 276 MRF, Iowa City, IA 52240 USA</nlm:aff><country xml:lang="fr">États-Unis</country><placeName><region type="state">Iowa</region></placeName><wicri:cityArea>Department of Pediatrics, University of Iowa Hospitals and Clinics, 200 Hawkins Drive, 276 MRF, Iowa City</wicri:cityArea></affiliation></author><author><name sortKey="Ahuja, Monika" sort="Ahuja, Monika" uniqKey="Ahuja M" first="Monika" last="Ahuja">Monika Ahuja</name><affiliation wicri:level="2"><nlm:aff id="Aff3">Institue for Clinical and Translational Science, University of Iowa, Iowa City, IA USA</nlm:aff><country>États-Unis</country><placeName><region type="state">Iowa</region></placeName><wicri:cityArea>Institue for Clinical and Translational Science, University of Iowa, Iowa City</wicri:cityArea></affiliation></author><author><name sortKey="Mcdonald, Erin L" sort="Mcdonald, Erin L" uniqKey="Mcdonald E" first="Erin L." last="Mcdonald">Erin L. Mcdonald</name><affiliation wicri:level="2"><nlm:aff id="Aff1">Department of Pediatrics, University of Iowa Hospitals and Clinics, 200 Hawkins Drive, 276 MRF, Iowa City, IA 52240 USA</nlm:aff><country xml:lang="fr">États-Unis</country><placeName><region type="state">Iowa</region></placeName><wicri:cityArea>Department of Pediatrics, University of Iowa Hospitals and Clinics, 200 Hawkins Drive, 276 MRF, Iowa City</wicri:cityArea></affiliation></author><author><name sortKey="Ryckman, Kelli K" sort="Ryckman, Kelli K" uniqKey="Ryckman K" first="Kelli K." last="Ryckman">Kelli K. Ryckman</name><affiliation wicri:level="2"><nlm:aff id="Aff2">Department of Epidemiology, University of Iowa, Iowa City, IA USA</nlm:aff><country>États-Unis</country><placeName><region type="state">Iowa</region></placeName><wicri:cityArea>Department of Epidemiology, University of Iowa, Iowa City</wicri:cityArea></affiliation></author><author><name sortKey="Weathers, Nancy" sort="Weathers, Nancy" uniqKey="Weathers N" first="Nancy" last="Weathers">Nancy Weathers</name><affiliation wicri:level="2"><nlm:aff id="Aff1">Department of Pediatrics, University of Iowa Hospitals and Clinics, 200 Hawkins Drive, 276 MRF, Iowa City, IA 52240 USA</nlm:aff><country xml:lang="fr">États-Unis</country><placeName><region type="state">Iowa</region></placeName><wicri:cityArea>Department of Pediatrics, University of Iowa Hospitals and Clinics, 200 Hawkins Drive, 276 MRF, Iowa City</wicri:cityArea></affiliation></author><author><name sortKey="Burstain, Todd" sort="Burstain, Todd" uniqKey="Burstain T" first="Todd" last="Burstain">Todd Burstain</name><affiliation wicri:level="2"><nlm:aff id="Aff3">Institue for Clinical and Translational Science, University of Iowa, Iowa City, IA USA</nlm:aff><country>États-Unis</country><placeName><region type="state">Iowa</region></placeName><wicri:cityArea>Institue for Clinical and Translational Science, University of Iowa, Iowa City</wicri:cityArea></affiliation></author><author><name sortKey="Dagle, John M" sort="Dagle, John M" uniqKey="Dagle J" first="John M." last="Dagle">John M. Dagle</name><affiliation wicri:level="2"><nlm:aff id="Aff1">Department of Pediatrics, University of Iowa Hospitals and Clinics, 200 Hawkins Drive, 276 MRF, Iowa City, IA 52240 USA</nlm:aff><country xml:lang="fr">États-Unis</country><placeName><region type="state">Iowa</region></placeName><wicri:cityArea>Department of Pediatrics, University of Iowa Hospitals and Clinics, 200 Hawkins Drive, 276 MRF, Iowa City</wicri:cityArea></affiliation></author><author><name sortKey="Murray, Jeffrey C" sort="Murray, Jeffrey C" uniqKey="Murray J" first="Jeffrey C." last="Murray">Jeffrey C. Murray</name><affiliation wicri:level="2"><nlm:aff id="Aff1">Department of Pediatrics, University of Iowa Hospitals and Clinics, 200 Hawkins Drive, 276 MRF, Iowa City, IA 52240 USA</nlm:aff><country xml:lang="fr">États-Unis</country><placeName><region type="state">Iowa</region></placeName><wicri:cityArea>Department of Pediatrics, University of Iowa Hospitals and Clinics, 200 Hawkins Drive, 276 MRF, Iowa City</wicri:cityArea></affiliation></author><author><name sortKey="Nadkarni, Prakash" sort="Nadkarni, Prakash" uniqKey="Nadkarni P" first="Prakash" last="Nadkarni">Prakash Nadkarni</name><affiliation wicri:level="2"><nlm:aff id="Aff3">Institue for Clinical and Translational Science, University of Iowa, Iowa City, IA USA</nlm:aff><country>États-Unis</country><placeName><region type="state">Iowa</region></placeName><wicri:cityArea>Institue for Clinical and Translational Science, University of Iowa, Iowa City</wicri:cityArea></affiliation></author></titleStmt><publicationStmt><idno type="wicri:source">PMC</idno><idno type="pmid">27130217</idno><idno type="pmc">4851819</idno><idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4851819</idno><idno type="RBID">PMC:4851819</idno><idno type="doi">10.1186/s12887-016-0592-z</idno><date when="2016">2016</date><idno type="wicri:Area/Pmc/Corpus">000037</idno><idno type="wicri:Area/Pmc/Curation">000037</idno><idno type="wicri:Area/Pmc/Checkpoint">000004</idno><idno type="wicri:Area/Ncbi/Merge">000261</idno><idno type="wicri:Area/Ncbi/Curation">000261</idno><idno type="wicri:Area/Ncbi/Checkpoint">000261</idno><idno type="wicri:Area/Main/Merge">000005</idno><idno type="wicri:Area/Main/Curation">000006</idno></publicationStmt><sourceDesc><biblStruct><analytic><title xml:lang="en" level="a" type="main">Quality of EHR data extractions for studies of preterm birth in a tertiary care center: guidelines for obtaining reliable data</title><author><name sortKey="Knake, Lindsey A" sort="Knake, Lindsey A" uniqKey="Knake L" first="Lindsey A." last="Knake">Lindsey A. Knake</name><affiliation wicri:level="2"><nlm:aff id="Aff1">Department of Pediatrics, University of Iowa Hospitals and Clinics, 200 Hawkins Drive, 276 MRF, Iowa City, IA 52240 USA</nlm:aff><country xml:lang="fr">États-Unis</country><placeName><region type="state">Iowa</region></placeName><wicri:cityArea>Department of Pediatrics, University of Iowa Hospitals and Clinics, 200 Hawkins Drive, 276 MRF, Iowa City</wicri:cityArea></affiliation></author><author><name sortKey="Ahuja, Monika" sort="Ahuja, Monika" uniqKey="Ahuja M" first="Monika" last="Ahuja">Monika Ahuja</name><affiliation wicri:level="2"><nlm:aff id="Aff3">Institue for Clinical and Translational Science, University of Iowa, Iowa City, IA USA</nlm:aff><country>États-Unis</country><placeName><region type="state">Iowa</region></placeName><wicri:cityArea>Institue for Clinical and Translational Science, University of Iowa, Iowa City</wicri:cityArea></affiliation></author><author><name sortKey="Mcdonald, Erin L" sort="Mcdonald, Erin L" uniqKey="Mcdonald E" first="Erin L." last="Mcdonald">Erin L. Mcdonald</name><affiliation wicri:level="2"><nlm:aff id="Aff1">Department of Pediatrics, University of Iowa Hospitals and Clinics, 200 Hawkins Drive, 276 MRF, Iowa City, IA 52240 USA</nlm:aff><country xml:lang="fr">États-Unis</country><placeName><region type="state">Iowa</region></placeName><wicri:cityArea>Department of Pediatrics, University of Iowa Hospitals and Clinics, 200 Hawkins Drive, 276 MRF, Iowa City</wicri:cityArea></affiliation></author><author><name sortKey="Ryckman, Kelli K" sort="Ryckman, Kelli K" uniqKey="Ryckman K" first="Kelli K." last="Ryckman">Kelli K. Ryckman</name><affiliation wicri:level="2"><nlm:aff id="Aff2">Department of Epidemiology, University of Iowa, Iowa City, IA USA</nlm:aff><country>États-Unis</country><placeName><region type="state">Iowa</region></placeName><wicri:cityArea>Department of Epidemiology, University of Iowa, Iowa City</wicri:cityArea></affiliation></author><author><name sortKey="Weathers, Nancy" sort="Weathers, Nancy" uniqKey="Weathers N" first="Nancy" last="Weathers">Nancy Weathers</name><affiliation wicri:level="2"><nlm:aff id="Aff1">Department of Pediatrics, University of Iowa Hospitals and Clinics, 200 Hawkins Drive, 276 MRF, Iowa City, IA 52240 USA</nlm:aff><country xml:lang="fr">États-Unis</country><placeName><region type="state">Iowa</region></placeName><wicri:cityArea>Department of Pediatrics, University of Iowa Hospitals and Clinics, 200 Hawkins Drive, 276 MRF, Iowa City</wicri:cityArea></affiliation></author><author><name sortKey="Burstain, Todd" sort="Burstain, Todd" uniqKey="Burstain T" first="Todd" last="Burstain">Todd Burstain</name><affiliation wicri:level="2"><nlm:aff id="Aff3">Institue for Clinical and Translational Science, University of Iowa, Iowa City, IA USA</nlm:aff><country>États-Unis</country><placeName><region type="state">Iowa</region></placeName><wicri:cityArea>Institue for Clinical and Translational Science, University of Iowa, Iowa City</wicri:cityArea></affiliation></author><author><name sortKey="Dagle, John M" sort="Dagle, John M" uniqKey="Dagle J" first="John M." last="Dagle">John M. Dagle</name><affiliation wicri:level="2"><nlm:aff id="Aff1">Department of Pediatrics, University of Iowa Hospitals and Clinics, 200 Hawkins Drive, 276 MRF, Iowa City, IA 52240 USA</nlm:aff><country xml:lang="fr">États-Unis</country><placeName><region type="state">Iowa</region></placeName><wicri:cityArea>Department of Pediatrics, University of Iowa Hospitals and Clinics, 200 Hawkins Drive, 276 MRF, Iowa City</wicri:cityArea></affiliation></author><author><name sortKey="Murray, Jeffrey C" sort="Murray, Jeffrey C" uniqKey="Murray J" first="Jeffrey C." last="Murray">Jeffrey C. Murray</name><affiliation wicri:level="2"><nlm:aff id="Aff1">Department of Pediatrics, University of Iowa Hospitals and Clinics, 200 Hawkins Drive, 276 MRF, Iowa City, IA 52240 USA</nlm:aff><country xml:lang="fr">États-Unis</country><placeName><region type="state">Iowa</region></placeName><wicri:cityArea>Department of Pediatrics, University of Iowa Hospitals and Clinics, 200 Hawkins Drive, 276 MRF, Iowa City</wicri:cityArea></affiliation></author><author><name sortKey="Nadkarni, Prakash" sort="Nadkarni, Prakash" uniqKey="Nadkarni P" first="Prakash" last="Nadkarni">Prakash Nadkarni</name><affiliation wicri:level="2"><nlm:aff id="Aff3">Institue for Clinical and Translational Science, University of Iowa, Iowa City, IA USA</nlm:aff><country>États-Unis</country><placeName><region type="state">Iowa</region></placeName><wicri:cityArea>Institue for Clinical and Translational Science, University of Iowa, Iowa City</wicri:cityArea></affiliation></author></analytic><series><title level="j">BMC Pediatrics</title><idno type="eISSN">1471-2431</idno><imprint><date when="2016">2016</date></imprint></series></biblStruct></sourceDesc></fileDesc><profileDesc><textClass></textClass></profileDesc></teiHeader><front><div type="abstract" xml:lang="en"><sec><title>Background</title><p>The use of Electronic Health Records (EHR) has increased significantly in the past 15 years. This study compares electronic vs. manual data abstractions from an EHR for accuracy. While the dataset is limited to preterm birth data, our work is generally applicable. We enumerate challenges to reliable extraction, and state guidelines to maximize reliability.</p></sec><sec><title>Methods</title><p>An Epic™ EHR data extraction of structured data values from 1,772 neonatal records born between the years 2001–2011 was performed. The data were directly compared to a manually-abstracted database. Specific data values important to studies of perinatology were chosen to compare discrepancies between the two databases.</p></sec><sec><title>Results</title><p>Discrepancy rates between the EHR extraction and the manual database were calculated for gestational age in weeks (2.6 %), birthweight (9.7 %), first white blood cell count (3.2 %), initial hemoglobin (11.9 %), peak total and direct bilirubin (11.4 % and 4.9 %), and patent ductus arteriosus (PDA) diagnosis (12.8 %). Using the discrepancies, errors were quantified in both datasets using chart review. The EHR extraction errors were significantly fewer than manual abstraction errors for PDA and laboratory values excluding neonates transferred from outside hospitals, but significantly greater for birth weight. Reasons for the observed errors are discussed.</p></sec><sec><title>Conclusions</title><p>We show that an EHR not modified specifically for research purposes had discrepancy ranges comparable to a manually created database. We offer guidelines to minimize EHR extraction errors in future study designs. As EHRs become more research-friendly, electronic chart extractions should be more efficient and have lower error rates compared to manual abstractions.</p></sec><sec><title>Electronic supplementary material</title><p>The online version of this article (doi:10.1186/s12887-016-0592-z) contains supplementary material, which is available to authorized users.</p></sec></div></front><back><div1 type="bibliography"><listBibl><biblStruct></biblStruct><biblStruct><analytic><author><name sortKey="Melton, J" uniqKey="Melton J">J Melton</name></author><author><name sortKey="Simon, Ar" uniqKey="Simon A">AR Simon</name></author><author><name sortKey="Gray, J" uniqKey="Gray J">J Gray</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Spong, Cy" uniqKey="Spong C">CY Spong</name></author></analytic></biblStruct><biblStruct></biblStruct><biblStruct><analytic><author><name sortKey="Wasserman, Rc" uniqKey="Wasserman R">RC Wasserman</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Pathak, J" uniqKey="Pathak J">J Pathak</name></author><author><name sortKey="Bailey, Kr" uniqKey="Bailey K">KR Bailey</name></author><author><name sortKey="Beebe, Ce" uniqKey="Beebe C">CE Beebe</name></author><author><name sortKey="Bethard, S" uniqKey="Bethard S">S Bethard</name></author><author><name sortKey="Carrell, Dc" uniqKey="Carrell D">DC Carrell</name></author><author><name sortKey="Chen, Pj" uniqKey="Chen P">PJ Chen</name></author><author><name sortKey="Dligach, D" uniqKey="Dligach D">D Dligach</name></author><author><name sortKey="Endle, Cm" uniqKey="Endle C">CM Endle</name></author><author><name sortKey="Hart, La" uniqKey="Hart L">LA Hart</name></author><author><name sortKey="Haug, Pj" uniqKey="Haug P">PJ Haug</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Nadkarni, Pm" uniqKey="Nadkarni P">PM Nadkarni</name></author><author><name sortKey="Ohno Machado, L" uniqKey="Ohno Machado L">L Ohno-Machado</name></author><author><name sortKey="Chapman, Ww" uniqKey="Chapman W">WW Chapman</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Mccoy, Ab" uniqKey="Mccoy A">AB McCoy</name></author><author><name sortKey="Wright, A" uniqKey="Wright A">A Wright</name></author><author><name sortKey="Eysenbach, G" uniqKey="Eysenbach G">G Eysenbach</name></author><author><name sortKey="Malin, Ba" uniqKey="Malin B">BA Malin</name></author><author><name sortKey="Patterson, Es" uniqKey="Patterson E">ES Patterson</name></author><author><name sortKey="Xu, H" uniqKey="Xu H">H Xu</name></author><author><name sortKey="Sittig, Df" uniqKey="Sittig D">DF Sittig</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Freund, J" uniqKey="Freund J">J Freund</name></author><author><name sortKey="Meiman, J" uniqKey="Meiman J">J Meiman</name></author><author><name sortKey="Kraus, C" uniqKey="Kraus C">C Kraus</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Wu, St" uniqKey="Wu S">ST Wu</name></author><author><name sortKey="Sohn, S" uniqKey="Sohn S">S Sohn</name></author><author><name sortKey="Ravikumar, Ke" uniqKey="Ravikumar K">KE Ravikumar</name></author><author><name sortKey="Wagholikar, K" uniqKey="Wagholikar K">K Wagholikar</name></author><author><name sortKey="Jonnalagadda, Sr" uniqKey="Jonnalagadda S">SR Jonnalagadda</name></author><author><name sortKey="Liu, H" uniqKey="Liu H">H Liu</name></author><author><name sortKey="Juhn, Yj" uniqKey="Juhn Y">YJ Juhn</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Steidl, M" uniqKey="Steidl M">M Steidl</name></author><author><name sortKey="Zimmern, P" uniqKey="Zimmern P">P Zimmern</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Newgard, Cd" uniqKey="Newgard C">CD Newgard</name></author><author><name sortKey="Zive, D" uniqKey="Zive D">D Zive</name></author><author><name sortKey="Jui, J" uniqKey="Jui J">J Jui</name></author><author><name sortKey="Weathers, C" uniqKey="Weathers C">C Weathers</name></author><author><name sortKey="Daya, M" uniqKey="Daya M">M Daya</name></author></analytic></biblStruct><biblStruct></biblStruct><biblStruct><analytic><author><name sortKey="Hartung, J" uniqKey="Hartung J">J Hartung</name></author><author><name sortKey="Knapp, G" uniqKey="Knapp G">G Knapp</name></author><author><name sortKey="Sinha, B" uniqKey="Sinha B">B Sinha</name></author></analytic></biblStruct></listBibl></div1></back></TEI></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/OcrV1/Data/Main/Curation
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000006 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Main/Curation/biblio.hfd -nk 000006 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Ticri/CIDE
|area= OcrV1
|flux= Main
|étape= Curation
|type= RBID
|clé= PMC:4851819
|texte= Quality of EHR data extractions for studies of preterm birth in a tertiary care center: guidelines for obtaining reliable data
}}
Pour générer des pages wiki
HfdIndexSelect -h $EXPLOR_AREA/Data/Main/Curation/RBID.i -Sk "pubmed:27130217" \
| HfdSelect -Kh $EXPLOR_AREA/Data/Main/Curation/biblio.hfd \
| NlmPubMed2Wicri -a OcrV1
| This area was generated with Dilib version V0.6.32. |  |