Serveur d'exploration sur la télématique

Attention, ce site est en cours de développement !
Attention, site généré par des moyens informatiques à partir de corpus bruts.
Les informations ne sont donc pas validées.
***** Acces problem to record *****\

Identifieur interne : 000028 ( Pmc/Corpus ); précédent : 0000279; suivant : 0000290 ***** probable Xml problem with record *****

Links to Exploration step


Le document en format XML

<record>
<TEI>
<teiHeader>
<fileDesc>
<titleStmt>
<title xml:lang="en">Automatic Prediction of Cardiovascular and Cerebrovascular Events Using Heart Rate Variability Analysis</title>
<author>
<name sortKey="Melillo, Paolo" sort="Melillo, Paolo" uniqKey="Melillo P" first="Paolo" last="Melillo">Paolo Melillo</name>
<affiliation>
<nlm:aff id="aff001">
<addr-line>Multidisciplinary Department of Medical, Surgical and Dental Sciences, Second University of Naples, Naples, Italy</addr-line>
</nlm:aff>
</affiliation>
<affiliation>
<nlm:aff id="aff002">
<addr-line>SHARE Project, Italian Ministry of Education, Scientific Research and University, Rome, Italy</addr-line>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Izzo, Raffaele" sort="Izzo, Raffaele" uniqKey="Izzo R" first="Raffaele" last="Izzo">Raffaele Izzo</name>
<affiliation>
<nlm:aff id="aff003">
<addr-line>Department of Translational Medical Sciences, University of Naples Federico II, Naples, Italy</addr-line>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Orrico, Ada" sort="Orrico, Ada" uniqKey="Orrico A" first="Ada" last="Orrico">Ada Orrico</name>
<affiliation>
<nlm:aff id="aff001">
<addr-line>Multidisciplinary Department of Medical, Surgical and Dental Sciences, Second University of Naples, Naples, Italy</addr-line>
</nlm:aff>
</affiliation>
<affiliation>
<nlm:aff id="aff002">
<addr-line>SHARE Project, Italian Ministry of Education, Scientific Research and University, Rome, Italy</addr-line>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Scala, Paolo" sort="Scala, Paolo" uniqKey="Scala P" first="Paolo" last="Scala">Paolo Scala</name>
<affiliation>
<nlm:aff id="aff002">
<addr-line>SHARE Project, Italian Ministry of Education, Scientific Research and University, Rome, Italy</addr-line>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Attanasio, Marcella" sort="Attanasio, Marcella" uniqKey="Attanasio M" first="Marcella" last="Attanasio">Marcella Attanasio</name>
<affiliation>
<nlm:aff id="aff001">
<addr-line>Multidisciplinary Department of Medical, Surgical and Dental Sciences, Second University of Naples, Naples, Italy</addr-line>
</nlm:aff>
</affiliation>
<affiliation>
<nlm:aff id="aff002">
<addr-line>SHARE Project, Italian Ministry of Education, Scientific Research and University, Rome, Italy</addr-line>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Mirra, Marco" sort="Mirra, Marco" uniqKey="Mirra M" first="Marco" last="Mirra">Marco Mirra</name>
<affiliation>
<nlm:aff id="aff003">
<addr-line>Department of Translational Medical Sciences, University of Naples Federico II, Naples, Italy</addr-line>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="De Luca, Nicola" sort="De Luca, Nicola" uniqKey="De Luca N" first="Nicola" last="De Luca">Nicola De Luca</name>
<affiliation>
<nlm:aff id="aff003">
<addr-line>Department of Translational Medical Sciences, University of Naples Federico II, Naples, Italy</addr-line>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Pecchia, Leandro" sort="Pecchia, Leandro" uniqKey="Pecchia L" first="Leandro" last="Pecchia">Leandro Pecchia</name>
<affiliation>
<nlm:aff id="aff004">
<addr-line>School of Engineering, University of Warwick, Coventry, United Kingdom</addr-line>
</nlm:aff>
</affiliation>
</author>
</titleStmt>
<publicationStmt>
<idno type="wicri:source">PMC</idno>
<idno type="pmid">25793605</idno>
<idno type="pmc">4368686</idno>
<idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4368686</idno>
<idno type="RBID">PMC:4368686</idno>
<idno type="doi">10.1371/journal.pone.0118504</idno>
<date when="2015">2015</date>
<idno type="wicri:Area/Pmc/Corpus">000028</idno>
<idno type="wicri:explorRef" wicri:stream="Pmc" wicri:step="Corpus" wicri:corpus="PMC">000028</idno>
</publicationStmt>
<sourceDesc>
<biblStruct>
<analytic>
<title xml:lang="en" level="a" type="main">Automatic Prediction of Cardiovascular and Cerebrovascular Events Using Heart Rate Variability Analysis</title>
<author>
<name sortKey="Melillo, Paolo" sort="Melillo, Paolo" uniqKey="Melillo P" first="Paolo" last="Melillo">Paolo Melillo</name>
<affiliation>
<nlm:aff id="aff001">
<addr-line>Multidisciplinary Department of Medical, Surgical and Dental Sciences, Second University of Naples, Naples, Italy</addr-line>
</nlm:aff>
</affiliation>
<affiliation>
<nlm:aff id="aff002">
<addr-line>SHARE Project, Italian Ministry of Education, Scientific Research and University, Rome, Italy</addr-line>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Izzo, Raffaele" sort="Izzo, Raffaele" uniqKey="Izzo R" first="Raffaele" last="Izzo">Raffaele Izzo</name>
<affiliation>
<nlm:aff id="aff003">
<addr-line>Department of Translational Medical Sciences, University of Naples Federico II, Naples, Italy</addr-line>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Orrico, Ada" sort="Orrico, Ada" uniqKey="Orrico A" first="Ada" last="Orrico">Ada Orrico</name>
<affiliation>
<nlm:aff id="aff001">
<addr-line>Multidisciplinary Department of Medical, Surgical and Dental Sciences, Second University of Naples, Naples, Italy</addr-line>
</nlm:aff>
</affiliation>
<affiliation>
<nlm:aff id="aff002">
<addr-line>SHARE Project, Italian Ministry of Education, Scientific Research and University, Rome, Italy</addr-line>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Scala, Paolo" sort="Scala, Paolo" uniqKey="Scala P" first="Paolo" last="Scala">Paolo Scala</name>
<affiliation>
<nlm:aff id="aff002">
<addr-line>SHARE Project, Italian Ministry of Education, Scientific Research and University, Rome, Italy</addr-line>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Attanasio, Marcella" sort="Attanasio, Marcella" uniqKey="Attanasio M" first="Marcella" last="Attanasio">Marcella Attanasio</name>
<affiliation>
<nlm:aff id="aff001">
<addr-line>Multidisciplinary Department of Medical, Surgical and Dental Sciences, Second University of Naples, Naples, Italy</addr-line>
</nlm:aff>
</affiliation>
<affiliation>
<nlm:aff id="aff002">
<addr-line>SHARE Project, Italian Ministry of Education, Scientific Research and University, Rome, Italy</addr-line>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Mirra, Marco" sort="Mirra, Marco" uniqKey="Mirra M" first="Marco" last="Mirra">Marco Mirra</name>
<affiliation>
<nlm:aff id="aff003">
<addr-line>Department of Translational Medical Sciences, University of Naples Federico II, Naples, Italy</addr-line>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="De Luca, Nicola" sort="De Luca, Nicola" uniqKey="De Luca N" first="Nicola" last="De Luca">Nicola De Luca</name>
<affiliation>
<nlm:aff id="aff003">
<addr-line>Department of Translational Medical Sciences, University of Naples Federico II, Naples, Italy</addr-line>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Pecchia, Leandro" sort="Pecchia, Leandro" uniqKey="Pecchia L" first="Leandro" last="Pecchia">Leandro Pecchia</name>
<affiliation>
<nlm:aff id="aff004">
<addr-line>School of Engineering, University of Warwick, Coventry, United Kingdom</addr-line>
</nlm:aff>
</affiliation>
</author>
</analytic>
<series>
<title level="j">PLoS ONE</title>
<idno type="eISSN">1932-6203</idno>
<imprint>
<date when="2015">2015</date>
</imprint>
</series>
</biblStruct>
</sourceDesc>
</fileDesc>
<profileDesc>
<textClass></textClass>
</profileDesc>
</teiHeader>
<front>
<div type="abstract" xml:lang="en">
<sec id="sec001">
<title>Background</title>
<p>There is consensus that Heart Rate Variability is associated with the risk of vascular events. However, Heart Rate Variability predictive value for vascular events is not completely clear. The aim of this study is to develop novel predictive models based on data-mining algorithms to provide an automatic risk stratification tool for hypertensive patients.</p>
</sec>
<sec id="sec002">
<title>Methods</title>
<p>A database of 139 Holter recordings with clinical data of hypertensive patients followed up for at least 12 months were collected ad hoc. Subjects who experienced a vascular event (i.e., myocardial infarction, stroke, syncopal event) were considered as high-risk subjects. Several data-mining algorithms (such as support vector machine, tree-based classifier, artificial neural network) were used to develop automatic classifiers and their accuracy was tested by assessing the receiver-operator characteristics curve. Moreover, we tested the echographic parameters, which have been showed as powerful predictors of future vascular events.</p>
</sec>
<sec id="sec003">
<title>Results</title>
<p>The best predictive model was based on random forest and enabled to identify high-risk hypertensive patients with sensitivity and specificity rates of 71.4% and 87.8%, respectively. The Heart Rate Variability based classifier showed higher predictive values than the conventional echographic parameters, which are considered as significant cardiovascular risk factors.</p>
</sec>
<sec id="sec004">
<title>Conclusions</title>
<p>Combination of Heart Rate Variability measures, analyzed with data-mining algorithm, could be a reliable tool for identifying hypertensive patients at high risk to develop future vascular events.</p>
</sec>
</div>
</front>
<back>
<div1 type="bibliography">
<listBibl>
<biblStruct>
<analytic>
<author>
<name sortKey="Fuster, V" uniqKey="Fuster V">V Fuster</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Murray, Cj" uniqKey="Murray C">CJ Murray</name>
</author>
<author>
<name sortKey="Lopez, Ad" uniqKey="Lopez A">AD Lopez</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Rothwell, Pm" uniqKey="Rothwell P">PM Rothwell</name>
</author>
<author>
<name sortKey="Coull, Aj" uniqKey="Coull A">AJ Coull</name>
</author>
<author>
<name sortKey="Silver, Le" uniqKey="Silver L">LE Silver</name>
</author>
<author>
<name sortKey="Fairhead, Jf" uniqKey="Fairhead J">JF Fairhead</name>
</author>
<author>
<name sortKey="Giles, Mf" uniqKey="Giles M">MF Giles</name>
</author>
<author>
<name sortKey="Lovelock, Ce" uniqKey="Lovelock C">CE Lovelock</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Lorenz, Mw" uniqKey="Lorenz M">MW Lorenz</name>
</author>
<author>
<name sortKey="Markus, Hs" uniqKey="Markus H">HS Markus</name>
</author>
<author>
<name sortKey="Bots, Ml" uniqKey="Bots M">ML Bots</name>
</author>
<author>
<name sortKey="Rosvall, M" uniqKey="Rosvall M">M Rosvall</name>
</author>
<author>
<name sortKey="Sitzer, M" uniqKey="Sitzer M">M Sitzer</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Nagai, K" uniqKey="Nagai K">K Nagai</name>
</author>
<author>
<name sortKey="Shibata, S" uniqKey="Shibata S">S Shibata</name>
</author>
<author>
<name sortKey="Akishita, M" uniqKey="Akishita M">M Akishita</name>
</author>
<author>
<name sortKey="Sudoh, N" uniqKey="Sudoh N">N Sudoh</name>
</author>
<author>
<name sortKey="Obara, T" uniqKey="Obara T">T Obara</name>
</author>
<author>
<name sortKey="Toba, K" uniqKey="Toba K">K Toba</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Schillaci, G" uniqKey="Schillaci G">G Schillaci</name>
</author>
<author>
<name sortKey="Verdecchia, P" uniqKey="Verdecchia P">P Verdecchia</name>
</author>
<author>
<name sortKey="Porcellati, C" uniqKey="Porcellati C">C Porcellati</name>
</author>
<author>
<name sortKey="Cuccurullo, O" uniqKey="Cuccurullo O">O Cuccurullo</name>
</author>
<author>
<name sortKey="Cosco, C" uniqKey="Cosco C">C Cosco</name>
</author>
<author>
<name sortKey="Perticone, F" uniqKey="Perticone F">F Perticone</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="De Simone, G" uniqKey="De Simone G">G de Simone</name>
</author>
<author>
<name sortKey="Izzo, R" uniqKey="Izzo R">R Izzo</name>
</author>
<author>
<name sortKey="Chinali, M" uniqKey="Chinali M">M Chinali</name>
</author>
<author>
<name sortKey="De Marco, M" uniqKey="De Marco M">M De Marco</name>
</author>
<author>
<name sortKey="Casalnuovo, G" uniqKey="Casalnuovo G">G Casalnuovo</name>
</author>
<author>
<name sortKey="Rozza, F" uniqKey="Rozza F">F Rozza</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Sajadieh, A" uniqKey="Sajadieh A">A Sajadieh</name>
</author>
<author>
<name sortKey="Rasmussen, V" uniqKey="Rasmussen V">V Rasmussen</name>
</author>
<author>
<name sortKey="Hein, Ho" uniqKey="Hein H">HO Hein</name>
</author>
<author>
<name sortKey="Hansen, Jf" uniqKey="Hansen J">JF Hansen</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Dekker, Jm" uniqKey="Dekker J">JM Dekker</name>
</author>
<author>
<name sortKey="Crow, Rs" uniqKey="Crow R">RS Crow</name>
</author>
<author>
<name sortKey="Folsom, Ar" uniqKey="Folsom A">AR Folsom</name>
</author>
<author>
<name sortKey="Hannan, Pj" uniqKey="Hannan P">PJ Hannan</name>
</author>
<author>
<name sortKey="Liao, D" uniqKey="Liao D">D Liao</name>
</author>
<author>
<name sortKey="Swenne, Ca" uniqKey="Swenne C">CA Swenne</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Binici, Z" uniqKey="Binici Z">Z Binici</name>
</author>
<author>
<name sortKey="Mouridsen, Mr" uniqKey="Mouridsen M">MR Mouridsen</name>
</author>
<author>
<name sortKey="K Ber, L" uniqKey="K Ber L">L Køber</name>
</author>
<author>
<name sortKey="Sajadieh, A" uniqKey="Sajadieh A">A Sajadieh</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Melillo, P" uniqKey="Melillo P">P Melillo</name>
</author>
<author>
<name sortKey="Fusco, R" uniqKey="Fusco R">R Fusco</name>
</author>
<author>
<name sortKey="Sansone, M" uniqKey="Sansone M">M Sansone</name>
</author>
<author>
<name sortKey="Bracale, M" uniqKey="Bracale M">M Bracale</name>
</author>
<author>
<name sortKey="Pecchia, L" uniqKey="Pecchia L">L Pecchia</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Pecchia, L" uniqKey="Pecchia L">L Pecchia</name>
</author>
<author>
<name sortKey="Melillo, P" uniqKey="Melillo P">P Melillo</name>
</author>
<author>
<name sortKey="Bracale, M" uniqKey="Bracale M">M Bracale</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Pecchia, L" uniqKey="Pecchia L">L Pecchia</name>
</author>
<author>
<name sortKey="Melillo, P" uniqKey="Melillo P">P Melillo</name>
</author>
<author>
<name sortKey="Sansone, M" uniqKey="Sansone M">M Sansone</name>
</author>
<author>
<name sortKey="Bracale, M" uniqKey="Bracale M">M Bracale</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Melillo, P" uniqKey="Melillo P">P Melillo</name>
</author>
<author>
<name sortKey="De Luca, N" uniqKey="De Luca N">N De Luca</name>
</author>
<author>
<name sortKey="Bracale, M" uniqKey="Bracale M">M Bracale</name>
</author>
<author>
<name sortKey="Pecchia, L" uniqKey="Pecchia L">L Pecchia</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Isler, Y" uniqKey="Isler Y">Y Isler</name>
</author>
<author>
<name sortKey="Kuntalp, M" uniqKey="Kuntalp M">M Kuntalp</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Jovic, A" uniqKey="Jovic A">A Jovic</name>
</author>
<author>
<name sortKey="Bogunovic, N" uniqKey="Bogunovic N">N Bogunovic</name>
</author>
</analytic>
</biblStruct>
<biblStruct></biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Melillo, P" uniqKey="Melillo P">P Melillo</name>
</author>
<author>
<name sortKey="Bracale, M" uniqKey="Bracale M">M Bracale</name>
</author>
<author>
<name sortKey="Pecchia, L" uniqKey="Pecchia L">L Pecchia</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Ramirez Villegas, Jf" uniqKey="Ramirez Villegas J">JF Ramirez-Villegas</name>
</author>
<author>
<name sortKey="Lam Espinosa, E" uniqKey="Lam Espinosa E">E Lam-Espinosa</name>
</author>
<author>
<name sortKey="Ramirez Moreno, Df" uniqKey="Ramirez Moreno D">DF Ramirez-Moreno</name>
</author>
<author>
<name sortKey="Calvo Echeverry, Pc" uniqKey="Calvo Echeverry P">PC Calvo-Echeverry</name>
</author>
<author>
<name sortKey="Agredo Rodriguez, W" uniqKey="Agredo Rodriguez W">W Agredo-Rodriguez</name>
</author>
</analytic>
</biblStruct>
<biblStruct></biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Song, T" uniqKey="Song T">T Song</name>
</author>
<author>
<name sortKey="Qu, Xf" uniqKey="Qu X">XF Qu</name>
</author>
<author>
<name sortKey="Zhang, Yt" uniqKey="Zhang Y">YT Zhang</name>
</author>
<author>
<name sortKey="Cao, W" uniqKey="Cao W">W Cao</name>
</author>
<author>
<name sortKey="Han, Bh" uniqKey="Han B">BH Han</name>
</author>
<author>
<name sortKey="Li, Y" uniqKey="Li Y">Y Li</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Ebrahimzadeh, E" uniqKey="Ebrahimzadeh E">E Ebrahimzadeh</name>
</author>
<author>
<name sortKey="Pooyan, M" uniqKey="Pooyan M">M Pooyan</name>
</author>
<author>
<name sortKey="Bijar, A" uniqKey="Bijar A">A Bijar</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="De Luca, N" uniqKey="De Luca N">N De Luca</name>
</author>
<author>
<name sortKey="Izzo, R" uniqKey="Izzo R">R Izzo</name>
</author>
<author>
<name sortKey="Iaccarino, G" uniqKey="Iaccarino G">G Iaccarino</name>
</author>
<author>
<name sortKey="Malini, Pl" uniqKey="Malini P">PL Malini</name>
</author>
<author>
<name sortKey="Morisco, C" uniqKey="Morisco C">C Morisco</name>
</author>
<author>
<name sortKey="Rozza, F" uniqKey="Rozza F">F Rozza</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Izzo, R" uniqKey="Izzo R">R Izzo</name>
</author>
<author>
<name sortKey="De Simone, G" uniqKey="De Simone G">G de Simone</name>
</author>
<author>
<name sortKey="Trimarco, V" uniqKey="Trimarco V">V Trimarco</name>
</author>
<author>
<name sortKey="Gerdts, E" uniqKey="Gerdts E">E Gerdts</name>
</author>
<author>
<name sortKey="Giudice, R" uniqKey="Giudice R">R Giudice</name>
</author>
<author>
<name sortKey="Vaccaro, O" uniqKey="Vaccaro O">O Vaccaro</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Devereux, Rb" uniqKey="Devereux R">RB Devereux</name>
</author>
<author>
<name sortKey="Alonso, Dr" uniqKey="Alonso D">DR Alonso</name>
</author>
<author>
<name sortKey="Lutas, Em" uniqKey="Lutas E">EM Lutas</name>
</author>
<author>
<name sortKey="Gottlieb, Gj" uniqKey="Gottlieb G">GJ Gottlieb</name>
</author>
<author>
<name sortKey="Campo, E" uniqKey="Campo E">E Campo</name>
</author>
<author>
<name sortKey="Sachs, I" uniqKey="Sachs I">I Sachs</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Lang, Rm" uniqKey="Lang R">RM Lang</name>
</author>
<author>
<name sortKey="Bierig, M" uniqKey="Bierig M">M Bierig</name>
</author>
<author>
<name sortKey="Devereux, Rb" uniqKey="Devereux R">RB Devereux</name>
</author>
<author>
<name sortKey="Flachskampf, Fa" uniqKey="Flachskampf F">FA Flachskampf</name>
</author>
<author>
<name sortKey="Foster, E" uniqKey="Foster E">E Foster</name>
</author>
<author>
<name sortKey="Pellikka, Pa" uniqKey="Pellikka P">PA Pellikka</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Melillo, P" uniqKey="Melillo P">P Melillo</name>
</author>
<author>
<name sortKey="Izzo, R" uniqKey="Izzo R">R Izzo</name>
</author>
<author>
<name sortKey="Luca, N" uniqKey="Luca N">N Luca</name>
</author>
<author>
<name sortKey="Pecchia, L" uniqKey="Pecchia L">L Pecchia</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Goldberger, Al" uniqKey="Goldberger A">AL Goldberger</name>
</author>
<author>
<name sortKey="Amaral, Lan" uniqKey="Amaral L">LAN Amaral</name>
</author>
<author>
<name sortKey="Glass, L" uniqKey="Glass L">L Glass</name>
</author>
<author>
<name sortKey="Hausdorff, Jm" uniqKey="Hausdorff J">JM Hausdorff</name>
</author>
<author>
<name sortKey="Ivanov, Pc" uniqKey="Ivanov P">PC Ivanov</name>
</author>
<author>
<name sortKey="Mark, Rg" uniqKey="Mark R">RG Mark</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Zong, W" uniqKey="Zong W">W Zong</name>
</author>
<author>
<name sortKey="Moody, G" uniqKey="Moody G">G Moody</name>
</author>
<author>
<name sortKey="Jiang, D" uniqKey="Jiang D">D Jiang</name>
</author>
</analytic>
</biblStruct>
<biblStruct></biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Malik, M" uniqKey="Malik M">M Malik</name>
</author>
<author>
<name sortKey="Bigger, Jt" uniqKey="Bigger J">JT Bigger</name>
</author>
<author>
<name sortKey="Camm, Aj" uniqKey="Camm A">AJ Camm</name>
</author>
<author>
<name sortKey="Kleiger, Re" uniqKey="Kleiger R">RE Kleiger</name>
</author>
<author>
<name sortKey="Malliani, A" uniqKey="Malliani A">A Malliani</name>
</author>
<author>
<name sortKey="Moss, Aj" uniqKey="Moss A">AJ Moss</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Clifford, Gd" uniqKey="Clifford G">GD Clifford</name>
</author>
<author>
<name sortKey="Tarassenko, L" uniqKey="Tarassenko L">L Tarassenko</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Brennan, M" uniqKey="Brennan M">M Brennan</name>
</author>
<author>
<name sortKey="Palaniswami, M" uniqKey="Palaniswami M">M Palaniswami</name>
</author>
<author>
<name sortKey="Kamen, P" uniqKey="Kamen P">P Kamen</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Richman, Js" uniqKey="Richman J">JS Richman</name>
</author>
<author>
<name sortKey="Moorman, Jr" uniqKey="Moorman J">JR Moorman</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Lake, De" uniqKey="Lake D">DE Lake</name>
</author>
<author>
<name sortKey="Richman, Js" uniqKey="Richman J">JS Richman</name>
</author>
<author>
<name sortKey="Griffin, Mp" uniqKey="Griffin M">MP Griffin</name>
</author>
<author>
<name sortKey="Moorman, Jr" uniqKey="Moorman J">JR Moorman</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Carvajal, R" uniqKey="Carvajal R">R Carvajal</name>
</author>
<author>
<name sortKey="Wessel, N" uniqKey="Wessel N">N Wessel</name>
</author>
<author>
<name sortKey="Vallverdu, M" uniqKey="Vallverdu M">M Vallverdú</name>
</author>
<author>
<name sortKey="Caminal, P" uniqKey="Caminal P">P Caminal</name>
</author>
<author>
<name sortKey="Voss, A" uniqKey="Voss A">A Voss</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Penzel, T" uniqKey="Penzel T">T Penzel</name>
</author>
<author>
<name sortKey="Kantelhardt, Jw" uniqKey="Kantelhardt J">JW Kantelhardt</name>
</author>
<author>
<name sortKey="Grote, L" uniqKey="Grote L">L Grote</name>
</author>
<author>
<name sortKey="Peter, Jh" uniqKey="Peter J">JH Peter</name>
</author>
<author>
<name sortKey="Bunde, A" uniqKey="Bunde A">A Bunde</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Peng, Ck" uniqKey="Peng C">CK Peng</name>
</author>
<author>
<name sortKey="Havlin, S" uniqKey="Havlin S">S Havlin</name>
</author>
<author>
<name sortKey="Stanley, He" uniqKey="Stanley H">HE Stanley</name>
</author>
<author>
<name sortKey="Goldberger, Al" uniqKey="Goldberger A">AL Goldberger</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Trulla, Ll" uniqKey="Trulla L">LL Trulla</name>
</author>
<author>
<name sortKey="Giuliani, A" uniqKey="Giuliani A">A Giuliani</name>
</author>
<author>
<name sortKey="Zbilut, Jp" uniqKey="Zbilut J">JP Zbilut</name>
</author>
<author>
<name sortKey="Webber, Cl" uniqKey="Webber C">CL Webber</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Webber, Cl" uniqKey="Webber C">CL Webber</name>
</author>
<author>
<name sortKey="Zbilut, Jp" uniqKey="Zbilut J">JP Zbilut</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Zbilut, Jp" uniqKey="Zbilut J">JP Zbilut</name>
</author>
<author>
<name sortKey="Thomasson, N" uniqKey="Thomasson N">N Thomasson</name>
</author>
<author>
<name sortKey="Webber, Cl" uniqKey="Webber C">CL Webber</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Melillo, P" uniqKey="Melillo P">P Melillo</name>
</author>
<author>
<name sortKey="Pecchia, L" uniqKey="Pecchia L">L Pecchia</name>
</author>
<author>
<name sortKey="Ursino, M" uniqKey="Ursino M">M Ursino</name>
</author>
</analytic>
</biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Breiman, L" uniqKey="Breiman L">L Breiman</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Sajadieh, A" uniqKey="Sajadieh A">A Sajadieh</name>
</author>
<author>
<name sortKey="Nielsen, Ow" uniqKey="Nielsen O">OW Nielsen</name>
</author>
<author>
<name sortKey="Rasmussen, V" uniqKey="Rasmussen V">V Rasmussen</name>
</author>
<author>
<name sortKey="Hein, Ho" uniqKey="Hein H">HO Hein</name>
</author>
<author>
<name sortKey="Abedini, S" uniqKey="Abedini S">S Abedini</name>
</author>
<author>
<name sortKey="Hansen, Jf" uniqKey="Hansen J">JF Hansen</name>
</author>
</analytic>
</biblStruct>
<biblStruct></biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Saeys, Y" uniqKey="Saeys Y">Y Saeys</name>
</author>
<author>
<name sortKey="Abeel, T" uniqKey="Abeel T">T Abeel</name>
</author>
<author>
<name sortKey="Van De Peer, Y" uniqKey="Van De Peer Y">Y Van de Peer</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Maldonado, S" uniqKey="Maldonado S">S Maldonado</name>
</author>
<author>
<name sortKey="Weber, R" uniqKey="Weber R">R Weber</name>
</author>
<author>
<name sortKey="Basak, J" uniqKey="Basak J">J Basak</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Melillo, P" uniqKey="Melillo P">P Melillo</name>
</author>
<author>
<name sortKey="Scala, P" uniqKey="Scala P">P Scala</name>
</author>
<author>
<name sortKey="Crispino, F" uniqKey="Crispino F">F Crispino</name>
</author>
<author>
<name sortKey="Pecchia, L" uniqKey="Pecchia L">L Pecchia</name>
</author>
</analytic>
</biblStruct>
</listBibl>
</div1>
</back>
</TEI>
<pmc article-type="research-article">
<pmc-dir>properties open_access</pmc-dir>
<front>
<journal-meta>
<journal-id journal-id-type="nlm-ta">PLoS One</journal-id>
<journal-id journal-id-type="iso-abbrev">PLoS ONE</journal-id>
<journal-id journal-id-type="publisher-id">plos</journal-id>
<journal-id journal-id-type="pmc">plosone</journal-id>
<journal-title-group>
<journal-title>PLoS ONE</journal-title>
</journal-title-group>
<issn pub-type="epub">1932-6203</issn>
<publisher>
<publisher-name>Public Library of Science</publisher-name>
<publisher-loc>San Francisco, CA USA</publisher-loc>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="pmid">25793605</article-id>
<article-id pub-id-type="pmc">4368686</article-id>
<article-id pub-id-type="doi">10.1371/journal.pone.0118504</article-id>
<article-id pub-id-type="publisher-id">PONE-D-14-34158</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Research Article</subject>
</subj-group>
</article-categories>
<title-group>
<article-title>Automatic Prediction of Cardiovascular and Cerebrovascular Events Using Heart Rate Variability Analysis</article-title>
<alt-title alt-title-type="running-head">Automatic Prediction of Vascular Events by HRV</alt-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name>
<surname>Melillo</surname>
<given-names>Paolo</given-names>
</name>
<xref ref-type="aff" rid="aff001">
<sup>1</sup>
</xref>
<xref ref-type="aff" rid="aff002">
<sup>2</sup>
</xref>
<xref rid="cor001" ref-type="corresp">*</xref>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Izzo</surname>
<given-names>Raffaele</given-names>
</name>
<xref ref-type="aff" rid="aff003">
<sup>3</sup>
</xref>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Orrico</surname>
<given-names>Ada</given-names>
</name>
<xref ref-type="aff" rid="aff001">
<sup>1</sup>
</xref>
<xref ref-type="aff" rid="aff002">
<sup>2</sup>
</xref>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Scala</surname>
<given-names>Paolo</given-names>
</name>
<xref ref-type="aff" rid="aff002">
<sup>2</sup>
</xref>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Attanasio</surname>
<given-names>Marcella</given-names>
</name>
<xref ref-type="aff" rid="aff001">
<sup>1</sup>
</xref>
<xref ref-type="aff" rid="aff002">
<sup>2</sup>
</xref>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Mirra</surname>
<given-names>Marco</given-names>
</name>
<xref ref-type="aff" rid="aff003">
<sup>3</sup>
</xref>
</contrib>
<contrib contrib-type="author">
<name>
<surname>De Luca</surname>
<given-names>Nicola</given-names>
</name>
<xref ref-type="aff" rid="aff003">
<sup>3</sup>
</xref>
<xref rid="cor001" ref-type="corresp">*</xref>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Pecchia</surname>
<given-names>Leandro</given-names>
</name>
<xref ref-type="aff" rid="aff004">
<sup>4</sup>
</xref>
</contrib>
</contrib-group>
<aff id="aff001">
<label>1</label>
<addr-line>Multidisciplinary Department of Medical, Surgical and Dental Sciences, Second University of Naples, Naples, Italy</addr-line>
</aff>
<aff id="aff002">
<label>2</label>
<addr-line>SHARE Project, Italian Ministry of Education, Scientific Research and University, Rome, Italy</addr-line>
</aff>
<aff id="aff003">
<label>3</label>
<addr-line>Department of Translational Medical Sciences, University of Naples Federico II, Naples, Italy</addr-line>
</aff>
<aff id="aff004">
<label>4</label>
<addr-line>School of Engineering, University of Warwick, Coventry, United Kingdom</addr-line>
</aff>
<contrib-group>
<contrib contrib-type="editor">
<name>
<surname>Frasch</surname>
<given-names>Martin Gerbert</given-names>
</name>
<role>Academic Editor</role>
<xref ref-type="aff" rid="edit1"></xref>
</contrib>
</contrib-group>
<aff id="edit1">
<addr-line>Université de Montréal, CANADA</addr-line>
</aff>
<author-notes>
<fn fn-type="conflict" id="coi001">
<p>
<bold>Competing Interests: </bold>
The authors have declared that no competing interests exist.</p>
</fn>
<fn fn-type="con" id="contrib001">
<p>Conceived and designed the experiments: PM AO LP. Performed the experiments: RI MM NDL. Analyzed the data: PM AO LP. Contributed reagents/materials/analysis tools: PS. Wrote the paper: PM AO PS LP. Obtained funding: PM AO MA.</p>
</fn>
<corresp id="cor001">* E-mail:
<email>paolomelillo85@gmail.com</email>
(PM);
<email>nideluca@unina.it</email>
(NDL)</corresp>
</author-notes>
<pub-date pub-type="epub">
<day>20</day>
<month>3</month>
<year>2015</year>
</pub-date>
<pub-date pub-type="collection">
<year>2015</year>
</pub-date>
<volume>10</volume>
<issue>3</issue>
<elocation-id>e0118504</elocation-id>
<history>
<date date-type="received">
<day>30</day>
<month>7</month>
<year>2014</year>
</date>
<date date-type="accepted">
<day>27</day>
<month>12</month>
<year>2014</year>
</date>
</history>
<permissions>
<copyright-year>2015</copyright-year>
<copyright-holder>Melillo et al</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/">
<license-p>This is an open access article distributed under the terms of the
<ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/licenses/by/4.0/">Creative Commons Attribution License</ext-link>
, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited</license-p>
</license>
</permissions>
<self-uri content-type="pdf" xlink:type="simple" xlink:href="pone.0118504.pdf"></self-uri>
<abstract>
<sec id="sec001">
<title>Background</title>
<p>There is consensus that Heart Rate Variability is associated with the risk of vascular events. However, Heart Rate Variability predictive value for vascular events is not completely clear. The aim of this study is to develop novel predictive models based on data-mining algorithms to provide an automatic risk stratification tool for hypertensive patients.</p>
</sec>
<sec id="sec002">
<title>Methods</title>
<p>A database of 139 Holter recordings with clinical data of hypertensive patients followed up for at least 12 months were collected ad hoc. Subjects who experienced a vascular event (i.e., myocardial infarction, stroke, syncopal event) were considered as high-risk subjects. Several data-mining algorithms (such as support vector machine, tree-based classifier, artificial neural network) were used to develop automatic classifiers and their accuracy was tested by assessing the receiver-operator characteristics curve. Moreover, we tested the echographic parameters, which have been showed as powerful predictors of future vascular events.</p>
</sec>
<sec id="sec003">
<title>Results</title>
<p>The best predictive model was based on random forest and enabled to identify high-risk hypertensive patients with sensitivity and specificity rates of 71.4% and 87.8%, respectively. The Heart Rate Variability based classifier showed higher predictive values than the conventional echographic parameters, which are considered as significant cardiovascular risk factors.</p>
</sec>
<sec id="sec004">
<title>Conclusions</title>
<p>Combination of Heart Rate Variability measures, analyzed with data-mining algorithm, could be a reliable tool for identifying hypertensive patients at high risk to develop future vascular events.</p>
</sec>
</abstract>
<funding-group>
<funding-statement>The current study was supported by “the 2007-2013 NOP for Research and Competitiveness for the Convergence Regions (Calabria, Campania, Puglia and Sicilia)” with code PON04a3_00139—Project Smart Health and Artificial Intelligence for Risk Estimation. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.</funding-statement>
</funding-group>
<counts>
<fig-count count="3"></fig-count>
<table-count count="4"></table-count>
<page-count count="14"></page-count>
</counts>
<custom-meta-group>
<custom-meta id="data-availability">
<meta-name>Data Availability</meta-name>
<meta-value>Data are available at
<ext-link ext-link-type="uri" xlink:href="https://physionet.org/works/ElectrocardiogramDatabaseforVascularEventsPre/">https://physionet.org/works/ElectrocardiogramDatabaseforVascularEventsPre/</ext-link>
.</meta-value>
</custom-meta>
</custom-meta-group>
</article-meta>
<notes>
<title>Data Availability</title>
<p>Data are available at
<ext-link ext-link-type="uri" xlink:href="https://physionet.org/works/ElectrocardiogramDatabaseforVascularEventsPre/">https://physionet.org/works/ElectrocardiogramDatabaseforVascularEventsPre/</ext-link>
.</p>
</notes>
</front>
<body>
<sec sec-type="intro" id="sec005">
<title>Introduction</title>
<p>Cardiovascular and cerebrovascular events (i.e., myocardial infarction, stroke) are the leading cause of premature death and disability in the developed countries[
<xref rid="pone.0118504.ref001" ref-type="bibr">1</xref>
<xref rid="pone.0118504.ref003" ref-type="bibr">3</xref>
]. Therefore, there has been great interest in the development of computational tools for prognosis and diagnosis of cardiac disease and, in particular, vascular events. The aim of these tools is to support cardiologists on prognostic and diagnostic tasks, reducing both the number of missed diagnoses or prognoses and reduce the time taken to reach such decisions. In literature, different risk factors for vascular events have been identified and are currently used for prognostics purposes, particularly, arterial intima media thickness (IMT), assessed by carotid ultrasound, and left ventricular mass, evaluated by echocardiography, have been proven as powerful predictor of future vascular events [
<xref rid="pone.0118504.ref004" ref-type="bibr">4</xref>
<xref rid="pone.0118504.ref007" ref-type="bibr">7</xref>
]. However, their positive predictive value should be constantly improved to comply with the higher possible quality level required for the clinical practice.</p>
<p>Heart rate variability (HRV) is a standard method for studying the control mechanisms of autonomic nervous system (ANS) on heart function and several studies showed that statistical, geometrical, spectral and nonlinear analysis of HRV are powerful tools for the evaluation of cardiovascular health and that HRV could be an independent risk factor for vascular events[
<xref rid="pone.0118504.ref008" ref-type="bibr">8</xref>
<xref rid="pone.0118504.ref010" ref-type="bibr">10</xref>
]. Sajadieh et al. showed that subjects with familial predisposition to premature heart attack and sudden death have reduced HRV[
<xref rid="pone.0118504.ref008" ref-type="bibr">8</xref>
]. Dekker et al. concluded that low HRV is associated with increased risk of coronary heart disease and death from several causes[
<xref rid="pone.0118504.ref009" ref-type="bibr">9</xref>
]. Binici et al. demonstrated that depressed nocturnal heart rate variability is a strong marker for the development of stroke in apparently healthy subject[
<xref rid="pone.0118504.ref010" ref-type="bibr">10</xref>
]. These previous studies focused on the most common linear HRV measures, suggesting that HRV could be useful for adoption in clinical practice.</p>
<p>Since HRV can be expressed using several measures, some recent studies proposed automatic classification and feature selection algorithms for diagnosis of cardiovascular diseases[
<xref rid="pone.0118504.ref011" ref-type="bibr">11</xref>
<xref rid="pone.0118504.ref016" ref-type="bibr">16</xref>
] or stressful conditions[
<xref rid="pone.0118504.ref017" ref-type="bibr">17</xref>
,
<xref rid="pone.0118504.ref018" ref-type="bibr">18</xref>
]. The performance of these classifiers in prognostic or diagnostic tasks is relatively high (80% to 95% sensitivity in the best cases); however, they have been used for the recognition of several patterns in specific cardiac diseases (e.g., Congestive Heart Failure, paroxysmal atrial fibrillation, myocardial infarction, cardiac arrhythmias, amongst others) rather than for the prognosis of cardiovascular risk. Few studies focussed on automatic cardiovascular risk assessment based on HRV. Ramirez-Villegas et al. adopted HRV and pattern recognition techniques to discriminate between healthy control subjects and cardiovascular risk patients[
<xref rid="pone.0118504.ref019" ref-type="bibr">19</xref>
]. Singh and Guttag proposed classification tree-based risk stratification models to predict 90 day mortality in patients who suffered from a non-ST elevation acute coronary syndrome[
<xref rid="pone.0118504.ref020" ref-type="bibr">20</xref>
]. Recently, Song et al. developed Support Vector Machine (SVM) models to quantify the risk of cardiac death in patients after acute myocardial infarction[
<xref rid="pone.0118504.ref021" ref-type="bibr">21</xref>
], while Ebrahimzadeh et al. proposed a novel approach to distinguish between patients prone to Sudden Cardiac Death and normal people[
<xref rid="pone.0118504.ref022" ref-type="bibr">22</xref>
].</p>
<p>In the present study, linear and nonlinear HRV analysis methods and pattern recognition schemes were used to discriminate between cardiovascular high risk and low risk hypertensive patients. The risk of developing a vascular event was assessed over a one-year follow-up after electrocardiographic recordings. The developed classifier achieved high sensitivity and specificity rates in automatically identifying patients developing vascular events one year within electrocardiographic recording.</p>
</sec>
<sec sec-type="materials|methods" id="sec006">
<title>Materials and Methods</title>
<sec id="sec007">
<title>Dataset</title>
<p>The current study was performed on a database containing nominal 24-h electrocardiographic (ECG) holter recordings of 139 hypertensive patients aged 55 and over (including 49 female and 90 male, age 72 ± 7 years), recruited between 1 January 2012 to 10 November 2013 at the Centre of Hypertension of the University Hospital Federico II. The ECG Holter was performed after a one-month antihypertensive therapy wash-out. The patients were followed up for 12 months after the recordings in order to record major cardiovascular and cerebrovascular events, i.e. fatal or non-fatal acute coronary syndrome including myocardial infarctions, syncopal events, coronary revascularization, fatal or non-fatal stroke and transient ischemic attack. All the events were adjudicated by the Committee for Event Adjudication in the Hypertension Center. Adjudication was based on patient history, contact with the reference general practitioner and clinical records documenting the occurrence of the event/arrhythmia[
<xref rid="pone.0118504.ref023" ref-type="bibr">23</xref>
,
<xref rid="pone.0118504.ref024" ref-type="bibr">24</xref>
]. Among the study sample, in the 12-month follow-up after recordings, 17 patients experienced a recorded event (11 myocardial infarctions, 3 strokes, 3 syncopal events) and for that reason, were considered as high-risk subjects, while the remaining ones as low-risk subjects. Moreover, the patients were evaluated by a cardiac and carotid ultrasonography. Left ventricular mass was determined by using the formula developed by Devereux[
<xref rid="pone.0118504.ref025" ref-type="bibr">25</xref>
] as recommended by American Society of Echocardiography (ASE)[
<xref rid="pone.0118504.ref026" ref-type="bibr">26</xref>
] and divided by the body surface area to calculate left ventricular mass index (LVMi, g/m
<sup>2</sup>
). B-mode ultrasonography of carotid arteries was performed in order to compute the maximum IMT (mm). Further details about the ECG recording, the cardioecographic and carotid ultrasonographic procedures can be found in a previous report[
<xref rid="pone.0118504.ref027" ref-type="bibr">27</xref>
]. The current study was approved by the Ethics Committee of Federico II University Hospital Trust and the data were collected by the Department of Translational Medical science of the University of Naples Federico II in the framework of the Smart Health and Artificial intelligence for Risk Estimation (SHARE) project. All the participants signed informed consent for the use of data for scientific purposes. The whole dataset could be downloaded as "Smart Health for Assessing the Risk of Events via ECG database" from the physionet.org website[
<xref rid="pone.0118504.ref028" ref-type="bibr">28</xref>
].</p>
</sec>
<sec id="sec008">
<title>HRV processing</title>
<p>The series of beat intervals (RR) were obtained from ECG recordings using an open-source software for QRS detection[
<xref rid="pone.0118504.ref029" ref-type="bibr">29</xref>
]. A stationary segment of 5 minutes recorded during daytime was randomly selected for each subject[
<xref rid="pone.0118504.ref015" ref-type="bibr">15</xref>
]. Stationarity was assessed by a stationarity test based on time-frequency features of the surrogates[
<xref rid="pone.0118504.ref030" ref-type="bibr">30</xref>
].</p>
<p>Standard linear HRV analysis according to International Guidelines was performed[
<xref rid="pone.0118504.ref031" ref-type="bibr">31</xref>
]. A number of standard time-domain HRV measures were calculated: Average of all RR intervals (AVNN), standard deviation of all RR intervals (SDNN), square root of the mean of the sum of the squares of differences between adjacent NN intervals (RMSSD), number and percentage of differences between adjacent RR intervals that are longer than 50 ms (NN50 and pNN50, respectively), HRV triangular index (HRVTi), i.e. the proportion of all accepted RR intervals to their modal measurement at a discrete scale of 1/128s bins, triangular interpolation of RR interval histogram (TI), i.e. the baseline width of the distribution measured as a base of a triangle, approximating the RR interval distribution by using the minimum square difference.</p>
<p>The frequency-domain HRV measures relied on the estimation of power spectral density (PSD) computed, in this work, with the Lomb-Scamble periodogram[
<xref rid="pone.0118504.ref032" ref-type="bibr">32</xref>
]. The generalized frequency bands in case of short-term HRV recordings are the very low frequency (VLF, 0–0.04 Hz), low frequency (LF, 0.04–0.15 Hz), and high frequency (HF, 0.15–0.4 Hz). The frequency-domain measures extracted from the PSD estimated for each frequency band included absolute and relative powers of VLF, LF, and HF bands, LF and HF band powers in normalized units, the LF/HF power ratio, and peak frequencies for each band. The relative powers and the peak frequencies were indicated with the suffices % and peak, respectively, for example LF
<sub>%</sub>
and LF
<sub>peak</sub>
indicated the LF power normalized to the Total Power (TP) and the peak frequency of LF, respectively.</p>
<p>Moreover, nonlinear properties of HRV were analysed by the following methods: Poincaré Plot (features SD
<sub>1</sub>
and SD
<sub>2</sub>
)[
<xref rid="pone.0118504.ref011" ref-type="bibr">11</xref>
,
<xref rid="pone.0118504.ref033" ref-type="bibr">33</xref>
], Approximate Entropy (AppEn)[
<xref rid="pone.0118504.ref034" ref-type="bibr">34</xref>
], Sample Entropy (SampEn)[
<xref rid="pone.0118504.ref035" ref-type="bibr">35</xref>
], Correlation Dimension (CD)[
<xref rid="pone.0118504.ref036" ref-type="bibr">36</xref>
], Detrended Fluctuation Analysis (features: Alpha
<sub>1</sub>
and Alpha
<sub>2</sub>
)[
<xref rid="pone.0118504.ref037" ref-type="bibr">37</xref>
,
<xref rid="pone.0118504.ref038" ref-type="bibr">38</xref>
], and Recurrence Plot [
<xref rid="pone.0118504.ref039" ref-type="bibr">39</xref>
<xref rid="pone.0118504.ref041" ref-type="bibr">41</xref>
]. Details about the non-linear measurements were reported in
<xref rid="pone.0118504.s001" ref-type="supplementary-material">S1 Appendix</xref>
. Further details about the methods could be found elsewhere[
<xref rid="pone.0118504.ref018" ref-type="bibr">18</xref>
,
<xref rid="pone.0118504.ref042" ref-type="bibr">42</xref>
]. The HRV analysis was performed using an
<italic>ad hoc</italic>
developed HRV software based on MATLAB implementation[
<xref rid="pone.0118504.ref043" ref-type="bibr">43</xref>
].</p>
</sec>
<sec id="sec009">
<title>Statistical analysis, feature selection and data-mining methods</title>
<p>All values of continuous and categorical variables were presented as mean ± standard deviation and as count and percentage, respectively. Unpaired t-tests were adopted to compare continuous clinical variable, while chi-square tests were used to compare categorical variables between those who experienced a vascular event and those who did not.</p>
<p>In order to assess the generation ability of the models, we adopted the hold-out approach, i.e. the whole dataset was split into two subsets: training set (60% of instances) and test set (the remaining 40% of instances). The training set was used for feature selection and choice of the optimal parameters. The test set was adopted to evaluate the performance of the developed classifiers (with the features and parameters chosen on training set): ROC curves were constructed to compare the predictive value of each method for predicting vascular events and accuracy, sensitivity, specificity were computed according to standard formulae.</p>
<p>Since the number of HRV measures was high compared to the instances and some of them were strongly correlated, we adopted a chi-squared statistics[
<xref rid="pone.0118504.ref044" ref-type="bibr">44</xref>
] and a correlation-based [
<xref rid="pone.0118504.ref045" ref-type="bibr">45</xref>
] feature selection methods to filter out irrelevant and redundant features. The first method ranked the features by computing the value of the chi-squared statistic of each feature with respect to the classification problem. The second method scores the worth of subsets of features by taking into account the usefulness of individual features for predicting the class along with the level of intercorrelation among them with the belief that good feature subsets include features highly correlated with the class, yet uncorrelated with each other. Moreover, we computed the feature importance measures based on Random Forests (RF)[
<xref rid="pone.0118504.ref046" ref-type="bibr">46</xref>
].</p>
<p>Several data-mining approach were used to develop classifier for vascular event prediction based on HRV features, including Naïve Bayes classifier(NB), decision trees using the C4.5 decision tree induction algorithm, RF, boosting meta-learning approach i.e. AdaboostM1 (AB), SVM and artificial neural networks using a Multilayer Perceptron (MLP). More details about the algorithms and the optimal parameter choice could be found in
<xref rid="pone.0118504.s002" ref-type="supplementary-material">S2 Appendix</xref>
.</p>
</sec>
</sec>
<sec sec-type="results" id="sec010">
<title>Results</title>
<p>The clinical characteristics of the study sample of patients were reported in
<xref rid="pone.0118504.t001" ref-type="table">Table 1</xref>
. No statistical differences were detected between the two groups of patients.</p>
<table-wrap id="pone.0118504.t001" orientation="portrait" position="float">
<object-id pub-id-type="doi">10.1371/journal.pone.0118504.t001</object-id>
<label>Table 1</label>
<caption>
<title>Patient baseline characteristics.</title>
</caption>
<alternatives>
<graphic id="pone.0118504.t001g" xlink:href="pone.0118504.t001"></graphic>
<table frame="hsides" rules="groups">
<colgroup span="1">
<col align="left" valign="middle" span="1"></col>
<col align="left" valign="middle" span="1"></col>
<col align="left" valign="middle" span="1"></col>
<col align="left" valign="middle" span="1"></col>
</colgroup>
<thead>
<tr>
<th align="left" rowspan="1" colspan="1">Clinical Features</th>
<th align="left" rowspan="1" colspan="1">Low-risk subjects</th>
<th align="left" rowspan="1" colspan="1">High-risk subjects</th>
<th align="left" rowspan="1" colspan="1">p-value</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" rowspan="1" colspan="1">Age (years)</td>
<td align="left" rowspan="1" colspan="1">71.4±7</td>
<td align="left" rowspan="1" colspan="1">74.1±6.5</td>
<td align="left" rowspan="1" colspan="1">0.136</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Sex (female)</td>
<td align="left" rowspan="1" colspan="1">41 (33.6%)</td>
<td align="left" rowspan="1" colspan="1">8 (47.1%)</td>
<td align="left" rowspan="1" colspan="1">0.277</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Family history of hypertension</td>
<td align="left" rowspan="1" colspan="1">41 (33.6%)</td>
<td align="left" rowspan="1" colspan="1">7 (41.2%)</td>
<td align="left" rowspan="1" colspan="1">0.622</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Family history of stroke</td>
<td align="left" rowspan="1" colspan="1">10 (8.2%)</td>
<td align="left" rowspan="1" colspan="1">3 (17.6%)</td>
<td align="left" rowspan="1" colspan="1">0.236</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Smoking</td>
<td align="left" rowspan="1" colspan="1">35 (28.7%)</td>
<td align="left" rowspan="1" colspan="1">5 (29.4%)</td>
<td align="left" rowspan="1" colspan="1">0.983</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Diabetes</td>
<td align="left" rowspan="1" colspan="1">18 (14.8%)</td>
<td align="left" rowspan="1" colspan="1">3 (17.6%)</td>
<td align="left" rowspan="1" colspan="1">0.834</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Diastolic Blood Pressure (mmHg)</td>
<td align="left" rowspan="1" colspan="1">76.3±9.1</td>
<td align="left" rowspan="1" colspan="1">73.5±8.4</td>
<td align="left" rowspan="1" colspan="1">0.204</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Systolic Blood Pressure (mmHg)</td>
<td align="left" rowspan="1" colspan="1">136.6±19.5</td>
<td align="left" rowspan="1" colspan="1">141.7±23.5</td>
<td align="left" rowspan="1" colspan="1">0.326</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Total Cholesterol (mg/dl)</td>
<td align="left" rowspan="1" colspan="1">175.7±35.1</td>
<td align="left" rowspan="1" colspan="1">182.9±42.7</td>
<td align="left" rowspan="1" colspan="1">0.460</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Low Density Lipoprotein (mg/dl)</td>
<td align="left" rowspan="1" colspan="1">101±30.1</td>
<td align="left" rowspan="1" colspan="1">102±34.3</td>
<td align="left" rowspan="1" colspan="1">0.907</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">High Density Lipoprotein (mg/dl)</td>
<td align="left" rowspan="1" colspan="1">52.4±13.1</td>
<td align="left" rowspan="1" colspan="1">53.3±15.3</td>
<td align="left" rowspan="1" colspan="1">0.813</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Body Mass Index (kg/m
<sup>2</sup>
)</td>
<td align="left" rowspan="1" colspan="1">27.6±3.9</td>
<td align="left" rowspan="1" colspan="1">27.9±4.9</td>
<td align="left" rowspan="1" colspan="1">0.793</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Body Surface Area (m
<sup>2</sup>
)</td>
<td align="left" rowspan="1" colspan="1">1.9±0.2</td>
<td align="left" rowspan="1" colspan="1">1.9±0.2</td>
<td align="left" rowspan="1" colspan="1">0.442</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Alpha-blockers</td>
<td align="left" rowspan="1" colspan="1">17 (13.9%)</td>
<td align="left" rowspan="1" colspan="1">3 (17.6%)</td>
<td align="left" rowspan="1" colspan="1">0.782</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Beta-blockers</td>
<td align="left" rowspan="1" colspan="1">50 (41%)</td>
<td align="left" rowspan="1" colspan="1">6 (35.3%)</td>
<td align="left" rowspan="1" colspan="1">0.487</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">ACE inhibitor</td>
<td align="left" rowspan="1" colspan="1">37 (30.3%)</td>
<td align="left" rowspan="1" colspan="1">8 (47.1%)</td>
<td align="left" rowspan="1" colspan="1">0.247</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Dihydropyridine</td>
<td align="left" rowspan="1" colspan="1">27 (22.1%)</td>
<td align="left" rowspan="1" colspan="1">7 (41.2%)</td>
<td align="left" rowspan="1" colspan="1">0.131</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Intima Media Thickness (mm)</td>
<td align="left" rowspan="1" colspan="1">2.3±0.7</td>
<td align="left" rowspan="1" colspan="1">2.4±1.1</td>
<td align="left" rowspan="1" colspan="1">0.685</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Left Ventricular Mass index (g/m
<sup>2</sup>
)</td>
<td align="left" rowspan="1" colspan="1">130.1±26.1</td>
<td align="left" rowspan="1" colspan="1">140.2±25.1</td>
<td align="left" rowspan="1" colspan="1">0.135</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">Ejection Fraction (%)</td>
<td align="left" rowspan="1" colspan="1">59.3±10.9</td>
<td align="left" rowspan="1" colspan="1">57.8±13</td>
<td align="left" rowspan="1" colspan="1">0.591</td>
</tr>
</tbody>
</table>
</alternatives>
<table-wrap-foot>
<fn id="t001fn001">
<p>Data are expressed as mean and standard deviation for continuous variables (e.g. age) and as count and percentage of patients per each group for categorical variables (e.g. gender).</p>
</fn>
</table-wrap-foot>
</table-wrap>
<p>Among the 33 HRV features, the chi-squared statistics feature selection method identified as relevant the following features (reported in descending order of ranking): CD, SampEn, SD
<sub>2</sub>
, SDNN, LF, LF
<sub>peak</sub>
, HF, HRVTi, TP, LF
<sub>%</sub>
, while the correlation-based algorithm selected the subset of the following features: HRVTi, LF, HF, LF
<sub>%</sub>
, LF
<sub>peak</sub>
, SD
<sub>2</sub>
, SampEn, CD. Finally,
<xref rid="pone.0118504.g001" ref-type="fig">Fig. 1</xref>
showed the importance of each feature as computed by the RF algorithm. All the features identified by the feature selection methods were ranked among the ten most important features by RF, with the only exception of TP, which was ranked as 13
<sup>rd</sup>
.</p>
<fig id="pone.0118504.g001" orientation="portrait" position="float">
<object-id pub-id-type="doi">10.1371/journal.pone.0118504.g001</object-id>
<label>Fig 1</label>
<caption>
<title>Feature importance computed by using Random Forest algorithm.</title>
<p>CD: Correlation dimension. SampEn: Sample entropy. LF
<sub>peak</sub>
: peak frequency of LF band. SD
<sub>2</sub>
: long-term variability in Poincaré Plot. LF: absolute power in low frequency band (0.04–0.15 Hz). SDNN: standard deviation of all RR intervals. HF: absolute power in high frequency band (0.15–0.4 Hz). VLF
<sub>%</sub>
: relative power in very low frequency band (0–0.04 Hz). LF
<sub>%</sub>
: relative power in low frequency band (0.04–0.15 Hz). HRVTi: HRV triangular index. HF
<sub>%</sub>
: relative power in high frequency band (0.15–0.4 Hz). SD
<sub>1</sub>
: short-term variability in Poincaré Plot. TP: total power. DET: determinism. LF/HF: the ratio between LF and HF. VLF
<sub>peak</sub>
: peak frequency of VLF band. TINN: triangular interpolation of RR interval histogram. NN50: number of differences between adjacent RR intervals that are longer than 50 ms. REC: recurrence rate. L
<sub>mean</sub>
: mean length of lines in recurrence plot. AppEn: Approximate Entropy. HF
<sub>peak</sub>
: peak frequency of HF band. Alpha
<sub>1</sub>
: short-term fluctuations in Detrended Fluctuation Analysis. RMSSD: square root of the mean of the sum of the squares of differences between adjacent RR intervals. HF
<sub>nu</sub>
: power in high frequency band (0.15–0.4 Hz), expressed in normalized unit. LF
<sub>nu</sub>
: power in low frequency band (0.04–0.15 Hz), expressed in normalized unit. AVNN: Average of all RR intervals. ShanEn: Shannon Entropy. DIV: Divergence. VLF: absolute power in very low frequency band (0–0.04 Hz). Alpha
<sub>2</sub>
: long-term fluctuations in Detrended Fluctuation Analysis. L
<sub>max</sub>
: maximal length of lines in recurrence plot. pNN50: percentage of differences between adjacent RR intervals that are longer than 50 ms.</p>
</caption>
<graphic xlink:href="pone.0118504.g001"></graphic>
</fig>
<p>For each data-mining method, the optimal combination of parameters and the best subset of input features were selected by maximizing the accuracy estimated by 10-fold-crossvalidation as shown in
<xref rid="pone.0118504.t002" ref-type="table">Table 2</xref>
. C4.5 and AB achieved the highest performances with chi-squared feature selection algorithm, while MLP and NB with the the correlation-based algorithm. SVM and RF performed well with all the features.</p>
<table-wrap id="pone.0118504.t002" orientation="portrait" position="float">
<object-id pub-id-type="doi">10.1371/journal.pone.0118504.t002</object-id>
<label>Table 2</label>
<caption>
<title>Performance measurement (10-fold-crossvalidation estimation) of the proposed algorithms based on HRV features.</title>
</caption>
<alternatives>
<graphic id="pone.0118504.t002g" xlink:href="pone.0118504.t002"></graphic>
<table frame="hsides" rules="groups">
<colgroup span="1">
<col align="left" valign="middle" span="1"></col>
<col align="left" valign="middle" span="1"></col>
<col align="left" valign="middle" span="1"></col>
<col align="left" valign="middle" span="1"></col>
<col align="left" valign="middle" span="1"></col>
<col align="left" valign="middle" span="1"></col>
<col align="left" valign="middle" span="1"></col>
</colgroup>
<thead>
<tr>
<th align="left" rowspan="1" colspan="1">Classifier</th>
<th align="left" rowspan="1" colspan="1">Parameters</th>
<th align="left" rowspan="1" colspan="1">Feature selection (# features)</th>
<th align="left" rowspan="1" colspan="1">AUC</th>
<th align="left" rowspan="1" colspan="1">ACC</th>
<th align="left" rowspan="1" colspan="1">SEN</th>
<th align="left" rowspan="1" colspan="1">SPE</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" rowspan="1" colspan="1">AB</td>
<td align="left" rowspan="1" colspan="1">NI: 220; CF 0.5; MI: 20</td>
<td align="left" rowspan="1" colspan="1">None (33)</td>
<td align="left" rowspan="1" colspan="1">94.5%</td>
<td align="left" rowspan="1" colspan="1">91.8%</td>
<td align="left" rowspan="1" colspan="1">93.2%</td>
<td align="left" rowspan="1" colspan="1">90.4%</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">AB</td>
<td align="left" rowspan="1" colspan="1">NI: 20; CF: 0.3; MI: 10</td>
<td align="left" rowspan="1" colspan="1">CFS (8)</td>
<td align="left" rowspan="1" colspan="1">92.2%</td>
<td align="left" rowspan="1" colspan="1">85.6%</td>
<td align="left" rowspan="1" colspan="1">86.3%</td>
<td align="left" rowspan="1" colspan="1">84.9%</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>AB</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<bold>NI: 120; CF: 0.45; MI: 10</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<bold>Χ</bold>
<sup>
<bold>2</bold>
</sup>
-
<bold>FS(10)</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<bold>94.7%</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<bold>89.0%</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<bold>90.4%</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<bold>87.7%</bold>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">C4.5</td>
<td align="left" rowspan="1" colspan="1">CF: 0.3; MI: 5</td>
<td align="left" rowspan="1" colspan="1">None (33)</td>
<td align="left" rowspan="1" colspan="1">80.3%</td>
<td align="left" rowspan="1" colspan="1">76.7%</td>
<td align="left" rowspan="1" colspan="1">78.1%</td>
<td align="left" rowspan="1" colspan="1">75.3%</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">C4.5</td>
<td align="left" rowspan="1" colspan="1">CF: 0.3; MI: 5</td>
<td align="left" rowspan="1" colspan="1">CFS (8)</td>
<td align="left" rowspan="1" colspan="1">82.8%</td>
<td align="left" rowspan="1" colspan="1">80.8%</td>
<td align="left" rowspan="1" colspan="1">87.7%</td>
<td align="left" rowspan="1" colspan="1">74.0%</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>C4.5</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<bold>CF: 0.1; MI: 5</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<bold>Χ</bold>
<sup>
<bold>2</bold>
</sup>
-
<bold>FS (10)</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<bold>83.0%</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<bold>76.7%</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<bold>76.7%</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<bold>76.7%</bold>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">MLP</td>
<td align="left" rowspan="1" colspan="1">LR 0.3; M 0.6; NE 200</td>
<td align="left" rowspan="1" colspan="1">None (33)</td>
<td align="left" rowspan="1" colspan="1">86.7%</td>
<td align="left" rowspan="1" colspan="1">82.9%</td>
<td align="left" rowspan="1" colspan="1">80.8%</td>
<td align="left" rowspan="1" colspan="1">84.9%</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>MLP</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<bold>LR 0.6; M 0.4; NE 200</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<bold>CFS (8)</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<bold>86.9%</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<bold>78.1%</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<bold>86.3%</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<bold>69.9%</bold>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">MLP</td>
<td align="left" rowspan="1" colspan="1">LR 0.3; M 0.2; NE 1800</td>
<td align="left" rowspan="1" colspan="1">Χ
<sup>2</sup>
-FS (10)</td>
<td align="left" rowspan="1" colspan="1">86.1%</td>
<td align="left" rowspan="1" colspan="1">78.8%</td>
<td align="left" rowspan="1" colspan="1">82.2%</td>
<td align="left" rowspan="1" colspan="1">75.3%</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">NF</td>
<td align="left" rowspan="1" colspan="1">-</td>
<td align="left" rowspan="1" colspan="1">None (33)</td>
<td align="left" rowspan="1" colspan="1">72.4%</td>
<td align="left" rowspan="1" colspan="1">65.8%</td>
<td align="left" rowspan="1" colspan="1">76.7%</td>
<td align="left" rowspan="1" colspan="1">54.8%</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>NF</bold>
</td>
<td align="left" rowspan="1" colspan="1">-</td>
<td align="left" rowspan="1" colspan="1">
<bold>CFS (8)</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<bold>80.1%</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<bold>70.5%</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<bold>78.1%</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<bold>63.0%</bold>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">NF</td>
<td align="left" rowspan="1" colspan="1">-</td>
<td align="left" rowspan="1" colspan="1">Χ
<sup>2</sup>
-FS (10)</td>
<td align="left" rowspan="1" colspan="1">77.8%</td>
<td align="left" rowspan="1" colspan="1">71.9%</td>
<td align="left" rowspan="1" colspan="1">82.2%</td>
<td align="left" rowspan="1" colspan="1">61.6%</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>RF</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<bold>NT 300 NF 5</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<bold>None (33)</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<bold>94.5%</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<bold>88.4%</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<bold>91.8%</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<bold>84.9%</bold>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">RF</td>
<td align="left" rowspan="1" colspan="1">NT 20 NF 5</td>
<td align="left" rowspan="1" colspan="1">CFS (8)</td>
<td align="left" rowspan="1" colspan="1">92.3%</td>
<td align="left" rowspan="1" colspan="1">87.7%</td>
<td align="left" rowspan="1" colspan="1">90.4%</td>
<td align="left" rowspan="1" colspan="1">84.9%</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">RF</td>
<td align="left" rowspan="1" colspan="1">NT 400 NF 4</td>
<td align="left" rowspan="1" colspan="1">Χ
<sup>2</sup>
-FS (10)</td>
<td align="left" rowspan="1" colspan="1">93.2%</td>
<td align="left" rowspan="1" colspan="1">89.0%</td>
<td align="left" rowspan="1" colspan="1">93.2%</td>
<td align="left" rowspan="1" colspan="1">84.9%</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">
<bold>SVM</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<bold>G: 1.4</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<bold>None (33)</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<bold>93.1%</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<bold>89.0%</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<bold>86.3%</bold>
</td>
<td align="left" rowspan="1" colspan="1">
<bold>91.8%</bold>
</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">SVM</td>
<td align="left" rowspan="1" colspan="1">G: 2.3</td>
<td align="left" rowspan="1" colspan="1">CFS (8)</td>
<td align="left" rowspan="1" colspan="1">89.1%</td>
<td align="left" rowspan="1" colspan="1">81.5%</td>
<td align="left" rowspan="1" colspan="1">84.9%</td>
<td align="left" rowspan="1" colspan="1">78.1%</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">SVM</td>
<td align="left" rowspan="1" colspan="1">G: 1.6</td>
<td align="left" rowspan="1" colspan="1">Χ
<sup>2</sup>
-FS (10)</td>
<td align="left" rowspan="1" colspan="1">89.2%</td>
<td align="left" rowspan="1" colspan="1">80.8%</td>
<td align="left" rowspan="1" colspan="1">86.3%</td>
<td align="left" rowspan="1" colspan="1">75.3%</td>
</tr>
</tbody>
</table>
</alternatives>
<table-wrap-foot>
<fn id="t002fn001">
<p>CFS: correlation-based feature selection algorithm (a subset of 8 HRV features)</p>
</fn>
<fn id="t002fn002">
<p>Χ
<sup>2</sup>
-FS: chi-squared feature selection algorithm (a subset of 10 HRV features)</p>
</fn>
<fn id="t002fn003">
<p>NI: number of iteration</p>
</fn>
<fn id="t002fn004">
<p>ML: minimum number of instances per leaf.</p>
</fn>
<fn id="t002fn005">
<p>CF: confidence factor for pruning</p>
</fn>
<fn id="t002fn006">
<p>LR: learning rate</p>
</fn>
<fn id="t002fn007">
<p>M: momentum</p>
</fn>
<fn id="t002fn008">
<p>NE: number of epoch</p>
</fn>
<fn id="t002fn009">
<p>NT: number of trees</p>
</fn>
<fn id="t002fn010">
<p>NF: number of randomly chosen features</p>
</fn>
<fn id="t002fn011">
<p>G: gamma</p>
</fn>
<fn id="t002fn012">
<p>AUC: area under the curve</p>
</fn>
<fn id="t002fn013">
<p>CI: confidence interval</p>
</fn>
<fn id="t002fn014">
<p>ACC: accuracy</p>
</fn>
<fn id="t002fn015">
<p>SEN: sensitivity</p>
</fn>
<fn id="t002fn016">
<p>SPE: specificity</p>
</fn>
<fn id="t002fn017">
<p>In bold: the best performances of each classifier.</p>
</fn>
</table-wrap-foot>
</table-wrap>
<p>The performance measurements estimated on the independent test set are reported in
<xref rid="pone.0118504.t003" ref-type="table">Table 3</xref>
for each classification algorithm based on HRV features. The RF outperformed the other data-mining methods by achieving the best value of performance measures, i.e., an accuracy of 85.7%, a sensitivity of 71.4%, and a specificity of 87.8%. The prediction based on the echographic parameters, i.e., IMT and LVMi, resulted in a very low sensitivity rate (<45%), as shown in
<xref rid="pone.0118504.t004" ref-type="table">Table 4</xref>
.</p>
<table-wrap id="pone.0118504.t003" orientation="portrait" position="float">
<object-id pub-id-type="doi">10.1371/journal.pone.0118504.t003</object-id>
<label>Table 3</label>
<caption>
<title>Performance measurements estimated on the test set (hold-out estimation) of the best classifiers based on HRV features.</title>
</caption>
<alternatives>
<graphic id="pone.0118504.t003g" xlink:href="pone.0118504.t003"></graphic>
<table frame="hsides" rules="groups">
<colgroup span="1">
<col align="left" valign="middle" span="1"></col>
<col align="left" valign="middle" span="1"></col>
<col align="left" valign="middle" span="1"></col>
<col align="left" valign="middle" span="1"></col>
<col align="left" valign="middle" span="1"></col>
<col align="left" valign="middle" span="1"></col>
<col align="left" valign="middle" span="1"></col>
</colgroup>
<thead>
<tr>
<th align="left" rowspan="1" colspan="1">Class.</th>
<th align="left" rowspan="1" colspan="1">Parameters</th>
<th align="left" rowspan="1" colspan="1">Feature selection (# features)</th>
<th align="left" rowspan="1" colspan="1">AUC</th>
<th align="left" rowspan="1" colspan="1">ACC (95% CI)</th>
<th align="left" rowspan="1" colspan="1">SEN</th>
<th align="left" rowspan="1" colspan="1">SPE</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" rowspan="1" colspan="1">AB</td>
<td align="left" rowspan="1" colspan="1">NI: 120; CF: 0.45; MI: 10</td>
<td align="left" rowspan="1" colspan="1">Χ
<sup>2</sup>
-FS(10)</td>
<td align="left" rowspan="1" colspan="1">81.9%</td>
<td align="left" rowspan="1" colspan="1">83.9%(76.9–86.6)</td>
<td align="left" rowspan="1" colspan="1">71.4%</td>
<td align="left" rowspan="1" colspan="1">85.7%</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">C4.5</td>
<td align="left" rowspan="1" colspan="1">CF: 0.1; MI: 5</td>
<td align="left" rowspan="1" colspan="1">Χ
<sup>2</sup>
-FS (10)</td>
<td align="left" rowspan="1" colspan="1">69.8%</td>
<td align="left" rowspan="1" colspan="1">75.0% (67.7–79.1)</td>
<td align="left" rowspan="1" colspan="1">57.1%</td>
<td align="left" rowspan="1" colspan="1">77.6%</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">MLP</td>
<td align="left" rowspan="1" colspan="1">LR: 0.6; M: 0.4; NE: 200</td>
<td align="left" rowspan="1" colspan="1">CFS (8)</td>
<td align="left" rowspan="1" colspan="1">64.7%</td>
<td align="left" rowspan="1" colspan="1">76.8% (69.5–80.6)</td>
<td align="left" rowspan="1" colspan="1">42.9%</td>
<td align="left" rowspan="1" colspan="1">81.6%</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">NF</td>
<td align="left" rowspan="1" colspan="1">-</td>
<td align="left" rowspan="1" colspan="1">CFS (8)</td>
<td align="left" rowspan="1" colspan="1">74.9%</td>
<td align="left" rowspan="1" colspan="1">69.6% (62.4–74.4)</td>
<td align="left" rowspan="1" colspan="1">57.1%</td>
<td align="left" rowspan="1" colspan="1">71.4%</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">RF</td>
<td align="left" rowspan="1" colspan="1">NT: 300 NF: 5</td>
<td align="left" rowspan="1" colspan="1">None (33)</td>
<td align="left" rowspan="1" colspan="1">88.8%</td>
<td align="left" rowspan="1" colspan="1">85.7% (78.7–88.1)</td>
<td align="left" rowspan="1" colspan="1">71.4%</td>
<td align="left" rowspan="1" colspan="1">87.8%</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">SVM</td>
<td align="left" rowspan="1" colspan="1">G: 1.4</td>
<td align="left" rowspan="1" colspan="1">None (33)</td>
<td align="left" rowspan="1" colspan="1">90.1%</td>
<td align="left" rowspan="1" colspan="1">83.9% (76.9–86.6)</td>
<td align="left" rowspan="1" colspan="1">71.4%</td>
<td align="left" rowspan="1" colspan="1">85.7%</td>
</tr>
</tbody>
</table>
</alternatives>
<table-wrap-foot>
<fn id="t003fn001">
<p>Class.: Classifier</p>
</fn>
<fn id="t003fn002">
<p>AB: Adaboost</p>
</fn>
<fn id="t003fn003">
<p>MLP: Multilayer Perceptron</p>
</fn>
<fn id="t003fn004">
<p>NB: Naïve Bayes classifier</p>
</fn>
<fn id="t003fn005">
<p>RF: Random Forest</p>
</fn>
<fn id="t003fn006">
<p>SVM: Support Vector Machine</p>
</fn>
<fn id="t003fn007">
<p>NI: number of iteration</p>
</fn>
<fn id="t003fn008">
<p>ML: minimum number of instances per leaf.</p>
</fn>
<fn id="t003fn009">
<p>CF: confidence factor for pruning</p>
</fn>
<fn id="t003fn010">
<p>LR: learning rate</p>
</fn>
<fn id="t003fn011">
<p>M: momentum</p>
</fn>
<fn id="t003fn012">
<p>NE: number of epoch</p>
</fn>
<fn id="t003fn013">
<p>NT: number of trees</p>
</fn>
<fn id="t003fn014">
<p>NF: number of randomly chosen features</p>
</fn>
<fn id="t003fn015">
<p>G: gamma</p>
</fn>
<fn id="t003fn016">
<p>Χ
<sup>2</sup>
-FS: chi squared feature selection algorithm (a subset of 10 HRV features)</p>
</fn>
<fn id="t003fn017">
<p>CFS: correlation-based feature selection algorithm (a subset of 8 HRV features)</p>
</fn>
<fn id="t003fn018">
<p>AUC: area under the curve</p>
</fn>
<fn id="t003fn019">
<p>ACC: accuracy</p>
</fn>
<fn id="t003fn020">
<p>CI: confidence interval</p>
</fn>
<fn id="t003fn021">
<p>SEN: sensitivity</p>
</fn>
<fn id="t003fn022">
<p>SPE: specificity.</p>
</fn>
</table-wrap-foot>
</table-wrap>
<table-wrap id="pone.0118504.t004" orientation="portrait" position="float">
<object-id pub-id-type="doi">10.1371/journal.pone.0118504.t004</object-id>
<label>Table 4</label>
<caption>
<title>Performance measurements of classification based on echographic parameters.</title>
</caption>
<alternatives>
<graphic id="pone.0118504.t004g" xlink:href="pone.0118504.t004"></graphic>
<table frame="hsides" rules="groups">
<colgroup span="1">
<col align="left" valign="middle" span="1"></col>
<col align="left" valign="middle" span="1"></col>
<col align="left" valign="middle" span="1"></col>
<col align="left" valign="middle" span="1"></col>
<col align="left" valign="middle" span="1"></col>
</colgroup>
<thead>
<tr>
<th align="left" rowspan="1" colspan="1">Parameter</th>
<th align="left" rowspan="1" colspan="1">AUC</th>
<th align="left" rowspan="1" colspan="1">ACC (95% CI)</th>
<th align="left" rowspan="1" colspan="1">SEN</th>
<th align="left" rowspan="1" colspan="1">SPE</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" rowspan="1" colspan="1">LVMi</td>
<td align="left" rowspan="1" colspan="1">63.5%</td>
<td align="left" rowspan="1" colspan="1">69.5% (69.9–73.0)</td>
<td align="left" rowspan="1" colspan="1">41.2%</td>
<td align="left" rowspan="1" colspan="1">73.9%</td>
</tr>
<tr>
<td align="left" rowspan="1" colspan="1">IMT MAX</td>
<td align="left" rowspan="1" colspan="1">49.1%</td>
<td align="left" rowspan="1" colspan="1">61.9% (57.3–65.8)</td>
<td align="left" rowspan="1" colspan="1">40.0%</td>
<td align="left" rowspan="1" colspan="1">64.9%</td>
</tr>
</tbody>
</table>
</alternatives>
<table-wrap-foot>
<fn id="t004fn001">
<p>LVMi.: Left ventricular mass index</p>
</fn>
<fn id="t004fn002">
<p>IMT MAX: maximum of intima media thickness</p>
</fn>
<fn id="t004fn003">
<p>AUC: area under the curve</p>
</fn>
<fn id="t004fn004">
<p>ACC: accuracy</p>
</fn>
<fn id="t004fn005">
<p>CI: confidence interval</p>
</fn>
<fn id="t004fn006">
<p>SEN: sensitivity</p>
</fn>
<fn id="t004fn007">
<p>SPE: specificity.</p>
</fn>
</table-wrap-foot>
</table-wrap>
<p>The ROC curves (estimated on the independent test set) for predicting vascular events over twelve months with HRV or echographic parameters are compared in
<xref rid="pone.0118504.g002" ref-type="fig">Fig. 2</xref>
. The HRV-based classifier showed higher AUC compared to echographic parameters. Among clinical parameters, the higher AUC was achieved by LVMi, followed by IMT. The other clinical available parameters (e.g. blood pressure, cholesterol) resulted in ROC with AUC lower than 0.5, i.e., worst performance than random choice, and for that reason, they are omitted. Among HRV-based classifier, SVM achieved the highest AUC, followed by RF.</p>
<fig id="pone.0118504.g002" orientation="portrait" position="float">
<object-id pub-id-type="doi">10.1371/journal.pone.0118504.g002</object-id>
<label>Fig 2</label>
<caption>
<title>Receiver-operator characteristic curves for predicting vascular events by HRV-based classifiers and echographic parameters.</title>
<p>The HRV-based classifiers are able to predict vascular events with higher sensitivity and specificity rate than echographic parameters. Sensitivity is determined from the proportion of patient developing a vascular event identified as high risk; specificity is determined from the proportion of patient free of vascular events identified as low risk. Solid lines represent classifier based on HRV features, dash-dot lines represent classifications based on echographic parameters. AB: Adaboost. MLP: Multilayer Perceptron. NB: Naïve Bayes classifier. RF: Random Forest. SVM: Support Vector Machine. LVMi.: Left ventricular mass index. IMT MAX: maximum of intima media thickness.</p>
</caption>
<graphic xlink:href="pone.0118504.g002"></graphic>
</fig>
<p>Since AB achieved satisfactory performances, it was interesting to observe the rules obtained from the decision tree with the highest weight, shown in
<xref rid="pone.0118504.g003" ref-type="fig">Fig. 3</xref>
:</p>
<list list-type="bullet">
<list-item>
<p>the subject was classified as low-risk if HRVTi>13.6;</p>
</list-item>
<list-item>
<p>a depression of HRVTi (<13.6) associated with a decreased SampEn (<0.997) or decreased LF
<sub>%</sub>
(<18.1%) leaded to high-risk classification;</p>
</list-item>
<list-item>
<p>otherwise, the subject was classified based on LF and CD, in particular, reduced CD (<3.43), although with LF > 0.011 s
<sup>2</sup>
, leaded to high-risk classification, otherwise, the subject was classified as low-risk.</p>
</list-item>
</list>
<fig id="pone.0118504.g003" orientation="portrait" position="float">
<object-id pub-id-type="doi">10.1371/journal.pone.0118504.g003</object-id>
<label>Fig 3</label>
<caption>
<title>Decision tree for prediction of vascular events.</title>
<p>The decision tree shows the set of rules adopted for classify high and low risk subjects: if HRVTi is higher than 13.6, the subject is classified as low risk, otherwise if SampEn lower than 0.997 or LF% lower than 18.1%, the subject is classified as high risk. The remaining subjects (with higher SampEn and LF
<sub>%</sub>
), are classified based on LF and CF: as high risk, if LF is higher than 0.001 s
<sup>2</sup>
and CD is lower 3.43, otherwise as low risk. HRVTi: HRV Triangular Index. SampEn: Sample Entropy. LF: Low Frequency. LF
<sub>%</sub>
: Low Frequency expressed as percentage of Total Power. CD: correlation dimension.</p>
</caption>
<graphic xlink:href="pone.0118504.g003"></graphic>
</fig>
</sec>
<sec sec-type="conclusions" id="sec011">
<title>Discussion</title>
<p>In this study, we used HRV features extracted from 5 minutes excerpts of 24-hour clinical electrocardiographic dataset from hypertensive patients to develop a computer-aided predictive tool that improves risk stratification. Tree-based models applied on HRV features resulted effective in identifying high-risk patients among a population of hypertensive patients.</p>
<p>Linear HRV features demonstrated prognostic value for vascular events[
<xref rid="pone.0118504.ref008" ref-type="bibr">8</xref>
<xref rid="pone.0118504.ref010" ref-type="bibr">10</xref>
]. Nevertheless, these traditional measures had only a partial predictive capability. In this study, to advance the predictability of vascular events in hypertensive patients over twelve months, several data-miming approach were tested by combining linear and non-linear HRV features. The feature selection and ranking showed that nonlinear features, particularly CD, SampEn and SD
<sub>2</sub>
, increased the discrimination power when they were used in combination with the linear HRV features, such as HRVTi, LF, and HF. As a result, we proposed tree-based models, which resulted to be effective at predicting vascular events among hypertensive. Nevertheless, our results clearly showed that the HRV-based classifiers had a better prognostic capacity compared with LVMi and IMT, which are considered as powerful predictors of vascular events[
<xref rid="pone.0118504.ref004" ref-type="bibr">4</xref>
<xref rid="pone.0118504.ref006" ref-type="bibr">6</xref>
].</p>
<p>The sensitivity and specificity rates obtained in the current study were comparable with the performances achieved by Ebrahuimzaded et al.[
<xref rid="pone.0118504.ref022" ref-type="bibr">22</xref>
] and by Song et al.[
<xref rid="pone.0118504.ref021" ref-type="bibr">21</xref>
], who recently proposed HRV-based classifier for prediction of sudden cardiac death. However, in the present study none of the cardiovascular and cerebrovascular events occurred over the follow-up was fatal. Moreover, in the current study, we adopted a nested cross-validation approach: an inner 10-fold-crossvalidation loop was performed for model section (i.e., features selection and machine learning parameter optimization), while a hold-out test set was used to obtain almost unbiased estimates of the true classification performances.</p>
<p>The sets of rules of the tree models presented were consistent with the findings of previous studies, even if no medical a priori knowledge was adopted in the data-mining methods. In fact, depressed HRV was showed to be associated with high cardiovascular risk in previous studies[
<xref rid="pone.0118504.ref008" ref-type="bibr">8</xref>
<xref rid="pone.0118504.ref010" ref-type="bibr">10</xref>
]. Since HRV was proven to be the result of changes in heart rate caused by fluctuations in sympathetic and parasympathetic outflow (the two branches of ANS), less compensatory change, as evaluated by depressed HRV, suggested a less adaptive ANS. One of the reasons could be that ANS resulted less sensitive for minor hemodynamic changes in some hypertensive patients, which could have been a direct cause of the vascular event registered in this study. Furthermore, a possible mechanism underlying our findings could be low-grade inflammation: it has been suggested that autonomic imbalance could activate inflammation by influencing the bone marrow and lymphoreticular system and increased inflammation is associated with higher risk of cardiovascular events[
<xref rid="pone.0118504.ref047" ref-type="bibr">47</xref>
]. Finally, another possible explanation for the association between HRV and vascular risk was that individuals with low HRV already suffered from subclinical or silent vascular disease, which, if not detected, resulted in cardiovascular events in the following months[
<xref rid="pone.0118504.ref048" ref-type="bibr">48</xref>
].</p>
<p>As regards the comparison of data-mining methods, RF showed extremely good performance in the current study when comparing several methods for diagnosis of congestive heart failure based on HRV features, confirming previous findings[
<xref rid="pone.0118504.ref016" ref-type="bibr">16</xref>
]. Moreover, RF and SVM performed well without any feature selection, consistently with the capability of these algorithms to constitute embedded feature selection strategy, as demonstrated in previous studies[
<xref rid="pone.0118504.ref049" ref-type="bibr">49</xref>
,
<xref rid="pone.0118504.ref050" ref-type="bibr">50</xref>
].</p>
<p>The clinical feasibility and uptake of the developed tool are now tested in a prospective study in subjects aged 55 and over recruited by the Center of Hypertension of the University Hospital of Naples. The physicians accessed the tool by an
<italic>ad hoc</italic>
developed web-based application; they could upload the ECG signals by a Windows application, a browser or an Android App. More details about the developed platform were reported elsewhere[
<xref rid="pone.0118504.ref051" ref-type="bibr">51</xref>
]. The physicians can visualize the signals, the HRV features and the results of the tool by using a web browser. The involved clinicians are pleased to use the tool and confirmed that it is clinical feasible and could be useful in clinical practice. They have specialist background in cardiology or emergency medicine and experience with ECG Holter analysis. Moreover, since 5-minute HRV measurement is inexpensive, easy to assess, and non-invasive, future research will focus on the clinical applicability of the system as a screening tool in non-specialized ambulatories (e.g. at General Practitioners’), in order to identify high-risk patients to be shortlisted for more complex (and costly) investigations. Improved identification of individuals at risk for the development of vascular events may result in more targeted and adequate prevention strategies.</p>
<p>The current study had the following limitations. First, we used only linear and nonlinear HRV features and not strong risk markers, such as Heart Rate Turbulence or T wave alterations. Secondly, further investigations are needed to assess whether the proposed models can perform well using other datasets, since the dataset of the current study was relatively small and unbalanced. Therefore, this novel predictive approach should be studied in a larger number of patients.</p>
</sec>
<sec sec-type="conclusions" id="sec012">
<title>Conclusions</title>
<p>This study proposed an automated system for prediction of vascular events in the following year using HRV analysis. The developed classifier enabled to identify hypertensive patients, which will undergo a cardiovascular event or stroke many weeks/months before the events by using a 5-minute ECG recording, achieving sensitivity and specificity rates of 71.4% and 87.8%.</p>
<p>Finally, since some echographic parameters have been proven as power predictors of vascular events[
<xref rid="pone.0118504.ref004" ref-type="bibr">4</xref>
<xref rid="pone.0118504.ref006" ref-type="bibr">6</xref>
], we compared the performance of our classifier with decision rules based on these parameters and we showed that the HRV-based system outperformed the classification based on echographic parameters. These findings confirmed that HRV could be a good predictor of future vascular events in the following year among hypertensive patients.</p>
</sec>
<sec sec-type="supplementary-material" id="sec013">
<title>Supporting Information</title>
<supplementary-material content-type="local-data" id="pone.0118504.s001">
<label>S1 Appendix</label>
<caption>
<title>Nonlinear HRV measurements.</title>
<p>(DOCX)</p>
</caption>
<media xlink:href="pone.0118504.s001.docx">
<caption>
<p>Click here for additional data file.</p>
</caption>
</media>
</supplementary-material>
<supplementary-material content-type="local-data" id="pone.0118504.s002">
<label>S2 Appendix</label>
<caption>
<title>Data-mining methods.</title>
<p>(DOCX)</p>
</caption>
<media xlink:href="pone.0118504.s002.docx">
<caption>
<p>Click here for additional data file.</p>
</caption>
</media>
</supplementary-material>
</sec>
</body>
<back>
<ref-list>
<title>References</title>
<ref id="pone.0118504.ref001">
<label>1</label>
<mixed-citation publication-type="journal">
<name>
<surname>Fuster</surname>
<given-names>V</given-names>
</name>
.
<article-title>Epidemic of cardiovascular disease and stroke: the three main challenges. Presented at the 71st scientific sessions of the American Heart Association. Dallas, Texas</article-title>
.
<source>Circulation</source>
.
<year>1999</year>
;
<volume>99</volume>
(
<issue>9</issue>
):
<fpage>1132</fpage>
<lpage>7</lpage>
. PubMed PMID: .
<pub-id pub-id-type="pmid">10069778</pub-id>
</mixed-citation>
</ref>
<ref id="pone.0118504.ref002">
<label>2</label>
<mixed-citation publication-type="journal">
<name>
<surname>Murray</surname>
<given-names>CJ</given-names>
</name>
,
<name>
<surname>Lopez</surname>
<given-names>AD</given-names>
</name>
.
<article-title>Mortality by cause for eight regions of the world: Global Burden of Disease Study</article-title>
.
<source>Lancet</source>
.
<year>1997</year>
;
<volume>349</volume>
(
<issue>9061</issue>
):
<fpage>1269</fpage>
<lpage>76</lpage>
.
<comment>doi:
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1016/S0140-6736(96)07493-4">10.1016/S0140-6736(96)07493-4</ext-link>
</comment>
PubMed PMID: .
<pub-id pub-id-type="pmid">9142060</pub-id>
</mixed-citation>
</ref>
<ref id="pone.0118504.ref003">
<label>3</label>
<mixed-citation publication-type="journal">
<name>
<surname>Rothwell</surname>
<given-names>PM</given-names>
</name>
,
<name>
<surname>Coull</surname>
<given-names>AJ</given-names>
</name>
,
<name>
<surname>Silver</surname>
<given-names>LE</given-names>
</name>
,
<name>
<surname>Fairhead</surname>
<given-names>JF</given-names>
</name>
,
<name>
<surname>Giles</surname>
<given-names>MF</given-names>
</name>
,
<name>
<surname>Lovelock</surname>
<given-names>CE</given-names>
</name>
,
<etal>et al</etal>
<article-title>Population-based study of event-rate, incidence, case fatality, and mortality for all acute vascular events in all arterial territories (Oxford Vascular Study)</article-title>
.
<source>Lancet</source>
.
<year>2005</year>
;
<volume>366</volume>
(
<issue>9499</issue>
):
<fpage>1773</fpage>
<lpage>83</lpage>
.
<comment>doi:
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1016/S0140-6736(05)67702-1">10.1016/S0140-6736(05)67702-1</ext-link>
</comment>
PubMed PMID: .
<pub-id pub-id-type="pmid">16298214</pub-id>
</mixed-citation>
</ref>
<ref id="pone.0118504.ref004">
<label>4</label>
<mixed-citation publication-type="journal">
<name>
<surname>Lorenz</surname>
<given-names>MW</given-names>
</name>
,
<name>
<surname>Markus</surname>
<given-names>HS</given-names>
</name>
,
<name>
<surname>Bots</surname>
<given-names>ML</given-names>
</name>
,
<name>
<surname>Rosvall</surname>
<given-names>M</given-names>
</name>
,
<name>
<surname>Sitzer</surname>
<given-names>M</given-names>
</name>
.
<article-title>Prediction of clinical cardiovascular events with carotid intima-media thickness: a systematic review and meta-analysis</article-title>
.
<source>Circulation</source>
.
<year>2007</year>
;
<volume>115</volume>
(
<issue>4</issue>
):
<fpage>459</fpage>
<lpage>67</lpage>
.
<comment>doi:
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1161/CIRCULATIONAHA.106.628875">10.1161/CIRCULATIONAHA.106.628875</ext-link>
</comment>
PubMed PMID: .
<pub-id pub-id-type="pmid">17242284</pub-id>
</mixed-citation>
</ref>
<ref id="pone.0118504.ref005">
<label>5</label>
<mixed-citation publication-type="journal">
<name>
<surname>Nagai</surname>
<given-names>K</given-names>
</name>
,
<name>
<surname>Shibata</surname>
<given-names>S</given-names>
</name>
,
<name>
<surname>Akishita</surname>
<given-names>M</given-names>
</name>
,
<name>
<surname>Sudoh</surname>
<given-names>N</given-names>
</name>
,
<name>
<surname>Obara</surname>
<given-names>T</given-names>
</name>
,
<name>
<surname>Toba</surname>
<given-names>K</given-names>
</name>
,
<etal>et al</etal>
<article-title>Efficacy of combined use of three non-invasive atherosclerosis tests to predict vascular events in the elderly; carotid intima-media thickness, flow-mediated dilation of brachial artery and pulse wave velocity</article-title>
.
<source>Atherosclerosis</source>
.
<year>2013</year>
;
<volume>231</volume>
(
<issue>2</issue>
):
<fpage>365</fpage>
<lpage>70</lpage>
.
<comment>doi:
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1016/j.atherosclerosis.2013.09.028">10.1016/j.atherosclerosis.2013.09.028</ext-link>
</comment>
<pub-id pub-id-type="pmid">24267253</pub-id>
</mixed-citation>
</ref>
<ref id="pone.0118504.ref006">
<label>6</label>
<mixed-citation publication-type="journal">
<name>
<surname>Schillaci</surname>
<given-names>G</given-names>
</name>
,
<name>
<surname>Verdecchia</surname>
<given-names>P</given-names>
</name>
,
<name>
<surname>Porcellati</surname>
<given-names>C</given-names>
</name>
,
<name>
<surname>Cuccurullo</surname>
<given-names>O</given-names>
</name>
,
<name>
<surname>Cosco</surname>
<given-names>C</given-names>
</name>
,
<name>
<surname>Perticone</surname>
<given-names>F</given-names>
</name>
.
<article-title>Continuous relation between left ventricular mass and cardiovascular risk in essential hypertension</article-title>
.
<source>Hypertension</source>
.
<year>2000</year>
;
<volume>35</volume>
(
<issue>2</issue>
):
<fpage>580</fpage>
<lpage>6</lpage>
.
<pub-id pub-id-type="pmid">10679501</pub-id>
</mixed-citation>
</ref>
<ref id="pone.0118504.ref007">
<label>7</label>
<mixed-citation publication-type="journal">
<name>
<surname>de Simone</surname>
<given-names>G</given-names>
</name>
,
<name>
<surname>Izzo</surname>
<given-names>R</given-names>
</name>
,
<name>
<surname>Chinali</surname>
<given-names>M</given-names>
</name>
,
<name>
<surname>De Marco</surname>
<given-names>M</given-names>
</name>
,
<name>
<surname>Casalnuovo</surname>
<given-names>G</given-names>
</name>
,
<name>
<surname>Rozza</surname>
<given-names>F</given-names>
</name>
,
<etal>et al</etal>
<article-title>Does information on systolic and diastolic function improve prediction of a cardiovascular event by left ventricular hypertrophy in arterial hypertension?</article-title>
<source>Hypertension</source>
.
<year>2010</year>
;
<volume>56</volume>
(
<issue>1</issue>
):
<fpage>99</fpage>
<lpage>104</lpage>
. Epub 2010/05/26.
<comment>doi:
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1161/hypertensionaha.110.150128">10.1161/hypertensionaha.110.150128</ext-link>
</comment>
PubMed PMID: .
<pub-id pub-id-type="pmid">20497990</pub-id>
</mixed-citation>
</ref>
<ref id="pone.0118504.ref008">
<label>8</label>
<mixed-citation publication-type="journal">
<name>
<surname>Sajadieh</surname>
<given-names>A</given-names>
</name>
,
<name>
<surname>Rasmussen</surname>
<given-names>V</given-names>
</name>
,
<name>
<surname>Hein</surname>
<given-names>HO</given-names>
</name>
,
<name>
<surname>Hansen</surname>
<given-names>JF</given-names>
</name>
.
<article-title>Familial predisposition to premature heart attack and reduced heart rate variability</article-title>
.
<source>Am J Cardiol</source>
.
<year>2003</year>
;
<volume>92</volume>
(
<issue>2</issue>
):
<fpage>234</fpage>
<lpage>6</lpage>
. PubMed PMID: .
<pub-id pub-id-type="pmid">12860234</pub-id>
</mixed-citation>
</ref>
<ref id="pone.0118504.ref009">
<label>9</label>
<mixed-citation publication-type="journal">
<name>
<surname>Dekker</surname>
<given-names>JM</given-names>
</name>
,
<name>
<surname>Crow</surname>
<given-names>RS</given-names>
</name>
,
<name>
<surname>Folsom</surname>
<given-names>AR</given-names>
</name>
,
<name>
<surname>Hannan</surname>
<given-names>PJ</given-names>
</name>
,
<name>
<surname>Liao</surname>
<given-names>D</given-names>
</name>
,
<name>
<surname>Swenne</surname>
<given-names>CA</given-names>
</name>
,
<etal>et al</etal>
<article-title>Low heart rate variability in a 2-minute rhythm strip predicts risk of coronary heart disease and mortality from several causes: the ARIC Study. Atherosclerosis Risk In Communities</article-title>
.
<source>Circulation</source>
.
<year>2000</year>
;
<volume>102</volume>
(
<issue>11</issue>
):
<fpage>1239</fpage>
<lpage>44</lpage>
. PubMed PMID: .
<pub-id pub-id-type="pmid">10982537</pub-id>
</mixed-citation>
</ref>
<ref id="pone.0118504.ref010">
<label>10</label>
<mixed-citation publication-type="journal">
<name>
<surname>Binici</surname>
<given-names>Z</given-names>
</name>
,
<name>
<surname>Mouridsen</surname>
<given-names>MR</given-names>
</name>
,
<name>
<surname>Køber</surname>
<given-names>L</given-names>
</name>
,
<name>
<surname>Sajadieh</surname>
<given-names>A</given-names>
</name>
.
<article-title>Decreased Nighttime Heart Rate Variability Is Associated With Increased Stroke Risk</article-title>
.
<source>Stroke</source>
.
<year>2011</year>
;
<volume>42</volume>
(
<issue>11</issue>
):
<fpage>3196</fpage>
<lpage>201</lpage>
.
<comment>doi:
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1161/strokeaha.110.607697">10.1161/strokeaha.110.607697</ext-link>
</comment>
<pub-id pub-id-type="pmid">21921280</pub-id>
</mixed-citation>
</ref>
<ref id="pone.0118504.ref011">
<label>11</label>
<mixed-citation publication-type="journal">
<name>
<surname>Melillo</surname>
<given-names>P</given-names>
</name>
,
<name>
<surname>Fusco</surname>
<given-names>R</given-names>
</name>
,
<name>
<surname>Sansone</surname>
<given-names>M</given-names>
</name>
,
<name>
<surname>Bracale</surname>
<given-names>M</given-names>
</name>
,
<name>
<surname>Pecchia</surname>
<given-names>L</given-names>
</name>
.
<article-title>Discrimination power of long-term heart rate variability measures for chronic heart failure detection</article-title>
.
<source>Med Biol Eng Comput</source>
.
<year>2011</year>
;
<volume>49</volume>
(
<issue>1</issue>
):
<fpage>67</fpage>
<lpage>74</lpage>
.
<comment>doi:
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1007/s11517-010-0728-5">10.1007/s11517-010-0728-5</ext-link>
</comment>
<pub-id pub-id-type="pmid">21203855</pub-id>
</mixed-citation>
</ref>
<ref id="pone.0118504.ref012">
<label>12</label>
<mixed-citation publication-type="journal">
<name>
<surname>Pecchia</surname>
<given-names>L</given-names>
</name>
,
<name>
<surname>Melillo</surname>
<given-names>P</given-names>
</name>
,
<name>
<surname>Bracale</surname>
<given-names>M</given-names>
</name>
.
<article-title>Remote health monitoring of heart failure with data mining via CART method on HRV features</article-title>
.
<source>IEEE Trans Bio Med Eng</source>
.
<year>2011</year>
;
<volume>58</volume>
(
<issue>3</issue>
):
<fpage>800</fpage>
<lpage>4</lpage>
. Epub 2010/11/17.
<comment>doi:
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1109/TBME.2010.2092776">10.1109/TBME.2010.2092776</ext-link>
</comment>
PubMed PMID: .
<pub-id pub-id-type="pmid">21078568</pub-id>
</mixed-citation>
</ref>
<ref id="pone.0118504.ref013">
<label>13</label>
<mixed-citation publication-type="journal">
<name>
<surname>Pecchia</surname>
<given-names>L</given-names>
</name>
,
<name>
<surname>Melillo</surname>
<given-names>P</given-names>
</name>
,
<name>
<surname>Sansone</surname>
<given-names>M</given-names>
</name>
,
<name>
<surname>Bracale</surname>
<given-names>M</given-names>
</name>
.
<article-title>Discrimination power of short-term heart rate variability measures for CHF assessment</article-title>
.
<source>IEEE Trans Inf Technol Biomed</source>
.
<year>2011</year>
;
<volume>15</volume>
(
<issue>1</issue>
):
<fpage>40</fpage>
<lpage>6</lpage>
. Epub 2010/11/16.
<comment>doi:
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1109/TITB.2010.2091647">10.1109/TITB.2010.2091647</ext-link>
</comment>
PubMed PMID: .
<pub-id pub-id-type="pmid">21075731</pub-id>
</mixed-citation>
</ref>
<ref id="pone.0118504.ref014">
<label>14</label>
<mixed-citation publication-type="journal">
<name>
<surname>Melillo</surname>
<given-names>P</given-names>
</name>
,
<name>
<surname>De Luca</surname>
<given-names>N</given-names>
</name>
,
<name>
<surname>Bracale</surname>
<given-names>M</given-names>
</name>
,
<name>
<surname>Pecchia</surname>
<given-names>L</given-names>
</name>
.
<article-title>Classification Tree for Risk Assessment in Patients Suffering From Congestive Heart Failure via Long-Term Heart Rate Variability</article-title>
.
<source>IEEE J Biomed Health Inform</source>
.
<year>2013</year>
;
<volume>17</volume>
(
<issue>3</issue>
):
<fpage>727</fpage>
<lpage>33</lpage>
.
<comment>doi:
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1109/jbhi.2013.2244902">10.1109/jbhi.2013.2244902</ext-link>
</comment>
PubMed PMID: .
<pub-id pub-id-type="pmid">24592473</pub-id>
</mixed-citation>
</ref>
<ref id="pone.0118504.ref015">
<label>15</label>
<mixed-citation publication-type="journal">
<name>
<surname>Isler</surname>
<given-names>Y</given-names>
</name>
,
<name>
<surname>Kuntalp</surname>
<given-names>M</given-names>
</name>
.
<article-title>Combining classical HRV indices with wavelet entropy measures improves to performance in diagnosing congestive heart failure</article-title>
.
<source>Computers in Biology and Medicine</source>
.
<year>2007</year>
;
<volume>37</volume>
(
<issue>10</issue>
):
<fpage>1502</fpage>
<lpage>10</lpage>
.
<comment>doi:
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1016/j.compbiomed.2007.01.012">10.1016/j.compbiomed.2007.01.012</ext-link>
</comment>
PubMed PMID: .
<pub-id pub-id-type="pmid">17359959</pub-id>
</mixed-citation>
</ref>
<ref id="pone.0118504.ref016">
<label>16</label>
<mixed-citation publication-type="journal">
<name>
<surname>Jovic</surname>
<given-names>A</given-names>
</name>
,
<name>
<surname>Bogunovic</surname>
<given-names>N</given-names>
</name>
.
<article-title>Electrocardiogram analysis using a combination of statistical, geometric, and nonlinear heart rate variability features</article-title>
.
<source>Artificial Intelligence in Medicine</source>
.
<year>2011</year>
;
<volume>51</volume>
(
<issue>3</issue>
):
<fpage>175</fpage>
<lpage>86</lpage>
.
<comment>doi:
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1016/j.artmed.2010.09.005">10.1016/j.artmed.2010.09.005</ext-link>
</comment>
<pub-id pub-id-type="pmid">20980134</pub-id>
</mixed-citation>
</ref>
<ref id="pone.0118504.ref017">
<label>17</label>
<mixed-citation publication-type="other">Melillo P, Formisano C, Bracale U, Pecchia L. Classification tree for real-life stress detection using linear Heart Rate Variability analysis. Case study: students under stress due to university examination. In: Long M, editor. World Congress on Medical Physics and Biomedical Engineering May 26–31, 2012, Beijing, China. IFMBE Proceedings. 39: Springer Berlin Heidelberg; 2013. p. 477–80.</mixed-citation>
</ref>
<ref id="pone.0118504.ref018">
<label>18</label>
<mixed-citation publication-type="journal">
<name>
<surname>Melillo</surname>
<given-names>P</given-names>
</name>
,
<name>
<surname>Bracale</surname>
<given-names>M</given-names>
</name>
,
<name>
<surname>Pecchia</surname>
<given-names>L</given-names>
</name>
.
<article-title>Nonlinear Heart Rate Variability features for real-life stress detection. Case study: students under stress due to university examination</article-title>
.
<source>Biomed Eng Online</source>
.
<year>2011</year>
;
<volume>10</volume>
(
<issue>1</issue>
):
<fpage>96</fpage>
PubMed PMID:
<comment>doi:
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1186/1475-925X-10-96">10.1186/1475-925X-10-96</ext-link>
</comment>
<pub-id pub-id-type="pmid">22059697</pub-id>
</mixed-citation>
</ref>
<ref id="pone.0118504.ref019">
<label>19</label>
<mixed-citation publication-type="journal">
<name>
<surname>Ramirez-Villegas</surname>
<given-names>JF</given-names>
</name>
,
<name>
<surname>Lam-Espinosa</surname>
<given-names>E</given-names>
</name>
,
<name>
<surname>Ramirez-Moreno</surname>
<given-names>DF</given-names>
</name>
,
<name>
<surname>Calvo-Echeverry</surname>
<given-names>PC</given-names>
</name>
,
<name>
<surname>Agredo-Rodriguez</surname>
<given-names>W</given-names>
</name>
.
<article-title>Heart rate variability dynamics for the prognosis of cardiovascular risk</article-title>
.
<source>PLoS One</source>
.
<year>2011</year>
;
<volume>6</volume>
(
<issue>2</issue>
):
<fpage>e17060</fpage>
<comment>doi:
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1371/journal.pone.0017060">10.1371/journal.pone.0017060</ext-link>
</comment>
PubMed PMID: ; PubMed Central PMCID: PMC3046173.
<pub-id pub-id-type="pmid">21386966</pub-id>
</mixed-citation>
</ref>
<ref id="pone.0118504.ref020">
<label>20</label>
<mixed-citation publication-type="other">Singh A, Guttag JV, editors. A comparison of non-symmetric entropy-based classification trees and support vector machine for cardiovascular risk stratification. Engineering in Medicine and Biology Society,EMBC, 2011 Annual International Conference of the IEEE; 2011 Aug. 30 2011-Sept. 3 2011.</mixed-citation>
</ref>
<ref id="pone.0118504.ref021">
<label>21</label>
<mixed-citation publication-type="journal">
<name>
<surname>Song</surname>
<given-names>T</given-names>
</name>
,
<name>
<surname>Qu</surname>
<given-names>XF</given-names>
</name>
,
<name>
<surname>Zhang</surname>
<given-names>YT</given-names>
</name>
,
<name>
<surname>Cao</surname>
<given-names>W</given-names>
</name>
,
<name>
<surname>Han</surname>
<given-names>BH</given-names>
</name>
,
<name>
<surname>Li</surname>
<given-names>Y</given-names>
</name>
,
<etal>et al</etal>
<article-title>Usefulness of the heart-rate variability complex for predicting cardiac mortality after acute myocardial infarction</article-title>
.
<source>BMC Cardiovasc Disord</source>
.
<year>2014</year>
;
<volume>14</volume>
(
<issue>1</issue>
):
<fpage>59</fpage>
<comment>doi:
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1186/1471-2261-14-59">10.1186/1471-2261-14-59</ext-link>
</comment>
PubMed PMID: ; PubMed Central PMCID: PMC4023175.
<pub-id pub-id-type="pmid">24886422</pub-id>
</mixed-citation>
</ref>
<ref id="pone.0118504.ref022">
<label>22</label>
<mixed-citation publication-type="journal">
<name>
<surname>Ebrahimzadeh</surname>
<given-names>E</given-names>
</name>
,
<name>
<surname>Pooyan</surname>
<given-names>M</given-names>
</name>
,
<name>
<surname>Bijar</surname>
<given-names>A</given-names>
</name>
.
<article-title>A novel approach to predict sudden cardiac death (SCD) using nonlinear and time-frequency analyses from HRV signals</article-title>
.
<source>PLoS One</source>
.
<year>2014</year>
;
<volume>9</volume>
(
<issue>2</issue>
):
<fpage>e81896</fpage>
<comment>doi:
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1371/journal.pone.0081896">10.1371/journal.pone.0081896</ext-link>
</comment>
PubMed PMID: ; PubMed Central PMCID: PMC3913584.
<pub-id pub-id-type="pmid">24504331</pub-id>
</mixed-citation>
</ref>
<ref id="pone.0118504.ref023">
<label>23</label>
<mixed-citation publication-type="journal">
<name>
<surname>De Luca</surname>
<given-names>N</given-names>
</name>
,
<name>
<surname>Izzo</surname>
<given-names>R</given-names>
</name>
,
<name>
<surname>Iaccarino</surname>
<given-names>G</given-names>
</name>
,
<name>
<surname>Malini</surname>
<given-names>PL</given-names>
</name>
,
<name>
<surname>Morisco</surname>
<given-names>C</given-names>
</name>
,
<name>
<surname>Rozza</surname>
<given-names>F</given-names>
</name>
,
<etal>et al</etal>
<article-title>The use of a telematic connection for the follow-up of hypertensive patients improves the cardiovascular prognosis</article-title>
.
<source>Journal of hypertension</source>
.
<year>2005</year>
;
<volume>23</volume>
(
<issue>7</issue>
):
<fpage>1417</fpage>
<lpage>23</lpage>
.
<pub-id pub-id-type="pmid">15942466</pub-id>
</mixed-citation>
</ref>
<ref id="pone.0118504.ref024">
<label>24</label>
<mixed-citation publication-type="journal">
<name>
<surname>Izzo</surname>
<given-names>R</given-names>
</name>
,
<name>
<surname>de Simone</surname>
<given-names>G</given-names>
</name>
,
<name>
<surname>Trimarco</surname>
<given-names>V</given-names>
</name>
,
<name>
<surname>Gerdts</surname>
<given-names>E</given-names>
</name>
,
<name>
<surname>Giudice</surname>
<given-names>R</given-names>
</name>
,
<name>
<surname>Vaccaro</surname>
<given-names>O</given-names>
</name>
,
<etal>et al</etal>
<article-title>Hypertensive target organ damage predicts incident diabetes mellitus</article-title>
.
<source>Eur Heart J</source>
.
<year>2013</year>
;
<volume>34</volume>
(
<issue>44</issue>
):
<fpage>3419</fpage>
<lpage>26</lpage>
.
<comment>doi:
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1093/eurheartj/eht281">10.1093/eurheartj/eht281</ext-link>
</comment>
PubMed PMID: ; PubMed Central PMCID: PMC3836008.
<pub-id pub-id-type="pmid">23882068</pub-id>
</mixed-citation>
</ref>
<ref id="pone.0118504.ref025">
<label>25</label>
<mixed-citation publication-type="journal">
<name>
<surname>Devereux</surname>
<given-names>RB</given-names>
</name>
,
<name>
<surname>Alonso</surname>
<given-names>DR</given-names>
</name>
,
<name>
<surname>Lutas</surname>
<given-names>EM</given-names>
</name>
,
<name>
<surname>Gottlieb</surname>
<given-names>GJ</given-names>
</name>
,
<name>
<surname>Campo</surname>
<given-names>E</given-names>
</name>
,
<name>
<surname>Sachs</surname>
<given-names>I</given-names>
</name>
,
<etal>et al</etal>
<article-title>Echocardiographic assessment of left ventricular hypertrophy: comparison to necropsy findings</article-title>
.
<source>Am J Cardiol</source>
.
<year>1986</year>
;
<volume>57</volume>
(
<issue>6</issue>
):
<fpage>450</fpage>
<lpage>8</lpage>
. Epub 1986/02/15. doi: 0002-9149(86)90771-X [pii]. PubMed PMID: .
<pub-id pub-id-type="pmid">2936235</pub-id>
</mixed-citation>
</ref>
<ref id="pone.0118504.ref026">
<label>26</label>
<mixed-citation publication-type="journal">
<name>
<surname>Lang</surname>
<given-names>RM</given-names>
</name>
,
<name>
<surname>Bierig</surname>
<given-names>M</given-names>
</name>
,
<name>
<surname>Devereux</surname>
<given-names>RB</given-names>
</name>
,
<name>
<surname>Flachskampf</surname>
<given-names>FA</given-names>
</name>
,
<name>
<surname>Foster</surname>
<given-names>E</given-names>
</name>
,
<name>
<surname>Pellikka</surname>
<given-names>PA</given-names>
</name>
,
<etal>et al</etal>
<article-title>Recommendations for chamber quantification: A report from the American Society of Echocardiography's guidelines and standards committee and the chamber quantification writing group, developed in conjunction with the European Association of Echocardiography, a branch of the European Society of Cardiology</article-title>
.
<source>J Am Soc Echocardiog</source>
.
<year>2005</year>
;
<volume>18</volume>
(
<issue>12</issue>
):
<fpage>1440</fpage>
<lpage>63</lpage>
.
<comment>doi:
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1016/j.echo.2005.10.005">10.1016/j.echo.2005.10.005</ext-link>
</comment>
PubMed PMID: .</mixed-citation>
</ref>
<ref id="pone.0118504.ref027">
<label>27</label>
<mixed-citation publication-type="journal">
<name>
<surname>Melillo</surname>
<given-names>P</given-names>
</name>
,
<name>
<surname>Izzo</surname>
<given-names>R</given-names>
</name>
,
<name>
<surname>Luca</surname>
<given-names>N</given-names>
</name>
,
<name>
<surname>Pecchia</surname>
<given-names>L</given-names>
</name>
.
<article-title>Heart rate variability and target organ damage in hypertensive patients</article-title>
.
<source>BMC Cardiovasc Disord</source>
.
<year>2012</year>
;
<volume>12</volume>
(
<issue>1</issue>
):
<fpage>105</fpage>
Epub 2012/11/17.
<comment>doi:
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1186/1471-2261-12-105">10.1186/1471-2261-12-105</ext-link>
</comment>
PubMed PMID: .
<pub-id pub-id-type="pmid">23153340</pub-id>
</mixed-citation>
</ref>
<ref id="pone.0118504.ref028">
<label>28</label>
<mixed-citation publication-type="journal">
<name>
<surname>Goldberger</surname>
<given-names>AL</given-names>
</name>
,
<name>
<surname>Amaral</surname>
<given-names>LAN</given-names>
</name>
,
<name>
<surname>Glass</surname>
<given-names>L</given-names>
</name>
,
<name>
<surname>Hausdorff</surname>
<given-names>JM</given-names>
</name>
,
<name>
<surname>Ivanov</surname>
<given-names>PC</given-names>
</name>
,
<name>
<surname>Mark</surname>
<given-names>RG</given-names>
</name>
,
<etal>et al</etal>
<article-title>PhysioBank, PhysioToolkit, and PhysioNet: Components of a New Research Resource for Complex Physiologic Signals</article-title>
.
<source>Circulation</source>
.
<year>2000</year>
;
<volume>101</volume>
(
<issue>23</issue>
):
<fpage>e215</fpage>
<lpage>20</lpage>
.
<pub-id pub-id-type="pmid">10851218</pub-id>
</mixed-citation>
</ref>
<ref id="pone.0118504.ref029">
<label>29</label>
<mixed-citation publication-type="book">
<name>
<surname>Zong</surname>
<given-names>W</given-names>
</name>
,
<name>
<surname>Moody</surname>
<given-names>G</given-names>
</name>
,
<name>
<surname>Jiang</surname>
<given-names>D</given-names>
</name>
, editors.
<chapter-title>A robust open-source algorithm to detect onset and duration of QRS complexes</chapter-title>
<source>Computers in Cardiology</source>
;
<year>2003</year>
:
<publisher-name>IEEE</publisher-name>
.</mixed-citation>
</ref>
<ref id="pone.0118504.ref030">
<label>30</label>
<mixed-citation publication-type="other">Xiao J, Borgnat P, Flandrin P. TESTING STATIONARITY WITH TIME-FREQUENCY SURROGATES. 2007.</mixed-citation>
</ref>
<ref id="pone.0118504.ref031">
<label>31</label>
<mixed-citation publication-type="journal">
<name>
<surname>Malik</surname>
<given-names>M</given-names>
</name>
,
<name>
<surname>Bigger</surname>
<given-names>JT</given-names>
</name>
,
<name>
<surname>Camm</surname>
<given-names>AJ</given-names>
</name>
,
<name>
<surname>Kleiger</surname>
<given-names>RE</given-names>
</name>
,
<name>
<surname>Malliani</surname>
<given-names>A</given-names>
</name>
,
<name>
<surname>Moss</surname>
<given-names>AJ</given-names>
</name>
,
<etal>et al</etal>
<article-title>Heart rate variability: Standards of measurement, physiological interpretation, and clinical use</article-title>
.
<source>Eur Heart J</source>
.
<year>1996</year>
;
<volume>17</volume>
(
<issue>3</issue>
):
<fpage>354</fpage>
<lpage>81</lpage>
.
<pub-id pub-id-type="pmid">8737210</pub-id>
</mixed-citation>
</ref>
<ref id="pone.0118504.ref032">
<label>32</label>
<mixed-citation publication-type="journal">
<name>
<surname>Clifford</surname>
<given-names>GD</given-names>
</name>
,
<name>
<surname>Tarassenko</surname>
<given-names>L</given-names>
</name>
.
<article-title>Quantifying errors in spectral estimates of HRV due to beat, replacement and resampling</article-title>
.
<source>IEEE Trans Bio Med Eng</source>
.
<year>2005</year>
;
<volume>52</volume>
(
<issue>4</issue>
):
<fpage>630</fpage>
<lpage>8</lpage>
.
<comment>doi:
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1109/Tbme.2005.844028">10.1109/Tbme.2005.844028</ext-link>
</comment>
PubMed PMID: .</mixed-citation>
</ref>
<ref id="pone.0118504.ref033">
<label>33</label>
<mixed-citation publication-type="journal">
<name>
<surname>Brennan</surname>
<given-names>M</given-names>
</name>
,
<name>
<surname>Palaniswami</surname>
<given-names>M</given-names>
</name>
,
<name>
<surname>Kamen</surname>
<given-names>P</given-names>
</name>
.
<article-title>Do existing measures of Poincare plot geometry reflect nonlinear features of heart rate variability?</article-title>
<source>IEEE Trans Bio Med Eng</source>
.
<year>2001</year>
;
<volume>48</volume>
(
<issue>11</issue>
):
<fpage>1342</fpage>
<lpage>7</lpage>
. PubMed PMID: .</mixed-citation>
</ref>
<ref id="pone.0118504.ref034">
<label>34</label>
<mixed-citation publication-type="journal">
<name>
<surname>Richman</surname>
<given-names>JS</given-names>
</name>
,
<name>
<surname>Moorman</surname>
<given-names>JR</given-names>
</name>
.
<article-title>Physiological time-series analysis using approximate entropy and sample entropy</article-title>
.
<source>American Journal of Physiology-Heart and Circulatory Physiology</source>
.
<year>2000</year>
;
<volume>278</volume>
(
<issue>6</issue>
):
<fpage>H2039</fpage>
<lpage>H49</lpage>
. PubMed PMID: .
<pub-id pub-id-type="pmid">10843903</pub-id>
</mixed-citation>
</ref>
<ref id="pone.0118504.ref035">
<label>35</label>
<mixed-citation publication-type="journal">
<name>
<surname>Lake</surname>
<given-names>DE</given-names>
</name>
,
<name>
<surname>Richman</surname>
<given-names>JS</given-names>
</name>
,
<name>
<surname>Griffin</surname>
<given-names>MP</given-names>
</name>
,
<name>
<surname>Moorman</surname>
<given-names>JR</given-names>
</name>
.
<article-title>Sample entropy analysis of neonatal heart rate variability</article-title>
.
<source>American Journal of Physiology-Regulatory, Integrative and Comparative Physiology</source>
.
<year>2002</year>
;
<volume>283</volume>
(
<issue>3</issue>
):
<fpage>R789</fpage>
<lpage>R97</lpage>
.
<pub-id pub-id-type="pmid">12185014</pub-id>
</mixed-citation>
</ref>
<ref id="pone.0118504.ref036">
<label>36</label>
<mixed-citation publication-type="journal">
<name>
<surname>Carvajal</surname>
<given-names>R</given-names>
</name>
,
<name>
<surname>Wessel</surname>
<given-names>N</given-names>
</name>
,
<name>
<surname>Vallverdú</surname>
<given-names>M</given-names>
</name>
,
<name>
<surname>Caminal</surname>
<given-names>P</given-names>
</name>
,
<name>
<surname>Voss</surname>
<given-names>A</given-names>
</name>
.
<article-title>Correlation dimension analysis of heart rate variability in patients with dilated cardiomyopathy</article-title>
.
<source>Computer Methods and Programs in Biomedicine</source>
.
<year>2005</year>
;
<volume>78</volume>
(
<issue>2</issue>
):
<fpage>133</fpage>
<lpage>40</lpage>
.
<comment>doi:
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1016/j.cmpb.2005.01.004">10.1016/j.cmpb.2005.01.004</ext-link>
</comment>
<pub-id pub-id-type="pmid">15848268</pub-id>
</mixed-citation>
</ref>
<ref id="pone.0118504.ref037">
<label>37</label>
<mixed-citation publication-type="journal">
<name>
<surname>Penzel</surname>
<given-names>T</given-names>
</name>
,
<name>
<surname>Kantelhardt</surname>
<given-names>JW</given-names>
</name>
,
<name>
<surname>Grote</surname>
<given-names>L</given-names>
</name>
,
<name>
<surname>Peter</surname>
<given-names>JH</given-names>
</name>
,
<name>
<surname>Bunde</surname>
<given-names>A</given-names>
</name>
.
<article-title>Comparison of detrended fluctuation analysis and spectral analysis for heart rate variability in sleep and sleep apnea</article-title>
.
<source>IEEE Trans Bio Med Eng</source>
.
<year>2003</year>
;
<volume>50</volume>
(
<issue>10</issue>
):
<fpage>1143</fpage>
<lpage>51</lpage>
.
<comment>doi:
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1109/Tbme.2003.817636">10.1109/Tbme.2003.817636</ext-link>
</comment>
PubMed PMID: .</mixed-citation>
</ref>
<ref id="pone.0118504.ref038">
<label>38</label>
<mixed-citation publication-type="journal">
<name>
<surname>Peng</surname>
<given-names>CK</given-names>
</name>
,
<name>
<surname>Havlin</surname>
<given-names>S</given-names>
</name>
,
<name>
<surname>Stanley</surname>
<given-names>HE</given-names>
</name>
,
<name>
<surname>Goldberger</surname>
<given-names>AL</given-names>
</name>
.
<article-title>Quantification of Scaling Exponents and Crossover Phenomena in Nonstationary Heartbeat Time-Series</article-title>
.
<source>Chaos</source>
.
<year>1995</year>
;
<volume>5</volume>
(
<issue>1</issue>
):
<fpage>82</fpage>
<lpage>7</lpage>
. PubMed PMID: .
<pub-id pub-id-type="pmid">11538314</pub-id>
</mixed-citation>
</ref>
<ref id="pone.0118504.ref039">
<label>39</label>
<mixed-citation publication-type="journal">
<name>
<surname>Trulla</surname>
<given-names>LL</given-names>
</name>
,
<name>
<surname>Giuliani</surname>
<given-names>A</given-names>
</name>
,
<name>
<surname>Zbilut</surname>
<given-names>JP</given-names>
</name>
,
<name>
<surname>Webber</surname>
<given-names>CL</given-names>
</name>
.
<article-title>Recurrence quantification analysis of the logistic equation with transients</article-title>
.
<source>Phys Lett A</source>
.
<year>1996</year>
;
<volume>223</volume>
(
<issue>4</issue>
):
<fpage>255</fpage>
<lpage>60</lpage>
. PubMed PMID: .</mixed-citation>
</ref>
<ref id="pone.0118504.ref040">
<label>40</label>
<mixed-citation publication-type="journal">
<name>
<surname>Webber</surname>
<given-names>CL</given-names>
</name>
,
<name>
<surname>Zbilut</surname>
<given-names>JP</given-names>
</name>
.
<article-title>Dynamical Assessment of Physiological Systems and States Using Recurrence Plot Strategies</article-title>
.
<source>Journal of Applied Physiology</source>
.
<year>1994</year>
;
<volume>76</volume>
(
<issue>2</issue>
):
<fpage>965</fpage>
<lpage>73</lpage>
. PubMed PMID: .
<pub-id pub-id-type="pmid">8175612</pub-id>
</mixed-citation>
</ref>
<ref id="pone.0118504.ref041">
<label>41</label>
<mixed-citation publication-type="journal">
<name>
<surname>Zbilut</surname>
<given-names>JP</given-names>
</name>
,
<name>
<surname>Thomasson</surname>
<given-names>N</given-names>
</name>
,
<name>
<surname>Webber</surname>
<given-names>CL</given-names>
</name>
.
<article-title>Recurrence quantification analysis as a tool for nonlinear exploration of nonstationary cardiac signals</article-title>
.
<source>Medical Engineering & Physics</source>
.
<year>2002</year>
;
<volume>24</volume>
(
<issue>1</issue>
):
<fpage>53</fpage>
<lpage>60</lpage>
. Pii S1350-4533(01)00112–6. PubMed PMID: .
<pub-id pub-id-type="pmid">11891140</pub-id>
</mixed-citation>
</ref>
<ref id="pone.0118504.ref042">
<label>42</label>
<mixed-citation publication-type="book">
<name>
<surname>Melillo</surname>
<given-names>P</given-names>
</name>
,
<name>
<surname>Pecchia</surname>
<given-names>L</given-names>
</name>
,
<name>
<surname>Ursino</surname>
<given-names>M</given-names>
</name>
.
<chapter-title>Nonlinear analysis research in biomedical engineering</chapter-title>
<source>Focus on Nonlinear Analysis Research</source>
:
<publisher-name>Nova Science Publishers</publisher-name>
;
<year>2013</year>
.</mixed-citation>
</ref>
<ref id="pone.0118504.ref043">
<label>43</label>
<mixed-citation publication-type="other">Ramshur J. Design, Evaluation and application of Heart rate variability software. 2010.</mixed-citation>
</ref>
<ref id="pone.0118504.ref044">
<label>44</label>
<mixed-citation publication-type="other">Liu H, Setiono R, editors. Chi2: Feature selection and discretization of numeric attributes. 2012 IEEE 24th International Conference on Tools with Artificial Intelligence; 1995: IEEE Computer Society.</mixed-citation>
</ref>
<ref id="pone.0118504.ref045">
<label>45</label>
<mixed-citation publication-type="other">Hall MA, Smith LA. Feature subset selection: a correlation based filter approach. 1997.</mixed-citation>
</ref>
<ref id="pone.0118504.ref046">
<label>46</label>
<mixed-citation publication-type="journal">
<name>
<surname>Breiman</surname>
<given-names>L</given-names>
</name>
.
<article-title>Random Forests</article-title>
.
<source>Mach Learn</source>
.
<year>2001</year>
;
<volume>45</volume>
(
<issue>1</issue>
):
<fpage>5</fpage>
<lpage>32</lpage>
.</mixed-citation>
</ref>
<ref id="pone.0118504.ref047">
<label>47</label>
<mixed-citation publication-type="journal">
<name>
<surname>Sajadieh</surname>
<given-names>A</given-names>
</name>
,
<name>
<surname>Nielsen</surname>
<given-names>OW</given-names>
</name>
,
<name>
<surname>Rasmussen</surname>
<given-names>V</given-names>
</name>
,
<name>
<surname>Hein</surname>
<given-names>HO</given-names>
</name>
,
<name>
<surname>Abedini</surname>
<given-names>S</given-names>
</name>
,
<name>
<surname>Hansen</surname>
<given-names>JF</given-names>
</name>
.
<article-title>Increased heart rate and reduced heart-rate variability are associated with subclinical inflammation in middle-aged and elderly subjects with no apparent heart disease</article-title>
.
<source>Eur Heart J</source>
.
<year>2004</year>
;
<volume>25</volume>
(
<issue>5</issue>
):
<fpage>363</fpage>
<lpage>70</lpage>
.
<comment>doi:
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1016/j.ehj.2003.12.003">10.1016/j.ehj.2003.12.003</ext-link>
</comment>
PubMed PMID: .
<pub-id pub-id-type="pmid">15033247</pub-id>
</mixed-citation>
</ref>
<ref id="pone.0118504.ref048">
<label>48</label>
<mixed-citation publication-type="other">Hillebrand S, Gast KB, de Mutsert R, Swenne CA, Jukema JW, Middeldorp S, et al. Heart rate variability and first cardiovascular event in populations without known cardiovascular disease: meta-analysis and dose–response meta-regression. Europace. 2013.
<comment>doi:
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1093/europace/eus341">10.1093/europace/eus341</ext-link>
</comment>
</mixed-citation>
</ref>
<ref id="pone.0118504.ref049">
<label>49</label>
<mixed-citation publication-type="book">
<name>
<surname>Saeys</surname>
<given-names>Y</given-names>
</name>
,
<name>
<surname>Abeel</surname>
<given-names>T</given-names>
</name>
,
<name>
<surname>Van de Peer</surname>
<given-names>Y</given-names>
</name>
.
<chapter-title>Robust feature selection using ensemble feature selection techniques</chapter-title>
<source>Machine learning and knowledge discovery in databases</source>
:
<publisher-name>Springer</publisher-name>
;
<year>2008</year>
p.
<fpage>313</fpage>
<lpage>25</lpage>
.</mixed-citation>
</ref>
<ref id="pone.0118504.ref050">
<label>50</label>
<mixed-citation publication-type="journal">
<name>
<surname>Maldonado</surname>
<given-names>S</given-names>
</name>
,
<name>
<surname>Weber</surname>
<given-names>R</given-names>
</name>
,
<name>
<surname>Basak</surname>
<given-names>J</given-names>
</name>
.
<article-title>Simultaneous feature selection and classification using kernel-penalized support vector machines</article-title>
.
<source>Information Sciences</source>
.
<year>2011</year>
;
<volume>181</volume>
(
<issue>1</issue>
):
<fpage>115</fpage>
<lpage>28</lpage>
.</mixed-citation>
</ref>
<ref id="pone.0118504.ref051">
<label>51</label>
<mixed-citation publication-type="book">
<name>
<surname>Melillo</surname>
<given-names>P</given-names>
</name>
,
<name>
<surname>Scala</surname>
<given-names>P</given-names>
</name>
,
<name>
<surname>Crispino</surname>
<given-names>F</given-names>
</name>
,
<name>
<surname>Pecchia</surname>
<given-names>L</given-names>
</name>
.
<chapter-title>Cloud-Based Remote Processing and Data-Mining Platform for Automatic Risk Assessment in Hypertensive Patients</chapter-title>
<source>Ambient Assisted Living and Daily Activities</source>
:
<publisher-name>Springer</publisher-name>
;
<year>2014</year>
p.
<fpage>155</fpage>
<lpage>62</lpage>
.</mixed-citation>
</ref>
</ref-list>
</back>
</pmc>
</record>

Pour manipuler ce document sous Unix (Dilib)

EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/TelematiV1/Data/Pmc/Corpus
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000028  | SxmlIndent | more

Ou

HfdSelect -h $EXPLOR_AREA/Data/Pmc/Corpus/biblio.hfd -nk 000028  | SxmlIndent | more

Pour mettre un lien sur cette page dans le réseau Wicri

{{Explor lien
   |wiki=    Ticri/CIDE
   |area=    TelematiV1
   |flux=    Pmc
   |étape=   Corpus
   |type=    RBID
   |clé=     
   |texte=   
}}

Wicri

This area was generated with Dilib version V0.6.31.
Data generation: Thu Nov 2 16:09:04 2017. Site generation: Sun Mar 10 16:42:28 2024