Higher Order Feature Extraction and Selection for Robust Human Gesture Recognition using CSI of COTS Wi-Fi Devices
Identifieur interne : 000281 ( Pmc/Corpus ); précédent : 000280; suivant : 000282Higher Order Feature Extraction and Selection for Robust Human Gesture Recognition using CSI of COTS Wi-Fi Devices
Auteurs : Hasmath Farhana Thariq Ahmed ; Hafisoh Ahmad ; Swee King Phang ; Chockalingam Aravind Vaithilingam ; Houda Harkat ; Kulasekharan NarasingamurthiSource :
- Sensors (Basel, Switzerland) [ 1424-8220 ] ; 2019.
Abstract
Device-free human gesture recognition (HGR) using commercial off the shelf (COTS) Wi-Fi devices has gained attention with recent advances in wireless technology. HGR recognizes the human activity performed, by capturing the reflections of Wi-Fi signals from moving humans and storing them as raw channel state information (CSI) traces. Existing work on HGR applies noise reduction and transformation to pre-process the raw CSI traces. However, these methods fail to capture the non-Gaussian information in the raw CSI data due to its limitation to deal with linear signal representation alone. The proposed higher order statistics-based recognition (HOS-Re) model extracts higher order statistical (HOS) features from raw CSI traces and selects a robust feature subset for the recognition task. HOS-Re addresses the limitations in the existing methods, by extracting third order cumulant features that maximizes the recognition accuracy. Subsequently, feature selection methods derived from information theory construct a robust and highly informative feature subset, fed as input to the multilevel support vector machine (SVM) classifier in order to measure the performance. The proposed methodology is validated using a public database SignFi, consisting of 276 gestures with 8280 gesture instances, out of which 5520 are from the laboratory and 2760 from the home environment using a 10 × 5 cross-validation. HOS-Re achieved an average recognition accuracy of 97.84%, 98.26% and 96.34% for the lab, home and lab + home environment respectively. The average recognition accuracy for 150 sign gestures with 7500 instances, collected from five different users was 96.23% in the laboratory environment.
Url:
DOI: 10.3390/s19132959
PubMed: 31277492
PubMed Central: 6651246
Links to Exploration step
PMC:6651246Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">Higher Order Feature Extraction and Selection for Robust Human Gesture Recognition using CSI of COTS Wi-Fi Devices</title>
<author><name sortKey="Farhana Thariq Ahmed, Hasmath" sort="Farhana Thariq Ahmed, Hasmath" uniqKey="Farhana Thariq Ahmed H" first="Hasmath" last="Farhana Thariq Ahmed">Hasmath Farhana Thariq Ahmed</name>
<affiliation><nlm:aff id="af1-sensors-19-02959">School of Engineering, Taylor’s University, 1, Jalan Taylor’s, Subang Jaya, Selangor 47500, Malaysia</nlm:aff>
</affiliation>
</author>
<author><name sortKey="Ahmad, Hafisoh" sort="Ahmad, Hafisoh" uniqKey="Ahmad H" first="Hafisoh" last="Ahmad">Hafisoh Ahmad</name>
<affiliation><nlm:aff id="af1-sensors-19-02959">School of Engineering, Taylor’s University, 1, Jalan Taylor’s, Subang Jaya, Selangor 47500, Malaysia</nlm:aff>
</affiliation>
</author>
<author><name sortKey="Phang, Swee King" sort="Phang, Swee King" uniqKey="Phang S" first="Swee King" last="Phang">Swee King Phang</name>
<affiliation><nlm:aff id="af1-sensors-19-02959">School of Engineering, Taylor’s University, 1, Jalan Taylor’s, Subang Jaya, Selangor 47500, Malaysia</nlm:aff>
</affiliation>
</author>
<author><name sortKey="Vaithilingam, Chockalingam Aravind" sort="Vaithilingam, Chockalingam Aravind" uniqKey="Vaithilingam C" first="Chockalingam Aravind" last="Vaithilingam">Chockalingam Aravind Vaithilingam</name>
<affiliation><nlm:aff id="af1-sensors-19-02959">School of Engineering, Taylor’s University, 1, Jalan Taylor’s, Subang Jaya, Selangor 47500, Malaysia</nlm:aff>
</affiliation>
</author>
<author><name sortKey="Harkat, Houda" sort="Harkat, Houda" uniqKey="Harkat H" first="Houda" last="Harkat">Houda Harkat</name>
<affiliation><nlm:aff id="af2-sensors-19-02959">Faculty of Sciences and Technologies, University of Sidi Mohamed Ben Abdellah, Route Imouzzer Fez, BP 2626, Fes 30000, Morocco</nlm:aff>
</affiliation>
<affiliation><nlm:aff id="af3-sensors-19-02959">Faculty of Science and Technology, University of Algarve, Campus de Gambelas, 8005-139 Faro, Portugal</nlm:aff>
</affiliation>
</author>
<author><name sortKey="Narasingamurthi, Kulasekharan" sort="Narasingamurthi, Kulasekharan" uniqKey="Narasingamurthi K" first="Kulasekharan" last="Narasingamurthi">Kulasekharan Narasingamurthi</name>
<affiliation><nlm:aff id="af4-sensors-19-02959">Simulation Metier, Valeo India Pvt Ltd., 1/396, Old Mahabalipuram Road, Navallur, Chennai, Tamil Nadu 600130, India</nlm:aff>
</affiliation>
</author>
</titleStmt>
<publicationStmt><idno type="wicri:source">PMC</idno>
<idno type="pmid">31277492</idno>
<idno type="pmc">6651246</idno>
<idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC6651246</idno>
<idno type="RBID">PMC:6651246</idno>
<idno type="doi">10.3390/s19132959</idno>
<date when="2019">2019</date>
<idno type="wicri:Area/Pmc/Corpus">000281</idno>
<idno type="wicri:explorRef" wicri:stream="Pmc" wicri:step="Corpus" wicri:corpus="PMC">000281</idno>
</publicationStmt>
<sourceDesc><biblStruct><analytic><title xml:lang="en" level="a" type="main">Higher Order Feature Extraction and Selection for Robust Human Gesture Recognition using CSI of COTS Wi-Fi Devices</title>
<author><name sortKey="Farhana Thariq Ahmed, Hasmath" sort="Farhana Thariq Ahmed, Hasmath" uniqKey="Farhana Thariq Ahmed H" first="Hasmath" last="Farhana Thariq Ahmed">Hasmath Farhana Thariq Ahmed</name>
<affiliation><nlm:aff id="af1-sensors-19-02959">School of Engineering, Taylor’s University, 1, Jalan Taylor’s, Subang Jaya, Selangor 47500, Malaysia</nlm:aff>
</affiliation>
</author>
<author><name sortKey="Ahmad, Hafisoh" sort="Ahmad, Hafisoh" uniqKey="Ahmad H" first="Hafisoh" last="Ahmad">Hafisoh Ahmad</name>
<affiliation><nlm:aff id="af1-sensors-19-02959">School of Engineering, Taylor’s University, 1, Jalan Taylor’s, Subang Jaya, Selangor 47500, Malaysia</nlm:aff>
</affiliation>
</author>
<author><name sortKey="Phang, Swee King" sort="Phang, Swee King" uniqKey="Phang S" first="Swee King" last="Phang">Swee King Phang</name>
<affiliation><nlm:aff id="af1-sensors-19-02959">School of Engineering, Taylor’s University, 1, Jalan Taylor’s, Subang Jaya, Selangor 47500, Malaysia</nlm:aff>
</affiliation>
</author>
<author><name sortKey="Vaithilingam, Chockalingam Aravind" sort="Vaithilingam, Chockalingam Aravind" uniqKey="Vaithilingam C" first="Chockalingam Aravind" last="Vaithilingam">Chockalingam Aravind Vaithilingam</name>
<affiliation><nlm:aff id="af1-sensors-19-02959">School of Engineering, Taylor’s University, 1, Jalan Taylor’s, Subang Jaya, Selangor 47500, Malaysia</nlm:aff>
</affiliation>
</author>
<author><name sortKey="Harkat, Houda" sort="Harkat, Houda" uniqKey="Harkat H" first="Houda" last="Harkat">Houda Harkat</name>
<affiliation><nlm:aff id="af2-sensors-19-02959">Faculty of Sciences and Technologies, University of Sidi Mohamed Ben Abdellah, Route Imouzzer Fez, BP 2626, Fes 30000, Morocco</nlm:aff>
</affiliation>
<affiliation><nlm:aff id="af3-sensors-19-02959">Faculty of Science and Technology, University of Algarve, Campus de Gambelas, 8005-139 Faro, Portugal</nlm:aff>
</affiliation>
</author>
<author><name sortKey="Narasingamurthi, Kulasekharan" sort="Narasingamurthi, Kulasekharan" uniqKey="Narasingamurthi K" first="Kulasekharan" last="Narasingamurthi">Kulasekharan Narasingamurthi</name>
<affiliation><nlm:aff id="af4-sensors-19-02959">Simulation Metier, Valeo India Pvt Ltd., 1/396, Old Mahabalipuram Road, Navallur, Chennai, Tamil Nadu 600130, India</nlm:aff>
</affiliation>
</author>
</analytic>
<series><title level="j">Sensors (Basel, Switzerland)</title>
<idno type="eISSN">1424-8220</idno>
<imprint><date when="2019">2019</date>
</imprint>
</series>
</biblStruct>
</sourceDesc>
</fileDesc>
<profileDesc><textClass></textClass>
</profileDesc>
</teiHeader>
<front><div type="abstract" xml:lang="en"><p>Device-free human gesture recognition (HGR) using commercial off the shelf (COTS) Wi-Fi devices has gained attention with recent advances in wireless technology. HGR recognizes the human activity performed, by capturing the reflections of Wi-Fi signals from moving humans and storing them as raw channel state information (CSI) traces. Existing work on HGR applies noise reduction and transformation to pre-process the raw CSI traces. However, these methods fail to capture the non-Gaussian information in the raw CSI data due to its limitation to deal with linear signal representation alone. The proposed higher order statistics-based recognition (HOS-Re) model extracts higher order statistical (HOS) features from raw CSI traces and selects a robust feature subset for the recognition task. HOS-Re addresses the limitations in the existing methods, by extracting third order cumulant features that maximizes the recognition accuracy. Subsequently, feature selection methods derived from information theory construct a robust and highly informative feature subset, fed as input to the multilevel support vector machine (SVM) classifier in order to measure the performance. The proposed methodology is validated using a public database SignFi, consisting of 276 gestures with 8280 gesture instances, out of which 5520 are from the laboratory and 2760 from the home environment using a 10 × 5 cross-validation. HOS-Re achieved an average recognition accuracy of 97.84%, 98.26% and 96.34% for the lab, home and lab + home environment respectively. The average recognition accuracy for 150 sign gestures with 7500 instances, collected from five different users was 96.23% in the laboratory environment.</p>
</div>
</front>
<back><div1 type="bibliography"><listBibl><biblStruct><analytic><author><name sortKey="Saini, R" uniqKey="Saini R">R. Saini</name>
</author>
<author><name sortKey="Kumar, P" uniqKey="Kumar P">P. Kumar</name>
</author>
<author><name sortKey="Roy, P P" uniqKey="Roy P">P.P. Roy</name>
</author>
<author><name sortKey="Dogra, D P" uniqKey="Dogra D">D.P. Dogra</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Kellogg, B" uniqKey="Kellogg B">B. Kellogg</name>
</author>
<author><name sortKey="Talla, V" uniqKey="Talla V">V. Talla</name>
</author>
<author><name sortKey="Gollakota, S" uniqKey="Gollakota S">S. Gollakota</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Zhao, M" uniqKey="Zhao M">M. Zhao</name>
</author>
<author><name sortKey="Adib, F" uniqKey="Adib F">F. Adib</name>
</author>
<author><name sortKey="Katabi, D" uniqKey="Katabi D">D. Katabi</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Rana, S P" uniqKey="Rana S">S.P. Rana</name>
</author>
<author><name sortKey="Dey, M" uniqKey="Dey M">M. Dey</name>
</author>
<author><name sortKey="Ghavami, M" uniqKey="Ghavami M">M. Ghavami</name>
</author>
<author><name sortKey="Dudley, S" uniqKey="Dudley S">S. Dudley</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Li, W" uniqKey="Li W">W. Li</name>
</author>
<author><name sortKey="Tan, B" uniqKey="Tan B">B. Tan</name>
</author>
<author><name sortKey="Piechocki, R J" uniqKey="Piechocki R">R.J. Piechocki</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Zeng, Y" uniqKey="Zeng Y">Y. Zeng</name>
</author>
<author><name sortKey="Pathak, P H" uniqKey="Pathak P">P.H. Pathak</name>
</author>
<author><name sortKey="Mohapatra, P" uniqKey="Mohapatra P">P. Mohapatra</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Chereshnev, R" uniqKey="Chereshnev R">R. Chereshnev</name>
</author>
<author><name sortKey="Kertesz Farkas, A" uniqKey="Kertesz Farkas A">A. Kertész-Farkas</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Yang, J" uniqKey="Yang J">J. Yang</name>
</author>
<author><name sortKey="Zou, H" uniqKey="Zou H">H. Zou</name>
</author>
<author><name sortKey="Jiang, H" uniqKey="Jiang H">H. Jiang</name>
</author>
<author><name sortKey="Xie, L" uniqKey="Xie L">L. Xie</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Lee, H" uniqKey="Lee H">H. Lee</name>
</author>
<author><name sortKey="Ahn, C R" uniqKey="Ahn C">C.R. Ahn</name>
</author>
<author><name sortKey="Choi, N" uniqKey="Choi N">N. Choi</name>
</author>
<author><name sortKey="Kim, T" uniqKey="Kim T">T. Kim</name>
</author>
<author><name sortKey="Lee, H" uniqKey="Lee H">H. Lee</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Xin, T" uniqKey="Xin T">T. Xin</name>
</author>
<author><name sortKey="Guo, B" uniqKey="Guo B">B. Guo</name>
</author>
<author><name sortKey="Wang, Z" uniqKey="Wang Z">Z. Wang</name>
</author>
<author><name sortKey="Li, M" uniqKey="Li M">M. Li</name>
</author>
<author><name sortKey="Yu, Z" uniqKey="Yu Z">Z. Yu</name>
</author>
<author><name sortKey="Zhou, X" uniqKey="Zhou X">X. Zhou</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Wang, G" uniqKey="Wang G">G. Wang</name>
</author>
<author><name sortKey="Zou, Y" uniqKey="Zou Y">Y. Zou</name>
</author>
<author><name sortKey="Zhou, Z" uniqKey="Zhou Z">Z. Zhou</name>
</author>
<author><name sortKey="Wu, K" uniqKey="Wu K">K. Wu</name>
</author>
<author><name sortKey="Ni, L M" uniqKey="Ni L">L.M. Ni</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Sun, L" uniqKey="Sun L">L. Sun</name>
</author>
<author><name sortKey="Sen, S" uniqKey="Sen S">S. Sen</name>
</author>
<author><name sortKey="Koutsonikolas, D" uniqKey="Koutsonikolas D">D. Koutsonikolas</name>
</author>
<author><name sortKey="Kim, K H" uniqKey="Kim K">K.-H. Kim</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Xiao, F" uniqKey="Xiao F">F. Xiao</name>
</author>
<author><name sortKey="Chen, J" uniqKey="Chen J">J. Chen</name>
</author>
<author><name sortKey="Xie, X H" uniqKey="Xie X">X.H. Xie</name>
</author>
<author><name sortKey="Gui, L" uniqKey="Gui L">L. Gui</name>
</author>
<author><name sortKey="Sun, J L" uniqKey="Sun J">J.L. Sun</name>
</author>
<author><name sortKey="None Ruchuan, W" uniqKey="None Ruchuan W">W. none Ruchuan</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Di Domenico, S" uniqKey="Di Domenico S">S. Di Domenico</name>
</author>
<author><name sortKey="De Sanctis, M" uniqKey="De Sanctis M">M. De Sanctis</name>
</author>
<author><name sortKey="Cianca, E" uniqKey="Cianca E">E. Cianca</name>
</author>
<author><name sortKey="Giuliano, F" uniqKey="Giuliano F">F. Giuliano</name>
</author>
<author><name sortKey="Bianchi, G" uniqKey="Bianchi G">G. Bianchi</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Ali, K" uniqKey="Ali K">K. Ali</name>
</author>
<author><name sortKey="Liu, A X" uniqKey="Liu A">A.X. Liu</name>
</author>
<author><name sortKey="Wang, W" uniqKey="Wang W">W. Wang</name>
</author>
<author><name sortKey="Shahzad, M" uniqKey="Shahzad M">M. Shahzad</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Wang, W" uniqKey="Wang W">W. Wang</name>
</author>
<author><name sortKey="Liu, A X" uniqKey="Liu A">A.X. Liu</name>
</author>
<author><name sortKey="Shahzad, M" uniqKey="Shahzad M">M. Shahzad</name>
</author>
<author><name sortKey="Ling, K" uniqKey="Ling K">K. Ling</name>
</author>
<author><name sortKey="Lu, S" uniqKey="Lu S">S. Lu</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Xu, Y" uniqKey="Xu Y">Y. Xu</name>
</author>
<author><name sortKey="Yang, W" uniqKey="Yang W">W. Yang</name>
</author>
<author><name sortKey="Wang, J" uniqKey="Wang J">J. Wang</name>
</author>
<author><name sortKey="Zhou, X" uniqKey="Zhou X">X. Zhou</name>
</author>
<author><name sortKey="Li, H" uniqKey="Li H">H. Li</name>
</author>
<author><name sortKey="Huang, L" uniqKey="Huang L">L. Huang</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Dang, X" uniqKey="Dang X">X. Dang</name>
</author>
<author><name sortKey="Si, X" uniqKey="Si X">X. Si</name>
</author>
<author><name sortKey="Hao, Z" uniqKey="Hao Z">Z. Hao</name>
</author>
<author><name sortKey="Huang, Y" uniqKey="Huang Y">Y. Huang</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Zhuo, Y" uniqKey="Zhuo Y">Y. Zhuo</name>
</author>
<author><name sortKey="Zhu, H" uniqKey="Zhu H">H. Zhu</name>
</author>
<author><name sortKey="Xue, H" uniqKey="Xue H">H. Xue</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Battiti, R" uniqKey="Battiti R">R. Battiti</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Peng, H" uniqKey="Peng H">H. Peng</name>
</author>
<author><name sortKey="Long, F" uniqKey="Long F">F. Long</name>
</author>
<author><name sortKey="Ding, C" uniqKey="Ding C">C. Ding</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Nguyen, X V" uniqKey="Nguyen X">X.V. Nguyen</name>
</author>
<author><name sortKey="Chan, J" uniqKey="Chan J">J. Chan</name>
</author>
<author><name sortKey="Romano, S" uniqKey="Romano S">S. Romano</name>
</author>
<author><name sortKey="Bailey, J" uniqKey="Bailey J">J. Bailey</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Lin, D" uniqKey="Lin D">D. Lin</name>
</author>
<author><name sortKey="Tang, X" uniqKey="Tang X">X. Tang</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Yang, H" uniqKey="Yang H">H. Yang</name>
</author>
<author><name sortKey="Moody, J" uniqKey="Moody J">J. Moody</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Fleuret, F" uniqKey="Fleuret F">F. Fleuret</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Meyer, P E" uniqKey="Meyer P">P.E. Meyer</name>
</author>
<author><name sortKey="Bontempi, G" uniqKey="Bontempi G">G. Bontempi</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Jakulin, A" uniqKey="Jakulin A">A. Jakulin</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Brown, G" uniqKey="Brown G">G. Brown</name>
</author>
<author><name sortKey="Pocock, A" uniqKey="Pocock A">A. Pocock</name>
</author>
<author><name sortKey="Zhao, M J" uniqKey="Zhao M">M.-J. Zhao</name>
</author>
<author><name sortKey="Lujan, M" uniqKey="Lujan M">M. Luján</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Ma, Y" uniqKey="Ma Y">Y. Ma</name>
</author>
<author><name sortKey="Zhou, G" uniqKey="Zhou G">G. Zhou</name>
</author>
<author><name sortKey="Wang, S" uniqKey="Wang S">S. Wang</name>
</author>
<author><name sortKey="Zhao, H" uniqKey="Zhao H">H. Zhao</name>
</author>
<author><name sortKey="Jung, W" uniqKey="Jung W">W. Jung</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Kanokoda, T" uniqKey="Kanokoda T">T. Kanokoda</name>
</author>
<author><name sortKey="Kushitani, Y" uniqKey="Kushitani Y">Y. Kushitani</name>
</author>
<author><name sortKey="Shimada, M" uniqKey="Shimada M">M. Shimada</name>
</author>
<author><name sortKey="Shirakashi, J I" uniqKey="Shirakashi J">J.-I. Shirakashi</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Shukor, A Z" uniqKey="Shukor A">A.Z. Shukor</name>
</author>
<author><name sortKey="Miskon, M F" uniqKey="Miskon M">M.F. Miskon</name>
</author>
<author><name sortKey="Jamaluddin, M H" uniqKey="Jamaluddin M">M.H. Jamaluddin</name>
</author>
<author><name sortKey="Bin Ali, F" uniqKey="Bin Ali F">F. bin Ali</name>
</author>
<author><name sortKey="Asyraf, M F" uniqKey="Asyraf M">M.F. Asyraf</name>
</author>
<author><name sortKey="Bin Bahar, M B" uniqKey="Bin Bahar M">M.B. bin Bahar</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Goswami, P" uniqKey="Goswami P">P. Goswami</name>
</author>
<author><name sortKey="Rao, S" uniqKey="Rao S">S. Rao</name>
</author>
<author><name sortKey="Bharadwaj, S" uniqKey="Bharadwaj S">S. Bharadwaj</name>
</author>
<author><name sortKey="Nguyen, A" uniqKey="Nguyen A">A. Nguyen</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Tan, S" uniqKey="Tan S">S. Tan</name>
</author>
<author><name sortKey="Yang, J" uniqKey="Yang J">J. Yang</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Abdelnasser, H" uniqKey="Abdelnasser H">H. Abdelnasser</name>
</author>
<author><name sortKey="Youssef, M" uniqKey="Youssef M">M. Youssef</name>
</author>
<author><name sortKey="Harras, K A" uniqKey="Harras K">K.A. Harras</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Wang, H" uniqKey="Wang H">H. Wang</name>
</author>
<author><name sortKey="Zhang, D" uniqKey="Zhang D">D. Zhang</name>
</author>
<author><name sortKey="Wang, Y" uniqKey="Wang Y">Y. Wang</name>
</author>
<author><name sortKey="Ma, J" uniqKey="Ma J">J. Ma</name>
</author>
<author><name sortKey="Wang, Y" uniqKey="Wang Y">Y. Wang</name>
</author>
<author><name sortKey="Li, S" uniqKey="Li S">S. Li</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Al Qaness, M A A" uniqKey="Al Qaness M">M.A.A. Al-qaness</name>
</author>
<author><name sortKey="Li, F" uniqKey="Li F">F. Li</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Tian, Z" uniqKey="Tian Z">Z. Tian</name>
</author>
<author><name sortKey="Wang, J" uniqKey="Wang J">J. Wang</name>
</author>
<author><name sortKey="Yang, X" uniqKey="Yang X">X. Yang</name>
</author>
<author><name sortKey="Zhou, M" uniqKey="Zhou M">M. Zhou</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Zhang, O" uniqKey="Zhang O">O. Zhang</name>
</author>
<author><name sortKey="Srinivasan, K" uniqKey="Srinivasan K">K. Srinivasan</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Zhou, R" uniqKey="Zhou R">R. Zhou</name>
</author>
<author><name sortKey="Lu, X" uniqKey="Lu X">X. Lu</name>
</author>
<author><name sortKey="Zhao, P" uniqKey="Zhao P">P. Zhao</name>
</author>
<author><name sortKey="Chen, J" uniqKey="Chen J">J. Chen</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Hong, F" uniqKey="Hong F">F. Hong</name>
</author>
<author><name sortKey="Wang, X" uniqKey="Wang X">X. Wang</name>
</author>
<author><name sortKey="Yang, Y" uniqKey="Yang Y">Y. Yang</name>
</author>
<author><name sortKey="Zong, Y" uniqKey="Zong Y">Y. Zong</name>
</author>
<author><name sortKey="Zhang, Y" uniqKey="Zhang Y">Y. Zhang</name>
</author>
<author><name sortKey="Guo, Z" uniqKey="Guo Z">Z. Guo</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Zhao, J" uniqKey="Zhao J">J. Zhao</name>
</author>
<author><name sortKey="Liu, L" uniqKey="Liu L">L. Liu</name>
</author>
<author><name sortKey="Wei, Z" uniqKey="Wei Z">Z. Wei</name>
</author>
<author><name sortKey="Zhang, C" uniqKey="Zhang C">C. Zhang</name>
</author>
<author><name sortKey="Wang, W" uniqKey="Wang W">W. Wang</name>
</author>
<author><name sortKey="Fan, Y" uniqKey="Fan Y">Y. Fan</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Zhu, H" uniqKey="Zhu H">H. Zhu</name>
</author>
<author><name sortKey="Xiao, F" uniqKey="Xiao F">F. Xiao</name>
</author>
<author><name sortKey="Sun, L" uniqKey="Sun L">L. Sun</name>
</author>
<author><name sortKey="Wang, R" uniqKey="Wang R">R. Wang</name>
</author>
<author><name sortKey="Yang, P" uniqKey="Yang P">P. Yang</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Palipana, S" uniqKey="Palipana S">S. Palipana</name>
</author>
<author><name sortKey="Rojas, D" uniqKey="Rojas D">D. Rojas</name>
</author>
<author><name sortKey="Agrawal, P" uniqKey="Agrawal P">P. Agrawal</name>
</author>
<author><name sortKey="Pesch, D" uniqKey="Pesch D">D. Pesch</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Jia, W" uniqKey="Jia W">W. Jia</name>
</author>
<author><name sortKey="Peng, H" uniqKey="Peng H">H. Peng</name>
</author>
<author><name sortKey="Ruan, N" uniqKey="Ruan N">N. Ruan</name>
</author>
<author><name sortKey="Tang, Z" uniqKey="Tang Z">Z. Tang</name>
</author>
<author><name sortKey="Zhao, W" uniqKey="Zhao W">W. Zhao</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Zhang, Z" uniqKey="Zhang Z">Z. Zhang</name>
</author>
<author><name sortKey="Ishida, S" uniqKey="Ishida S">S. Ishida</name>
</author>
<author><name sortKey="Tagashira, S" uniqKey="Tagashira S">S. Tagashira</name>
</author>
<author><name sortKey="Fukuda, A" uniqKey="Fukuda A">A. Fukuda</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Fang, B" uniqKey="Fang B">B. Fang</name>
</author>
<author><name sortKey="Lane, N D" uniqKey="Lane N">N.D. Lane</name>
</author>
<author><name sortKey="Zhang, M" uniqKey="Zhang M">M. Zhang</name>
</author>
<author><name sortKey="Boran, A" uniqKey="Boran A">A. Boran</name>
</author>
<author><name sortKey="Kawsar, F" uniqKey="Kawsar F">F. Kawsar</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Gong, L" uniqKey="Gong L">L. Gong</name>
</author>
<author><name sortKey="Yang, W" uniqKey="Yang W">W. Yang</name>
</author>
<author><name sortKey="Man, D" uniqKey="Man D">D. Man</name>
</author>
<author><name sortKey="Dong, G" uniqKey="Dong G">G. Dong</name>
</author>
<author><name sortKey="Yu, M" uniqKey="Yu M">M. Yu</name>
</author>
<author><name sortKey="Lv, J" uniqKey="Lv J">J. Lv</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Gong, L" uniqKey="Gong L">L. Gong</name>
</author>
<author><name sortKey="Yang, W" uniqKey="Yang W">W. Yang</name>
</author>
<author><name sortKey="Zhou, Z" uniqKey="Zhou Z">Z. Zhou</name>
</author>
<author><name sortKey="Man, D" uniqKey="Man D">D. Man</name>
</author>
<author><name sortKey="Cai, H" uniqKey="Cai H">H. Cai</name>
</author>
<author><name sortKey="Zhou, X" uniqKey="Zhou X">X. Zhou</name>
</author>
<author><name sortKey="Yang, Z" uniqKey="Yang Z">Z. Yang</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Gao, Q" uniqKey="Gao Q">Q. Gao</name>
</author>
<author><name sortKey="Wang, J" uniqKey="Wang J">J. Wang</name>
</author>
<author><name sortKey="Ma, X" uniqKey="Ma X">X. Ma</name>
</author>
<author><name sortKey="Feng, X" uniqKey="Feng X">X. Feng</name>
</author>
<author><name sortKey="Wang, H" uniqKey="Wang H">H. Wang</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Wang, W" uniqKey="Wang W">W. Wang</name>
</author>
<author><name sortKey="Chen, Y" uniqKey="Chen Y">Y. Chen</name>
</author>
<author><name sortKey="Zhang, Q" uniqKey="Zhang Q">Q. Zhang</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Wang, Y" uniqKey="Wang Y">Y. Wang</name>
</author>
<author><name sortKey="Jiang, X" uniqKey="Jiang X">X. Jiang</name>
</author>
<author><name sortKey="Cao, R" uniqKey="Cao R">R. Cao</name>
</author>
<author><name sortKey="Wang, X" uniqKey="Wang X">X. Wang</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Zhang, J" uniqKey="Zhang J">J. Zhang</name>
</author>
<author><name sortKey="Wei, B" uniqKey="Wei B">B. Wei</name>
</author>
<author><name sortKey="Hu, W" uniqKey="Hu W">W. Hu</name>
</author>
<author><name sortKey="Kanhere, S S" uniqKey="Kanhere S">S.S. Kanhere</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Cover, T M" uniqKey="Cover T">T.M. Cover</name>
</author>
<author><name sortKey="Thomas, J A" uniqKey="Thomas J">J.A. Thomas</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="De Sanctis, M" uniqKey="De Sanctis M">M. De Sanctis</name>
</author>
<author><name sortKey="Cianca, E" uniqKey="Cianca E">E. Cianca</name>
</author>
<author><name sortKey="Di Domenico, S" uniqKey="Di Domenico S">S. Di Domenico</name>
</author>
<author><name sortKey="Provenziani, D" uniqKey="Provenziani D">D. Provenziani</name>
</author>
<author><name sortKey="Bianchi, G" uniqKey="Bianchi G">G. Bianchi</name>
</author>
<author><name sortKey="Ruggieri, M" uniqKey="Ruggieri M">M. Ruggieri</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Mendel, J M" uniqKey="Mendel J">J.M. Mendel</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Swami, A" uniqKey="Swami A">A. Swami</name>
</author>
<author><name sortKey="Mendel, J M" uniqKey="Mendel J">J.M. Mendel</name>
</author>
<author><name sortKey="Nikias, C L" uniqKey="Nikias C">C.L. Nikias</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Chang, C C" uniqKey="Chang C">C.-C. Chang</name>
</author>
<author><name sortKey="Lin, C J" uniqKey="Lin C">C.-J. Lin</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Caselli, N K" uniqKey="Caselli N">N.K. Caselli</name>
</author>
<author><name sortKey="Sehyr, Z S" uniqKey="Sehyr Z">Z.S. Sehyr</name>
</author>
<author><name sortKey="Cohen Goldberg, A M" uniqKey="Cohen Goldberg A">A.M. Cohen-Goldberg</name>
</author>
<author><name sortKey="Emmorey, K" uniqKey="Emmorey K">K. Emmorey</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Halperin, D" uniqKey="Halperin D">D. Halperin</name>
</author>
<author><name sortKey="Hu, W" uniqKey="Hu W">W. Hu</name>
</author>
<author><name sortKey="Sheth, A" uniqKey="Sheth A">A. Sheth</name>
</author>
<author><name sortKey="Wetherall, D" uniqKey="Wetherall D">D. Wetherall</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Kumar, S" uniqKey="Kumar S">S. Kumar</name>
</author>
<author><name sortKey="Cifuentes, D" uniqKey="Cifuentes D">D. Cifuentes</name>
</author>
<author><name sortKey="Gollakota, S" uniqKey="Gollakota S">S. Gollakota</name>
</author>
<author><name sortKey="Katabi, D" uniqKey="Katabi D">D. Katabi</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Harkat, H" uniqKey="Harkat H">H. Harkat</name>
</author>
<author><name sortKey="Ruano, A" uniqKey="Ruano A">A. Ruano</name>
</author>
<author><name sortKey="Ruano, M" uniqKey="Ruano M">M. Ruano</name>
</author>
<author><name sortKey="Bennani, S" uniqKey="Bennani S">S. Bennani</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Hoque, N" uniqKey="Hoque N">N. Hoque</name>
</author>
<author><name sortKey="Bhattacharyya, D K" uniqKey="Bhattacharyya D">D.K. Bhattacharyya</name>
</author>
<author><name sortKey="Kalita, J K" uniqKey="Kalita J">J.K. Kalita</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Mariello, A" uniqKey="Mariello A">A. Mariello</name>
</author>
<author><name sortKey="Battiti, R" uniqKey="Battiti R">R. Battiti</name>
</author>
</analytic>
</biblStruct>
</listBibl>
</div1>
</back>
</TEI>
<pmc article-type="research-article"><pmc-dir>properties open_access</pmc-dir>
<front><journal-meta><journal-id journal-id-type="nlm-ta">Sensors (Basel)</journal-id>
<journal-id journal-id-type="iso-abbrev">Sensors (Basel)</journal-id>
<journal-id journal-id-type="publisher-id">sensors</journal-id>
<journal-title-group><journal-title>Sensors (Basel, Switzerland)</journal-title>
</journal-title-group>
<issn pub-type="epub">1424-8220</issn>
<publisher><publisher-name>MDPI</publisher-name>
</publisher>
</journal-meta>
<article-meta><article-id pub-id-type="pmid">31277492</article-id>
<article-id pub-id-type="pmc">6651246</article-id>
<article-id pub-id-type="doi">10.3390/s19132959</article-id>
<article-id pub-id-type="publisher-id">sensors-19-02959</article-id>
<article-categories><subj-group subj-group-type="heading"><subject>Article</subject>
</subj-group>
</article-categories>
<title-group><article-title>Higher Order Feature Extraction and Selection for Robust Human Gesture Recognition using CSI of COTS Wi-Fi Devices</article-title>
</title-group>
<contrib-group><contrib contrib-type="author"><name><surname>Farhana Thariq Ahmed</surname>
<given-names>Hasmath</given-names>
</name>
<xref ref-type="aff" rid="af1-sensors-19-02959">1</xref>
</contrib>
<contrib contrib-type="author"><name><surname>Ahmad</surname>
<given-names>Hafisoh</given-names>
</name>
<xref ref-type="aff" rid="af1-sensors-19-02959">1</xref>
<xref rid="c1-sensors-19-02959" ref-type="corresp">*</xref>
</contrib>
<contrib contrib-type="author"><contrib-id contrib-id-type="orcid" authenticated="true">https://orcid.org/0000-0002-7877-8766</contrib-id>
<name><surname>Phang</surname>
<given-names>Swee King</given-names>
</name>
<xref ref-type="aff" rid="af1-sensors-19-02959">1</xref>
</contrib>
<contrib contrib-type="author"><name><surname>Vaithilingam</surname>
<given-names>Chockalingam Aravind</given-names>
</name>
<xref ref-type="aff" rid="af1-sensors-19-02959">1</xref>
</contrib>
<contrib contrib-type="author"><contrib-id contrib-id-type="orcid" authenticated="true">https://orcid.org/0000-0002-7827-1527</contrib-id>
<name><surname>Harkat</surname>
<given-names>Houda</given-names>
</name>
<xref ref-type="aff" rid="af2-sensors-19-02959">2</xref>
<xref ref-type="aff" rid="af3-sensors-19-02959">3</xref>
</contrib>
<contrib contrib-type="author"><contrib-id contrib-id-type="orcid" authenticated="true">https://orcid.org/0000-0001-7919-7229</contrib-id>
<name><surname>Narasingamurthi</surname>
<given-names>Kulasekharan</given-names>
</name>
<xref ref-type="aff" rid="af4-sensors-19-02959">4</xref>
</contrib>
</contrib-group>
<aff id="af1-sensors-19-02959"><label>1</label>
School of Engineering, Taylor’s University, 1, Jalan Taylor’s, Subang Jaya, Selangor 47500, Malaysia</aff>
<aff id="af2-sensors-19-02959"><label>2</label>
Faculty of Sciences and Technologies, University of Sidi Mohamed Ben Abdellah, Route Imouzzer Fez, BP 2626, Fes 30000, Morocco</aff>
<aff id="af3-sensors-19-02959"><label>3</label>
Faculty of Science and Technology, University of Algarve, Campus de Gambelas, 8005-139 Faro, Portugal</aff>
<aff id="af4-sensors-19-02959"><label>4</label>
Simulation Metier, Valeo India Pvt Ltd., 1/396, Old Mahabalipuram Road, Navallur, Chennai, Tamil Nadu 600130, India</aff>
<author-notes><corresp id="c1-sensors-19-02959"><label>*</label>
Correspondence: <email>Hafisoh.Ahmad@taylors.edu.my</email>
; Tel.: +6-013-296-3400</corresp>
</author-notes>
<pub-date pub-type="epub"><day>04</day>
<month>7</month>
<year>2019</year>
</pub-date>
<pub-date pub-type="collection"><month>7</month>
<year>2019</year>
</pub-date>
<volume>19</volume>
<issue>13</issue>
<elocation-id>2959</elocation-id>
<history><date date-type="received"><day>07</day>
<month>5</month>
<year>2019</year>
</date>
<date date-type="accepted"><day>25</day>
<month>6</month>
<year>2019</year>
</date>
</history>
<permissions><copyright-statement>© 2019 by the authors.</copyright-statement>
<copyright-year>2019</copyright-year>
<license license-type="open-access"><license-p>Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (<ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/licenses/by/4.0/">http://creativecommons.org/licenses/by/4.0/</ext-link>
).</license-p>
</license>
</permissions>
<abstract><p>Device-free human gesture recognition (HGR) using commercial off the shelf (COTS) Wi-Fi devices has gained attention with recent advances in wireless technology. HGR recognizes the human activity performed, by capturing the reflections of Wi-Fi signals from moving humans and storing them as raw channel state information (CSI) traces. Existing work on HGR applies noise reduction and transformation to pre-process the raw CSI traces. However, these methods fail to capture the non-Gaussian information in the raw CSI data due to its limitation to deal with linear signal representation alone. The proposed higher order statistics-based recognition (HOS-Re) model extracts higher order statistical (HOS) features from raw CSI traces and selects a robust feature subset for the recognition task. HOS-Re addresses the limitations in the existing methods, by extracting third order cumulant features that maximizes the recognition accuracy. Subsequently, feature selection methods derived from information theory construct a robust and highly informative feature subset, fed as input to the multilevel support vector machine (SVM) classifier in order to measure the performance. The proposed methodology is validated using a public database SignFi, consisting of 276 gestures with 8280 gesture instances, out of which 5520 are from the laboratory and 2760 from the home environment using a 10 × 5 cross-validation. HOS-Re achieved an average recognition accuracy of 97.84%, 98.26% and 96.34% for the lab, home and lab + home environment respectively. The average recognition accuracy for 150 sign gestures with 7500 instances, collected from five different users was 96.23% in the laboratory environment.</p>
</abstract>
<kwd-group><kwd>gesture recognition</kwd>
<kwd>CSI</kwd>
<kwd>Wi-Fi</kwd>
<kwd>HOS</kwd>
<kwd>cumulants</kwd>
<kwd>mutual information</kwd>
<kwd>SVM</kwd>
</kwd-group>
</article-meta>
</front>
<body><sec sec-type="intro" id="sec1-sensors-19-02959"><title>1. Introduction</title>
<p>Device-free sensing implements human gesture recognition (HGR) using optical sensors [<xref rid="B1-sensors-19-02959" ref-type="bibr">1</xref>
], radio frequency (RF) [<xref rid="B2-sensors-19-02959" ref-type="bibr">2</xref>
,<xref rid="B3-sensors-19-02959" ref-type="bibr">3</xref>
] or ultra-wide bandwidth (UWB) [<xref rid="B4-sensors-19-02959" ref-type="bibr">4</xref>
] signals to achieve a higher gesture recognition accuracy. However, HGR using commercial off the shelf (COTS) Wi-Fi devices attracts significant research interest as it preserves privacy, is easy to deploy, low cost and readily available in an indoor environment. Wi-Fi based HGR systems capture signal reflections due to human movements between the transmitter and receiver pair as raw CSI traces. It has a wide range of application in the field of surveillance [<xref rid="B5-sensors-19-02959" ref-type="bibr">5</xref>
], physical analytics [<xref rid="B6-sensors-19-02959" ref-type="bibr">6</xref>
], healthcare [<xref rid="B7-sensors-19-02959" ref-type="bibr">7</xref>
] and have become a potential study in the smart home environment [<xref rid="B8-sensors-19-02959" ref-type="bibr">8</xref>
,<xref rid="B9-sensors-19-02959" ref-type="bibr">9</xref>
]. It is evident that the following factors, namely the number of users [<xref rid="B10-sensors-19-02959" ref-type="bibr">10</xref>
] and access point (AP) [<xref rid="B11-sensors-19-02959" ref-type="bibr">11</xref>
], orientation and distance between the users, as well as the transmitter and receiver pair [<xref rid="B12-sensors-19-02959" ref-type="bibr">12</xref>
,<xref rid="B13-sensors-19-02959" ref-type="bibr">13</xref>
], environmental factors [<xref rid="B14-sensors-19-02959" ref-type="bibr">14</xref>
], interferences, and multipath fading effect in the sensing environment influence the recognition accuracy [<xref rid="B15-sensors-19-02959" ref-type="bibr">15</xref>
].</p>
<p>Extensive researches were reported for feature extraction and selection, as it has a high impact on recognition accuracy of learning algorithms. Most of the existing recognition systems use Principal Component Analysis (PCA), a popular feature extraction technique to extract the principal components from the signal. For example, a CSI-based human activity recognition and monitoring system (CARM) [<xref rid="B16-sensors-19-02959" ref-type="bibr">16</xref>
] uses PCA for feature extraction and achieves a classification accuracy of 96% for eight different activities. The gesture recognition task initially acquires raw CSI traces of human reflections in subcarrier level with the implementation of the 802.11n standard in COTS Wi-Fi devices. The raw CSI traces consist of high-frequency noise and represents non-Gaussian signal distribution. Therefore, existing sensing methods pre-process the raw signal to reduce noise and apply transformations for unwrapping raw CSI measurement that reveals the phase change of the signal. The noise reduction phase mainly removes the phase offset, with outliers using the regression and filtering technique to de-noise the high-frequency signal. Fast fourier transform (FFT), inverse fast fourier transform (IFFT) and discrete wavelet transform (DWT) are the widely used signal transformation techniques for performing a linear transformation on the de-noised signal [<xref rid="B17-sensors-19-02959" ref-type="bibr">17</xref>
]. This pre-processed signal is of use in many applications that detect and locate human targets using CSI traces [<xref rid="B18-sensors-19-02959" ref-type="bibr">18</xref>
]. However, it pays little attention to addressing the linear phase error that prevails in CSI measurement, due to hardware limitations [<xref rid="B19-sensors-19-02959" ref-type="bibr">19</xref>
]. Ignoring useful information, such as the non-linear characteristic of the signal, will consequently affect the recognition accuracy in the later stage. Gesture recognition generally uses two approaches, namely deep learning (DL) and machine learning (ML). Recently, the research direction has migrated from traditional ML approaches to a DL approach, as DL methods report higher recognition accuracy. However, DL approaches demands a high volume of data for auto feature selection and better recognition accuracy and have a poor interpretation of data. Conversely, ML approaches can achieve satisfactory recognition accuracy even with a relatively lesser sample size but relies on the quality of hand-crafted features.</p>
<p>The limitations of the existing studies motivate the proposed work to study the non-Gaussian signal distribution with non-linearity, which carries useful signal information. The present work Higher Order Statistics based Recognition (HOS-Re) adopts a machine learning approach and proposes a HOS based third order cumulant feature extraction to maximize the recognition accuracy. The complexity of the classification model of the ML classifier increases with the number of feature inputs. Hence the present approach implements optimal feature selection methods that enable the machine learning algorithm to get trained faster and interpret the results easier by reducing the model complexity. Furthermore, it reduces overfitting and improves the accuracy of the model by mapping CSI traces to the ground truth values and by a selection of a robust subset of cumulant features. The idea proposed in the present work differs from the state-of-the-art method as it uses feature selection methods derived from information theory. Feature selection methods include mutual information feature selection (MIFS) [<xref rid="B20-sensors-19-02959" ref-type="bibr">20</xref>
], minimum-redundancy maximum-relevancy (mRMR) [<xref rid="B21-sensors-19-02959" ref-type="bibr">21</xref>
,<xref rid="B22-sensors-19-02959" ref-type="bibr">22</xref>
], conditional informative feature extraction (CIFE) [<xref rid="B23-sensors-19-02959" ref-type="bibr">23</xref>
], joint mutual information (JMI) [<xref rid="B24-sensors-19-02959" ref-type="bibr">24</xref>
], conditional mutual information maximization (CMIM) [<xref rid="B25-sensors-19-02959" ref-type="bibr">25</xref>
], double input symmetrical relevance (DISR) [<xref rid="B26-sensors-19-02959" ref-type="bibr">26</xref>
], interaction capping (ICAP) [<xref rid="B27-sensors-19-02959" ref-type="bibr">27</xref>
] and conditional redundancy (CONDRED) [<xref rid="B28-sensors-19-02959" ref-type="bibr">28</xref>
]. HOS-Re uses a secondary dataset, SignFi [<xref rid="B29-sensors-19-02959" ref-type="bibr">29</xref>
] for validating the proposed methodology. SignFi adopts a convolution neural network (CNN) [<xref rid="B29-sensors-19-02959" ref-type="bibr">29</xref>
] to measure the recognition accuracy. HOS-Re adopts multilevel support vector machine classifier that uses gaussian radial basis function (RBF) kernel.</p>
<p>In summary, the contribution of the paper is as follows:<list list-type="order"><list-item><p>This paper proposes a HOS-based third order cumulant feature extraction from raw CSI traces and applies various feature selection methods derived from information theory, which effectively extracts and selects a robust feature subset considering the non-Gaussian signal distribution.</p>
</list-item>
<list-item><p>HOS-Re measures the recognition performance using an ML classifier with feature inputs from feature selection methods. The experiment explores most of the mutual information based feature selection methods on cumulant features and identifies methods having higher recognition accuracy.</p>
</list-item>
<list-item><p>To the best of our knowledge, this is the first reported work to use the combination of cumulant features + feature selection method for machine learning in the HGR domain using CSI traces and achieve significant performance.</p>
</list-item>
</list>
</p>
<p>In the remainder of the paper, <xref ref-type="sec" rid="sec2-sensors-19-02959">Section 2</xref>
reviews the related work; <xref ref-type="sec" rid="sec3-sensors-19-02959">Section 3</xref>
provides the preliminaries of this work. <xref ref-type="sec" rid="sec4-sensors-19-02959">Section 4</xref>
gives an overview of the system under study, and details on feature extraction, selection, and classification. <xref ref-type="sec" rid="sec5-sensors-19-02959">Section 5</xref>
discusses the implementation of the proposed methodology and evaluates the performance of HGR, and <xref ref-type="sec" rid="sec6-sensors-19-02959">Section 6</xref>
concludes the discussion on HGR.</p>
</sec>
<sec id="sec2-sensors-19-02959"><title>2. Related Work</title>
<p>Hand gesture recognition is an emerging research topic, especially for interpreting the sign language communication of people with speech and hearing challenges. The related works on gesture recognition are broadly classified under two major categories: (i) device-based gesture recognition and (ii) device free gesture recognition. Device-based gesture recognition widely uses wearable sensors like data gloves to capture hand gestures in order to interpret sign language [<xref rid="B30-sensors-19-02959" ref-type="bibr">30</xref>
,<xref rid="B31-sensors-19-02959" ref-type="bibr">31</xref>
]. However, device-free gesture recognition leverages signals of the commercial hardware devices for the gesture recognition task. These systems are categorized as: radar-based [<xref rid="B32-sensors-19-02959" ref-type="bibr">32</xref>
], RSSI [<xref rid="B33-sensors-19-02959" ref-type="bibr">33</xref>
,<xref rid="B34-sensors-19-02959" ref-type="bibr">34</xref>
] and CSI-based [<xref rid="B15-sensors-19-02959" ref-type="bibr">15</xref>
,<xref rid="B35-sensors-19-02959" ref-type="bibr">35</xref>
].</p>
<p>CSI is of interest as it helps to produce better action recognition accuracy since it consists of both amplitude and phase information. It provides fine-grained signal information in subcarrier level, which has widespread application in the field of computer vision. WiGer [<xref rid="B36-sensors-19-02959" ref-type="bibr">36</xref>
] adopts DWT for recognizing hand gestures in 5 different scenarios and achieves an average accuracy of 97.28%, 91.8%, 95.5%, 94.4% and 91% respectively. WiCatch [<xref rid="B37-sensors-19-02959" ref-type="bibr">37</xref>
] rebuilds the trajectories of the of nine moving hand gestures and achieves a recognition accuracy of 96% using SVM. WiFinger [<xref rid="B33-sensors-19-02959" ref-type="bibr">33</xref>
] recognizes eight different finger gestures with an average accuracy of 95% using PCA and DTW. WiKey [<xref rid="B15-sensors-19-02959" ref-type="bibr">15</xref>
] recognizes the keystroke of 37 keys of the keyboard using CSI with an accuracy of 77.4% to 93.4% with 30 and 80 samples per key respectively using PCA and DWT based feature extraction. Mudra [<xref rid="B38-sensors-19-02959" ref-type="bibr">38</xref>
] recognizes seven different finger gestures using a modified DTW algorithm with 96% accuracy.</p>
<p>State of the art CSI based sensing uses two major approaches: (i) using pre-processed CSI signals and (ii) using raw CSI signals. This section also discusses some of the works that adopt feature selection mechanisms.</p>
<sec id="sec2dot1-sensors-19-02959"><title>2.1. Pre-Processed CSI Signals</title>
<p>Zhou et al. [<xref rid="B39-sensors-19-02959" ref-type="bibr">39</xref>
] uses PCA and achieves more than 97% detection accuracy with a localization error of 1.22 m and 1.39 m in a lab and meeting room environment using SVM. WFID [<xref rid="B40-sensors-19-02959" ref-type="bibr">40</xref>
] also applies PCA to uniquely identify humans from groups of nine and six people, and achieves an accuracy of 91.9% and 93.1% respectively with SVM. R-DEHM [<xref rid="B41-sensors-19-02959" ref-type="bibr">41</xref>
] achieves 94% accuracy in detecting human movements with an average error rate of 8% for duration estimation by implementing a back propagation neural network (BPNN) algorithm on principal components of CSI. R-TTWD [<xref rid="B42-sensors-19-02959" ref-type="bibr">42</xref>
] applies the majority vote algorithm on PCA based features to identify the presence and absence of human movement using one class SVM with true positive >99%. FallDeFi [<xref rid="B43-sensors-19-02959" ref-type="bibr">43</xref>
], a fall detection system achieves an accuracy of 93% and close to 80% in a pre-trained and new environment using PCA and SVM. WiFind [<xref rid="B44-sensors-19-02959" ref-type="bibr">44</xref>
] uses PCA based Hilbert-Hung Transform (HHT) to extract features for detecting the fatigue level of drivers and achieves accuracy of 89.6% and 73.9% for a single driver and multi-passenger, respectively, with one class SVM. Danger-pose detection system [<xref rid="B45-sensors-19-02959" ref-type="bibr">45</xref>
], detects a danger pose in the bathroom environment with an average accuracy of 96.23% using SVM as an anomaly detection algorithm. BodyScan [<xref rid="B46-sensors-19-02959" ref-type="bibr">46</xref>
] computes PSD from PCA features to recognize activities and detect breathing rates with 72.5% and 97.4% accuracy, respectively.</p>
</sec>
<sec id="sec2dot2-sensors-19-02959"><title>2.2. Raw CSI Signals</title>
<p>Few studies build a model-based recognition system that achieves better classification without signal pre-processing. For example, fine-grained real-time passive human detection, FRID [<xref rid="B47-sensors-19-02959" ref-type="bibr">47</xref>
], system computes the coefficient of temporal phase variation from the phase sensitivity due to human motion and detect the passive human motion with 90% precision. Gong et al. [<xref rid="B48-sensors-19-02959" ref-type="bibr">48</xref>
] proposed a threshold prediction model using Rician fading and the computation of cross-correlation factors to detect a human presence with a false positive and negative less than 4% and 5%, respectively. Gao et al. [<xref rid="B49-sensors-19-02959" ref-type="bibr">49</xref>
] proposed a deep learning model for implementing a device free wireless localization and activity recognition (DFLR) system using a sparse auto-encoder neural network. DFLR achieves recognition accuracy of 90% for eight different activities by transforming the CSI information as an image feature to the deep learning network. PriLA [<xref rid="B50-sensors-19-02959" ref-type="bibr">50</xref>
], the privacy preserving location authentication system, proposed a model exploiting the channel frequency offset and multipath information as the detrimental features and achieves an accuracy of 93.2% for authenticating user’s location information.</p>
</sec>
<sec id="sec2dot3-sensors-19-02959"><title>2.3. Feature Selection</title>
<p>This section reports some of the works that adopt feature selection paradigm. Wang et al. [<xref rid="B51-sensors-19-02959" ref-type="bibr">51</xref>
] used forward and backward feature selection to reduce the original 24 features obtained from the statistical data into 14 features. The feature selection with SVM reported better recognition accuracy as the selected features reveal the most useful information. WiHear [<xref rid="B11-sensors-19-02959" ref-type="bibr">11</xref>
] applies the multi-cluster/class feature selection (MCFS) algorithm to extract the optimal feature subset from the wavelet features. WiFi-ID [<xref rid="B52-sensors-19-02959" ref-type="bibr">52</xref>
] uses a combination of feature selection algorithm (relief) and sparse approximation-based classification (SAC) to extract the optimal feature subset and recognize the individual human subject.</p>
</sec>
</sec>
<sec id="sec3-sensors-19-02959"><title>3. Preliminaries</title>
<p>This section comprehensively discusses the basic concepts that are used in the proposed work.</p>
<sec id="sec3dot1-sensors-19-02959"><title>3.1. Channel State Information (CSI)</title>
<p>CSI value reveals the channel properties of the communication link. Since the wireless medium is unstable and channel conditions may vary from time-to-time, channel estimation keeps changing on a short-term basis. COTS Wi-Fi devices following 802.11n standards work with orthogonal frequency division multiplexing (OFDM), achieve increased data rates, improved capacity, and reduced bit error rate (BER) of the system. Also, devices starting from IEEE 802.11n support multiple input multiple output (MIMO) with the OFDM scheme, enabling them to send and receive information over multiple antennas, as shown in <xref ref-type="fig" rid="sensors-19-02959-f001">Figure 1</xref>
. The OFDM extracts the channel frequency response in the format of CSI, which contains both amplitude and phase information of the signal in subcarrier level, enabling the sensing to be more accurate. The CSI values at the transmitter and the receiver end may vary, and the data acquisition depends on how rapidly the channel conditions change. Therefore, the channel conditions highly influence the data acquisition of CSI traces and the instantaneous values need to be estimated in the receiver end on a short-term basis.</p>
<p>CSI contains information such as hardware timestamp, frame counter, number of receiving and transmitting antennas, received signal strength indicator (RSSI) of each antenna, noise, automatic gain control, amplitude, and phase information of the subcarriers in the form of a complex matrix. Among the information above, RSSI and CSI gain research interest in device free sensing methods. However, CSI is more preferred than RSSI, as RSSI does not provide the phase information. Equation (1) represents the received signal, which consists of signal information of the sender and the channel frequency response (CFR) with noise.
<disp-formula id="FD1-sensors-19-02959"><label>(1)</label>
<mml:math id="mm1"><mml:mrow><mml:mrow><mml:mi>R</mml:mi>
<mml:mfenced><mml:mrow><mml:mi>f</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>t</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mo>=</mml:mo>
<mml:mi>H</mml:mi>
<mml:mfenced><mml:mrow><mml:mi>f</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>t</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mo> </mml:mo>
<mml:mi>X</mml:mi>
<mml:mo> </mml:mo>
<mml:mi>T</mml:mi>
<mml:mfenced><mml:mrow><mml:mi>f</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>t</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mo>+</mml:mo>
<mml:mi>N</mml:mi>
<mml:mo>,</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:math>
</disp-formula>
where <italic>R(f, t)</italic>
is the received signal strength of carrier frequency <italic>f</italic>
measured at a time <italic>t</italic>
; <italic>H(f, t)</italic>
is the CSI in the form of CFR for carrier frequency <italic>f</italic>
measured at a time <italic>t</italic>
; <italic>T(f, t)</italic>
is the transmitter signal strength for carrier frequency f measured at a time t and <italic>N</italic>
is the noise. COTS Wi-Fi devices capture the varying signal characteristics of human reflections in the line of sight (LoS) or non-line of sight (NLoS) path between the COTS Wi-Fi device (Router) and AP’s (Laptop with Intel 5300 NIC) in the format of CSI, as shown in <xref ref-type="fig" rid="sensors-19-02959-f002">Figure 2</xref>
. Wi-Fi signals from the transmitter get reflected from the floor, side walls, the ceiling, and objects in the confined experimental space.</p>
</sec>
<sec id="sec3dot2-sensors-19-02959"><title>3.2. Higher Order Cumulants</title>
<p>First and second order statistics have limitations to handle the non-Gaussian signal distribution, which may reveal some useful information contained in the signal. However, HOS addresses such a limitation by extracting higher-order cumulant information, and computes the unbiased estimate of variables. </p>
<p>Let us consider a moment generating function <inline-formula><mml:math id="mm2"><mml:mrow><mml:mrow><mml:mi>m</mml:mi>
<mml:msub><mml:mi>g</mml:mi>
<mml:mi>X</mml:mi>
</mml:msub>
<mml:mfenced><mml:mi>i</mml:mi>
</mml:mfenced>
</mml:mrow>
</mml:mrow>
</mml:math>
</inline-formula>
exists for the variable <italic>X</italic>
, whenever the statistical expectation, <inline-formula><mml:math id="mm3"><mml:mrow><mml:mrow><mml:mi>E</mml:mi>
<mml:mfenced close="}" open="{"><mml:mrow><mml:msup><mml:mi>e</mml:mi>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mi>X</mml:mi>
</mml:mrow>
</mml:msup>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:mrow>
</mml:math>
</inline-formula>
exists, <italic>i</italic>
<inline-formula><mml:math id="mm4"><mml:mrow><mml:mo>∈</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula>
R. Therefore, the function <inline-formula><mml:math id="mm5"><mml:mrow><mml:mrow><mml:msub><mml:mi>g</mml:mi>
<mml:mi>X</mml:mi>
</mml:msub>
<mml:mfenced><mml:mi>i</mml:mi>
</mml:mfenced>
</mml:mrow>
</mml:mrow>
</mml:math>
</inline-formula>
can derive the first, second, third and fourth order moments, <italic>g</italic>
<sub>1</sub>
, <italic>g</italic>
<sub>2</sub>
, <italic>g</italic>
<sub>3</sub>
, <italic>g</italic>
<sub>4</sub>
as <disp-formula><italic>mg</italic>
<sub>1</sub>
<italic>x</italic>
= <italic>E</italic>
[<italic>X</italic>
(<italic>i</italic>
)]<break></break>
<italic>mg</italic>
<sub>2</sub>
<italic>x</italic>
(<italic>τ</italic>
<sub>1</sub>
) = <italic>E</italic>
[<italic>X</italic>
(<italic>i</italic>
) <italic>X</italic>
(<italic>i</italic>
+ <italic>τ</italic>
<sub>1</sub>
)]<break></break>
<italic>mg</italic>
<sub>3</sub>
<italic>x</italic>
(<italic>τ</italic>
<sub>1</sub>
, <italic>τ</italic>
<sub>2</sub>
) = <italic>E</italic>
[<italic>X</italic>
(<italic>i</italic>
) <italic>X</italic>
(<italic>i</italic>
+ <italic>τ</italic>
<sub>1</sub>
) <italic>X</italic>
(<italic>i</italic>
+ <italic>τ</italic>
<sub>2</sub>
)]<break></break>
<italic>mg</italic>
<sub>4</sub>
<italic>x</italic>
(<italic>τ</italic>
<sub>1</sub>
, <italic>τ</italic>
<sub>2</sub>
, <italic>τ</italic>
<sub>3</sub>
) = <italic>E</italic>
[<italic>X</italic>
(<italic>i</italic>
) <italic>X</italic>
(<italic>i</italic>
+ <italic>τ</italic>
<sub>1</sub>
) <italic>X</italic>
(<italic>i</italic>
+ <italic>τ</italic>
<sub>2</sub>
) <italic>X</italic>
(<italic>i</italic>
+ <italic>τ</italic>
<sub>3</sub>
)]
<label>(2)</label>
</disp-formula>
Let <italic>τ</italic>
<sub>1</sub>
, <italic>τ</italic>
<sub>2</sub>
, <italic>τ</italic>
<sub>3</sub>
are the time lag parameters and let {<italic>x</italic>
(<italic>τ</italic>
)} be a <italic>n</italic>
th order stationary random process, the <italic>n</italic>
th order moment is the joint moments of orders up to <italic>n</italic>
− 1 which is defined as:<disp-formula><italic>mg<sub>n</sub>
</italic>
<italic>x</italic>
(<italic>ττ</italic>
<sub>1</sub>
, <italic>τ</italic>
<sub>2</sub>
, <italic>τ</italic>
<sub>3</sub>
, …, <italic>τ</italic>
<sub><italic>n</italic>
−1</sub>
) = <italic>E</italic>
[<italic>X</italic>
(<italic>i</italic>
) <italic>X</italic>
(<italic>i</italic>
+ <italic>τ</italic>
<sub>1</sub>
) <italic>X</italic>
(<italic>i</italic>
+ <italic>τ</italic>
<sub>2</sub>
) <italic>X</italic>
(<italic>i</italic>
+ <italic>τ</italic>
<sub>3</sub>
) … <italic>X</italic>
(<italic>i</italic>
+ <italic>τ</italic>
<sub><italic>n</italic>
−1</sub>
)]
<label>(3)</label>
</disp-formula>
</p>
<p>The corresponding non-zero mean cumulants <italic>C</italic>
<sub>1</sub>
<italic>x</italic>
, <italic>C</italic>
<sub>2</sub>
<italic>x</italic>
, <italic>C</italic>
<sub>3</sub>
<italic>x</italic>
and <italic>C</italic>
<sub>4</sub>
<italic>x</italic>
can be computed as the non-linear combination of the moments as,<disp-formula><italic>C</italic>
<sub>1</sub>
<italic>x</italic>
= <italic>mg</italic>
<sub>1</sub>
<italic>x</italic>
<break></break>
<italic>C</italic>
<sub>2</sub>
<italic>x</italic>
(<italic>τ</italic>
<sub>1</sub>
) = <italic>mg</italic>
<sub>2</sub>
<italic>x</italic>
(<italic>τ</italic>
<sub>1</sub>
)<break></break>
<italic>C</italic>
<sub>3</sub>
<italic>x</italic>
(<italic>τ</italic>
<sub>1</sub>
, <italic>τ</italic>
<sub>2</sub>
) =<italic>mg</italic>
<sub>3</sub>
<italic>x</italic>
(<italic>τ</italic>
<sub>1</sub>
, <italic>τ</italic>
<sub>2</sub>
)<break></break>
<italic>C</italic>
<sub>4</sub>
<italic>x</italic>
(<italic>τ</italic>
<sub>1</sub>
, <italic>τ</italic>
<sub>2</sub>
, <italic>τ</italic>
<sub>3</sub>
) = <italic>mg</italic>
<sub>4</sub>
<italic>x</italic>
(<italic>τ</italic>
<sub>1</sub>
, <italic>τ</italic>
<sub>2</sub>
, <italic>τ</italic>
<sub>3</sub>
) − <italic>mg</italic>
<sub>2</sub>
<italic>x</italic>
(<italic>τ</italic>
<sub>1</sub>
) <italic>mg</italic>
<sub>2</sub>
<italic>x</italic>
(<italic>τ</italic>
<sub>2</sub>
− <italic>τ</italic>
<sub>3</sub>
) − <italic>mg</italic>
<sub>2</sub>
<italic>x</italic>
(<italic>τ</italic>
<sub>2</sub>
) <italic>mg</italic>
<sub>2</sub>
<italic>x</italic>
(<italic>τ</italic>
<sub>3</sub>
− <italic>τ</italic>
<sub>1</sub>
) − <italic>mg</italic>
<sub>2</sub>
<italic>x</italic>
(<italic>τ</italic>
<sub>3</sub>
) <italic>mg</italic>
<sub>2</sub>
<italic>x</italic>
(<italic>τ</italic>
<sub>1</sub>
− <italic>τ</italic>
<sub>2</sub>
),
<label>(4)</label>
</disp-formula>
and the <italic>n</italic>
th order cumulant is derived using the <italic>n</italic>
th order moment as:<disp-formula><italic>C<sub>n</sub>
x</italic>
(<italic>τ</italic>
<sub>1</sub>
, <italic>τ</italic>
<sub>2</sub>
, <italic>τ</italic>
<sub>3</sub>
, ⋯,<italic>τ</italic>
<sub><italic>n</italic>
−1</sub>
) = <italic>mg<sub>n</sub>
x</italic>
(<italic>τ</italic>
<sub>1</sub>
, <italic>τ</italic>
<sub>2</sub>
, <italic>τ</italic>
<sub>3</sub>
, ⋯, <italic>τ</italic>
<sub><italic>n</italic>
−1</sub>
) – <italic>mg<sub>GN</sub>
x</italic>
(<italic>τ</italic>
<sub>1</sub>
, <italic>τ</italic>
<sub>2</sub>
, <italic>τ</italic>
<sub>3</sub>
, ⋯, <italic>τ</italic>
<sub><italic>n</italic>
−1</sub>
),
<label>(5)</label>
</disp-formula>
where, <italic>mg<sub>n</sub>
x</italic>
(<italic>τ</italic>
<sub>1</sub>
, <italic>τ</italic>
<sub>2</sub>
, <italic>τ</italic>
<sub>3</sub>
, ⋯,<italic>τ</italic>
<sub><italic>n</italic>
−1</sub>
) is the <italic>n</italic>
th order moment and <italic>mg<sub>GN</sub>
x</italic>
(<italic>τ</italic>
<sub>1</sub>
, <italic>τ</italic>
<sub>2</sub>
, <italic>τ</italic>
<sub>3</sub>
, ⋯,<italic>τ</italic>
<sub><italic>n</italic>
−1</sub>
) is the <italic>n</italic>
th order moment of the corresponding Gaussian process. The first order cumulant is the mean of the process while the second order cumulant is the autocovariance sequence, and the third is designed as the third central moment. The zero lag cumulants have special names: <italic>C<sub>2</sub>
x(0)</italic>
is the variance, <italic>C<sub>3</sub>
x(0, 0)</italic>
is the skewness and <italic>C<sub>4</sub>
x(0, 0, 0)</italic>
is the kurtosis. Third-order cumulants are preferred to extract the features from the raw CSI signal without applying any pre-processing. Fourth order cumulants build highly complex matrices, need huge computational efforts, and do not justify the recognition accuracy benefit over the efforts involved. Hence it is not considered in the present work. </p>
</sec>
<sec id="sec3dot3-sensors-19-02959"><title>3.3. Feature Selection</title>
<p>Information theory feature selection algorithms measure the randomness of the feature <italic>F</italic>
through entropy. The higher the entropy, the higher the uncertainty, which makes the feature become less informative. Feature selection methods derived from information theory measure the mutual information that exists between the features to reduce the uncertainty and select only the highly informative features [<xref rid="B53-sensors-19-02959" ref-type="bibr">53</xref>
]. The proposed work explores various feature selection algorithms using mutual information as relationship measure for computing a robust feature subset. The optimal feature subset will serve as the input to the machine learning classifier.</p>
</sec>
</sec>
<sec id="sec4-sensors-19-02959"><title>4. System Overview—HOS–Re</title>
<p>The proposed work emphasizes the use of non-linear behavior of raw CSI traces using a HOS cumulant approach. <xref ref-type="fig" rid="sensors-19-02959-f003">Figure 3</xref>
shows the schematic representation of the proposed HOS-Re methodology. The experimentation setup extracts the CSI values for the gestures performed by the users and stores the corresponding raw data with appropriate labelling to form a dataset. The presently proposed methodology extracts the higher order cumulant features from the raw CSI dataset using computational experiments. The feature selection step reduces the dimensionality of the extracted features and computes a robust set of best features. This feature subset will serve as a rationale input to the machine learning classifier and measure the performance of the system.</p>
<p><xref ref-type="fig" rid="sensors-19-02959-f004">Figure 4</xref>
shows the detailed HOS-Re methodology adopted in the present work. <xref ref-type="fig" rid="sensors-19-02959-f004">Figure 4</xref>
a shows that HOS extracts a set of third order cumulant features <italic>F<sub>n</sub>
</italic>
from raw CSI traces, as explained in <xref ref-type="sec" rid="sec4dot1-sensors-19-02959">Section 4.1</xref>
. Information theory feature selection methods select a robust feature subset containing <italic>k</italic>
mutually informative cumulant features from the extracted features <italic>F<sub>n</sub>
</italic>
as shown in <xref ref-type="fig" rid="sensors-19-02959-f004">Figure 4</xref>
b. The values <italic>F<sub>a</sub>
</italic>
, <italic>F<sub>b</sub>
</italic>
, and <italic>F<sub>c</sub>
</italic>
, are chosen experimentally by feature selection algorithms to show the influence of feature subset on recognition, accuracy will be discussed in <xref ref-type="sec" rid="sec4dot2-sensors-19-02959">Section 4.2</xref>
. The optimal subset of cumulant features serves as input to the ML classifier as in <xref ref-type="fig" rid="sensors-19-02959-f004">Figure 4</xref>
c. The parameters are experimentally optimized in the classification step to estimate the recognition accuracy, as discussed in <xref ref-type="sec" rid="sec4dot3-sensors-19-02959">Section 4.3</xref>
.</p>
<sec id="sec4dot1-sensors-19-02959"><title>4.1. Feature Extraction</title>
<p>SignFi dataset is acquired in a scenario where background noises, signal interferences, and reflections exist in the presence of other Wi-Fi signals. Signal pre-processing techniques were deployed in most of the reported work, for improved recognition accuracy. When the signals are not pre-processed, accuracy declines. A statistical metric like power spectral density (PSD) [<xref rid="B46-sensors-19-02959" ref-type="bibr">46</xref>
,<xref rid="B54-sensors-19-02959" ref-type="bibr">54</xref>
] derived from the first and second order statistical moments, do not deal with the non-Gaussian signal distributions. The present work addresses this limitation by introducing third-order cumulant estimates for feature extraction and exploits useful signal information from the non-Gaussian distribution. Furthermore, third order cumulants consider amplitude, phase information, boost the signal to noise ratio (SNR) [<xref rid="B55-sensors-19-02959" ref-type="bibr">55</xref>
] and improve the recognition accuracy even without applying any pre-processing methods. Also, cumulant features are robust to background noises and signal interferences; hence, it is used in the present work. This section discusses third-order cumulant feature extraction from raw CSI traces in order to achieve better classification accuracy. </p>
<sec><title>Third Order Cumulants</title>
<p>HOS third order cumulant features are extracted from the raw CSI traces of the dataset with the assumptions that the statistical estimates are unbiased. <xref ref-type="fig" rid="sensors-19-02959-f005">Figure 5</xref>
shows the process of cumulant feature extraction. CSI data extraction from Wi-Fi signals needs a number of transmitting channels (<italic>N<sub>t</sub>
</italic>
) and receiving channel (<italic>N</italic>
<sub>r</sub>
). The receiving channel collects CSI measurements for the chosen sub carriers (<italic>N<sub>s</sub>
</italic>
), with a specific number of CSI samples per gesture.</p>
<p>The present work extracts 11 coefficients of the third order cumulant feature (<italic>F</italic>
<sub>1</sub>
to <italic>F</italic>
<sub>11</sub>
,⋯, <italic>F</italic>
<sub><italic>n</italic>
−11</sub>
to <italic>F<sub>n</sub>
</italic>
) from <italic>N<sub>t</sub>
</italic>
channels having <italic>N<sub>s</sub>
</italic>
subcarriers per channel. Thus, a total of <italic>F<sub>n</sub>
</italic>
cumulant features (= 11 × <italic>N<sub>t</sub>
</italic>
× <italic>N<sub>s</sub>
</italic>
) were extracted. Finally, the <italic>n</italic>
th record of the cumulant feature removes the sample mean and stores only the unbiased sample estimates of cumulants, as discussed in <xref ref-type="sec" rid="sec3dot2-sensors-19-02959">Section 3.2</xref>
. HOS-Re uses higher order spectral analysis (HOSA) toolbox integrated with MATLAB [<xref rid="B56-sensors-19-02959" ref-type="bibr">56</xref>
] for extracting the third order cumulant features.</p>
</sec>
</sec>
<sec id="sec4dot2-sensors-19-02959"><title>4.2. Feature Selection</title>
<p>The HOS-Re extracts cumulant features from the raw CSI data. However, the recognition task with <italic>F<sub>n</sub>
</italic>
cumulant features is time-consuming and computationally expensive. In such a case, adopting a proper feature selection method simplifies the complexity of the recognition task by reducing the total number of cumulant features to form an optimal subset of features, as explained in <xref ref-type="sec" rid="sec3dot3-sensors-19-02959">Section 3.3</xref>
. Information theory feature selection algorithms like MIFS, mRMR, CIFE, JMI, CMIM, DISR, ICAP, and CONDRED helps in reducing the <italic>F<sub>n</sub>
</italic>
cumulant features to <italic>k</italic>
selected indices of feature subset based on mutual information. The feature selection criteria in the proposed work limit the feature size <italic>k</italic>
as 30, 50 and 80 cumulant features to make it serve as well-grounded input to the multi-level SVM classifier to reduce the training time and complexity. The three values adopted in the present study are chosen from the experience gained in conducting some experimental runs to assess the performance of the present methodology. The results proved that if the set of the selected features is less than 30, the given accuracy drops significantly. When <italic>k</italic>
is higher than 80, the recognition accuracy is stable with a marginal increase in recognition accuracy beyond <italic>k</italic>
= 80, but the designed model becomes very complex. The ML classifier measures the performance of feature selection algorithms and identifies the best algorithm based on the recognition accuracy. HOS-Re implements feature selection algorithms, using feature selection toolbox (FEAST) integrated with MATLAB [<xref rid="B28-sensors-19-02959" ref-type="bibr">28</xref>
].</p>
</sec>
<sec id="sec4dot3-sensors-19-02959"><title>4.3. Human Gesture Recognition</title>
<p>The recognition task performed using an SVM with Gaussian RBF can non-linearly map samples into a higher dimensional space, unlike other linear kernels. The regularization parameter (C and γ) influences the classification performance of a non-linear SVM with Gaussian RBF kernel. C and γ are the parameters for a nonlinear SVM, which influences the accuracy and cost parameter of the resulting SVM model. SVM classifier is trained and tested with combinations of regularization parameter C and γ {0.003, 0.01, 0.03, 0.1, 0.3, 1, 3, 10, 30, 100 and 300} and validates the results using 10 × 5 cross-validation to find the optimal value of γ. The repeated cross-validation allows robust model assessment and reduces the variation in the model prediction to a greater extent. Experiments conducted using non repeated cross validation had shown that for some datasets, the results are completely unstable. When using a five cross-validation repeated five times, the results were found to be not very stable. Hence, a five cross-validation repeated 10 times is adopted in the present work. Multilevel SVM classifier with Gaussian RBF performs the multi-class classification problem using the feature subset of feature selection criteria. SVM partitions 80% of samples for training and 20% for testing. HOS-Re uses the library for support vector machine (LIBSVM) [<xref rid="B57-sensors-19-02959" ref-type="bibr">57</xref>
] package, which supports multiclass classification.</p>
</sec>
</sec>
<sec id="sec5-sensors-19-02959"><title>5. Implementation and Evaluation</title>
<p>This section discusses the implementation of the proposed methodology and performance evaluation of various feature selection method on the dataset identified from the literature. The present work uses raw CSI traces of the SignFi dataset [<xref rid="B29-sensors-19-02959" ref-type="bibr">29</xref>
] where the gesture movements refer to American Sign Language, ASL-LEX database [<xref rid="B58-sensors-19-02959" ref-type="bibr">58</xref>
], and the authors manually added labels for gestures that are not present in the database. </p>
<sec id="sec5dot1-sensors-19-02959"><title>5.1. SignFi Dataset</title>
<p>The authors of SignFi dataset [<xref rid="B29-sensors-19-02959" ref-type="bibr">29</xref>
] have captured the raw CSI measurements for 276 sign gesture with 20 and 10 instances for each gesture in the laboratory (lab) and home environments. The SignFi [<xref rid="B29-sensors-19-02959" ref-type="bibr">29</xref>
] dataset is chosen as the reference dataset for the present work, as this is the only dataset containing CSI traces with 276 gestures and a larger number of gesture samples with greater clarity in data acquisition. Hence, it is considered as the most promising dataset to implement our proposed methodology. There are 8280 gesture instances, 5520 from the lab and 2760 from the home, for 276 sign gestures in total from 1 user. Experiments also performed to capture CSI traces from 5 different users in the lab environment for 7500 instances of 150 sign gestures. </p>
<p>The setting of the lab and home environment used for the measurement as reported in [<xref rid="B29-sensors-19-02959" ref-type="bibr">29</xref>
] is shown in <xref ref-type="fig" rid="sensors-19-02959-f006">Figure 6</xref>
, and the description of the lab and home environments is reproduced here for immediate reference. The lab has more surrounding objects, leading to a more complex multi-path environment than the home. The distance between the Wi-Fi transmitter (AP) and receiver (STA) is 230 cm and 130 cm respectively, for the lab and home environment. For the home environment, the transmit antenna array is orthogonal to the direction from the transmitter to receiver. For the lab environment, the angle between the transmitter antenna array and the direct path is about 40 degrees. The major differences of these two environments are (1) dimension of the room, (2) distance between the transmitter and receiver, (3) angle between the transmit antenna array and the direct path, and (4) multi-path environments.</p>
<p><xref rid="sensors-19-02959-t001" ref-type="table">Table 1</xref>
shows a part of the full gesture labels representation of the SignFi dataset [<xref rid="B29-sensors-19-02959" ref-type="bibr">29</xref>
]. The raw CSI traces of the gestures were extracted using 802.11n CSI tool [<xref rid="B59-sensors-19-02959" ref-type="bibr">59</xref>
] in openrf [<xref rid="B60-sensors-19-02959" ref-type="bibr">60</xref>
] environment, with two Intel 5300 network interface card (NIC) equipped laptops. One laptop (AP) with three external antennas works as a transmitter (<italic>N<sub>t</sub>
</italic>
= 3), and another laptop with one internal antenna acts as a receiver (<italic>N<sub>r</sub>
</italic>
= 1) for data acquisition. Both transmitter and receiver operate at 5 GHz, with the channel width of 20 MHz in the Non-Line of Sight (NLoS) scenario. However, the 802.11n CSI tool [<xref rid="B59-sensors-19-02959" ref-type="bibr">59</xref>
] extracts the signal information for first 30 subcarriers (<italic>N<sub>S</sub>
</italic>
= 30) only, out of 52 subcarriers available, with 200 CSI samples per gesture. Interested readers are recommended to refer the SignFi [<xref rid="B29-sensors-19-02959" ref-type="bibr">29</xref>
] paper for more insight about data acquisition and experimental setup.</p>
</sec>
<sec id="sec5dot2-sensors-19-02959"><title>5.2. Cumulant Feature Extraction</title>
<p>HOS third order cumulant features extracted from the raw CSI traces of the SignFi dataset assumes statistical estimates are unbiased. The process of cumulant feature extraction shown in <xref ref-type="fig" rid="sensors-19-02959-f007">Figure 7</xref>
, extracts the cumulants as feature vector. As explained earlier, the SignFi dataset based on Wi-Fi CSI signals deploys one transmitter with three internal antennae (<italic>N<sub>t</sub>
</italic>
= 3), one receiver (<italic>N<sub>r</sub>
</italic>
= 1) and collected 200 samples per gesture from 30 subcarriers (<italic>N<sub>s</sub>
</italic>
= 30).</p>
<p>HOS-Re, extracts 11 cumulant features (<italic>F</italic>
<sub>1</sub>
<italic>to F</italic>
<sub>11</sub>
, …, <italic>F</italic>
<sub>331</sub>
<italic>to F</italic>
<sub>341</sub>
, …, <italic>F</italic>
<sub>661</sub>
<italic>to F</italic>
<sub>671</sub>
, …, <italic>F</italic>
<sub>980</sub>
<italic>to F</italic>
<sub>990</sub>
) from 3 channels having 30 subcarriers per channel; thus a feature vector of 990 cumulant features (11 × 3 × 30 = 990) were extracted. Similar features were extracted from the dataset, which consists of 7,500 instances from five different users for 150 gestures with 200 CSI samples per gesture. Finally, the nth record of the cumulant feature removes the sample mean and stores only the unbiased sample estimates of cumulants, as discussed in <xref ref-type="sec" rid="sec3dot2-sensors-19-02959">Section 3.2</xref>
. The total number of cumulant features extracted (990) should be optimally reduced based on certain feature selection criteria, to reduce the computational complexity.</p>
<p>The contours in <xref ref-type="fig" rid="sensors-19-02959-f008">Figure 8</xref>
a–d shows 2D plots of the estimated third order unbiased cumulants, between the first-time lag and the second time lag. The plot for chosen gestures ‘HORSE’, ‘MONKEY’, ‘SNAKE’, ‘TIGER’ with overlapping segments, reveals the basic symmetry of the gestures. The time lag variable discussed in Equation (4), <xref ref-type="sec" rid="sec3dot2-sensors-19-02959">Section 3.2</xref>
, with the variable maxlag set to 10 for revealing the basic symmetry in the plots.</p>
</sec>
<sec id="sec5dot3-sensors-19-02959"><title>5.3. Feature Selection</title>
<p>As mentioned in <xref ref-type="sec" rid="sec4dot2-sensors-19-02959">Section 4.2</xref>
, several feature selection methods evaluated in the present study selects the feature indices <italic>k</italic>
(30, 50 or 80) experimentally, to show the influence of sample size on accuracy. The feature selection algorithms that use mutual information as a relationship measure are explained in <xref rid="sensors-19-02959-t002" ref-type="table">Table 2</xref>
. Among the different feature selection algorithms evaluated, MIFS and CIFE are explained in the following section as they achieve better recognition accuracy and the details are discussed in the subsequent sections.</p>
<sec id="sec5dot3dot1-sensors-19-02959"><title>5.3.1. MIFS</title>
<p>MIFS [<xref rid="B20-sensors-19-02959" ref-type="bibr">20</xref>
], a greedy feature selection approach, measures the mutual information between the candidate features and the output class, which reduces the uncertainty of preserving the useful information. This reduced feature subset serves as an optimal feature subset for the multi-class classification problem. MIFS is advantageous over linear transform dependent methods as it considers the non-linear relationship within the features and that between the features and the output gesture class. Therefore, MIFS provides a good generalization for the training and reduces the computational time. MIFS ensures that every selected feature is an informative one as follows: <list list-type="order"><list-item><p>Set CF ← Initial ‘n’ cumulant features (<italic>Fn</italic>
CF), S ← Empty set</p>
</list-item>
<list-item><p>For each cf ∈ CF, compute MI (GC; cf)</p>
<p>(Compute mutual information, MI for every individual feature ‘cf’ that belong to the output gesture class ‘GC’)</p>
</list-item>
<list-item><p>Find the cf that maximizes MI (GC; cf)<list list-type="alpha-lower"><list-item><p>Set CF ← CF\{cf}; Set S ← {cf}</p>
</list-item>
</list>
</p>
</list-item>
<list-item><p>Greedy selection repeats until |S| = <italic>k</italic>
(where, <italic>k</italic>
= 30/50/80)<list list-type="alpha-lower"><list-item><p>Computation of MI between CF:</p>
<p>for all pair of variables (cf, s) with cf ∈ CF, s ∈ S. Compute I(cf, s), if it is not already available</p>
</list-item>
<list-item><p>Selection of next CF:</p>
<p>Choose feature cf as the one that maximizes I(GC; cf) – β <inline-formula><mml:math id="mm6"><mml:mrow><mml:mrow><mml:msub><mml:mstyle mathsize="70%" displaystyle="true"><mml:mo>∑</mml:mo>
</mml:mstyle>
<mml:mrow><mml:mrow><mml:mi mathvariant="normal">s</mml:mi>
<mml:mo>∈</mml:mo>
<mml:mi mathvariant="normal">S</mml:mi>
</mml:mrow>
</mml:mrow>
</mml:msub>
<mml:mrow><mml:mi mathvariant="normal">I</mml:mi>
<mml:mo> </mml:mo>
</mml:mrow>
<mml:mfenced><mml:mrow><mml:mi>cf</mml:mi>
<mml:mo>;</mml:mo>
<mml:mi mathvariant="normal">s</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:mrow>
</mml:math>
</inline-formula>
</p>
<p>Set CF ← CF\{cf}; set S∈ S ∪ {cf}</p>
</list-item>
</list>
</p>
</list-item>
<list-item><p>Output the set S containing the selected features (Selected feature subset with 30/50/80) </p>
</list-item>
</list>
where CF is the cumulant features, S is the set of currently selected indices of CF (30, 50 or 80) and β is the regularization parameter. MIFS ensures the term I(GC; cf)consist of only relevant CF and adds the CF iteratively in the feature subset S. Experiments were conducted by varying the β values from 0.1 to 1 as it contributes in reducing the redundancy among the CF.</p>
</sec>
<sec id="sec5dot3dot2-sensors-19-02959"><title>5.3.2. CIFE</title>
<p>The entropy of cumulant feature CF is denoted by H(CF) to measure the uncertainty and represent total information carried by the CF. Mutual information I (CF; GC) is defined by:<disp-formula>I (CF; GC) = H(CF) − H (CF|GC),
<label>(6)</label>
</disp-formula>
</p>
<p>CIFE organizes an optimal feature subset that maximizes the class-relevant information between the features by reducing the redundancies among the cumulant features [<xref rid="B23-sensors-19-02959" ref-type="bibr">23</xref>
]. Equation (6) indicates the information delivered from CF to GC will reduce the uncertainty of GC when ‘CF’ is known. CIFE computes the joint class relevant information for k selected indices (30/50/80) of cumulant features as shown in Equation (2).
<disp-formula id="FD2-sensors-19-02959"><label>(7)</label>
<mml:math id="mm7"><mml:mrow><mml:mrow><mml:mrow><mml:mi mathvariant="normal">I</mml:mi>
<mml:mo> </mml:mo>
<mml:mo>(</mml:mo>
<mml:mi>CF</mml:mi>
<mml:mo>;</mml:mo>
<mml:mo> </mml:mo>
<mml:mi>GC</mml:mi>
<mml:mo>)</mml:mo>
<mml:mo> </mml:mo>
<mml:mo>=</mml:mo>
<mml:mo> </mml:mo>
<mml:msubsup><mml:mstyle mathsize="70%" displaystyle="true"><mml:mo>∑</mml:mo>
</mml:mstyle>
<mml:mrow><mml:mi mathvariant="normal">t</mml:mi>
<mml:mo>=</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mi mathvariant="normal">n</mml:mi>
</mml:msubsup>
<mml:mi mathvariant="normal">I</mml:mi>
</mml:mrow>
<mml:mrow><mml:mo>(</mml:mo>
<mml:mi>CF</mml:mi>
<mml:mo>(</mml:mo>
<mml:mi mathvariant="normal">t</mml:mi>
<mml:mo>)</mml:mo>
<mml:mo>;</mml:mo>
<mml:mo> </mml:mo>
<mml:mi>GC</mml:mi>
<mml:mo>)</mml:mo>
<mml:mo> </mml:mo>
<mml:mo>−</mml:mo>
<mml:mo> </mml:mo>
<mml:msubsup><mml:mstyle mathsize="70%" displaystyle="true"><mml:mo>∑</mml:mo>
</mml:mstyle>
<mml:mrow><mml:mi mathvariant="normal">u</mml:mi>
<mml:mo>=</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mrow><mml:mi mathvariant="normal">t</mml:mi>
<mml:mo>−</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msubsup>
<mml:msub><mml:mi mathvariant="normal">R</mml:mi>
<mml:mrow><mml:mi>GC</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>(</mml:mo>
<mml:mi>CF</mml:mi>
<mml:mo>(</mml:mo>
<mml:mi mathvariant="normal">u</mml:mi>
<mml:mo>)</mml:mo>
<mml:mo>;</mml:mo>
<mml:mo> </mml:mo>
<mml:mi>CF</mml:mi>
<mml:mo>(</mml:mo>
<mml:mi mathvariant="normal">t</mml:mi>
<mml:mo>)</mml:mo>
<mml:mo>)</mml:mo>
<mml:mo>,</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:mrow>
</mml:math>
</disp-formula>
Equation (7) extracts the cumulant features sequentially given that (t − 1) CF are extracted, the tth feature can be extracted by optimizing the conditional informative objective as,
<disp-formula id="FD4-sensors-19-02959"><label>(8)</label>
<mml:math id="mm9"><mml:mrow><mml:mrow><mml:mrow><mml:msub><mml:mi mathvariant="sans-serif">θ</mml:mi>
<mml:mi mathvariant="normal">t</mml:mi>
</mml:msub>
</mml:mrow>
<mml:mrow><mml:mo>=</mml:mo>
<mml:mo> </mml:mo>
<mml:mfrac linethickness="0"><mml:mrow><mml:mi>argmax</mml:mi>
</mml:mrow>
<mml:mrow><mml:msub><mml:mi mathvariant="sans-serif">θ</mml:mi>
<mml:mi mathvariant="normal">t</mml:mi>
</mml:msub>
</mml:mrow>
</mml:mfrac>
<mml:mfenced close="}" open="{"><mml:mrow><mml:mrow><mml:mi mathvariant="normal">I</mml:mi>
<mml:mo> </mml:mo>
</mml:mrow>
<mml:mfenced><mml:mrow><mml:msup><mml:mrow><mml:mi>CF</mml:mi>
</mml:mrow>
<mml:mrow><mml:mfenced><mml:mi mathvariant="normal">t</mml:mi>
</mml:mfenced>
</mml:mrow>
</mml:msup>
<mml:mo> </mml:mo>
<mml:mo>;</mml:mo>
<mml:mrow><mml:mo> </mml:mo>
<mml:mi>GC</mml:mi>
</mml:mrow>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:mfenced>
<mml:mo>−</mml:mo>
<mml:mo> </mml:mo>
<mml:msubsup><mml:mstyle mathsize="70%" displaystyle="true"><mml:mo>∑</mml:mo>
</mml:mstyle>
<mml:mrow><mml:mi mathvariant="normal">u</mml:mi>
<mml:mo>=</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mrow><mml:mi mathvariant="normal">t</mml:mi>
<mml:mo>−</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msubsup>
<mml:msub><mml:mi mathvariant="normal">R</mml:mi>
<mml:mrow><mml:mi>GC</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo stretchy="false">(</mml:mo>
<mml:mi>CF</mml:mi>
<mml:mo stretchy="false">(</mml:mo>
<mml:mi mathvariant="normal">u</mml:mi>
<mml:mo stretchy="false">)</mml:mo>
<mml:mo>;</mml:mo>
<mml:mo> </mml:mo>
<mml:mi>CF</mml:mi>
<mml:mo stretchy="false">(</mml:mo>
<mml:mi mathvariant="normal">t</mml:mi>
<mml:mo stretchy="false">)</mml:mo>
<mml:mo stretchy="false">)</mml:mo>
<mml:mo>,</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:mrow>
</mml:math>
</disp-formula>
where θ is the tth CF parameter and Equation (8) derives the conditional informative cumulant feature.</p>
</sec>
</sec>
<sec id="sec5dot4-sensors-19-02959"><title>5.4. HGR Performance Evaluation</title>
<p>HOS-Re evaluates the recognition performance of the proposed methodology using the machine learning classifier SVM with Gaussian RBF Kernel. SVM classifier evaluates the performance of feature selection algorithms with the combinations of regularization parameter <italic>C</italic>
and γ. <italic>C</italic>
is the cost parameter, and γ is the non-linear classification parameter of the Gaussian kernel. One value amongst {0.003, 0.01, 0.03, 0.1, 0.3, 1, 3, 10, 30, 100, 300} is assigned to <italic>C</italic>
at a time and γ takes all values in sequence for each iteration, making 11 × 11 = 121 combinations and validates the results using 10 × 5 cross-validation. The recognition accuracy reported for the lab, home, lab + home dataset with 276 gesture and lab data set with 150 gestures using MIFS (<italic>k</italic>
= 30/50/80 cumulant feature) by varying <italic>β</italic>
.</p>
<p>The comparison of recognition accuracy of all feature selection algorithms like MIFS, mRMR, CIFE, JMI, CMIM, DISR, ICAP and CONDRED (<italic>k</italic>
= 30/50/80 cumulant feature) for the lab, home, lab + home environment datasets are discussed below.</p>
<sec id="sec5dot4dot1-sensors-19-02959"><title>5.4.1. Recognition Accuracy</title>
<p>Multilevel SVM RBF classifier measures the performance of the proposed model using accuracy as a metric, with selected <italic>k</italic>
features fed as input from the feature selection algorithm. <xref ref-type="fig" rid="sensors-19-02959-f009">Figure 9</xref>
a–d compares the performance of various feature selection algorithms with <italic>k</italic>
, for the lab, home, lab + home datasets with 276 gestures and lab dataset with 150 gestures respectively. The overall accuracy increases with an increase in <italic>k</italic>
for MIFS and CIFE, which reports higher recognition accuracy than other feature selection algorithms. </p>
<p>Based on the results, it is clearly visible that SVM achieves better recognition accuracy firstly with MIFS and secondly with the CIFE among all the tested feature selection algorithms.</p>
<p>The performance of MIFS is evaluated with <italic>k</italic>
= 30, 50 or 80 selected indices of cumulant features as input to the SVM classifier. <xref ref-type="fig" rid="sensors-19-02959-f010">Figure 10</xref>
shows the performance variation of MIFS with <italic>k</italic>
features for different datasets for β = 0.8. With an increase in <italic>k</italic>
, the performance of MIFS increases in all environments. MIFS achieves better performance in the home environment for all <italic>k</italic>
(30/50/80). The classification and recognition task reports better recognition accuracy for β = 0.5 and 0.8. MIFS achieves better recognition accuracy with <italic>k</italic>
= 80, in all environments. Compared to the home environment, MIFS reports slightly lesser performance in a lab environment and further under performs in lab + home environment. In the lab environment, MIFS performance is better in a dataset with 276 gestures obtained from 1 user than the dataset with 150 gestures obtained from multiple users. For 10 × 5 cross-validation, MIFS performs better than all feature selection algorithms with an overall higher accuracy of 97.84%, 98.18% and 96.34% for lab, home, and lab + home environment respectively for 276 gestures with 8280 instances from one user. For 150 gestures with 7500 instances from five users in the lab environment MIFS achieves an overall higher accuracy of 96.23%. The recognition accuracy slightly declines for the lab data with 150 gestures as it involves multiple users for capturing the gesture instance, and the number of gesture samples per gesture per user decreases.</p>
<p>HOS-Re achieves better recognition accuracy with β = 0.8 for <italic>k</italic>
= 80 in all environments, as in <xref ref-type="fig" rid="sensors-19-02959-f010">Figure 10</xref>
. Hence, to study the influence of β on the recognition accuracy with MIFS, experiments were carried out by systematically varying β from 0.1 to 1. <xref ref-type="fig" rid="sensors-19-02959-f011">Figure 11</xref>
highlights the variation in accuracy with β for different datasets. MIFS achieves better recognition accuracy with increasing β value as it reduces the uncertainty between the features and gesture class. Home dataset (276 gestures) shows higher accuracy than dataset from the lab (276 gestures). Lab + home showed the least accuracy levels compared to other datasets in 276 gestures category, for all β. Lab and home dataset (276 gesture) show consistent accuracy levels at β = 0.2 and above. Interestingly, lab dataset shows a mildly decreasing trend in accuracy with an increase in β. For Lab + home, the peak recognition accuracy of 96.34% observed at β = 0.5. MIFS captures the arbitrary mutual relations that exist between the individual third-order cumulant feature without performing any transformation. Therefore, MIFS provides the robust subset of cumulant features as the input to the multi-level SVM classifier preserving the mutual information with less uncertainty.</p>
<p><xref ref-type="fig" rid="sensors-19-02959-f012">Figure 12</xref>
shows the comparison of overall recognition accuracy of CIFE algorithm with <italic>k</italic>
on different datasets. Similar to MIFS, the accuracy of CIFE increases with <italic>k</italic>
and shows higher recognition accuracy for the home dataset.</p>
<p><xref rid="sensors-19-02959-t003" ref-type="table">Table 3</xref>
compares the overall recognition accuracy of the proposed methodology HOS-Re with corresponding values from the literature [<xref rid="B29-sensors-19-02959" ref-type="bibr">29</xref>
] adopting CNN with and without signal processing (SP). The number of users (<italic>N<sub>u</sub>
</italic>
) that participated in the lab and home environment data acquisition with 276 gestures is 1, whereas for a lab environment with 150 gestures is 5. The number of samples per gesture per user (<italic>N<sub>su</sub>
</italic>
) for which the CSI values were acquired is 20 and 10 for lab and home environments with 276 gestures (<italic>N<sub>g</sub>
</italic>
). For a lab environment with 150 gestures, this value is 10. The product of <italic>N<sub>u</sub>
</italic>
× <italic>N<sub>su</sub>
</italic>
× <italic>N<sub>g</sub>
</italic>
gives the total number of gesture samples (<italic>N<sub>gs</sub>
</italic>
) acquired. From this <italic>N<sub>gs</sub>
</italic>
, the number of gesture samples per user is estimated to be 5520 and 2760 for lab and home environment respectively with 276 gestures (lab 276 and home 276). For the lab environment with 150 gestures (lab 150), this value is 1500. </p>
<p>SignFi [<xref rid="B29-sensors-19-02959" ref-type="bibr">29</xref>
] reported 95.72% recognition accuracy for lab 276 and for home 276, it is 93.98% when no signal pre-processing is applied. This reduction in recognition accuracy could be attributed to the reduced samples per user with home 276. Deep learning methods adopted in [<xref rid="B29-sensors-19-02959" ref-type="bibr">29</xref>
] is expected to produce higher gesture recognition accuracy with an increase in sample size. However, the combined lab + home 276 datasets reported 92.21% recognition accuracy. This drop in accuracy is anticipated due to the influence of environmental factors in lab 276 dataset, as inferred from <xref ref-type="fig" rid="sensors-19-02959-f006">Figure 6</xref>
a.</p>
<p>SignFi [<xref rid="B29-sensors-19-02959" ref-type="bibr">29</xref>
] with signal pre-processing achieves recognition accuracies higher than the corresponding values without pre-processing. For lab 276 the accuracy is 98.01%, and for home 276 it is 98.91%. This marginal increase in home 276 can be due to lower interference in the home environment compared to the <italic>lab</italic>
environment. As observed earlier, the recognition accuracy of lab + home 276 declines to 94.81%. Lab 150 achieves least recognition accuracy of 86.66% since the number of samples per user acquired is lesser than other datasets, where the performance of deep learning method suffers. </p>
<p>Deep learning methods [<xref rid="B29-sensors-19-02959" ref-type="bibr">29</xref>
] had large variations in recognition accuracy estimates influenced by the interferences and/or sample size. The present work HOS-Re achieved consistently higher recognition accuracies in all scenarios. In particular, when the samples acquired per user is lesser as in <italic>lab</italic>
150, the recognition accuracy estimated by present work is 96.23%, and it is almost 10% higher than the corresponding value obtained from the deep learning methods with signal pre-processing. It is preferred to have a gesture recognition method achieving higher recognition accuracy with minimum samples, as it is challenging to acquire a large number of samples from human participants. Therefore, the presently adopted machine learning approach along with the identified feature extraction, selection, and classification methods perform well, irrespective of the sample size and environmental factors.</p>
<p>For more insight on the robustness of recognition performance of the presently adopted HOS-Re methodology, the results from the present work are compared with the related work reported in the literature. <xref rid="sensors-19-02959-t004" ref-type="table">Table 4</xref>
compares some of the related work on gesture recognition using COTS Wi-Fi devices, and it can be observed that most of the work reported so far used lesser samples. SignFi [<xref rid="B29-sensors-19-02959" ref-type="bibr">29</xref>
] is the only dataset having more number of gesture classes and samples instances. Amongst the cited work in <xref rid="sensors-19-02959-t004" ref-type="table">Table 4</xref>
, the works that used machine learning classifiers on CSI traces to recognize the gesture, have not handled such sizeable data and complex multi-class classification task. It can also be observed that the presently adopted HOS-Re methodology achieves the highest recognition accuracy.</p>
</sec>
<sec id="sec5dot4dot2-sensors-19-02959"><title>5.4.2. SVM Classifier Execution Time</title>
<p>The computational complexity is a key index for evaluating a given algorithm. <xref ref-type="fig" rid="sensors-19-02959-f013">Figure 13</xref>
shows the average time per sample for training and testing on each dataset, using MIFS with <italic>k</italic>
= 80. The time taken for testing phase is higher than the training phase for all datasets. Lab dataset with 150 gestures reports least execution time per sample (Training: 2.76 ms; Testing: 3.13 ms), whereas <italic>lab</italic>
+ <italic>home</italic>
dataset with 276 gestures reports highest execution time (Training: 4.05 ms; Testing: 8.94 ms). The simulations are done on an Intel(R) Core(TM) i5-7200U CPU @2.50GHz 2.71GHz RAM 8.00 GB.</p>
</sec>
</sec>
</sec>
<sec sec-type="conclusions" id="sec6-sensors-19-02959"><title>6. Conclusions</title>
<p>HOS-Re adopts a ML approach and proposes higher order statistical features that extracts useful information from the non-Gaussian signal distribution. Results from presently proposed HOS-Re approach, achieve attractive classification accuracy with MIFS on SignFi dataset [<xref rid="B29-sensors-19-02959" ref-type="bibr">29</xref>
]. HOS-Re extracts third-order cumulant feature that maximizes the recognition accuracy. Subsequently, feature selection methods derived from information theory construct a robust and highly mutually informative feature subset as input to multilevel SVM classifier with Gaussian RBF kernel to measure the performance. MIFS and CIFE report better performance compared to other feature selection algorithms. However, MIFS reports the most striking performance in comparison to CIFE in extracting the mutually informative cumulant feature subset. The importance of reducing the uncertainty and preserving useful information considering the non-linear relationship for achieving better recognition accuracy is evident while looking at the other feature selection criteria in the present study.</p>
<p>MIFS reports the best overall trade-off accuracy because it selects highly mutually informative cumulant feature subset and it significantly reduces the uncertainty among the features and the gesture class. For 10 × 5 cross-validations, HOS-Re with MIFS achieved average recognition accuracy of 97.84%, 98.26% and 96.34% for the <italic>lab</italic>
, home and <italic>lab</italic>
+ <italic>home</italic>
environment respectively. The average recognition accuracy for 150 sign gestures with 7,500 instances, collected from five different users was 96.23% in the lab environment. This work presents clear evidence that with proper feature extraction and selection technique, ML algorithms can achieve notable recognition accuracy, even without applying any form signal processing technique.</p>
</sec>
</body>
<back><ack><title>Acknowledgments</title>
<p>This work was supported by Taylor’s University through its TAYLOR’S PhD SCHOLARSHIP Programme. The authors of this article would like to acknowledge the authors of SignFi dataset for providing Wi-Fi CSI traces, labels, and videos of the 276 sign words in GitHub.</p>
</ack>
<fn-group><fn><p><bold>Sample Availability:</bold>
SignFi dataset: CSI traces, labels, and videos of the 276 sign words are made available by the authors at <uri xlink:href="https://yongsen.github.io/SignFi/">https://yongsen.github.io/SignFi/</uri>
for download.</p>
</fn>
</fn-group>
<notes><title>Author Contributions</title>
<p>Conceptualization, H.F.; methodology, H.F.; software, H.F.; validation, H.F.; formal analysis, H.F.; investigation, H.F.; writing—original draft preparation, H.F.; writing—review and editing, H.F., H.A., S.K.P., A.C., H.H., K.N.; visualization, H.F.; supervision, H.A. </p>
</notes>
<notes notes-type="COI-statement"><title>Conflicts of Interest</title>
<p>The authors declare no conflict of interest. </p>
</notes>
<ref-list><title>References</title>
<ref id="B1-sensors-19-02959"><label>1.</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Saini</surname>
<given-names>R.</given-names>
</name>
<name><surname>Kumar</surname>
<given-names>P.</given-names>
</name>
<name><surname>Roy</surname>
<given-names>P.P.</given-names>
</name>
<name><surname>Dogra</surname>
<given-names>D.P.</given-names>
</name>
</person-group>
<article-title>A novel framework of continuous human-activity recognition using Kinect</article-title>
<source>Neurocomputing</source>
<year>2018</year>
<volume>311</volume>
<fpage>99</fpage>
<lpage>111</lpage>
<pub-id pub-id-type="doi">10.1016/j.neucom.2018.05.042</pub-id>
</element-citation>
</ref>
<ref id="B2-sensors-19-02959"><label>2.</label>
<element-citation publication-type="confproc"><person-group person-group-type="author"><name><surname>Kellogg</surname>
<given-names>B.</given-names>
</name>
<name><surname>Talla</surname>
<given-names>V.</given-names>
</name>
<name><surname>Gollakota</surname>
<given-names>S.</given-names>
</name>
</person-group>
<article-title>Bringing gesture recognition to all devices</article-title>
<source>Proceedings of the 11th USENIX Symposium on Networked Systems Design and Implementation (NSDI 14)</source>
<conf-loc>Seattle, WA, USA</conf-loc>
<conf-date>2–4 April 2014</conf-date>
<fpage>303</fpage>
<lpage>316</lpage>
</element-citation>
</ref>
<ref id="B3-sensors-19-02959"><label>3.</label>
<element-citation publication-type="confproc"><person-group person-group-type="author"><name><surname>Zhao</surname>
<given-names>M.</given-names>
</name>
<name><surname>Adib</surname>
<given-names>F.</given-names>
</name>
<name><surname>Katabi</surname>
<given-names>D.</given-names>
</name>
</person-group>
<article-title>Emotion recognition using wireless signals</article-title>
<source>Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking</source>
<conf-loc>New York, NY, USA</conf-loc>
<conf-date>3–7 October 2016</conf-date>
<fpage>95</fpage>
<lpage>108</lpage>
</element-citation>
</ref>
<ref id="B4-sensors-19-02959"><label>4.</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Rana</surname>
<given-names>S.P.</given-names>
</name>
<name><surname>Dey</surname>
<given-names>M.</given-names>
</name>
<name><surname>Ghavami</surname>
<given-names>M.</given-names>
</name>
<name><surname>Dudley</surname>
<given-names>S.</given-names>
</name>
</person-group>
<article-title>Signature Inspired Home Environments Monitoring System Using IR-UWB Technology</article-title>
<source>Sensors</source>
<year>2019</year>
<volume>19</volume>
<elocation-id>385</elocation-id>
<pub-id pub-id-type="doi">10.3390/s19020385</pub-id>
<pub-id pub-id-type="pmid">30669319</pub-id>
</element-citation>
</ref>
<ref id="B5-sensors-19-02959"><label>5.</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Li</surname>
<given-names>W.</given-names>
</name>
<name><surname>Tan</surname>
<given-names>B.</given-names>
</name>
<name><surname>Piechocki</surname>
<given-names>R.J.</given-names>
</name>
</person-group>
<article-title>WiFi-based passive sensing system for human presence and activity event classification</article-title>
<source>IET Wirel. Sens. Syst.</source>
<year>2018</year>
<volume>8</volume>
<fpage>276</fpage>
<lpage>283</lpage>
<pub-id pub-id-type="doi">10.1049/iet-wss.2018.5113</pub-id>
</element-citation>
</ref>
<ref id="B6-sensors-19-02959"><label>6.</label>
<element-citation publication-type="confproc"><person-group person-group-type="author"><name><surname>Zeng</surname>
<given-names>Y.</given-names>
</name>
<name><surname>Pathak</surname>
<given-names>P.H.</given-names>
</name>
<name><surname>Mohapatra</surname>
<given-names>P.</given-names>
</name>
</person-group>
<article-title>Analyzing shopper’s behavior through wifi signals</article-title>
<source>Proceedings of the 2nd workshop on Workshop on Physical Analytics</source>
<conf-loc>Florence, Italy</conf-loc>
<conf-date>22 May 2015</conf-date>
<fpage>13</fpage>
<lpage>18</lpage>
</element-citation>
</ref>
<ref id="B7-sensors-19-02959"><label>7.</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Chereshnev</surname>
<given-names>R.</given-names>
</name>
<name><surname>Kertész-Farkas</surname>
<given-names>A.</given-names>
</name>
</person-group>
<article-title>GaIn: Human gait inference for lower limbic prostheses for patients suffering from double trans-femoral amputation</article-title>
<source>Sensors</source>
<year>2018</year>
<volume>18</volume>
<elocation-id>4146</elocation-id>
<pub-id pub-id-type="doi">10.3390/s18124146</pub-id>
<pub-id pub-id-type="pmid">30486308</pub-id>
</element-citation>
</ref>
<ref id="B8-sensors-19-02959"><label>8.</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Yang</surname>
<given-names>J.</given-names>
</name>
<name><surname>Zou</surname>
<given-names>H.</given-names>
</name>
<name><surname>Jiang</surname>
<given-names>H.</given-names>
</name>
<name><surname>Xie</surname>
<given-names>L.</given-names>
</name>
</person-group>
<article-title>Device-Free Occupant Activity Sensing Using WiFi-Enabled IoT Devices for Smart Homes</article-title>
<source>IEEE Internet Things J.</source>
<year>2018</year>
<volume>5</volume>
<fpage>3991</fpage>
<lpage>4002</lpage>
<pub-id pub-id-type="doi">10.1109/JIOT.2018.2849655</pub-id>
</element-citation>
</ref>
<ref id="B9-sensors-19-02959"><label>9.</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Lee</surname>
<given-names>H.</given-names>
</name>
<name><surname>Ahn</surname>
<given-names>C.R.</given-names>
</name>
<name><surname>Choi</surname>
<given-names>N.</given-names>
</name>
<name><surname>Kim</surname>
<given-names>T.</given-names>
</name>
<name><surname>Lee</surname>
<given-names>H.</given-names>
</name>
</person-group>
<article-title>The Effects of Housing Environments on the Performance of Activity-Recognition Systems Using Wi-Fi Channel State Information: An Exploratory Study</article-title>
<source>Sensors</source>
<year>2019</year>
<volume>19</volume>
<elocation-id>983</elocation-id>
<pub-id pub-id-type="doi">10.3390/s19050983</pub-id>
<pub-id pub-id-type="pmid">30813514</pub-id>
</element-citation>
</ref>
<ref id="B10-sensors-19-02959"><label>10.</label>
<element-citation publication-type="confproc"><person-group person-group-type="author"><name><surname>Xin</surname>
<given-names>T.</given-names>
</name>
<name><surname>Guo</surname>
<given-names>B.</given-names>
</name>
<name><surname>Wang</surname>
<given-names>Z.</given-names>
</name>
<name><surname>Li</surname>
<given-names>M.</given-names>
</name>
<name><surname>Yu</surname>
<given-names>Z.</given-names>
</name>
<name><surname>Zhou</surname>
<given-names>X.</given-names>
</name>
</person-group>
<article-title>Freesense: Indoor human identification with Wi-Fi signals</article-title>
<source>Proceedings of the 2016 IEEE Global Communications Conference (GLOBECOM)</source>
<conf-loc>Washington, DC, USA</conf-loc>
<conf-date>4–8 December 2016</conf-date>
<fpage>1</fpage>
<lpage>7</lpage>
</element-citation>
</ref>
<ref id="B11-sensors-19-02959"><label>11.</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Wang</surname>
<given-names>G.</given-names>
</name>
<name><surname>Zou</surname>
<given-names>Y.</given-names>
</name>
<name><surname>Zhou</surname>
<given-names>Z.</given-names>
</name>
<name><surname>Wu</surname>
<given-names>K.</given-names>
</name>
<name><surname>Ni</surname>
<given-names>L.M.</given-names>
</name>
</person-group>
<article-title>We can hear you with wi-fi!</article-title>
<source>IEEE Trans. Mob. Comput.</source>
<year>2016</year>
<volume>15</volume>
<fpage>2907</fpage>
<lpage>2920</lpage>
<pub-id pub-id-type="doi">10.1109/TMC.2016.2517630</pub-id>
</element-citation>
</ref>
<ref id="B12-sensors-19-02959"><label>12.</label>
<element-citation publication-type="confproc"><person-group person-group-type="author"><name><surname>Sun</surname>
<given-names>L.</given-names>
</name>
<name><surname>Sen</surname>
<given-names>S.</given-names>
</name>
<name><surname>Koutsonikolas</surname>
<given-names>D.</given-names>
</name>
<name><surname>Kim</surname>
<given-names>K.-H.</given-names>
</name>
</person-group>
<article-title>Widraw: Enabling hands-free drawing in the air on commodity wifi devices</article-title>
<source>Proceedings of the 21st Annual International Conference on Mobile Computing and Networking</source>
<conf-loc>Paris, France</conf-loc>
<conf-date>7–11 September 2015</conf-date>
<fpage>77</fpage>
<lpage>89</lpage>
</element-citation>
</ref>
<ref id="B13-sensors-19-02959"><label>13.</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Xiao</surname>
<given-names>F.</given-names>
</name>
<name><surname>Chen</surname>
<given-names>J.</given-names>
</name>
<name><surname>Xie</surname>
<given-names>X.H.</given-names>
</name>
<name><surname>Gui</surname>
<given-names>L.</given-names>
</name>
<name><surname>Sun</surname>
<given-names>J.L.</given-names>
</name>
<name><surname>none Ruchuan</surname>
<given-names>W.</given-names>
</name>
</person-group>
<article-title>SEARE: A system for exercise activity recognition and quality evaluation based on green sensing</article-title>
<source>IEEE Trans. Emerg. Top. Comput.</source>
<year>2018</year>
<pub-id pub-id-type="doi">10.1109/TETC.2018.2790080</pub-id>
</element-citation>
</ref>
<ref id="B14-sensors-19-02959"><label>14.</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Di Domenico</surname>
<given-names>S.</given-names>
</name>
<name><surname>De Sanctis</surname>
<given-names>M.</given-names>
</name>
<name><surname>Cianca</surname>
<given-names>E.</given-names>
</name>
<name><surname>Giuliano</surname>
<given-names>F.</given-names>
</name>
<name><surname>Bianchi</surname>
<given-names>G.</given-names>
</name>
</person-group>
<article-title>Exploring training options for RF sensing using CSI</article-title>
<source>IEEE Commun. Mag.</source>
<year>2018</year>
<volume>56</volume>
<fpage>116</fpage>
<lpage>123</lpage>
<pub-id pub-id-type="doi">10.1109/MCOM.2018.1700145</pub-id>
</element-citation>
</ref>
<ref id="B15-sensors-19-02959"><label>15.</label>
<element-citation publication-type="confproc"><person-group person-group-type="author"><name><surname>Ali</surname>
<given-names>K.</given-names>
</name>
<name><surname>Liu</surname>
<given-names>A.X.</given-names>
</name>
<name><surname>Wang</surname>
<given-names>W.</given-names>
</name>
<name><surname>Shahzad</surname>
<given-names>M.</given-names>
</name>
</person-group>
<article-title>Keystroke recognition using wifi signals</article-title>
<source>Proceedings of the 21st Annual International Conference on Mobile Computing and Networking</source>
<conf-loc>Paris, France</conf-loc>
<conf-date>7–11 September 2015</conf-date>
<fpage>90</fpage>
<lpage>102</lpage>
</element-citation>
</ref>
<ref id="B16-sensors-19-02959"><label>16.</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Wang</surname>
<given-names>W.</given-names>
</name>
<name><surname>Liu</surname>
<given-names>A.X.</given-names>
</name>
<name><surname>Shahzad</surname>
<given-names>M.</given-names>
</name>
<name><surname>Ling</surname>
<given-names>K.</given-names>
</name>
<name><surname>Lu</surname>
<given-names>S.</given-names>
</name>
</person-group>
<article-title>Device-free human activity recognition using commercial WiFi devices</article-title>
<source>IEEE J. Sel. Areas Commun.</source>
<year>2017</year>
<volume>35</volume>
<fpage>1118</fpage>
<lpage>1131</lpage>
<pub-id pub-id-type="doi">10.1109/JSAC.2017.2679658</pub-id>
</element-citation>
</ref>
<ref id="B17-sensors-19-02959"><label>17.</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Xu</surname>
<given-names>Y.</given-names>
</name>
<name><surname>Yang</surname>
<given-names>W.</given-names>
</name>
<name><surname>Wang</surname>
<given-names>J.</given-names>
</name>
<name><surname>Zhou</surname>
<given-names>X.</given-names>
</name>
<name><surname>Li</surname>
<given-names>H.</given-names>
</name>
<name><surname>Huang</surname>
<given-names>L.</given-names>
</name>
</person-group>
<article-title>WiStep: Device-free Step Counting with WiFi Signals</article-title>
<source>Proc. ACM Interact. Mob. Wearable Ubiquitous Technol.</source>
<year>2018</year>
<volume>1</volume>
<pub-id pub-id-type="doi">10.1145/3161415</pub-id>
</element-citation>
</ref>
<ref id="B18-sensors-19-02959"><label>18.</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Dang</surname>
<given-names>X.</given-names>
</name>
<name><surname>Si</surname>
<given-names>X.</given-names>
</name>
<name><surname>Hao</surname>
<given-names>Z.</given-names>
</name>
<name><surname>Huang</surname>
<given-names>Y.</given-names>
</name>
</person-group>
<article-title>A Novel Passive Indoor Localization Method by Fusion CSI Amplitude and Phase Information</article-title>
<source>Sensors</source>
<year>2019</year>
<volume>19</volume>
<elocation-id>875</elocation-id>
<pub-id pub-id-type="doi">10.3390/s19040875</pub-id>
<pub-id pub-id-type="pmid">30791554</pub-id>
</element-citation>
</ref>
<ref id="B19-sensors-19-02959"><label>19.</label>
<element-citation publication-type="confproc"><person-group person-group-type="author"><name><surname>Zhuo</surname>
<given-names>Y.</given-names>
</name>
<name><surname>Zhu</surname>
<given-names>H.</given-names>
</name>
<name><surname>Xue</surname>
<given-names>H.</given-names>
</name>
</person-group>
<article-title>Identifying a new non-linear CSI phase measurement error with commodity WiFi devices</article-title>
<source>Proceedings of the 2016 IEEE 22nd International Conference on Parallel and Distributed Systems (ICPADS)</source>
<conf-loc>Wuhan, China</conf-loc>
<conf-date>13–16 December 2016</conf-date>
<fpage>72</fpage>
<lpage>79</lpage>
</element-citation>
</ref>
<ref id="B20-sensors-19-02959"><label>20.</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Battiti</surname>
<given-names>R.</given-names>
</name>
</person-group>
<article-title>Using mutual information for selecting features in supervised neural net learning</article-title>
<source>IEEE Trans. Neural Networks</source>
<year>1994</year>
<volume>5</volume>
<fpage>537</fpage>
<lpage>550</lpage>
<pub-id pub-id-type="doi">10.1109/72.298224</pub-id>
<pub-id pub-id-type="pmid">18267827</pub-id>
</element-citation>
</ref>
<ref id="B21-sensors-19-02959"><label>21.</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Peng</surname>
<given-names>H.</given-names>
</name>
<name><surname>Long</surname>
<given-names>F.</given-names>
</name>
<name><surname>Ding</surname>
<given-names>C.</given-names>
</name>
</person-group>
<article-title>Feature selection based on mutual information: criteria of max-dependency, max-relevance, and min-redundancy</article-title>
<source>IEEE Trans. Pattern Anal. Mach. Intell.</source>
<year>2005</year>
<fpage>1226</fpage>
<lpage>1238</lpage>
<pub-id pub-id-type="doi">10.1109/TPAMI.2005.159</pub-id>
<pub-id pub-id-type="pmid">16119262</pub-id>
</element-citation>
</ref>
<ref id="B22-sensors-19-02959"><label>22.</label>
<element-citation publication-type="confproc"><person-group person-group-type="author"><name><surname>Nguyen</surname>
<given-names>X.V.</given-names>
</name>
<name><surname>Chan</surname>
<given-names>J.</given-names>
</name>
<name><surname>Romano</surname>
<given-names>S.</given-names>
</name>
<name><surname>Bailey</surname>
<given-names>J.</given-names>
</name>
</person-group>
<article-title>Effective global approaches for mutual information based feature selection</article-title>
<source>Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining</source>
<conf-loc>New York, NY, USA</conf-loc>
<conf-date>24–27 August 2014</conf-date>
<fpage>512</fpage>
<lpage>521</lpage>
</element-citation>
</ref>
<ref id="B23-sensors-19-02959"><label>23.</label>
<element-citation publication-type="confproc"><person-group person-group-type="author"><name><surname>Lin</surname>
<given-names>D.</given-names>
</name>
<name><surname>Tang</surname>
<given-names>X.</given-names>
</name>
</person-group>
<article-title>Conditional infomax learning: An integrated framework for feature extraction and fusion</article-title>
<source>Proceedings of the European Conference on Computer Vision</source>
<conf-loc>Graz, Austria</conf-loc>
<conf-date>7–13 May 2006</conf-date>
<fpage>68</fpage>
<lpage>82</lpage>
<pub-id pub-id-type="doi">10.1007/11744023_6</pub-id>
</element-citation>
</ref>
<ref id="B24-sensors-19-02959"><label>24.</label>
<element-citation publication-type="web"><person-group person-group-type="author"><name><surname>Yang</surname>
<given-names>H.</given-names>
</name>
<name><surname>Moody</surname>
<given-names>J.</given-names>
</name>
</person-group>
<article-title>Feature Selection Based on Joint Mutual Information</article-title>
<comment>Available online: <ext-link ext-link-type="uri" xlink:href="https://pdfs.semanticscholar.org/dd69/1540c3f28decb477a7738f16aa92709b0f59.pdf">https://pdfs.semanticscholar.org/dd69/1540c3f28decb477a7738f16aa92709b0f59.pdf</ext-link>
</comment>
<date-in-citation content-type="access-date" iso-8601-date="2019-06-28">(accessed on 28 June 2019)</date-in-citation>
</element-citation>
</ref>
<ref id="B25-sensors-19-02959"><label>25.</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Fleuret</surname>
<given-names>F.</given-names>
</name>
</person-group>
<article-title>Fast binary feature selection with conditional mutual information</article-title>
<source>J. Mach. Learn. Res.</source>
<year>2004</year>
<volume>5</volume>
<fpage>1531</fpage>
<lpage>1555</lpage>
</element-citation>
</ref>
<ref id="B26-sensors-19-02959"><label>26.</label>
<element-citation publication-type="web"><person-group person-group-type="author"><name><surname>Meyer</surname>
<given-names>P.E.</given-names>
</name>
<name><surname>Bontempi</surname>
<given-names>G.</given-names>
</name>
</person-group>
<article-title>On the Use of Variable Complementarity for Feature Selection in Cancer Classification</article-title>
<comment>Available online: <ext-link ext-link-type="uri" xlink:href="https://www.semanticscholar.org/paper/On-the-Use-of-Variable-Complementarity-for-Feature-Meyer-Bontempi/d72ff5063520ce4542d6d9b9e6a4f12aafab6091">https://www.semanticscholar.org/paper/On-the-Use-of-Variable-Complementarity-for-Feature-Meyer-Bontempi/d72ff5063520ce4542d6d9b9e6a4f12aafab6091</ext-link>
</comment>
<date-in-citation content-type="access-date" iso-8601-date="2019-06-28">(accessed on 28 June 2019)</date-in-citation>
</element-citation>
</ref>
<ref id="B27-sensors-19-02959"><label>27.</label>
<element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Jakulin</surname>
<given-names>A.</given-names>
</name>
</person-group>
<article-title>Machine Learning Based on Attribute Interactions</article-title>
<source>Ph.D. Thesis</source>
<publisher-name>Univerza v Ljubljani</publisher-name>
<publisher-loc>Ljubljana, Slovenia</publisher-loc>
<year>2005</year>
</element-citation>
</ref>
<ref id="B28-sensors-19-02959"><label>28.</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Brown</surname>
<given-names>G.</given-names>
</name>
<name><surname>Pocock</surname>
<given-names>A.</given-names>
</name>
<name><surname>Zhao</surname>
<given-names>M.-J.</given-names>
</name>
<name><surname>Luján</surname>
<given-names>M.</given-names>
</name>
</person-group>
<article-title>Conditional likelihood maximisation: A unifying framework for information theoretic feature selection</article-title>
<source>J. Mach. Learn. Res.</source>
<year>2012</year>
<volume>13</volume>
<fpage>27</fpage>
<lpage>66</lpage>
</element-citation>
</ref>
<ref id="B29-sensors-19-02959"><label>29.</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ma</surname>
<given-names>Y.</given-names>
</name>
<name><surname>Zhou</surname>
<given-names>G.</given-names>
</name>
<name><surname>Wang</surname>
<given-names>S.</given-names>
</name>
<name><surname>Zhao</surname>
<given-names>H.</given-names>
</name>
<name><surname>Jung</surname>
<given-names>W.</given-names>
</name>
</person-group>
<article-title>Signfi: Sign language recognition using wifi</article-title>
<source>Proc. ACM Interact. Mob. Wearable Ubiquitous Technol.</source>
<year>2018</year>
<volume>2</volume>
<fpage>23</fpage>
<pub-id pub-id-type="doi">10.1145/3191755</pub-id>
</element-citation>
</ref>
<ref id="B30-sensors-19-02959"><label>30.</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kanokoda</surname>
<given-names>T.</given-names>
</name>
<name><surname>Kushitani</surname>
<given-names>Y.</given-names>
</name>
<name><surname>Shimada</surname>
<given-names>M.</given-names>
</name>
<name><surname>Shirakashi</surname>
<given-names>J.-I.</given-names>
</name>
</person-group>
<article-title>Gesture Prediction Using Wearable Sensing Systems with Neural Networks for Temporal Data Analysis</article-title>
<source>Sensors</source>
<year>2019</year>
<volume>19</volume>
<elocation-id>710</elocation-id>
<pub-id pub-id-type="doi">10.3390/s19030710</pub-id>
<pub-id pub-id-type="pmid">30744117</pub-id>
</element-citation>
</ref>
<ref id="B31-sensors-19-02959"><label>31.</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Shukor</surname>
<given-names>A.Z.</given-names>
</name>
<name><surname>Miskon</surname>
<given-names>M.F.</given-names>
</name>
<name><surname>Jamaluddin</surname>
<given-names>M.H.</given-names>
</name>
<name><surname>bin Ali</surname>
<given-names>F.</given-names>
</name>
<name><surname>Asyraf</surname>
<given-names>M.F.</given-names>
</name>
<name><surname>bin Bahar</surname>
<given-names>M.B.</given-names>
</name>
</person-group>
<article-title>A new data glove approach for Malaysian sign language detection</article-title>
<source>Procedia Comput. Sci.</source>
<year>2015</year>
<volume>76</volume>
<fpage>60</fpage>
<lpage>67</lpage>
<pub-id pub-id-type="doi">10.1016/j.procs.2015.12.276</pub-id>
</element-citation>
</ref>
<ref id="B32-sensors-19-02959"><label>32.</label>
<element-citation publication-type="confproc"><person-group person-group-type="author"><name><surname>Goswami</surname>
<given-names>P.</given-names>
</name>
<name><surname>Rao</surname>
<given-names>S.</given-names>
</name>
<name><surname>Bharadwaj</surname>
<given-names>S.</given-names>
</name>
<name><surname>Nguyen</surname>
<given-names>A.</given-names>
</name>
</person-group>
<article-title>Real-Time Multi-Gesture Recognition using 77 GHz FMCW MIMO Single Chip Radar</article-title>
<source>Proceedings of the 2019 IEEE International Conference on Consumer Electronics (ICCE)</source>
<conf-loc>Las Vegas, NV, USA</conf-loc>
<conf-date>11–13 January 2019</conf-date>
<fpage>1</fpage>
<lpage>4</lpage>
</element-citation>
</ref>
<ref id="B33-sensors-19-02959"><label>33.</label>
<element-citation publication-type="confproc"><person-group person-group-type="author"><name><surname>Tan</surname>
<given-names>S.</given-names>
</name>
<name><surname>Yang</surname>
<given-names>J.</given-names>
</name>
</person-group>
<article-title>WiFinger: Leveraging commodity WiFi for fine-grained finger gesture recognition</article-title>
<source>Proceedings of the 17th ACM International Symposium on Mobile Ad Hoc Networking and Computing</source>
<conf-loc>Paderborn, Germany</conf-loc>
<conf-date>5–8 July 2016</conf-date>
<fpage>201</fpage>
<lpage>210</lpage>
</element-citation>
</ref>
<ref id="B34-sensors-19-02959"><label>34.</label>
<element-citation publication-type="confproc"><person-group person-group-type="author"><name><surname>Abdelnasser</surname>
<given-names>H.</given-names>
</name>
<name><surname>Youssef</surname>
<given-names>M.</given-names>
</name>
<name><surname>Harras</surname>
<given-names>K.A.</given-names>
</name>
</person-group>
<article-title>Wigest: A ubiquitous wifi-based gesture recognition system</article-title>
<source>Proceedings of the 2015 IEEE Conference on Computer Communications (INFOCOM)</source>
<conf-loc>Kowloon, Hong Kong</conf-loc>
<conf-date>26 April–1 May 2015</conf-date>
<fpage>1472</fpage>
<lpage>1480</lpage>
</element-citation>
</ref>
<ref id="B35-sensors-19-02959"><label>35.</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Wang</surname>
<given-names>H.</given-names>
</name>
<name><surname>Zhang</surname>
<given-names>D.</given-names>
</name>
<name><surname>Wang</surname>
<given-names>Y.</given-names>
</name>
<name><surname>Ma</surname>
<given-names>J.</given-names>
</name>
<name><surname>Wang</surname>
<given-names>Y.</given-names>
</name>
<name><surname>Li</surname>
<given-names>S.</given-names>
</name>
</person-group>
<article-title>RT-Fall: A real-time and contactless fall detection system with commodity WiFi devices</article-title>
<source>IEEE Trans. Mob. Comput.</source>
<year>2017</year>
<volume>16</volume>
<fpage>511</fpage>
<lpage>526</lpage>
<pub-id pub-id-type="doi">10.1109/TMC.2016.2557795</pub-id>
</element-citation>
</ref>
<ref id="B36-sensors-19-02959"><label>36.</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Al-qaness</surname>
<given-names>M.A.A.</given-names>
</name>
<name><surname>Li</surname>
<given-names>F.</given-names>
</name>
</person-group>
<article-title>WiGeR: WiFi-Based Gesture Recognition System</article-title>
<source>ISPRS Int. J. Geo-Inf.</source>
<year>2016</year>
<volume>5</volume>
<elocation-id>92</elocation-id>
<pub-id pub-id-type="doi">10.3390/ijgi5060092</pub-id>
</element-citation>
</ref>
<ref id="B37-sensors-19-02959"><label>37.</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Tian</surname>
<given-names>Z.</given-names>
</name>
<name><surname>Wang</surname>
<given-names>J.</given-names>
</name>
<name><surname>Yang</surname>
<given-names>X.</given-names>
</name>
<name><surname>Zhou</surname>
<given-names>M.</given-names>
</name>
</person-group>
<article-title>WiCatch: A Wi-Fi Based Hand Gesture Recognition System</article-title>
<source>IEEE Access</source>
<year>2018</year>
<volume>6</volume>
<fpage>16911</fpage>
<lpage>16923</lpage>
<pub-id pub-id-type="doi">10.1109/ACCESS.2018.2814575</pub-id>
</element-citation>
</ref>
<ref id="B38-sensors-19-02959"><label>38.</label>
<element-citation publication-type="confproc"><person-group person-group-type="author"><name><surname>Zhang</surname>
<given-names>O.</given-names>
</name>
<name><surname>Srinivasan</surname>
<given-names>K.</given-names>
</name>
</person-group>
<article-title>Mudra: User-friendly Fine-grained Gesture Recognition using WiFi Signals</article-title>
<source>Proceedings of the 12th International on Conference on emerging Networking EXperiments and Technologies</source>
<conf-loc>Irvine, CA, USA</conf-loc>
<conf-date>12–15 December 2016</conf-date>
<fpage>83</fpage>
<lpage>96</lpage>
</element-citation>
</ref>
<ref id="B39-sensors-19-02959"><label>39.</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Zhou</surname>
<given-names>R.</given-names>
</name>
<name><surname>Lu</surname>
<given-names>X.</given-names>
</name>
<name><surname>Zhao</surname>
<given-names>P.</given-names>
</name>
<name><surname>Chen</surname>
<given-names>J.</given-names>
</name>
</person-group>
<article-title>Device-free presence detection and localization with SVM and CSI fingerprinting</article-title>
<source>IEEE Sens. J.</source>
<year>2017</year>
<volume>17</volume>
<fpage>7990</fpage>
<lpage>7999</lpage>
<pub-id pub-id-type="doi">10.1109/JSEN.2017.2762428</pub-id>
</element-citation>
</ref>
<ref id="B40-sensors-19-02959"><label>40.</label>
<element-citation publication-type="confproc"><person-group person-group-type="author"><name><surname>Hong</surname>
<given-names>F.</given-names>
</name>
<name><surname>Wang</surname>
<given-names>X.</given-names>
</name>
<name><surname>Yang</surname>
<given-names>Y.</given-names>
</name>
<name><surname>Zong</surname>
<given-names>Y.</given-names>
</name>
<name><surname>Zhang</surname>
<given-names>Y.</given-names>
</name>
<name><surname>Guo</surname>
<given-names>Z.</given-names>
</name>
</person-group>
<article-title>WFID: Passive device-free human identification using WiFi signal</article-title>
<source>Proceedings of the 13th International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services</source>
<conf-loc>Hiroshima, Japan</conf-loc>
<conf-date>28 November–1 December 2016</conf-date>
<fpage>47</fpage>
<lpage>56</lpage>
</element-citation>
</ref>
<ref id="B41-sensors-19-02959"><label>41.</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Zhao</surname>
<given-names>J.</given-names>
</name>
<name><surname>Liu</surname>
<given-names>L.</given-names>
</name>
<name><surname>Wei</surname>
<given-names>Z.</given-names>
</name>
<name><surname>Zhang</surname>
<given-names>C.</given-names>
</name>
<name><surname>Wang</surname>
<given-names>W.</given-names>
</name>
<name><surname>Fan</surname>
<given-names>Y.</given-names>
</name>
</person-group>
<article-title>R-DEHM: CSI-Based Robust Duration Estimation of Human Motion with WiFi</article-title>
<source>Sensors</source>
<year>2019</year>
<volume>19</volume>
<elocation-id>1421</elocation-id>
<pub-id pub-id-type="doi">10.3390/s19061421</pub-id>
<pub-id pub-id-type="pmid">30909467</pub-id>
</element-citation>
</ref>
<ref id="B42-sensors-19-02959"><label>42.</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Zhu</surname>
<given-names>H.</given-names>
</name>
<name><surname>Xiao</surname>
<given-names>F.</given-names>
</name>
<name><surname>Sun</surname>
<given-names>L.</given-names>
</name>
<name><surname>Wang</surname>
<given-names>R.</given-names>
</name>
<name><surname>Yang</surname>
<given-names>P.</given-names>
</name>
</person-group>
<article-title>R-TTWD: Robust device-free through-the-wall detection of moving human with WiFi</article-title>
<source>IEEE J. Sel. Areas Commun.</source>
<year>2017</year>
<volume>35</volume>
<fpage>1090</fpage>
<lpage>1103</lpage>
<pub-id pub-id-type="doi">10.1109/JSAC.2017.2679578</pub-id>
</element-citation>
</ref>
<ref id="B43-sensors-19-02959"><label>43.</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Palipana</surname>
<given-names>S.</given-names>
</name>
<name><surname>Rojas</surname>
<given-names>D.</given-names>
</name>
<name><surname>Agrawal</surname>
<given-names>P.</given-names>
</name>
<name><surname>Pesch</surname>
<given-names>D.</given-names>
</name>
</person-group>
<article-title>FallDeFi: Ubiquitous fall detection using commodity Wi-Fi devices</article-title>
<source>Proc. ACM Interact. Mob. Wearable Ubiquitous Technol.</source>
<year>2018</year>
<volume>1</volume>
<fpage>155</fpage>
<pub-id pub-id-type="doi">10.1145/3161183</pub-id>
</element-citation>
</ref>
<ref id="B44-sensors-19-02959"><label>44.</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Jia</surname>
<given-names>W.</given-names>
</name>
<name><surname>Peng</surname>
<given-names>H.</given-names>
</name>
<name><surname>Ruan</surname>
<given-names>N.</given-names>
</name>
<name><surname>Tang</surname>
<given-names>Z.</given-names>
</name>
<name><surname>Zhao</surname>
<given-names>W.</given-names>
</name>
</person-group>
<article-title>WiFind: Driver fatigue detection with fine-grained Wi-Fi signal features</article-title>
<source>IEEE Trans. Big Data</source>
<year>2018</year>
<pub-id pub-id-type="doi">10.1109/TBDATA.2018.2848969</pub-id>
</element-citation>
</ref>
<ref id="B45-sensors-19-02959"><label>45.</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Zhang</surname>
<given-names>Z.</given-names>
</name>
<name><surname>Ishida</surname>
<given-names>S.</given-names>
</name>
<name><surname>Tagashira</surname>
<given-names>S.</given-names>
</name>
<name><surname>Fukuda</surname>
<given-names>A.</given-names>
</name>
</person-group>
<article-title>Danger-pose detection system using commodity Wi-Fi for bathroom monitoring</article-title>
<source>Sensors</source>
<year>2019</year>
<volume>19</volume>
<elocation-id>884</elocation-id>
<pub-id pub-id-type="doi">10.3390/s19040884</pub-id>
</element-citation>
</ref>
<ref id="B46-sensors-19-02959"><label>46.</label>
<element-citation publication-type="confproc"><person-group person-group-type="author"><name><surname>Fang</surname>
<given-names>B.</given-names>
</name>
<name><surname>Lane</surname>
<given-names>N.D.</given-names>
</name>
<name><surname>Zhang</surname>
<given-names>M.</given-names>
</name>
<name><surname>Boran</surname>
<given-names>A.</given-names>
</name>
<name><surname>Kawsar</surname>
<given-names>F.</given-names>
</name>
</person-group>
<article-title>BodyScan: Enabling radio-based sensing on wearable devices for contactless activity and vital sign monitoring</article-title>
<source>Proceedings of the 14th Annual International Conference on Mobile Systems, Applications, and Services</source>
<conf-loc>Singapore</conf-loc>
<conf-date>26–30 June 2016</conf-date>
<fpage>97</fpage>
<lpage>110</lpage>
</element-citation>
</ref>
<ref id="B47-sensors-19-02959"><label>47.</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gong</surname>
<given-names>L.</given-names>
</name>
<name><surname>Yang</surname>
<given-names>W.</given-names>
</name>
<name><surname>Man</surname>
<given-names>D.</given-names>
</name>
<name><surname>Dong</surname>
<given-names>G.</given-names>
</name>
<name><surname>Yu</surname>
<given-names>M.</given-names>
</name>
<name><surname>Lv</surname>
<given-names>J.</given-names>
</name>
</person-group>
<article-title>WiFi-based real-time calibration-free passive human motion detection</article-title>
<source>Sensors</source>
<year>2015</year>
<volume>15</volume>
<fpage>32213</fpage>
<lpage>32229</lpage>
<pub-id pub-id-type="doi">10.3390/s151229896</pub-id>
<pub-id pub-id-type="pmid">26703612</pub-id>
</element-citation>
</ref>
<ref id="B48-sensors-19-02959"><label>48.</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gong</surname>
<given-names>L.</given-names>
</name>
<name><surname>Yang</surname>
<given-names>W.</given-names>
</name>
<name><surname>Zhou</surname>
<given-names>Z.</given-names>
</name>
<name><surname>Man</surname>
<given-names>D.</given-names>
</name>
<name><surname>Cai</surname>
<given-names>H.</given-names>
</name>
<name><surname>Zhou</surname>
<given-names>X.</given-names>
</name>
<name><surname>Yang</surname>
<given-names>Z.</given-names>
</name>
</person-group>
<article-title>An adaptive wireless passive human detection via fine-grained physical layer information</article-title>
<source>Ad Hoc Netw.</source>
<year>2016</year>
<volume>38</volume>
<fpage>38</fpage>
<lpage>50</lpage>
<pub-id pub-id-type="doi">10.1016/j.adhoc.2015.09.005</pub-id>
</element-citation>
</ref>
<ref id="B49-sensors-19-02959"><label>49.</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gao</surname>
<given-names>Q.</given-names>
</name>
<name><surname>Wang</surname>
<given-names>J.</given-names>
</name>
<name><surname>Ma</surname>
<given-names>X.</given-names>
</name>
<name><surname>Feng</surname>
<given-names>X.</given-names>
</name>
<name><surname>Wang</surname>
<given-names>H.</given-names>
</name>
</person-group>
<article-title>CSI-based device-free wireless localization and activity recognition using radio image features</article-title>
<source>IEEE Trans. Veh. Technol.</source>
<year>2017</year>
<volume>66</volume>
<fpage>10346</fpage>
<lpage>10356</lpage>
<pub-id pub-id-type="doi">10.1109/TVT.2017.2737553</pub-id>
</element-citation>
</ref>
<ref id="B50-sensors-19-02959"><label>50.</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Wang</surname>
<given-names>W.</given-names>
</name>
<name><surname>Chen</surname>
<given-names>Y.</given-names>
</name>
<name><surname>Zhang</surname>
<given-names>Q.</given-names>
</name>
</person-group>
<article-title>Privacy-preserving location authentication in Wi-Fi networks using fine-grained physical layer signatures</article-title>
<source>IEEE Trans. Wirel. Commun.</source>
<year>2016</year>
<volume>15</volume>
<fpage>1218</fpage>
<lpage>1225</lpage>
<pub-id pub-id-type="doi">10.1109/TWC.2015.2487453</pub-id>
</element-citation>
</ref>
<ref id="B51-sensors-19-02959"><label>51.</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Wang</surname>
<given-names>Y.</given-names>
</name>
<name><surname>Jiang</surname>
<given-names>X.</given-names>
</name>
<name><surname>Cao</surname>
<given-names>R.</given-names>
</name>
<name><surname>Wang</surname>
<given-names>X.</given-names>
</name>
</person-group>
<article-title>Robust indoor human activity recognition using wireless signals</article-title>
<source>Sensors</source>
<year>2015</year>
<volume>15</volume>
<fpage>17195</fpage>
<lpage>17208</lpage>
<pub-id pub-id-type="doi">10.3390/s150717195</pub-id>
<pub-id pub-id-type="pmid">26184231</pub-id>
</element-citation>
</ref>
<ref id="B52-sensors-19-02959"><label>52.</label>
<element-citation publication-type="confproc"><person-group person-group-type="author"><name><surname>Zhang</surname>
<given-names>J.</given-names>
</name>
<name><surname>Wei</surname>
<given-names>B.</given-names>
</name>
<name><surname>Hu</surname>
<given-names>W.</given-names>
</name>
<name><surname>Kanhere</surname>
<given-names>S.S.</given-names>
</name>
</person-group>
<article-title>WiFi-ID: Human identification using wifi signal</article-title>
<source>Proceedings of the 2016 International Conference on Distributed Computing in Sensor Systems (DCOSS)</source>
<conf-loc>Washington, DC, USA</conf-loc>
<conf-date>26–28 May 2016</conf-date>
<fpage>75</fpage>
<lpage>82</lpage>
</element-citation>
</ref>
<ref id="B53-sensors-19-02959"><label>53.</label>
<element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Cover</surname>
<given-names>T.M.</given-names>
</name>
<name><surname>Thomas</surname>
<given-names>J.A.</given-names>
</name>
</person-group>
<source>Elements of Information Theory</source>
<publisher-name>John Wiley & Sons</publisher-name>
<publisher-loc>Hoboken, NJ, USA</publisher-loc>
<year>2012</year>
</element-citation>
</ref>
<ref id="B54-sensors-19-02959"><label>54.</label>
<element-citation publication-type="confproc"><person-group person-group-type="author"><name><surname>De Sanctis</surname>
<given-names>M.</given-names>
</name>
<name><surname>Cianca</surname>
<given-names>E.</given-names>
</name>
<name><surname>Di Domenico</surname>
<given-names>S.</given-names>
</name>
<name><surname>Provenziani</surname>
<given-names>D.</given-names>
</name>
<name><surname>Bianchi</surname>
<given-names>G.</given-names>
</name>
<name><surname>Ruggieri</surname>
<given-names>M.</given-names>
</name>
</person-group>
<article-title>Wibecam: Device free human activity recognition through wifi beacon-enabled camera</article-title>
<source>Proceedings of the 2nd workshop on Workshop on Physical Analytics</source>
<conf-loc>Florence, Italy</conf-loc>
<conf-date>22 May 2015</conf-date>
<fpage>7</fpage>
<lpage>12</lpage>
</element-citation>
</ref>
<ref id="B55-sensors-19-02959"><label>55.</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Mendel</surname>
<given-names>J.M.</given-names>
</name>
</person-group>
<article-title>Tutorial on higher-order statistics (spectra) in signal processing and system theory: Theoretical results and some applications</article-title>
<source>Proc. IEEE</source>
<year>1991</year>
<volume>79</volume>
<fpage>278</fpage>
<lpage>305</lpage>
<pub-id pub-id-type="doi">10.1109/5.75086</pub-id>
</element-citation>
</ref>
<ref id="B56-sensors-19-02959"><label>56.</label>
<element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Swami</surname>
<given-names>A.</given-names>
</name>
<name><surname>Mendel</surname>
<given-names>J.M.</given-names>
</name>
<name><surname>Nikias</surname>
<given-names>C.L.</given-names>
</name>
</person-group>
<source>Higher Order Spectral Analysis Toolbox, for Use with MATLAB</source>
<publisher-name>The MathWorks Inc.</publisher-name>
<publisher-loc>Natick, MA, USA</publisher-loc>
<year>1998</year>
</element-citation>
</ref>
<ref id="B57-sensors-19-02959"><label>57.</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Chang</surname>
<given-names>C.-C.</given-names>
</name>
<name><surname>Lin</surname>
<given-names>C.-J.</given-names>
</name>
</person-group>
<article-title>LIBSVM: A library for support vector machines</article-title>
<source>ACM Trans. Intell. Syst. Technol.</source>
<year>2011</year>
<volume>2</volume>
<fpage>1</fpage>
<lpage>27</lpage>
<pub-id pub-id-type="doi">10.1145/1961189.1961199</pub-id>
</element-citation>
</ref>
<ref id="B58-sensors-19-02959"><label>58.</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Caselli</surname>
<given-names>N.K.</given-names>
</name>
<name><surname>Sehyr</surname>
<given-names>Z.S.</given-names>
</name>
<name><surname>Cohen-Goldberg</surname>
<given-names>A.M.</given-names>
</name>
<name><surname>Emmorey</surname>
<given-names>K.</given-names>
</name>
</person-group>
<article-title>ASL-LEX: A lexical database of American Sign Language</article-title>
<source>Behav. Res. Methods</source>
<year>2017</year>
<volume>49</volume>
<fpage>784</fpage>
<lpage>801</lpage>
<pub-id pub-id-type="doi">10.3758/s13428-016-0742-0</pub-id>
<pub-id pub-id-type="pmid">27193158</pub-id>
</element-citation>
</ref>
<ref id="B59-sensors-19-02959"><label>59.</label>
<element-citation publication-type="web"><person-group person-group-type="author"><name><surname>Halperin</surname>
<given-names>D.</given-names>
</name>
<name><surname>Hu</surname>
<given-names>W.</given-names>
</name>
<name><surname>Sheth</surname>
<given-names>A.</given-names>
</name>
<name><surname>Wetherall</surname>
<given-names>D.</given-names>
</name>
</person-group>
<article-title>Linux 802.11 n CSI Tool</article-title>
<year>2010</year>
<comment>Available online: <ext-link ext-link-type="uri" xlink:href="http://dhalperi.github.io/linux-80211n-csitool">http://dhalperi.github.io/linux-80211n-csitool</ext-link>
</comment>
<date-in-citation content-type="access-date" iso-8601-date="2016-12-02">(accessed on 2 December 2016)</date-in-citation>
</element-citation>
</ref>
<ref id="B60-sensors-19-02959"><label>60.</label>
<element-citation publication-type="confproc"><person-group person-group-type="author"><name><surname>Kumar</surname>
<given-names>S.</given-names>
</name>
<name><surname>Cifuentes</surname>
<given-names>D.</given-names>
</name>
<name><surname>Gollakota</surname>
<given-names>S.</given-names>
</name>
<name><surname>Katabi</surname>
<given-names>D.</given-names>
</name>
</person-group>
<article-title>Bringing cross-layer MIMO to today’s wireless LANs</article-title>
<source>Proceedings of the ACM SIGCOMM Computer Communication Review</source>
<conf-loc>Hong Kong, China</conf-loc>
<conf-date>12–16 August 2013</conf-date>
<fpage>387</fpage>
<lpage>398</lpage>
</element-citation>
</ref>
<ref id="B61-sensors-19-02959"><label>61.</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Harkat</surname>
<given-names>H.</given-names>
</name>
<name><surname>Ruano</surname>
<given-names>A.</given-names>
</name>
<name><surname>Ruano</surname>
<given-names>M.</given-names>
</name>
<name><surname>Bennani</surname>
<given-names>S.</given-names>
</name>
</person-group>
<article-title>GPR target detection using a neural network classifier designed by a multi-objective genetic algorithm</article-title>
<source>Appl. Soft Comput.</source>
<year>2019</year>
<volume>79</volume>
<fpage>310</fpage>
<lpage>325</lpage>
<pub-id pub-id-type="doi">10.1016/j.asoc.2019.03.030</pub-id>
</element-citation>
</ref>
<ref id="B62-sensors-19-02959"><label>62.</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Hoque</surname>
<given-names>N.</given-names>
</name>
<name><surname>Bhattacharyya</surname>
<given-names>D.K.</given-names>
</name>
<name><surname>Kalita</surname>
<given-names>J.K.</given-names>
</name>
</person-group>
<article-title>MIFS-ND: A mutual information-based feature selection method</article-title>
<source>Expert Syst. Appl.</source>
<year>2014</year>
<volume>41</volume>
<fpage>6371</fpage>
<lpage>6385</lpage>
<pub-id pub-id-type="doi">10.1016/j.eswa.2014.04.019</pub-id>
</element-citation>
</ref>
<ref id="B63-sensors-19-02959"><label>63.</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Mariello</surname>
<given-names>A.</given-names>
</name>
<name><surname>Battiti</surname>
<given-names>R.</given-names>
</name>
</person-group>
<article-title>Feature Selection Based on the Neighborhood Entropy</article-title>
<source>IEEE Trans. Neural Netw. Learn. Syst.</source>
<year>2018</year>
<fpage>1</fpage>
<lpage>10</lpage>
<pub-id pub-id-type="doi">10.1109/TNNLS.2018.2830700</pub-id>
</element-citation>
</ref>
</ref-list>
</back>
<floats-group><fig id="sensors-19-02959-f001" orientation="portrait" position="float"><label>Figure 1</label>
<caption><p>CSI representation of MIMO.</p>
</caption>
<graphic xlink:href="sensors-19-02959-g001"></graphic>
</fig>
<fig id="sensors-19-02959-f002" orientation="portrait" position="float"><label>Figure 2</label>
<caption><p>Wi-Fi signal propagation in an indoor environment.</p>
</caption>
<graphic xlink:href="sensors-19-02959-g002"></graphic>
</fig>
<fig id="sensors-19-02959-f003" orientation="portrait" position="float"><label>Figure 3</label>
<caption><p>System overview.</p>
</caption>
<graphic xlink:href="sensors-19-02959-g003"></graphic>
</fig>
<fig id="sensors-19-02959-f004" orientation="portrait" position="float"><label>Figure 4</label>
<caption><p>HOS-Re methodology representing (<bold>a</bold>
) Feature extraction; (<bold>b</bold>
) Feature selection; (<bold>c</bold>
) Classification.</p>
</caption>
<graphic xlink:href="sensors-19-02959-g004"></graphic>
</fig>
<fig id="sensors-19-02959-f005" orientation="portrait" position="float"><label>Figure 5</label>
<caption><p>Feature extraction.</p>
</caption>
<graphic xlink:href="sensors-19-02959-g005"></graphic>
</fig>
<fig id="sensors-19-02959-f006" orientation="portrait" position="float"><label>Figure 6</label>
<caption><p>Schematic representation of testing environments as reported in SignFi [<xref rid="B29-sensors-19-02959" ref-type="bibr">29</xref>
].</p>
</caption>
<graphic xlink:href="sensors-19-02959-g006"></graphic>
</fig>
<fig id="sensors-19-02959-f007" orientation="portrait" position="float"><label>Figure 7</label>
<caption><p>Cumulant feature extraction.</p>
</caption>
<graphic xlink:href="sensors-19-02959-g007"></graphic>
</fig>
<fig id="sensors-19-02959-f008" orientation="portrait" position="float"><label>Figure 8</label>
<caption><p>The 2D contour plot of third order cumulants (<bold>a</bold>
) ‘HORSE’ (Sample 25); (<bold>b</bold>
) ‘MONKEY’ (Sample 27); (<bold>c</bold>
) ‘SNAKE’ (Sample 30); (<bold>d</bold>
) ‘TIGER’ (Sample 31).</p>
</caption>
<graphic xlink:href="sensors-19-02959-g008"></graphic>
</fig>
<fig id="sensors-19-02959-f009" orientation="portrait" position="float"><label>Figure 9</label>
<caption><p>Comparison of feature selection algorithms with <italic>k</italic>
(<bold>a</bold>
) 276 gestures − lab dataset; (<bold>b</bold>
) 276 gestures − home dataset; (<bold>c</bold>
) 276 gestures − lab + home dataset; (<bold>d</bold>
) 150 gestures − lab dataset.</p>
</caption>
<graphic xlink:href="sensors-19-02959-g009"></graphic>
</fig>
<fig id="sensors-19-02959-f010" orientation="portrait" position="float"><label>Figure 10</label>
<caption><p>Performance of MIFS with <italic>k</italic>
features on a different dataset.</p>
</caption>
<graphic xlink:href="sensors-19-02959-g010"></graphic>
</fig>
<fig id="sensors-19-02959-f011" orientation="portrait" position="float"><label>Figure 11</label>
<caption><p>Performance of MIFS with β on different datasets.</p>
</caption>
<graphic xlink:href="sensors-19-02959-g011"></graphic>
</fig>
<fig id="sensors-19-02959-f012" orientation="portrait" position="float"><label>Figure 12</label>
<caption><p>Performance of CIFE with <italic>k</italic>
on different datasets.</p>
</caption>
<graphic xlink:href="sensors-19-02959-g012"></graphic>
</fig>
<fig id="sensors-19-02959-f013" orientation="portrait" position="float"><label>Figure 13</label>
<caption><p>SVM classifier execution time.</p>
</caption>
<graphic xlink:href="sensors-19-02959-g013"></graphic>
</fig>
<table-wrap id="sensors-19-02959-t001" orientation="portrait" position="float"><object-id pub-id-type="pii">sensors-19-02959-t001_Table 1</object-id>
<label>Table 1</label>
<caption><p>Gesture class representation—part of the complete dataset [<xref rid="B29-sensors-19-02959" ref-type="bibr">29</xref>
].</p>
</caption>
<table frame="hsides" rules="groups"><thead><tr><th align="center" valign="middle" style="border-top:solid thin;border-bottom:solid thin" rowspan="1" colspan="1">Gesture<break></break>
Class</th>
<th align="center" valign="middle" style="border-top:solid thin;border-bottom:solid thin" rowspan="1" colspan="1">Count of<break></break>
Samples</th>
<th colspan="9" align="center" valign="middle" style="border-top:solid thin;border-bottom:solid thin" rowspan="1">Description</th>
</tr>
</thead>
<tbody><tr><td rowspan="2" align="center" valign="middle" colspan="1">Common</td>
<td rowspan="2" align="center" valign="middle" colspan="1">16</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘FINISH’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘GO’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘HELP’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘LIKE’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘LOVE’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘MORE’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘NEED’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘NO’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘NOT’</td>
</tr>
<tr><td align="center" valign="middle" rowspan="1" colspan="1">‘PLEASE’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘RIGHT’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘SORRY’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘WANT’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘WITH’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘WITHOUT’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘YES’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">-</td>
<td align="center" valign="middle" rowspan="1" colspan="1">-</td>
</tr>
<tr><td rowspan="2" align="center" valign="middle" colspan="1">Animals</td>
<td rowspan="2" align="center" valign="middle" colspan="1">15</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘ANIMAL’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘BEAR’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘BIRD’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘CAT’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘COW’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘DOG’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘ELEPHANT’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘GIRAFFE’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘HORSE’</td>
</tr>
<tr><td align="center" valign="middle" rowspan="1" colspan="1">‘LION’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘MONKEY’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘PET’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘RAT’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘SNAKE’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘TIGER’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">-</td>
<td align="center" valign="middle" rowspan="1" colspan="1">-</td>
<td align="center" valign="middle" rowspan="1" colspan="1">-</td>
</tr>
<tr><td rowspan="2" align="center" valign="middle" colspan="1">Colors</td>
<td rowspan="2" align="center" valign="middle" colspan="1">12</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘BLACK’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘BLUE’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘BROWN’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘COLOR’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘GRAY’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘GREEN’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘ORANGE’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘PINK’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘PURPLE’</td>
</tr>
<tr><td align="center" valign="middle" rowspan="1" colspan="1">‘RED’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘WHITE’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘YELLOW’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">-</td>
<td align="center" valign="middle" rowspan="1" colspan="1">-</td>
<td align="center" valign="middle" rowspan="1" colspan="1">-</td>
<td align="center" valign="middle" rowspan="1" colspan="1">-</td>
<td align="center" valign="middle" rowspan="1" colspan="1">-</td>
<td align="center" valign="middle" rowspan="1" colspan="1">-</td>
</tr>
<tr><td rowspan="2" align="center" valign="middle" colspan="1">Descriptions</td>
<td rowspan="2" align="center" valign="middle" colspan="1">32</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘AWFUL’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘BAD’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘BALD’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘BEAUTIFUL’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘CLEAN’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘COLD’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘CUTE’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘DEPRESSED’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘DIFFERENT’</td>
</tr>
<tr><td align="center" valign="middle" rowspan="1" colspan="1">‘EXCITED’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘FINE’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘GOOD’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">…</td>
<td align="center" valign="middle" rowspan="1" colspan="1">-</td>
<td align="center" valign="middle" rowspan="1" colspan="1">-</td>
<td align="center" valign="middle" rowspan="1" colspan="1">-</td>
<td align="center" valign="middle" rowspan="1" colspan="1">-</td>
<td align="center" valign="middle" rowspan="1" colspan="1">-</td>
</tr>
<tr><td rowspan="2" align="center" valign="middle" colspan="1">Family</td>
<td rowspan="2" align="center" valign="middle" colspan="1">31</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘AUNT’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘BABY’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘BOYFRIEND’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘BROTHER’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘CHILDREN’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘COUSIN(FEMALE)’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘COUSIN (MALE)’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘DAUGHTER’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘DIVORCE’</td>
</tr>
<tr><td align="center" valign="middle" rowspan="1" colspan="1">‘DAUGHTER’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘DIVORCE’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘FAMILY’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘FATHER’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘FRIEND’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">…</td>
<td align="center" valign="middle" rowspan="1" colspan="1">-</td>
<td align="center" valign="middle" rowspan="1" colspan="1">-</td>
<td align="center" valign="middle" rowspan="1" colspan="1">-</td>
</tr>
<tr><td rowspan="2" align="center" valign="middle" colspan="1">Food</td>
<td rowspan="2" align="center" valign="middle" colspan="1">54</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘DELICIOUS’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘DINNER’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘DRINK’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘EAT’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘EGGS’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘FISH’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘FOOD’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘FRUIT’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘GRAPES’</td>
</tr>
<tr><td align="center" valign="middle" rowspan="1" colspan="1">‘HAMBURGER’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘HOTDOG’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘ICECREAM’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘KETCHUP’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘LEMON’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">…</td>
<td align="center" valign="middle" rowspan="1" colspan="1">-</td>
<td align="center" valign="middle" rowspan="1" colspan="1">-</td>
<td align="center" valign="middle" rowspan="1" colspan="1">-</td>
</tr>
<tr><td rowspan="2" align="center" valign="middle" colspan="1">Home</td>
<td rowspan="2" align="center" valign="middle" colspan="1">17</td>
<td align="center" valign="middle" rowspan="1" colspan="1">APARTMENT’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘BATHROOM’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘BICYCLE’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘BUY’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘CAR’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘CLEAN’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘DOOR’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘GARAGE’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘GO-IN/ENTER’</td>
</tr>
<tr><td align="center" valign="middle" rowspan="1" colspan="1">‘HOME’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘HOUSE’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘KITCHEN’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘ROOM’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘SHOWER’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘SOFA’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘TELEPHONE’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘TOILET’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">-</td>
</tr>
<tr><td rowspan="2" align="center" valign="middle" colspan="1">People</td>
<td rowspan="2" align="center" valign="middle" colspan="1">13</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘ASK-YOU’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘BOY’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘DEAF’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘GIRL’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘GIVE-YOU’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘HEARING’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘I/ME’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘MAN’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘MY/MINE’</td>
</tr>
<tr><td align="center" valign="middle" rowspan="1" colspan="1">‘WOMAN’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘WORK’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘YOU’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘YOUR’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">-</td>
<td align="center" valign="middle" rowspan="1" colspan="1">-</td>
<td align="center" valign="middle" rowspan="1" colspan="1">-</td>
<td align="center" valign="middle" rowspan="1" colspan="1">-</td>
<td align="center" valign="middle" rowspan="1" colspan="1">-</td>
</tr>
<tr><td align="center" valign="middle" rowspan="1" colspan="1">Questions</td>
<td align="center" valign="middle" rowspan="1" colspan="1">6</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘HOW’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘WHAT’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘WHEN’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘WHERE’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘WHO’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘WHY’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">-</td>
<td align="center" valign="middle" rowspan="1" colspan="1">-</td>
<td align="center" valign="middle" rowspan="1" colspan="1">-</td>
</tr>
<tr><td rowspan="2" align="center" valign="middle" colspan="1">School</td>
<td rowspan="2" align="center" valign="middle" colspan="1">26</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘BOOK’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘BUS’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘CLASS’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘COLLEGE’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘DORM’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘DRAW’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘ELEMENTARY’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘ENGLISH’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘HIGH-SCHOOL’</td>
</tr>
<tr><td align="center" valign="middle" rowspan="1" colspan="1">‘HISTORY’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘KNOW’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">…</td>
<td align="center" valign="middle" rowspan="1" colspan="1">-</td>
<td align="center" valign="middle" rowspan="1" colspan="1">-</td>
<td align="center" valign="middle" rowspan="1" colspan="1">-</td>
<td align="center" valign="middle" rowspan="1" colspan="1">-</td>
<td align="center" valign="middle" rowspan="1" colspan="1">-</td>
<td align="center" valign="middle" rowspan="1" colspan="1">-</td>
</tr>
<tr><td rowspan="2" align="center" valign="middle" colspan="1">Time</td>
<td rowspan="2" align="center" valign="middle" colspan="1">31</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘AFTER’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘AFTERNOON’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘AGAIN’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘ALWAYS’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘BEFORE’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘DAY’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘FRIDAY’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘FUTURE’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘HOUR’</td>
</tr>
<tr><td align="center" valign="middle" rowspan="1" colspan="1">‘LAST/PAST’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘MIDNIGHT’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">…</td>
<td align="center" valign="middle" rowspan="1" colspan="1">-</td>
<td align="center" valign="middle" rowspan="1" colspan="1">-</td>
<td align="center" valign="middle" rowspan="1" colspan="1">-</td>
<td align="center" valign="middle" rowspan="1" colspan="1">-</td>
<td align="center" valign="middle" rowspan="1" colspan="1">-</td>
<td align="center" valign="middle" rowspan="1" colspan="1">-</td>
</tr>
<tr><td rowspan="2" align="center" valign="middle" style="border-bottom:solid thin" colspan="1">Others</td>
<td rowspan="2" align="center" valign="middle" style="border-bottom:solid thin" colspan="1">23</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘AIRCONDITIONER’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘BODY’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘LEG’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘FAN’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘RADIO’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘TV’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">REFRIGERATOR</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘BROWSER’</td>
<td align="center" valign="middle" rowspan="1" colspan="1">‘WINDOW’</td>
</tr>
<tr><td align="center" valign="middle" style="border-bottom:solid thin" rowspan="1" colspan="1">‘WASHER’</td>
<td align="center" valign="middle" style="border-bottom:solid thin" rowspan="1" colspan="1">‘COMPUTER’</td>
<td align="center" valign="middle" style="border-bottom:solid thin" rowspan="1" colspan="1">…</td>
<td align="center" valign="middle" style="border-bottom:solid thin" rowspan="1" colspan="1">-</td>
<td align="center" valign="middle" style="border-bottom:solid thin" rowspan="1" colspan="1">-</td>
<td align="center" valign="middle" style="border-bottom:solid thin" rowspan="1" colspan="1">-</td>
<td align="center" valign="middle" style="border-bottom:solid thin" rowspan="1" colspan="1">-</td>
<td align="center" valign="middle" style="border-bottom:solid thin" rowspan="1" colspan="1">-</td>
<td align="center" valign="middle" style="border-bottom:solid thin" rowspan="1" colspan="1">-</td>
</tr>
</tbody>
</table>
</table-wrap>
<table-wrap id="sensors-19-02959-t002" orientation="portrait" position="float"><object-id pub-id-type="pii">sensors-19-02959-t002_Table 2</object-id>
<label>Table 2</label>
<caption><p>Mutual information-based feature selection Algorithms.</p>
</caption>
<table frame="hsides" rules="groups"><thead><tr><th align="center" valign="middle" style="border-top:solid thin;border-bottom:solid thin" rowspan="1" colspan="1">Algorithms</th>
<th align="center" valign="middle" style="border-top:solid thin;border-bottom:solid thin" rowspan="1" colspan="1">Description</th>
</tr>
</thead>
<tbody><tr><td align="center" valign="middle" rowspan="1" colspan="1">MIFS [<xref rid="B20-sensors-19-02959" ref-type="bibr">20</xref>
]</td>
<td align="left" valign="middle" rowspan="1" colspan="1">A greedy approach that selects only highly informative feature and forms an optimal feature subset. It identifies the non-linear relationship between the selected feature and its output class to reduce the amount of redundancy and uncertainty in the feature vector [<xref rid="B61-sensors-19-02959" ref-type="bibr">61</xref>
,<xref rid="B62-sensors-19-02959" ref-type="bibr">62</xref>
,<xref rid="B63-sensors-19-02959" ref-type="bibr">63</xref>
].</td>
</tr>
<tr><td align="center" valign="middle" rowspan="1" colspan="1">mRMR [<xref rid="B21-sensors-19-02959" ref-type="bibr">21</xref>
,<xref rid="B22-sensors-19-02959" ref-type="bibr">22</xref>
]</td>
<td align="left" valign="middle" rowspan="1" colspan="1">An incremental feature selection algorithm that forms an optimal feature subset by selecting features with minimum Redundancy and Maximum Relevancy.</td>
</tr>
<tr><td align="center" valign="middle" rowspan="1" colspan="1">CIFE [<xref rid="B23-sensors-19-02959" ref-type="bibr">23</xref>
]</td>
<td align="left" valign="middle" rowspan="1" colspan="1">It forms an optimal feature subset that maximizes the class-relevant information between the features by reducing the redundancies among the features.</td>
</tr>
<tr><td align="center" valign="middle" rowspan="1" colspan="1">JMI [<xref rid="B24-sensors-19-02959" ref-type="bibr">24</xref>
]</td>
<td align="left" valign="middle" rowspan="1" colspan="1">An increment to mutual information which finds the conditional mutual information to define the joint mutual information among the features and eliminates the redundant features if any.</td>
</tr>
<tr><td align="center" valign="middle" rowspan="1" colspan="1">CMI [<xref rid="B25-sensors-19-02959" ref-type="bibr">25</xref>
]</td>
<td align="left" valign="middle" rowspan="1" colspan="1">Selects the features only if it carries additional information and eases the prediction task of the output class.</td>
</tr>
<tr><td align="center" valign="middle" rowspan="1" colspan="1">DISR [<xref rid="B26-sensors-19-02959" ref-type="bibr">26</xref>
]</td>
<td align="left" valign="middle" rowspan="1" colspan="1">DISR measures the symmetrical relevance and combines all features variable to describe more information about the output class instead of focusing on individual feature information.</td>
</tr>
<tr><td align="center" valign="middle" rowspan="1" colspan="1">ICAP [<xref rid="B27-sensors-19-02959" ref-type="bibr">27</xref>
]</td>
<td align="left" valign="middle" rowspan="1" colspan="1">Features are selected based on the interactions and understand the regularities of the feature set.</td>
</tr>
<tr><td align="center" valign="middle" style="border-bottom:solid thin" rowspan="1" colspan="1">CONDRED [<xref rid="B28-sensors-19-02959" ref-type="bibr">28</xref>
]</td>
<td align="left" valign="middle" style="border-bottom:solid thin" rowspan="1" colspan="1">Identifies the conditional redundancy exists between the features.</td>
</tr>
</tbody>
</table>
</table-wrap>
<table-wrap id="sensors-19-02959-t003" orientation="portrait" position="float"><object-id pub-id-type="pii">sensors-19-02959-t003_Table 3</object-id>
<label>Table 3</label>
<caption><p>Comparison of overall recognition accuracy.</p>
</caption>
<table frame="hsides" rules="groups"><thead><tr><th rowspan="2" align="center" valign="middle" style="border-top:solid thin;border-bottom:solid thin" colspan="1">Dataset</th>
<th rowspan="2" align="center" valign="middle" style="border-top:solid thin;border-bottom:solid thin" colspan="1">Number of Gestures (<italic>N<sub>g</sub>
</italic>
)</th>
<th rowspan="2" align="center" valign="middle" style="border-top:solid thin;border-bottom:solid thin" colspan="1">Number of<break></break>
Users (<italic>N<sub>u</sub>
</italic>
)</th>
<th rowspan="2" align="center" valign="middle" style="border-top:solid thin;border-bottom:solid thin" colspan="1">Number of Samples per Gesture per User (<italic>N<sub>su</sub>
</italic>
)</th>
<th rowspan="2" align="center" valign="middle" style="border-top:solid thin;border-bottom:solid thin" colspan="1">Total Number of Gesture Samples (<italic>N<sub>gs</sub>
</italic>
)</th>
<th rowspan="2" align="center" valign="middle" style="border-top:solid thin;border-bottom:solid thin" colspan="1">Number of Samples<break></break>
Per User</th>
<th colspan="3" align="center" valign="middle" style="border-top:solid thin;border-bottom:solid thin" rowspan="1">Overall Recognition Accuracy</th>
</tr>
<tr><th align="center" valign="middle" style="border-bottom:solid thin" rowspan="1" colspan="1">SignFi + CNN without SP [<xref rid="B29-sensors-19-02959" ref-type="bibr">29</xref>
]</th>
<th align="center" valign="middle" style="border-bottom:solid thin" rowspan="1" colspan="1">SignFi + CNN with SP [<xref rid="B29-sensors-19-02959" ref-type="bibr">29</xref>
]</th>
<th align="center" valign="middle" style="border-bottom:solid thin" rowspan="1" colspan="1">Present Work without SP (HOS-Re)</th>
</tr>
</thead>
<tbody><tr><td align="center" valign="middle" rowspan="1" colspan="1"><italic>Lab</italic>
276</td>
<td align="center" valign="middle" rowspan="1" colspan="1">276</td>
<td align="center" valign="middle" rowspan="1" colspan="1">1</td>
<td align="center" valign="middle" rowspan="1" colspan="1">20</td>
<td align="center" valign="middle" rowspan="1" colspan="1">5520</td>
<td align="center" valign="middle" rowspan="1" colspan="1">5520</td>
<td align="center" valign="middle" rowspan="1" colspan="1"><bold>95.72</bold>
</td>
<td align="center" valign="middle" rowspan="1" colspan="1">98.01</td>
<td align="center" valign="middle" rowspan="1" colspan="1"><bold>97.84</bold>
</td>
</tr>
<tr><td align="center" valign="middle" rowspan="1" colspan="1"><italic>Home</italic>
276</td>
<td align="center" valign="middle" rowspan="1" colspan="1">276</td>
<td align="center" valign="middle" rowspan="1" colspan="1">1</td>
<td align="center" valign="middle" rowspan="1" colspan="1">10</td>
<td align="center" valign="middle" rowspan="1" colspan="1">2760</td>
<td align="center" valign="middle" rowspan="1" colspan="1">2760</td>
<td align="center" valign="middle" rowspan="1" colspan="1"><bold>93.98</bold>
</td>
<td align="center" valign="middle" rowspan="1" colspan="1">98.91</td>
<td align="center" valign="middle" rowspan="1" colspan="1"><bold>98.26</bold>
</td>
</tr>
<tr><td align="center" valign="middle" rowspan="1" colspan="1"><italic>Lab</italic>
+ <italic>Home</italic>
276</td>
<td align="center" valign="middle" rowspan="1" colspan="1">276</td>
<td align="center" valign="middle" rowspan="1" colspan="1">1</td>
<td align="center" valign="middle" rowspan="1" colspan="1">-</td>
<td align="center" valign="middle" rowspan="1" colspan="1">8280</td>
<td align="center" valign="middle" rowspan="1" colspan="1">8280</td>
<td align="center" valign="middle" rowspan="1" colspan="1"><bold>92.21</bold>
</td>
<td align="center" valign="middle" rowspan="1" colspan="1">94.81</td>
<td align="center" valign="middle" rowspan="1" colspan="1"><bold>96.34</bold>
</td>
</tr>
<tr><td align="center" valign="middle" style="border-bottom:solid thin" rowspan="1" colspan="1"><italic>Lab</italic>
150</td>
<td align="center" valign="middle" style="border-bottom:solid thin" rowspan="1" colspan="1">150</td>
<td align="center" valign="middle" style="border-bottom:solid thin" rowspan="1" colspan="1">5</td>
<td align="center" valign="middle" style="border-bottom:solid thin" rowspan="1" colspan="1">10</td>
<td align="center" valign="middle" style="border-bottom:solid thin" rowspan="1" colspan="1">7500</td>
<td align="center" valign="middle" style="border-bottom:solid thin" rowspan="1" colspan="1">1500</td>
<td align="center" valign="middle" style="border-bottom:solid thin" rowspan="1" colspan="1">-</td>
<td align="center" valign="middle" style="border-bottom:solid thin" rowspan="1" colspan="1">86.66</td>
<td align="center" valign="middle" style="border-bottom:solid thin" rowspan="1" colspan="1"><bold>96.23</bold>
</td>
</tr>
</tbody>
</table>
</table-wrap>
<table-wrap id="sensors-19-02959-t004" orientation="portrait" position="float"><object-id pub-id-type="pii">sensors-19-02959-t004_Table 4</object-id>
<label>Table 4</label>
<caption><p>Comparison of recognition accuracy of systems using COTS Wi-Fi devices.</p>
</caption>
<table frame="hsides" rules="groups"><thead><tr><th align="center" valign="middle" style="border-top:solid thin;border-bottom:solid thin" rowspan="1" colspan="1">Reference/<break></break>
Sensing Metric</th>
<th align="center" valign="middle" style="border-top:solid thin;border-bottom:solid thin" rowspan="1" colspan="1">Signal Processing (SP)</th>
<th align="center" valign="middle" style="border-top:solid thin;border-bottom:solid thin" rowspan="1" colspan="1">Learning Algorithm</th>
<th align="center" valign="middle" style="border-top:solid thin;border-bottom:solid thin" rowspan="1" colspan="1">Application</th>
<th align="center" valign="middle" style="border-top:solid thin;border-bottom:solid thin" rowspan="1" colspan="1">Number of Gestures</th>
<th align="center" valign="middle" style="border-top:solid thin;border-bottom:solid thin" rowspan="1" colspan="1">Recognition<break></break>
Accuracy</th>
</tr>
</thead>
<tbody><tr><td align="center" valign="middle" rowspan="1" colspan="1">Wigest [<xref rid="B34-sensors-19-02959" ref-type="bibr">34</xref>
]/<break></break>
RSSI </td>
<td align="center" valign="middle" rowspan="1" colspan="1">Wavelet Filter; FFT, DWT;<break></break>
Threshold based signal extraction;</td>
<td align="center" valign="middle" rowspan="1" colspan="1">Pattern<break></break>
Matching</td>
<td align="center" valign="middle" rowspan="1" colspan="1">Hand Gesture Recognition:<break></break>
Hand movements with<break></break>
mobile device.</td>
<td align="center" valign="middle" rowspan="1" colspan="1">7 hand<break></break>
gestures</td>
<td align="center" valign="middle" rowspan="1" colspan="1">87.5%/96%<break></break>
(1 AP/3 AP’s)</td>
</tr>
<tr><td align="center" valign="middle" rowspan="1" colspan="1">WiGer [<xref rid="B36-sensors-19-02959" ref-type="bibr">36</xref>
]/<break></break>
CSI</td>
<td align="center" valign="middle" rowspan="1" colspan="1">Butterworth low<break></break>
pass filter</td>
<td align="center" valign="middle" rowspan="1" colspan="1">Segmentation: multi-level<break></break>
wavelet decomposition<break></break>
algorithm and the short-time<break></break>
energy algorithm, DTW</td>
<td align="center" valign="middle" rowspan="1" colspan="1">Hand gesture<break></break>
recognition</td>
<td align="center" valign="middle" rowspan="1" colspan="1">7 hand<break></break>
gestures</td>
<td align="center" valign="middle" rowspan="1" colspan="1">97.28%, 91.8%,<break></break>
95.5%, 94.4% and<break></break>
91% (Scenario 1 to 5)</td>
</tr>
<tr><td align="center" valign="middle" rowspan="1" colspan="1">WiCatch [<xref rid="B37-sensors-19-02959" ref-type="bibr">37</xref>
]/<break></break>
CSI</td>
<td align="center" valign="middle" rowspan="1" colspan="1">MUSIC algorithm</td>
<td align="center" valign="middle" rowspan="1" colspan="1">SVM</td>
<td align="center" valign="middle" rowspan="1" colspan="1">Two hand moving<break></break>
trajectories recognition</td>
<td align="center" valign="middle" rowspan="1" colspan="1">9 hand gesture </td>
<td align="center" valign="middle" rowspan="1" colspan="1">95%</td>
</tr>
<tr><td align="center" valign="middle" rowspan="1" colspan="1">WiFinger [<xref rid="B33-sensors-19-02959" ref-type="bibr">33</xref>
]/<break></break>
RSSI and CSI</td>
<td align="center" valign="middle" rowspan="1" colspan="1">Butterworth filter, Wavelet<break></break>
based denoising and PCA</td>
<td align="center" valign="middle" rowspan="1" colspan="1">DTW</td>
<td align="center" valign="middle" rowspan="1" colspan="1">Finger gesture<break></break>
recognition</td>
<td align="center" valign="middle" rowspan="1" colspan="1">8 finger<break></break>
gestures</td>
<td align="center" valign="middle" rowspan="1" colspan="1">76%(RSSI)<break></break>
and 95% (CSI)</td>
</tr>
<tr><td align="center" valign="middle" rowspan="1" colspan="1">WiKey [<xref rid="B15-sensors-19-02959" ref-type="bibr">15</xref>
]/<break></break>
CSI</td>
<td align="center" valign="middle" rowspan="1" colspan="1">Low pass filter, PCA, DWT Shape features</td>
<td align="center" valign="middle" rowspan="1" colspan="1">DTW</td>
<td align="center" valign="middle" rowspan="1" colspan="1">Keystroke<break></break>
recognition</td>
<td align="center" valign="middle" rowspan="1" colspan="1">37 keys</td>
<td align="center" valign="middle" rowspan="1" colspan="1">77.4% to<break></break>
93.4%</td>
</tr>
<tr><td align="center" valign="middle" rowspan="1" colspan="1">Mudra [<xref rid="B38-sensors-19-02959" ref-type="bibr">38</xref>
]/<break></break>
CSI</td>
<td align="center" valign="middle" rowspan="1" colspan="1">Thresholding</td>
<td align="center" valign="middle" rowspan="1" colspan="1">Stretch limited DTW</td>
<td align="center" valign="middle" rowspan="1" colspan="1">Mudra<break></break>
recognition</td>
<td align="center" valign="middle" rowspan="1" colspan="1">9 finger<break></break>
gestures</td>
<td align="center" valign="middle" rowspan="1" colspan="1">96%</td>
</tr>
<tr><td align="center" valign="middle" rowspan="1" colspan="1">SignFi [<xref rid="B29-sensors-19-02959" ref-type="bibr">29</xref>
]/<break></break>
CSI</td>
<td align="center" valign="middle" rowspan="1" colspan="1">Without SP</td>
<td align="center" valign="middle" rowspan="1" colspan="1">CNN</td>
<td align="center" valign="middle" rowspan="1" colspan="1">Sign language<break></break>
gesture recognition</td>
<td align="center" valign="middle" rowspan="1" colspan="1">276<break></break>
gestures </td>
<td align="center" valign="middle" rowspan="1" colspan="1">95.72%, 93.98%, and 92.21% for <italic>lab</italic>
276, <italic>home</italic>
276 and <italic>lab</italic>
+ <italic>home</italic>
276 environments respectively </td>
</tr>
<tr><td align="center" valign="middle" rowspan="1" colspan="1">SignFi [<xref rid="B29-sensors-19-02959" ref-type="bibr">29</xref>
]/<break></break>
CSI</td>
<td align="center" valign="middle" rowspan="1" colspan="1">With SP—Multiple Linear Regression</td>
<td align="center" valign="middle" rowspan="1" colspan="1">CNN</td>
<td align="center" valign="middle" rowspan="1" colspan="1">Sign language<break></break>
gesture recognition</td>
<td align="center" valign="middle" rowspan="1" colspan="1">276<break></break>
gestures</td>
<td align="center" valign="middle" rowspan="1" colspan="1">98.01%, 98.91%, 94.81%, and 86.66% for <italic>lab</italic>
276, <italic>home</italic>
276, <italic>lab</italic>
+ <italic>home</italic>
276 and <italic>lab</italic>
150 environments respectively</td>
</tr>
<tr><td align="center" valign="middle" style="border-bottom:solid thin" rowspan="1" colspan="1">HOS-Re (Present work)</td>
<td align="center" valign="middle" style="border-bottom:solid thin" rowspan="1" colspan="1">Without SP Cumulant Features</td>
<td align="center" valign="middle" style="border-bottom:solid thin" rowspan="1" colspan="1">SVM</td>
<td align="center" valign="middle" style="border-bottom:solid thin" rowspan="1" colspan="1">Sign language<break></break>
gesture recognition</td>
<td align="center" valign="middle" style="border-bottom:solid thin" rowspan="1" colspan="1">276<break></break>
gestures</td>
<td align="center" valign="middle" style="border-bottom:solid thin" rowspan="1" colspan="1">97.84%, 98.26%, 96.34%, and 96.23% for <italic>lab</italic>
276, <italic>home</italic>
276, <italic>lab</italic>
+ <italic>home</italic>
276 and <italic>lab</italic>
150 environments respectively</td>
</tr>
</tbody>
</table>
</table-wrap>
</floats-group>
</pmc>
</record>
Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Wicri/Sante/explor/MaghrebDataLibMedV2/Data/Pmc/Corpus
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000281 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Pmc/Corpus/biblio.hfd -nk 000281 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien |wiki= Wicri/Sante |area= MaghrebDataLibMedV2 |flux= Pmc |étape= Corpus |type= RBID |clé= PMC:6651246 |texte= Higher Order Feature Extraction and Selection for Robust Human Gesture Recognition using CSI of COTS Wi-Fi Devices }}
Pour générer des pages wiki
HfdIndexSelect -h $EXPLOR_AREA/Data/Pmc/Corpus/RBID.i -Sk "pubmed:31277492" \ | HfdSelect -Kh $EXPLOR_AREA/Data/Pmc/Corpus/biblio.hfd \ | NlmPubMed2Wicri -a MaghrebDataLibMedV2
![]() | This area was generated with Dilib version V0.6.38. | ![]() |