Optical computer recognition of facial expressions associated with stress induced by performance demands.
Identifieur interne : 001199 ( Main/Exploration ); précédent : 001198; suivant : 001200Optical computer recognition of facial expressions associated with stress induced by performance demands.
Auteurs : David F. Dinges [États-Unis] ; Robert L. Rider ; Jillian Dorrian ; Eleanor L. Mcglinchey ; Naomi L. Rogers ; Ziga Cizman ; Siome K. Goldenstein ; Christian Vogler ; Sundara Venkataraman ; Dimitris N. MetaxasSource :
- Aviation, space, and environmental medicine [ 0095-6562 ] ; 2005.
English descriptors
- KwdEn :
- Adult, Algorithms, Astronauts (psychology), Behavioral Research (methods), Diagnosis, Computer-Assisted, Emotions (physiology), Facial Expression, Feedback, Female, Humans, Male, Mental Health, Pattern Recognition, Automated, Stress, Psychological (diagnosis), Surveys and Questionnaires, Task Performance and Analysis, Time Factors.
- MESH :
- diagnosis : Stress, Psychological.
- methods : Behavioral Research.
- physiology : Emotions.
- psychology : Astronauts.
- Adult, Algorithms, Diagnosis, Computer-Assisted, Facial Expression, Feedback, Female, Humans, Male, Mental Health, Pattern Recognition, Automated, Surveys and Questionnaires, Task Performance and Analysis, Time Factors.
Abstract
Application of computer vision to track changes in human facial expressions during long-duration spaceflight may be a useful way to unobtrusively detect the presence of stress during critical operations. To develop such an approach, we applied optical computer recognition (OCR) algorithms for detecting facial changes during performance while people experienced both low- and high-stressor performance demands. Workload and social feedback were used to vary performance stress in 60 healthy adults (29 men, 31 women; mean age 30 yr). High-stressor scenarios involved more difficult performance tasks, negative social feedback, and greater time pressure relative to low workload scenarios. Stress reactions were tracked using self-report ratings, salivary cortisol, and heart rate. Subjects also completed personality, mood, and alexithymia questionnaires. To bootstrap development of the OCR algorithm, we had a human observer, blind to stressor condition, identify the expressive elements of the face of people undergoing high- vs. low-stressor performance. Different sets of videos of subjects' faces during performance conditions were used for OCR algorithm training. Subjective ratings of stress, task difficulty, effort required, frustration, and negative mood were significantly increased during high-stressor performance bouts relative to low-stressor bouts (all p < 0.01). The OCR algorithm was refined to provide robust 3-d tracking of facial expressions during head movement. Movements of eyebrows and asymmetries in the mouth were extracted. These parameters are being used in a Hidden Markov model to identify high- and low-stressor conditions. Preliminary results suggest that an OCR algorithm using mouth and eyebrow regions has the potential to discriminate high- from low-stressor performance bouts in 75-88% of subjects. The validity of the workload paradigm to induce differential levels of stress in facial expressions was established. The paradigm also provided the basic stress-related facial expressions required to establish a prototypical OCR algorithm to detect such changes. Efforts are underway to further improve the OCR algorithm by adding facial touching and automating application of the deformable masks and OCR algorithms to video footage of the moving faces as a prelude to blind validation of the automated approach.
PubMed: 15943210
Affiliations:
Links toward previous steps (curation, corpus...)
- to stream PubMed, to step Corpus: 000067
- to stream PubMed, to step Curation: 000067
- to stream PubMed, to step Checkpoint: 000067
- to stream Ncbi, to step Merge: 000022
- to stream Ncbi, to step Curation: 000022
- to stream Ncbi, to step Checkpoint: 000022
- to stream Main, to step Merge: 001235
- to stream Main, to step Curation: 001199
Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">Optical computer recognition of facial expressions associated with stress induced by performance demands.</title>
<author><name sortKey="Dinges, David F" sort="Dinges, David F" uniqKey="Dinges D" first="David F" last="Dinges">David F. Dinges</name>
<affiliation wicri:level="2"><nlm:affiliation>Unit for Experimental Psychiatry, Department of Psychiatry, University of Pennsylvania School of Medicine, Philadelphia, PA 19104-6021, USA. dinges@mail.med.upenn.edu</nlm:affiliation>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea>Unit for Experimental Psychiatry, Department of Psychiatry, University of Pennsylvania School of Medicine, Philadelphia, PA 19104-6021</wicri:regionArea>
<placeName><region type="state">Pennsylvanie</region>
</placeName>
</affiliation>
</author>
<author><name sortKey="Rider, Robert L" sort="Rider, Robert L" uniqKey="Rider R" first="Robert L" last="Rider">Robert L. Rider</name>
</author>
<author><name sortKey="Dorrian, Jillian" sort="Dorrian, Jillian" uniqKey="Dorrian J" first="Jillian" last="Dorrian">Jillian Dorrian</name>
</author>
<author><name sortKey="Mcglinchey, Eleanor L" sort="Mcglinchey, Eleanor L" uniqKey="Mcglinchey E" first="Eleanor L" last="Mcglinchey">Eleanor L. Mcglinchey</name>
</author>
<author><name sortKey="Rogers, Naomi L" sort="Rogers, Naomi L" uniqKey="Rogers N" first="Naomi L" last="Rogers">Naomi L. Rogers</name>
</author>
<author><name sortKey="Cizman, Ziga" sort="Cizman, Ziga" uniqKey="Cizman Z" first="Ziga" last="Cizman">Ziga Cizman</name>
</author>
<author><name sortKey="Goldenstein, Siome K" sort="Goldenstein, Siome K" uniqKey="Goldenstein S" first="Siome K" last="Goldenstein">Siome K. Goldenstein</name>
</author>
<author><name sortKey="Vogler, Christian" sort="Vogler, Christian" uniqKey="Vogler C" first="Christian" last="Vogler">Christian Vogler</name>
</author>
<author><name sortKey="Venkataraman, Sundara" sort="Venkataraman, Sundara" uniqKey="Venkataraman S" first="Sundara" last="Venkataraman">Sundara Venkataraman</name>
</author>
<author><name sortKey="Metaxas, Dimitris N" sort="Metaxas, Dimitris N" uniqKey="Metaxas D" first="Dimitris N" last="Metaxas">Dimitris N. Metaxas</name>
</author>
</titleStmt>
<publicationStmt><idno type="wicri:source">PubMed</idno>
<date when="2005">2005</date>
<idno type="RBID">pubmed:15943210</idno>
<idno type="pmid">15943210</idno>
<idno type="wicri:Area/PubMed/Corpus">000067</idno>
<idno type="wicri:Area/PubMed/Curation">000067</idno>
<idno type="wicri:Area/PubMed/Checkpoint">000067</idno>
<idno type="wicri:Area/Ncbi/Merge">000022</idno>
<idno type="wicri:Area/Ncbi/Curation">000022</idno>
<idno type="wicri:Area/Ncbi/Checkpoint">000022</idno>
<idno type="wicri:doubleKey">0095-6562:2005:Dinges D:optical:computer:recognition</idno>
<idno type="wicri:Area/Main/Merge">001235</idno>
<idno type="wicri:Area/Main/Curation">001199</idno>
<idno type="wicri:Area/Main/Exploration">001199</idno>
</publicationStmt>
<sourceDesc><biblStruct><analytic><title xml:lang="en">Optical computer recognition of facial expressions associated with stress induced by performance demands.</title>
<author><name sortKey="Dinges, David F" sort="Dinges, David F" uniqKey="Dinges D" first="David F" last="Dinges">David F. Dinges</name>
<affiliation wicri:level="2"><nlm:affiliation>Unit for Experimental Psychiatry, Department of Psychiatry, University of Pennsylvania School of Medicine, Philadelphia, PA 19104-6021, USA. dinges@mail.med.upenn.edu</nlm:affiliation>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea>Unit for Experimental Psychiatry, Department of Psychiatry, University of Pennsylvania School of Medicine, Philadelphia, PA 19104-6021</wicri:regionArea>
<placeName><region type="state">Pennsylvanie</region>
</placeName>
</affiliation>
</author>
<author><name sortKey="Rider, Robert L" sort="Rider, Robert L" uniqKey="Rider R" first="Robert L" last="Rider">Robert L. Rider</name>
</author>
<author><name sortKey="Dorrian, Jillian" sort="Dorrian, Jillian" uniqKey="Dorrian J" first="Jillian" last="Dorrian">Jillian Dorrian</name>
</author>
<author><name sortKey="Mcglinchey, Eleanor L" sort="Mcglinchey, Eleanor L" uniqKey="Mcglinchey E" first="Eleanor L" last="Mcglinchey">Eleanor L. Mcglinchey</name>
</author>
<author><name sortKey="Rogers, Naomi L" sort="Rogers, Naomi L" uniqKey="Rogers N" first="Naomi L" last="Rogers">Naomi L. Rogers</name>
</author>
<author><name sortKey="Cizman, Ziga" sort="Cizman, Ziga" uniqKey="Cizman Z" first="Ziga" last="Cizman">Ziga Cizman</name>
</author>
<author><name sortKey="Goldenstein, Siome K" sort="Goldenstein, Siome K" uniqKey="Goldenstein S" first="Siome K" last="Goldenstein">Siome K. Goldenstein</name>
</author>
<author><name sortKey="Vogler, Christian" sort="Vogler, Christian" uniqKey="Vogler C" first="Christian" last="Vogler">Christian Vogler</name>
</author>
<author><name sortKey="Venkataraman, Sundara" sort="Venkataraman, Sundara" uniqKey="Venkataraman S" first="Sundara" last="Venkataraman">Sundara Venkataraman</name>
</author>
<author><name sortKey="Metaxas, Dimitris N" sort="Metaxas, Dimitris N" uniqKey="Metaxas D" first="Dimitris N" last="Metaxas">Dimitris N. Metaxas</name>
</author>
</analytic>
<series><title level="j">Aviation, space, and environmental medicine</title>
<idno type="ISSN">0095-6562</idno>
<imprint><date when="2005" type="published">2005</date>
</imprint>
</series>
</biblStruct>
</sourceDesc>
</fileDesc>
<profileDesc><textClass><keywords scheme="KwdEn" xml:lang="en"><term>Adult</term>
<term>Algorithms</term>
<term>Astronauts (psychology)</term>
<term>Behavioral Research (methods)</term>
<term>Diagnosis, Computer-Assisted</term>
<term>Emotions (physiology)</term>
<term>Facial Expression</term>
<term>Feedback</term>
<term>Female</term>
<term>Humans</term>
<term>Male</term>
<term>Mental Health</term>
<term>Pattern Recognition, Automated</term>
<term>Stress, Psychological (diagnosis)</term>
<term>Surveys and Questionnaires</term>
<term>Task Performance and Analysis</term>
<term>Time Factors</term>
</keywords>
<keywords scheme="MESH" qualifier="diagnosis" xml:lang="en"><term>Stress, Psychological</term>
</keywords>
<keywords scheme="MESH" qualifier="methods" xml:lang="en"><term>Behavioral Research</term>
</keywords>
<keywords scheme="MESH" qualifier="physiology" xml:lang="en"><term>Emotions</term>
</keywords>
<keywords scheme="MESH" qualifier="psychology" xml:lang="en"><term>Astronauts</term>
</keywords>
<keywords scheme="MESH" xml:lang="en"><term>Adult</term>
<term>Algorithms</term>
<term>Diagnosis, Computer-Assisted</term>
<term>Facial Expression</term>
<term>Feedback</term>
<term>Female</term>
<term>Humans</term>
<term>Male</term>
<term>Mental Health</term>
<term>Pattern Recognition, Automated</term>
<term>Surveys and Questionnaires</term>
<term>Task Performance and Analysis</term>
<term>Time Factors</term>
</keywords>
</textClass>
</profileDesc>
</teiHeader>
<front><div type="abstract" xml:lang="en">Application of computer vision to track changes in human facial expressions during long-duration spaceflight may be a useful way to unobtrusively detect the presence of stress during critical operations. To develop such an approach, we applied optical computer recognition (OCR) algorithms for detecting facial changes during performance while people experienced both low- and high-stressor performance demands. Workload and social feedback were used to vary performance stress in 60 healthy adults (29 men, 31 women; mean age 30 yr). High-stressor scenarios involved more difficult performance tasks, negative social feedback, and greater time pressure relative to low workload scenarios. Stress reactions were tracked using self-report ratings, salivary cortisol, and heart rate. Subjects also completed personality, mood, and alexithymia questionnaires. To bootstrap development of the OCR algorithm, we had a human observer, blind to stressor condition, identify the expressive elements of the face of people undergoing high- vs. low-stressor performance. Different sets of videos of subjects' faces during performance conditions were used for OCR algorithm training. Subjective ratings of stress, task difficulty, effort required, frustration, and negative mood were significantly increased during high-stressor performance bouts relative to low-stressor bouts (all p < 0.01). The OCR algorithm was refined to provide robust 3-d tracking of facial expressions during head movement. Movements of eyebrows and asymmetries in the mouth were extracted. These parameters are being used in a Hidden Markov model to identify high- and low-stressor conditions. Preliminary results suggest that an OCR algorithm using mouth and eyebrow regions has the potential to discriminate high- from low-stressor performance bouts in 75-88% of subjects. The validity of the workload paradigm to induce differential levels of stress in facial expressions was established. The paradigm also provided the basic stress-related facial expressions required to establish a prototypical OCR algorithm to detect such changes. Efforts are underway to further improve the OCR algorithm by adding facial touching and automating application of the deformable masks and OCR algorithms to video footage of the moving faces as a prelude to blind validation of the automated approach.</div>
</front>
</TEI>
<affiliations><list><country><li>États-Unis</li>
</country>
<region><li>Pennsylvanie</li>
</region>
</list>
<tree><noCountry><name sortKey="Cizman, Ziga" sort="Cizman, Ziga" uniqKey="Cizman Z" first="Ziga" last="Cizman">Ziga Cizman</name>
<name sortKey="Dorrian, Jillian" sort="Dorrian, Jillian" uniqKey="Dorrian J" first="Jillian" last="Dorrian">Jillian Dorrian</name>
<name sortKey="Goldenstein, Siome K" sort="Goldenstein, Siome K" uniqKey="Goldenstein S" first="Siome K" last="Goldenstein">Siome K. Goldenstein</name>
<name sortKey="Mcglinchey, Eleanor L" sort="Mcglinchey, Eleanor L" uniqKey="Mcglinchey E" first="Eleanor L" last="Mcglinchey">Eleanor L. Mcglinchey</name>
<name sortKey="Metaxas, Dimitris N" sort="Metaxas, Dimitris N" uniqKey="Metaxas D" first="Dimitris N" last="Metaxas">Dimitris N. Metaxas</name>
<name sortKey="Rider, Robert L" sort="Rider, Robert L" uniqKey="Rider R" first="Robert L" last="Rider">Robert L. Rider</name>
<name sortKey="Rogers, Naomi L" sort="Rogers, Naomi L" uniqKey="Rogers N" first="Naomi L" last="Rogers">Naomi L. Rogers</name>
<name sortKey="Venkataraman, Sundara" sort="Venkataraman, Sundara" uniqKey="Venkataraman S" first="Sundara" last="Venkataraman">Sundara Venkataraman</name>
<name sortKey="Vogler, Christian" sort="Vogler, Christian" uniqKey="Vogler C" first="Christian" last="Vogler">Christian Vogler</name>
</noCountry>
<country name="États-Unis"><region name="Pennsylvanie"><name sortKey="Dinges, David F" sort="Dinges, David F" uniqKey="Dinges D" first="David F" last="Dinges">David F. Dinges</name>
</region>
</country>
</tree>
</affiliations>
</record>
Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/OcrV1/Data/Main/Exploration
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 001199 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Main/Exploration/biblio.hfd -nk 001199 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien |wiki= Ticri/CIDE |area= OcrV1 |flux= Main |étape= Exploration |type= RBID |clé= pubmed:15943210 |texte= Optical computer recognition of facial expressions associated with stress induced by performance demands. }}
Pour générer des pages wiki
HfdIndexSelect -h $EXPLOR_AREA/Data/Main/Exploration/RBID.i -Sk "pubmed:15943210" \ | HfdSelect -Kh $EXPLOR_AREA/Data/Main/Exploration/biblio.hfd \ | NlmPubMed2Wicri -a OcrV1
This area was generated with Dilib version V0.6.32. |