Impact of frame rate on automatic speech-text alignment for corpus-based phonetic studies
Identifieur interne : 002957 ( Hal/Corpus ); précédent : 002956; suivant : 002958Impact of frame rate on automatic speech-text alignment for corpus-based phonetic studies
Auteurs : Katarina Bartkova ; Denis JouvetSource :
English descriptors
Abstract
Phonetic segmentation is the basis for many phonetic and linguistic studies. As manual segmentation is a lengthy and tedious task, automatic procedures have been developed over the years. They rely on acoustic Hidden Markov Models. Many studies have been conducted, and refinements developed for corpus based speech synthesis, where the technology is mainly used in a speaker-dependent context and applied on good quality speech signals. In a different research direction, automatic speech-text alignment is also used for phonetic and linguistic studies on large speech corpora. In this case, speaker independent acoustic models are mandatory, and the speech quality may not be so good. The speech models rely on 10 ms shift between acoustic frames, and their topology leads to strong minimum duration constraints. This paper focuses on the acoustic analysis frame rate, and gives a first insight on the impact of the frame rate on corpus-based phonetic studies.
Url:
Links to Exploration step
Hal:hal-01183637Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">Impact of frame rate on automatic speech-text alignment for corpus-based phonetic studies</title><author><name sortKey="Bartkova, Katarina" sort="Bartkova, Katarina" uniqKey="Bartkova K" first="Katarina" last="Bartkova">Katarina Bartkova</name><affiliation><hal:affiliation type="laboratory" xml:id="struct-190838" status="VALID"><idno type="IdRef">074211714</idno><idno type="RNSR">200112505T</idno><idno type="IdUnivLorraine">[UL]ROB--</idno><orgName>Analyse et Traitement Informatique de la Langue Française</orgName><orgName type="acronym">ATILF</orgName><date type="start">2012-01-01</date><desc><address><addrLine>Université de Lorraine, 44 Av de la Libération, BP 30687 54063 Nancy Cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.atilf.fr</ref></desc><listRelation><relation active="#struct-413289" type="direct"></relation><relation name="UMR7118" active="#struct-441569" type="direct"></relation></listRelation><tutelles><tutelle active="#struct-413289" type="direct"><org type="institution" xml:id="struct-413289" status="VALID"><idno type="IdRef">157040569</idno><idno type="IdUnivLorraine">[UL]100--</idno><orgName>Université de Lorraine</orgName><orgName type="acronym">UL</orgName><date type="start">2012-01-01</date><desc><address><addrLine>34 cours Léopold - CS 25233 - 54052 Nancy cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.univ-lorraine.fr/</ref></desc></org></tutelle><tutelle name="UMR7118" active="#struct-441569" type="direct"><org type="institution" xml:id="struct-441569" status="VALID"><idno type="ISNI">0000000122597504</idno><idno type="IdRef">02636817X</idno><orgName>Centre National de la Recherche Scientifique</orgName><orgName type="acronym">CNRS</orgName><date type="start">1939-10-19</date><desc><address><country key="FR"></country></address><ref type="url">http://www.cnrs.fr/</ref></desc></org></tutelle></tutelles></hal:affiliation></affiliation></author><author><name sortKey="Jouvet, Denis" sort="Jouvet, Denis" uniqKey="Jouvet D" first="Denis" last="Jouvet">Denis Jouvet</name><affiliation><hal:affiliation type="researchteam" xml:id="struct-420403" status="VALID"><idno type="RNSR">201421147E</idno><orgName>Speech Modeling for Facilitating Oral-Based Communication</orgName><orgName type="acronym">MULTISPEECH</orgName><desc><address><country key="FR"></country></address><ref type="url">http://www.inria.fr/equipes/multispeech</ref></desc><listRelation><relation active="#struct-129671" type="direct"></relation><relation active="#struct-300009" type="indirect"></relation><relation active="#struct-423086" type="direct"></relation><relation active="#struct-206040" type="indirect"></relation><relation active="#struct-413289" type="indirect"></relation><relation name="UMR7503" active="#struct-441569" type="indirect"></relation></listRelation><tutelles><tutelle active="#struct-129671" type="direct"><org type="laboratory" xml:id="struct-129671" status="VALID"><idno type="RNSR">198618246Y</idno><orgName>INRIA Nancy - Grand Est</orgName><desc><address><addrLine>615 rue du Jardin Botanique 54600 Villers-lès-Nancy</addrLine><country key="FR"></country></address><ref type="url">http://www.inria.fr/nancy</ref></desc><listRelation><relation active="#struct-300009" type="direct"></relation></listRelation></org></tutelle><tutelle active="#struct-300009" type="indirect"><org type="institution" xml:id="struct-300009" status="VALID"><orgName>Institut National de Recherche en Informatique et en Automatique</orgName><orgName type="acronym">Inria</orgName><desc><address><addrLine>Domaine de VoluceauRocquencourt - BP 10578153 Le Chesnay Cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.inria.fr/en/</ref></desc></org></tutelle><tutelle active="#struct-423086" type="direct"><org type="department" xml:id="struct-423086" status="VALID"><orgName>Department of Natural Language Processing & Knowledge Discovery</orgName><orgName type="acronym">LORIA - NLPKD</orgName><desc><address><country key="FR"></country></address><ref type="url">http://www.loria.fr/la-recherche-en/departements/Knowledge-and-Language-Management</ref></desc><listRelation><relation active="#struct-206040" type="direct"></relation><relation active="#struct-300009" type="indirect"></relation><relation active="#struct-413289" type="indirect"></relation><relation name="UMR7503" active="#struct-441569" type="indirect"></relation></listRelation></org></tutelle><tutelle active="#struct-206040" type="indirect"><org type="laboratory" xml:id="struct-206040" status="VALID"><idno type="IdRef">067077927</idno><idno type="RNSR">198912571S</idno><idno type="IdUnivLorraine">[UL]RSI--</idno><orgName>Laboratoire Lorrain de Recherche en Informatique et ses Applications</orgName><orgName type="acronym">LORIA</orgName><date type="start">2012-01-01</date><desc><address><addrLine>Campus Scientifique BP 239 54506 Vandoeuvre-lès-Nancy Cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.loria.fr</ref></desc><listRelation><relation active="#struct-300009" type="direct"></relation><relation active="#struct-413289" type="direct"></relation><relation name="UMR7503" active="#struct-441569" type="direct"></relation></listRelation></org></tutelle><tutelle active="#struct-413289" type="indirect"><org type="institution" xml:id="struct-413289" status="VALID"><idno type="IdRef">157040569</idno><idno type="IdUnivLorraine">[UL]100--</idno><orgName>Université de Lorraine</orgName><orgName type="acronym">UL</orgName><date type="start">2012-01-01</date><desc><address><addrLine>34 cours Léopold - CS 25233 - 54052 Nancy cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.univ-lorraine.fr/</ref></desc></org></tutelle><tutelle name="UMR7503" active="#struct-441569" type="indirect"><org type="institution" xml:id="struct-441569" status="VALID"><idno type="ISNI">0000000122597504</idno><idno type="IdRef">02636817X</idno><orgName>Centre National de la Recherche Scientifique</orgName><orgName type="acronym">CNRS</orgName><date type="start">1939-10-19</date><desc><address><country key="FR"></country></address><ref type="url">http://www.cnrs.fr/</ref></desc></org></tutelle></tutelles></hal:affiliation></affiliation></author></titleStmt><publicationStmt><idno type="wicri:source">HAL</idno><idno type="RBID">Hal:hal-01183637</idno><idno type="halId">hal-01183637</idno><idno type="halUri">https://hal.inria.fr/hal-01183637</idno><idno type="url">https://hal.inria.fr/hal-01183637</idno><date when="2015-08-10">2015-08-10</date><idno type="wicri:Area/Hal/Corpus">002957</idno></publicationStmt><sourceDesc><biblStruct><analytic><title xml:lang="en">Impact of frame rate on automatic speech-text alignment for corpus-based phonetic studies</title><author><name sortKey="Bartkova, Katarina" sort="Bartkova, Katarina" uniqKey="Bartkova K" first="Katarina" last="Bartkova">Katarina Bartkova</name><affiliation><hal:affiliation type="laboratory" xml:id="struct-190838" status="VALID"><idno type="IdRef">074211714</idno><idno type="RNSR">200112505T</idno><idno type="IdUnivLorraine">[UL]ROB--</idno><orgName>Analyse et Traitement Informatique de la Langue Française</orgName><orgName type="acronym">ATILF</orgName><date type="start">2012-01-01</date><desc><address><addrLine>Université de Lorraine, 44 Av de la Libération, BP 30687 54063 Nancy Cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.atilf.fr</ref></desc><listRelation><relation active="#struct-413289" type="direct"></relation><relation name="UMR7118" active="#struct-441569" type="direct"></relation></listRelation><tutelles><tutelle active="#struct-413289" type="direct"><org type="institution" xml:id="struct-413289" status="VALID"><idno type="IdRef">157040569</idno><idno type="IdUnivLorraine">[UL]100--</idno><orgName>Université de Lorraine</orgName><orgName type="acronym">UL</orgName><date type="start">2012-01-01</date><desc><address><addrLine>34 cours Léopold - CS 25233 - 54052 Nancy cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.univ-lorraine.fr/</ref></desc></org></tutelle><tutelle name="UMR7118" active="#struct-441569" type="direct"><org type="institution" xml:id="struct-441569" status="VALID"><idno type="ISNI">0000000122597504</idno><idno type="IdRef">02636817X</idno><orgName>Centre National de la Recherche Scientifique</orgName><orgName type="acronym">CNRS</orgName><date type="start">1939-10-19</date><desc><address><country key="FR"></country></address><ref type="url">http://www.cnrs.fr/</ref></desc></org></tutelle></tutelles></hal:affiliation></affiliation></author><author><name sortKey="Jouvet, Denis" sort="Jouvet, Denis" uniqKey="Jouvet D" first="Denis" last="Jouvet">Denis Jouvet</name><affiliation><hal:affiliation type="researchteam" xml:id="struct-420403" status="VALID"><idno type="RNSR">201421147E</idno><orgName>Speech Modeling for Facilitating Oral-Based Communication</orgName><orgName type="acronym">MULTISPEECH</orgName><desc><address><country key="FR"></country></address><ref type="url">http://www.inria.fr/equipes/multispeech</ref></desc><listRelation><relation active="#struct-129671" type="direct"></relation><relation active="#struct-300009" type="indirect"></relation><relation active="#struct-423086" type="direct"></relation><relation active="#struct-206040" type="indirect"></relation><relation active="#struct-413289" type="indirect"></relation><relation name="UMR7503" active="#struct-441569" type="indirect"></relation></listRelation><tutelles><tutelle active="#struct-129671" type="direct"><org type="laboratory" xml:id="struct-129671" status="VALID"><idno type="RNSR">198618246Y</idno><orgName>INRIA Nancy - Grand Est</orgName><desc><address><addrLine>615 rue du Jardin Botanique 54600 Villers-lès-Nancy</addrLine><country key="FR"></country></address><ref type="url">http://www.inria.fr/nancy</ref></desc><listRelation><relation active="#struct-300009" type="direct"></relation></listRelation></org></tutelle><tutelle active="#struct-300009" type="indirect"><org type="institution" xml:id="struct-300009" status="VALID"><orgName>Institut National de Recherche en Informatique et en Automatique</orgName><orgName type="acronym">Inria</orgName><desc><address><addrLine>Domaine de VoluceauRocquencourt - BP 10578153 Le Chesnay Cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.inria.fr/en/</ref></desc></org></tutelle><tutelle active="#struct-423086" type="direct"><org type="department" xml:id="struct-423086" status="VALID"><orgName>Department of Natural Language Processing & Knowledge Discovery</orgName><orgName type="acronym">LORIA - NLPKD</orgName><desc><address><country key="FR"></country></address><ref type="url">http://www.loria.fr/la-recherche-en/departements/Knowledge-and-Language-Management</ref></desc><listRelation><relation active="#struct-206040" type="direct"></relation><relation active="#struct-300009" type="indirect"></relation><relation active="#struct-413289" type="indirect"></relation><relation name="UMR7503" active="#struct-441569" type="indirect"></relation></listRelation></org></tutelle><tutelle active="#struct-206040" type="indirect"><org type="laboratory" xml:id="struct-206040" status="VALID"><idno type="IdRef">067077927</idno><idno type="RNSR">198912571S</idno><idno type="IdUnivLorraine">[UL]RSI--</idno><orgName>Laboratoire Lorrain de Recherche en Informatique et ses Applications</orgName><orgName type="acronym">LORIA</orgName><date type="start">2012-01-01</date><desc><address><addrLine>Campus Scientifique BP 239 54506 Vandoeuvre-lès-Nancy Cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.loria.fr</ref></desc><listRelation><relation active="#struct-300009" type="direct"></relation><relation active="#struct-413289" type="direct"></relation><relation name="UMR7503" active="#struct-441569" type="direct"></relation></listRelation></org></tutelle><tutelle active="#struct-413289" type="indirect"><org type="institution" xml:id="struct-413289" status="VALID"><idno type="IdRef">157040569</idno><idno type="IdUnivLorraine">[UL]100--</idno><orgName>Université de Lorraine</orgName><orgName type="acronym">UL</orgName><date type="start">2012-01-01</date><desc><address><addrLine>34 cours Léopold - CS 25233 - 54052 Nancy cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.univ-lorraine.fr/</ref></desc></org></tutelle><tutelle name="UMR7503" active="#struct-441569" type="indirect"><org type="institution" xml:id="struct-441569" status="VALID"><idno type="ISNI">0000000122597504</idno><idno type="IdRef">02636817X</idno><orgName>Centre National de la Recherche Scientifique</orgName><orgName type="acronym">CNRS</orgName><date type="start">1939-10-19</date><desc><address><country key="FR"></country></address><ref type="url">http://www.cnrs.fr/</ref></desc></org></tutelle></tutelles></hal:affiliation></affiliation></author></analytic></biblStruct></sourceDesc></fileDesc><profileDesc><textClass><keywords scheme="mix" xml:lang="en"><term>Automatic speech-text alignment</term><term>frame rate</term><term>pronunciation variants</term></keywords></textClass></profileDesc></teiHeader><front><div type="abstract" xml:lang="en">Phonetic segmentation is the basis for many phonetic and linguistic studies. As manual segmentation is a lengthy and tedious task, automatic procedures have been developed over the years. They rely on acoustic Hidden Markov Models. Many studies have been conducted, and refinements developed for corpus based speech synthesis, where the technology is mainly used in a speaker-dependent context and applied on good quality speech signals. In a different research direction, automatic speech-text alignment is also used for phonetic and linguistic studies on large speech corpora. In this case, speaker independent acoustic models are mandatory, and the speech quality may not be so good. The speech models rely on 10 ms shift between acoustic frames, and their topology leads to strong minimum duration constraints. This paper focuses on the acoustic analysis frame rate, and gives a first insight on the impact of the frame rate on corpus-based phonetic studies.</div></front></TEI><hal api="V3"><titleStmt><title xml:lang="en">Impact of frame rate on automatic speech-text alignment for corpus-based phonetic studies</title><author role="crp"><persName><forename type="first">Katarina</forename><surname>Bartkova</surname></persName><email>katarina.bartkova@atilf.frdenis.jouvet@loria.fr</email><idno type="halauthor">1195710</idno><affiliation ref="#struct-190838"></affiliation></author><author role="aut"><persName><forename type="first">Denis</forename><surname>Jouvet</surname></persName><email></email><idno type="halauthor">656680</idno><affiliation ref="#struct-420403"></affiliation></author><editor role="depositor"><persName><forename>Denis</forename><surname>Jouvet</surname></persName><email>denis.jouvet@inria.fr</email></editor></titleStmt><editionStmt><edition n="v1" type="current"><date type="whenSubmitted">2015-08-10 15:01:42</date><date type="whenModified">2015-12-10 01:06:56</date><date type="whenReleased">2015-08-12 10:47:28</date><date type="whenProduced">2015-08-10</date><date type="whenEndEmbargoed">2015-08-10</date><ref type="file" target="https://hal.inria.fr/hal-01183637/document"><date notBefore="2015-08-10"></date></ref><ref type="file" subtype="author" n="1" target="https://hal.inria.fr/hal-01183637/file/FrameRateAndSpeechTextALignment-V1.2.pdf"><date notBefore="2015-08-10"></date></ref></edition><respStmt><resp>contributor</resp><name key="155601"><persName><forename>Denis</forename><surname>Jouvet</surname></persName><email>denis.jouvet@inria.fr</email></name></respStmt></editionStmt><publicationStmt><distributor>CCSD</distributor><idno type="halId">hal-01183637</idno><idno type="halUri">https://hal.inria.fr/hal-01183637</idno><idno type="halBibtex">bartkova:hal-01183637</idno><idno type="halRefHtml">ICPhS'2015 - 18th International Congress of Phonetic Sciences, Aug 2015, Glasgow, United Kingdom. Proceedings ICPhS 2015</idno><idno type="halRef">ICPhS'2015 - 18th International Congress of Phonetic Sciences, Aug 2015, Glasgow, United Kingdom. Proceedings ICPhS 2015</idno></publicationStmt><seriesStmt><idno type="stamp" n="CNRS">CNRS - Centre national de la recherche scientifique</idno><idno type="stamp" n="ATILF">Analyse et Traitement Informatique de la Langue Française</idno><idno type="stamp" n="INRIA-LORRAINE">INRIA Nancy - Grand Est</idno><idno type="stamp" n="INRIA-NANCY-GRAND-EST">INRIA Nancy - Grand Est</idno><idno type="stamp" n="LORIA2">Publications du LORIA</idno><idno type="stamp" n="INRIA">INRIA - Institut National de Recherche en Informatique et en Automatique</idno><idno type="stamp" n="LORIA">LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications</idno><idno type="stamp" n="INRIA_TEST">INRIA - Institut National de Recherche en Informatique et en Automatique</idno><idno type="stamp" n="UNIV-LORRAINE">Université de Lorraine</idno><idno type="stamp" n="INRIA2">INRIA 2</idno></seriesStmt><notesStmt><note type="audience" n="2">International</note><note type="invited" n="0">No</note><note type="popular" n="0">No</note><note type="peer" n="1">Yes</note><note type="proceedings" n="1">Yes</note></notesStmt><sourceDesc><biblStruct><analytic><title xml:lang="en">Impact of frame rate on automatic speech-text alignment for corpus-based phonetic studies</title><author role="crp"><persName><forename type="first">Katarina</forename><surname>Bartkova</surname></persName><email>katarina.bartkova@atilf.frdenis.jouvet@loria.fr</email><idno type="halAuthorId">1195710</idno><affiliation ref="#struct-190838"></affiliation></author><author role="aut"><persName><forename type="first">Denis</forename><surname>Jouvet</surname></persName><idno type="halAuthorId">656680</idno><affiliation ref="#struct-420403"></affiliation></author></analytic><monogr><title level="m">Proceedings ICPhS 2015</title><meeting><title>ICPhS'2015 - 18th International Congress of Phonetic Sciences</title><date type="start">2015-08-10</date><date type="end">2015-08-14</date><settlement>Glasgow</settlement><country key="GB">United Kingdom</country></meeting><imprint></imprint></monogr></biblStruct></sourceDesc><profileDesc><langUsage><language ident="en">English</language></langUsage><textClass><keywords scheme="author"><term xml:lang="en">Automatic speech-text alignment</term><term xml:lang="en">frame rate</term><term xml:lang="en">pronunciation variants</term></keywords><classCode scheme="halDomain" n="info.info-ts">Computer Science [cs]/Signal and Image Processing</classCode><classCode scheme="halTypology" n="COMM">Conference papers</classCode></textClass><abstract xml:lang="en">Phonetic segmentation is the basis for many phonetic and linguistic studies. As manual segmentation is a lengthy and tedious task, automatic procedures have been developed over the years. They rely on acoustic Hidden Markov Models. Many studies have been conducted, and refinements developed for corpus based speech synthesis, where the technology is mainly used in a speaker-dependent context and applied on good quality speech signals. In a different research direction, automatic speech-text alignment is also used for phonetic and linguistic studies on large speech corpora. In this case, speaker independent acoustic models are mandatory, and the speech quality may not be so good. The speech models rely on 10 ms shift between acoustic frames, and their topology leads to strong minimum duration constraints. This paper focuses on the acoustic analysis frame rate, and gives a first insight on the impact of the frame rate on corpus-based phonetic studies.</abstract></profileDesc></hal></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Wicri/Lorraine/explor/InforLorV4/Data/Hal/Corpus
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 002957 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Hal/Corpus/biblio.hfd -nk 002957 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Wicri/Lorraine
|area= InforLorV4
|flux= Hal
|étape= Corpus
|type= RBID
|clé= Hal:hal-01183637
|texte= Impact of frame rate on automatic speech-text alignment for corpus-based phonetic studies
}}
| This area was generated with Dilib version V0.6.33. |  |