Tools for sound spatialization on mobile devices
Identifieur interne : 000268 ( Main/Exploration ); précédent : 000267; suivant : 000269Tools for sound spatialization on mobile devices
Auteurs : Julian Palacino [France]Source :
Descripteurs français
English descriptors
Abstract
Mobile technologies (such as smartphones and tablets) are now common devices of the consumer market. In this PhD we want to use those technologies as the way to introduce tools of sound spatialization into the mass market. Today the size and the number of traducers used to pick-up and to render a spatial sound scene are the main factors which limit the portability of those devices.As a first step, a listening test, based on a spatial audio recording of an opera, let us to evaluate the 3D audio technologies available today for headphone rendering. The results of this test show that, using the appropriate binaural decoding, it is possible to achieve a good binaural rendering using only the four sensors of the Soundfield microphone. Then, the steps of the development of a 3D sound pick-up system are described. Several configurations are evaluated and compared. The device, composed of 3 cardioid micro- phones, was developed following an approach inspired by the sound source localization and by the concept of the "object format encoding". Using the microphone signals and an adapted post-processing it is possible to determine the directions of the sources and to extract a sound signal which is representative of the sound scene. In this way, it is possible to completely describe the sound scene and to compress the audio information. This method offer the advantage of being cross platform compatible. In fact, the sound scene encoded with this method can be rendered over any reproduction system.A second method to extract the spatial information is proposed. It uses the real in situ characteristics of the microphone array to perform the sound scene analysis.Some propositions are made to complement the 3D audio chain allowing to render the result of the sound scene encoding over a binaural system or any king of speaker array using all capabilities of the mobile devices.
Url:
Affiliations:
Links toward previous steps (curation, corpus...)
- to stream Hal, to step Corpus: 000296
- to stream Hal, to step Curation: 000296
- to stream Hal, to step Checkpoint: 000057
- to stream Main, to step Merge: 000268
- to stream Main, to step Curation: 000268
Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">Tools for sound spatialization on mobile devices</title><title xml:lang="fr">OUTILS DE SPATIALISATION SONORE POUR TERMINAUX MOBILES</title><title xml:lang="fr" type="sub">Microphone 3D pour une utilisation nomade</title><author><name sortKey="Palacino, Julian" sort="Palacino, Julian" uniqKey="Palacino J" first="Julian" last="Palacino">Julian Palacino</name><affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-14674" status="VALID"><orgName>Orange Labs [Lannion]</orgName><desc><address><addrLine>Technopole Anticipa 2 avenue Pierre Marzin 22300 LANNION</addrLine><country key="FR"></country></address></desc><listRelation><relation active="#struct-300518" type="direct"></relation></listRelation><tutelles><tutelle active="#struct-300518" type="direct"><org type="institution" xml:id="struct-300518" status="VALID"><orgName>France Télécom</orgName><desc><address><country key="FR"></country></address></desc></org></tutelle></tutelles></hal:affiliation><country>France</country></affiliation></author></titleStmt><publicationStmt><idno type="wicri:source">HAL</idno><idno type="RBID">Hal:tel-01139066</idno><idno type="halId">tel-01139066</idno><idno type="halUri">https://hal.archives-ouvertes.fr/tel-01139066</idno><idno type="url">https://hal.archives-ouvertes.fr/tel-01139066</idno><date when="2014-11-04">2014-11-04</date><idno type="wicri:Area/Hal/Corpus">000296</idno><idno type="wicri:Area/Hal/Curation">000296</idno><idno type="wicri:Area/Hal/Checkpoint">000057</idno><idno type="wicri:Area/Main/Merge">000268</idno><idno type="wicri:Area/Main/Curation">000268</idno><idno type="wicri:Area/Main/Exploration">000268</idno></publicationStmt><sourceDesc><biblStruct><analytic><title xml:lang="en">Tools for sound spatialization on mobile devices</title><title xml:lang="fr">OUTILS DE SPATIALISATION SONORE POUR TERMINAUX MOBILES</title><title xml:lang="fr" type="sub">Microphone 3D pour une utilisation nomade</title><author><name sortKey="Palacino, Julian" sort="Palacino, Julian" uniqKey="Palacino J" first="Julian" last="Palacino">Julian Palacino</name><affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-14674" status="VALID"><orgName>Orange Labs [Lannion]</orgName><desc><address><addrLine>Technopole Anticipa 2 avenue Pierre Marzin 22300 LANNION</addrLine><country key="FR"></country></address></desc><listRelation><relation active="#struct-300518" type="direct"></relation></listRelation><tutelles><tutelle active="#struct-300518" type="direct"><org type="institution" xml:id="struct-300518" status="VALID"><orgName>France Télécom</orgName><desc><address><country key="FR"></country></address></desc></org></tutelle></tutelles></hal:affiliation><country>France</country></affiliation></author></analytic></biblStruct></sourceDesc></fileDesc><profileDesc><textClass><keywords scheme="mix" xml:lang="en"><term>object format</term><term>source localization</term><term>spatial audio</term></keywords><keywords scheme="mix" xml:lang="fr"><term>HRTF</term><term>Son spatialisé</term><term>format objet</term><term>localisation des sources</term></keywords></textClass></profileDesc></teiHeader><front><div type="abstract" xml:lang="en">Mobile technologies (such as smartphones and tablets) are now common devices of the consumer market. In this PhD we want to use those technologies as the way to introduce tools of sound spatialization into the mass market. Today the size and the number of traducers used to pick-up and to render a spatial sound scene are the main factors which limit the portability of those devices.As a first step, a listening test, based on a spatial audio recording of an opera, let us to evaluate the 3D audio technologies available today for headphone rendering. The results of this test show that, using the appropriate binaural decoding, it is possible to achieve a good binaural rendering using only the four sensors of the Soundfield microphone. Then, the steps of the development of a 3D sound pick-up system are described. Several configurations are evaluated and compared. The device, composed of 3 cardioid micro- phones, was developed following an approach inspired by the sound source localization and by the concept of the "object format encoding". Using the microphone signals and an adapted post-processing it is possible to determine the directions of the sources and to extract a sound signal which is representative of the sound scene. In this way, it is possible to completely describe the sound scene and to compress the audio information. This method offer the advantage of being cross platform compatible. In fact, the sound scene encoded with this method can be rendered over any reproduction system.A second method to extract the spatial information is proposed. It uses the real in situ characteristics of the microphone array to perform the sound scene analysis.Some propositions are made to complement the 3D audio chain allowing to render the result of the sound scene encoding over a binaural system or any king of speaker array using all capabilities of the mobile devices.</div></front></TEI><affiliations><list><country><li>France</li></country></list><tree><country name="France"><noRegion><name sortKey="Palacino, Julian" sort="Palacino, Julian" uniqKey="Palacino J" first="Julian" last="Palacino">Julian Palacino</name></noRegion></country></tree></affiliations></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Wicri/Musique/explor/OperaV1/Data/Main/Exploration
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000268 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Main/Exploration/biblio.hfd -nk 000268 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Wicri/Musique
|area= OperaV1
|flux= Main
|étape= Exploration
|type= RBID
|clé= Hal:tel-01139066
|texte= Tools for sound spatialization on mobile devices
}}
| This area was generated with Dilib version V0.6.21. |  |