Kernel additive modeling for interference reduction in multi-channel music recordings
Identifieur interne : 000576 ( Main/Curation ); précédent : 000575; suivant : 000577Kernel additive modeling for interference reduction in multi-channel music recordings
Auteurs : Thomas Pr Tzlich [Allemagne] ; Rachel Bittner [États-Unis] ; Antoine Liutkus [France] ; Meinard Müller [Allemagne]Source :
English descriptors
- mix :
Abstract
When recording a live musical performance, the different voices, such as the instrument groups or soloists of an orchestra, are typically recorded in the same room simultaneously, with at least one microphone assigned to each voice. However, it is difficult to acoustically shield the microphones. In practice, each one contains interference from every other voice. In this paper, we aim to reduce these interferences in multi-channel recordings to recover only the isolated voices. Following the recently proposed Kernel Additive Modeling framework, we present a method that iteratively estimates both the power spectral density of each voice and the corresponding strength in each microphone signal. With this information, we build an optimal Wiener filter, strongly reducing interferences. The trade-off between distortion and separation can be controlled by the user through the number of iterations of the algorithm. Furthermore, we present a computationally effective approximation of the iterative procedure. Listening tests demonstrate the effectiveness of the method.
Url:
Links toward previous steps (curation, corpus...)
- to stream Hal, to step Corpus: Pour aller vers cette notice dans l'étape Curation :002D48
- to stream Hal, to step Curation: Pour aller vers cette notice dans l'étape Curation :002D48
- to stream Hal, to step Checkpoint: Pour aller vers cette notice dans l'étape Curation :000557
- to stream Main, to step Merge: Pour aller vers cette notice dans l'étape Curation :000576
Links to Exploration step
Hal:hal-01116686Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">Kernel additive modeling for interference reduction in multi-channel music recordings</title>
<author><name sortKey="Pr Tzlich, Thomas" sort="Pr Tzlich, Thomas" uniqKey="Pr Tzlich T" first="Thomas" last="Pr Tzlich">Thomas Pr Tzlich</name>
<affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-218524" status="INCOMING"><orgName>International Audio Laboratories Erlangen</orgName>
<orgName type="acronym">AudioLabs</orgName>
<desc><address><addrLine>International Audio Laboratories Erlangen Am Wolfsmantel 33 91058 Erlangen Deutschland</addrLine>
<country key="DE"></country>
</address>
<ref type="url">http://www.audiolabs-erlangen.de/</ref>
</desc>
<listRelation><relation active="#struct-353211" type="direct"></relation>
<relation active="#struct-353212" type="direct"></relation>
</listRelation>
<tutelles><tutelle active="#struct-353211" type="direct"><org type="institution" xml:id="struct-353211" status="INCOMING"><orgName>Fraunhofer Institut für Integrierte Schaltungen IIS</orgName>
<desc><address><country key="FR"></country>
</address>
</desc>
</org>
</tutelle>
<tutelle active="#struct-353212" type="direct"><org type="institution" xml:id="struct-353212" status="INCOMING"><orgName>Univ. Erlangen-Nürnberg</orgName>
<desc><address><country key="FR"></country>
</address>
</desc>
</org>
</tutelle>
</tutelles>
</hal:affiliation>
<country>Allemagne</country>
</affiliation>
</author>
<author><name sortKey="Bittner, Rachel" sort="Bittner, Rachel" uniqKey="Bittner R" first="Rachel" last="Bittner">Rachel Bittner</name>
<affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-412464" status="VALID"><orgName>Music and Audio Research Lab [New York]</orgName>
<orgName type="acronym">MARL</orgName>
<desc><address><addrLine>70 Washington Square South, New York, NY 10012</addrLine>
<country key="US"></country>
</address>
<ref type="url">http://steinhardt.nyu.edu/marl/</ref>
</desc>
<listRelation><relation active="#struct-300459" type="direct"></relation>
</listRelation>
<tutelles><tutelle active="#struct-300459" type="direct"><org type="institution" xml:id="struct-300459" status="VALID"><orgName>New York University [New York]</orgName>
<desc><address><addrLine>70 Washington Square South, New York, NY 10012</addrLine>
<country key="US"></country>
</address>
<ref type="url">http://www.nyu.edu/</ref>
</desc>
</org>
</tutelle>
</tutelles>
</hal:affiliation>
<country>États-Unis</country>
</affiliation>
</author>
<author><name sortKey="Liutkus, Antoine" sort="Liutkus, Antoine" uniqKey="Liutkus A" first="Antoine" last="Liutkus">Antoine Liutkus</name>
<affiliation wicri:level="1"><hal:affiliation type="researchteam" xml:id="struct-2359" status="OLD"><idno type="RNSR">200118295L</idno>
<orgName>Analysis, perception and recognition of speech</orgName>
<orgName type="acronym">PAROLE</orgName>
<desc><address><country key="FR"></country>
</address>
<ref type="url">http://www.inria.fr/equipes/parole</ref>
</desc>
<listRelation><relation active="#struct-160" type="direct"></relation>
<relation name="UMR7503" active="#struct-441569" type="indirect"></relation>
<relation active="#struct-300009" type="indirect"></relation>
<relation active="#struct-300291" type="indirect"></relation>
<relation active="#struct-300292" type="indirect"></relation>
<relation active="#struct-300293" type="indirect"></relation>
<relation active="#struct-2496" type="direct"></relation>
</listRelation>
<tutelles><tutelle active="#struct-160" type="direct"><org type="laboratory" xml:id="struct-160" status="OLD"><orgName>Laboratoire Lorrain de Recherche en Informatique et ses Applications</orgName>
<orgName type="acronym">LORIA</orgName>
<desc><address><addrLine>Campus Scientifique BP 239 54506 Vandoeuvre-lès-Nancy Cedex</addrLine>
<country key="FR"></country>
</address>
<ref type="url">http://www.loria.fr</ref>
</desc>
<listRelation><relation name="UMR7503" active="#struct-441569" type="direct"></relation>
<relation active="#struct-300009" type="direct"></relation>
<relation active="#struct-300291" type="direct"></relation>
<relation active="#struct-300292" type="direct"></relation>
<relation active="#struct-300293" type="direct"></relation>
</listRelation>
</org>
</tutelle>
<tutelle name="UMR7503" active="#struct-441569" type="indirect"><org type="institution" xml:id="struct-441569" status="VALID"><idno type="ISNI">0000000122597504</idno>
<idno type="IdRef">02636817X</idno>
<orgName>Centre National de la Recherche Scientifique</orgName>
<orgName type="acronym">CNRS</orgName>
<date type="start">1939-10-19</date>
<desc><address><country key="FR"></country>
</address>
<ref type="url">http://www.cnrs.fr/</ref>
</desc>
</org>
</tutelle>
<tutelle active="#struct-300009" type="indirect"><org type="institution" xml:id="struct-300009" status="VALID"><orgName>Institut National de Recherche en Informatique et en Automatique</orgName>
<orgName type="acronym">Inria</orgName>
<desc><address><addrLine>Domaine de VoluceauRocquencourt - BP 10578153 Le Chesnay Cedex</addrLine>
<country key="FR"></country>
</address>
<ref type="url">http://www.inria.fr/en/</ref>
</desc>
</org>
</tutelle>
<tutelle active="#struct-300291" type="indirect"><org type="institution" xml:id="struct-300291" status="OLD"><orgName>Université Henri Poincaré - Nancy 1</orgName>
<orgName type="acronym">UHP</orgName>
<date type="end">2011-12-31</date>
<desc><address><addrLine>24-30 rue Lionnois, BP 60120, 54 003 NANCY cedex, France</addrLine>
<country key="FR"></country>
</address>
</desc>
</org>
</tutelle>
<tutelle active="#struct-300292" type="indirect"><org type="institution" xml:id="struct-300292" status="OLD"><orgName>Université Nancy 2</orgName>
<date type="end">2011-12-31</date>
<desc><address><addrLine>91 avenue de la Libération, BP 454, 54001 Nancy cedex</addrLine>
<country key="FR"></country>
</address>
</desc>
</org>
</tutelle>
<tutelle active="#struct-300293" type="indirect"><org type="institution" xml:id="struct-300293" status="OLD"><orgName>Institut National Polytechnique de Lorraine</orgName>
<orgName type="acronym">INPL</orgName>
<date type="end">2011-12-31</date>
<desc><address><country key="FR"></country>
</address>
</desc>
</org>
</tutelle>
<tutelle active="#struct-2496" type="direct"><org type="laboratory" xml:id="struct-2496" status="OLD"><orgName>INRIA Lorraine</orgName>
<desc><address><addrLine>615 rue du Jardin Botanique 54600 Villers-lès-Nancy</addrLine>
<country key="FR"></country>
</address>
<ref type="url">http://www.inria.fr/centre-de-recherche-inria/nancy-grand-est</ref>
</desc>
<listRelation><relation active="#struct-300009" type="direct"></relation>
</listRelation>
</org>
</tutelle>
</tutelles>
</hal:affiliation>
<country>France</country>
<placeName><settlement type="city">Nancy</settlement>
<region type="region" nuts="2">Grand Est</region>
<region type="old region" nuts="2">Lorraine (région)</region>
</placeName>
<orgName type="university">Université Nancy 2</orgName>
<orgName type="institution" wicri:auto="newGroup">Université de Lorraine</orgName>
<placeName><settlement type="city">Nancy</settlement>
<region type="region" nuts="2">Grand Est</region>
<region type="old region" nuts="2">Lorraine (région)</region>
</placeName>
<orgName type="university">Institut national polytechnique de Lorraine</orgName>
<orgName type="institution" wicri:auto="newGroup">Université de Lorraine</orgName>
</affiliation>
</author>
<author><name sortKey="Muller, Meinard" sort="Muller, Meinard" uniqKey="Muller M" first="Meinard" last="Müller">Meinard Müller</name>
<affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-218524" status="INCOMING"><orgName>International Audio Laboratories Erlangen</orgName>
<orgName type="acronym">AudioLabs</orgName>
<desc><address><addrLine>International Audio Laboratories Erlangen Am Wolfsmantel 33 91058 Erlangen Deutschland</addrLine>
<country key="DE"></country>
</address>
<ref type="url">http://www.audiolabs-erlangen.de/</ref>
</desc>
<listRelation><relation active="#struct-353211" type="direct"></relation>
<relation active="#struct-353212" type="direct"></relation>
</listRelation>
<tutelles><tutelle active="#struct-353211" type="direct"><org type="institution" xml:id="struct-353211" status="INCOMING"><orgName>Fraunhofer Institut für Integrierte Schaltungen IIS</orgName>
<desc><address><country key="FR"></country>
</address>
</desc>
</org>
</tutelle>
<tutelle active="#struct-353212" type="direct"><org type="institution" xml:id="struct-353212" status="INCOMING"><orgName>Univ. Erlangen-Nürnberg</orgName>
<desc><address><country key="FR"></country>
</address>
</desc>
</org>
</tutelle>
</tutelles>
</hal:affiliation>
<country>Allemagne</country>
</affiliation>
</author>
</titleStmt>
<publicationStmt><idno type="wicri:source">HAL</idno>
<idno type="RBID">Hal:hal-01116686</idno>
<idno type="halId">hal-01116686</idno>
<idno type="halUri">https://hal.inria.fr/hal-01116686</idno>
<idno type="url">https://hal.inria.fr/hal-01116686</idno>
<date when="2015-04-19">2015-04-19</date>
<idno type="wicri:Area/Hal/Corpus">002D48</idno>
<idno type="wicri:Area/Hal/Curation">002D48</idno>
<idno type="wicri:Area/Hal/Checkpoint">000557</idno>
<idno type="wicri:explorRef" wicri:stream="Hal" wicri:step="Checkpoint">000557</idno>
<idno type="wicri:Area/Main/Merge">000576</idno>
<idno type="wicri:Area/Main/Curation">000576</idno>
</publicationStmt>
<sourceDesc><biblStruct><analytic><title xml:lang="en">Kernel additive modeling for interference reduction in multi-channel music recordings</title>
<author><name sortKey="Pr Tzlich, Thomas" sort="Pr Tzlich, Thomas" uniqKey="Pr Tzlich T" first="Thomas" last="Pr Tzlich">Thomas Pr Tzlich</name>
<affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-218524" status="INCOMING"><orgName>International Audio Laboratories Erlangen</orgName>
<orgName type="acronym">AudioLabs</orgName>
<desc><address><addrLine>International Audio Laboratories Erlangen Am Wolfsmantel 33 91058 Erlangen Deutschland</addrLine>
<country key="DE"></country>
</address>
<ref type="url">http://www.audiolabs-erlangen.de/</ref>
</desc>
<listRelation><relation active="#struct-353211" type="direct"></relation>
<relation active="#struct-353212" type="direct"></relation>
</listRelation>
<tutelles><tutelle active="#struct-353211" type="direct"><org type="institution" xml:id="struct-353211" status="INCOMING"><orgName>Fraunhofer Institut für Integrierte Schaltungen IIS</orgName>
<desc><address><country key="FR"></country>
</address>
</desc>
</org>
</tutelle>
<tutelle active="#struct-353212" type="direct"><org type="institution" xml:id="struct-353212" status="INCOMING"><orgName>Univ. Erlangen-Nürnberg</orgName>
<desc><address><country key="FR"></country>
</address>
</desc>
</org>
</tutelle>
</tutelles>
</hal:affiliation>
<country>Allemagne</country>
</affiliation>
</author>
<author><name sortKey="Bittner, Rachel" sort="Bittner, Rachel" uniqKey="Bittner R" first="Rachel" last="Bittner">Rachel Bittner</name>
<affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-412464" status="VALID"><orgName>Music and Audio Research Lab [New York]</orgName>
<orgName type="acronym">MARL</orgName>
<desc><address><addrLine>70 Washington Square South, New York, NY 10012</addrLine>
<country key="US"></country>
</address>
<ref type="url">http://steinhardt.nyu.edu/marl/</ref>
</desc>
<listRelation><relation active="#struct-300459" type="direct"></relation>
</listRelation>
<tutelles><tutelle active="#struct-300459" type="direct"><org type="institution" xml:id="struct-300459" status="VALID"><orgName>New York University [New York]</orgName>
<desc><address><addrLine>70 Washington Square South, New York, NY 10012</addrLine>
<country key="US"></country>
</address>
<ref type="url">http://www.nyu.edu/</ref>
</desc>
</org>
</tutelle>
</tutelles>
</hal:affiliation>
<country>États-Unis</country>
</affiliation>
</author>
<author><name sortKey="Liutkus, Antoine" sort="Liutkus, Antoine" uniqKey="Liutkus A" first="Antoine" last="Liutkus">Antoine Liutkus</name>
<affiliation wicri:level="1"><hal:affiliation type="researchteam" xml:id="struct-2359" status="OLD"><idno type="RNSR">200118295L</idno>
<orgName>Analysis, perception and recognition of speech</orgName>
<orgName type="acronym">PAROLE</orgName>
<desc><address><country key="FR"></country>
</address>
<ref type="url">http://www.inria.fr/equipes/parole</ref>
</desc>
<listRelation><relation active="#struct-160" type="direct"></relation>
<relation name="UMR7503" active="#struct-441569" type="indirect"></relation>
<relation active="#struct-300009" type="indirect"></relation>
<relation active="#struct-300291" type="indirect"></relation>
<relation active="#struct-300292" type="indirect"></relation>
<relation active="#struct-300293" type="indirect"></relation>
<relation active="#struct-2496" type="direct"></relation>
</listRelation>
<tutelles><tutelle active="#struct-160" type="direct"><org type="laboratory" xml:id="struct-160" status="OLD"><orgName>Laboratoire Lorrain de Recherche en Informatique et ses Applications</orgName>
<orgName type="acronym">LORIA</orgName>
<desc><address><addrLine>Campus Scientifique BP 239 54506 Vandoeuvre-lès-Nancy Cedex</addrLine>
<country key="FR"></country>
</address>
<ref type="url">http://www.loria.fr</ref>
</desc>
<listRelation><relation name="UMR7503" active="#struct-441569" type="direct"></relation>
<relation active="#struct-300009" type="direct"></relation>
<relation active="#struct-300291" type="direct"></relation>
<relation active="#struct-300292" type="direct"></relation>
<relation active="#struct-300293" type="direct"></relation>
</listRelation>
</org>
</tutelle>
<tutelle name="UMR7503" active="#struct-441569" type="indirect"><org type="institution" xml:id="struct-441569" status="VALID"><idno type="ISNI">0000000122597504</idno>
<idno type="IdRef">02636817X</idno>
<orgName>Centre National de la Recherche Scientifique</orgName>
<orgName type="acronym">CNRS</orgName>
<date type="start">1939-10-19</date>
<desc><address><country key="FR"></country>
</address>
<ref type="url">http://www.cnrs.fr/</ref>
</desc>
</org>
</tutelle>
<tutelle active="#struct-300009" type="indirect"><org type="institution" xml:id="struct-300009" status="VALID"><orgName>Institut National de Recherche en Informatique et en Automatique</orgName>
<orgName type="acronym">Inria</orgName>
<desc><address><addrLine>Domaine de VoluceauRocquencourt - BP 10578153 Le Chesnay Cedex</addrLine>
<country key="FR"></country>
</address>
<ref type="url">http://www.inria.fr/en/</ref>
</desc>
</org>
</tutelle>
<tutelle active="#struct-300291" type="indirect"><org type="institution" xml:id="struct-300291" status="OLD"><orgName>Université Henri Poincaré - Nancy 1</orgName>
<orgName type="acronym">UHP</orgName>
<date type="end">2011-12-31</date>
<desc><address><addrLine>24-30 rue Lionnois, BP 60120, 54 003 NANCY cedex, France</addrLine>
<country key="FR"></country>
</address>
</desc>
</org>
</tutelle>
<tutelle active="#struct-300292" type="indirect"><org type="institution" xml:id="struct-300292" status="OLD"><orgName>Université Nancy 2</orgName>
<date type="end">2011-12-31</date>
<desc><address><addrLine>91 avenue de la Libération, BP 454, 54001 Nancy cedex</addrLine>
<country key="FR"></country>
</address>
</desc>
</org>
</tutelle>
<tutelle active="#struct-300293" type="indirect"><org type="institution" xml:id="struct-300293" status="OLD"><orgName>Institut National Polytechnique de Lorraine</orgName>
<orgName type="acronym">INPL</orgName>
<date type="end">2011-12-31</date>
<desc><address><country key="FR"></country>
</address>
</desc>
</org>
</tutelle>
<tutelle active="#struct-2496" type="direct"><org type="laboratory" xml:id="struct-2496" status="OLD"><orgName>INRIA Lorraine</orgName>
<desc><address><addrLine>615 rue du Jardin Botanique 54600 Villers-lès-Nancy</addrLine>
<country key="FR"></country>
</address>
<ref type="url">http://www.inria.fr/centre-de-recherche-inria/nancy-grand-est</ref>
</desc>
<listRelation><relation active="#struct-300009" type="direct"></relation>
</listRelation>
</org>
</tutelle>
</tutelles>
</hal:affiliation>
<country>France</country>
<placeName><settlement type="city">Nancy</settlement>
<region type="region" nuts="2">Grand Est</region>
<region type="old region" nuts="2">Lorraine (région)</region>
</placeName>
<orgName type="university">Université Nancy 2</orgName>
<orgName type="institution" wicri:auto="newGroup">Université de Lorraine</orgName>
<placeName><settlement type="city">Nancy</settlement>
<region type="region" nuts="2">Grand Est</region>
<region type="old region" nuts="2">Lorraine (région)</region>
</placeName>
<orgName type="university">Institut national polytechnique de Lorraine</orgName>
<orgName type="institution" wicri:auto="newGroup">Université de Lorraine</orgName>
</affiliation>
</author>
<author><name sortKey="Muller, Meinard" sort="Muller, Meinard" uniqKey="Muller M" first="Meinard" last="Müller">Meinard Müller</name>
<affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-218524" status="INCOMING"><orgName>International Audio Laboratories Erlangen</orgName>
<orgName type="acronym">AudioLabs</orgName>
<desc><address><addrLine>International Audio Laboratories Erlangen Am Wolfsmantel 33 91058 Erlangen Deutschland</addrLine>
<country key="DE"></country>
</address>
<ref type="url">http://www.audiolabs-erlangen.de/</ref>
</desc>
<listRelation><relation active="#struct-353211" type="direct"></relation>
<relation active="#struct-353212" type="direct"></relation>
</listRelation>
<tutelles><tutelle active="#struct-353211" type="direct"><org type="institution" xml:id="struct-353211" status="INCOMING"><orgName>Fraunhofer Institut für Integrierte Schaltungen IIS</orgName>
<desc><address><country key="FR"></country>
</address>
</desc>
</org>
</tutelle>
<tutelle active="#struct-353212" type="direct"><org type="institution" xml:id="struct-353212" status="INCOMING"><orgName>Univ. Erlangen-Nürnberg</orgName>
<desc><address><country key="FR"></country>
</address>
</desc>
</org>
</tutelle>
</tutelles>
</hal:affiliation>
<country>Allemagne</country>
</affiliation>
</author>
</analytic>
</biblStruct>
</sourceDesc>
</fileDesc>
<profileDesc><textClass><keywords scheme="mix" xml:lang="en"><term>audio source separation</term>
<term>interference reduction</term>
<term>kernel additive modeling</term>
<term>multi-channel recordings</term>
</keywords>
</textClass>
</profileDesc>
</teiHeader>
<front><div type="abstract" xml:lang="en">When recording a live musical performance, the different voices, such as the instrument groups or soloists of an orchestra, are typically recorded in the same room simultaneously, with at least one microphone assigned to each voice. However, it is difficult to acoustically shield the microphones. In practice, each one contains interference from every other voice. In this paper, we aim to reduce these interferences in multi-channel recordings to recover only the isolated voices. Following the recently proposed Kernel Additive Modeling framework, we present a method that iteratively estimates both the power spectral density of each voice and the corresponding strength in each microphone signal. With this information, we build an optimal Wiener filter, strongly reducing interferences. The trade-off between distortion and separation can be controlled by the user through the number of iterations of the algorithm. Furthermore, we present a computationally effective approximation of the iterative procedure. Listening tests demonstrate the effectiveness of the method.</div>
</front>
</TEI>
</record>
Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Wicri/Lorraine/explor/InforLorV4/Data/Main/Curation
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000576 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Main/Curation/biblio.hfd -nk 000576 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien |wiki= Wicri/Lorraine |area= InforLorV4 |flux= Main |étape= Curation |type= RBID |clé= Hal:hal-01116686 |texte= Kernel additive modeling for interference reduction in multi-channel music recordings }}
![]() | This area was generated with Dilib version V0.6.33. | ![]() |