Bounds on the Risk for M-SVMs
Identifieur interne : 005500 ( Hal/Checkpoint ); précédent : 005499; suivant : 005501Bounds on the Risk for M-SVMs
Auteurs : Yann Guermeur [France] ; André Elisseeff [États-Unis] ; Dominique ZelusSource :
- Applied Stochastic Models in Business and Industry [ 1524-1904 ] ; 2003.
Descripteurs français
- mix :
Abstract
Vapnik's statistical learning theory has mainly been developed for two types of problems: pattern recognition (computation of dichotomies) and regression (estimation of real-valued functions). Only in recent years has multi-class discriminant analysis been studied independently. Extending several standard results, among which a famous theorem by Bartlett, we have derived distribution-free uniform strong laws of large numbers devoted to multi-class large margin discriminant models. The capacity measure appearing in the confidence interval, a covering number, has been bounded from above in terms of a new generalized VC dimension. In this paper, the aforementioned theorems are applied to the architecture shared by all the multi-class SVMs proposed so far, which provides us with a simple theoretical framework to study them, compare their performance and design new machines.
Url:
Links toward previous steps (curation, corpus...)
Links to Exploration step
Hal:inria-00099587Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">Bounds on the Risk for M-SVMs</title><author><name sortKey="Guermeur, Yann" sort="Guermeur, Yann" uniqKey="Guermeur Y" first="Yann" last="Guermeur">Yann Guermeur</name><affiliation wicri:level="1"><hal:affiliation type="researchteam" xml:id="struct-2356" status="OLD"><idno type="RNSR">200321395X</idno><orgName>Computational models in molecular biology</orgName><orgName type="acronym">MODBIO</orgName><desc><address><country key="FR"></country></address><ref type="url">http://www.inria.fr/equipes/modbio</ref></desc><listRelation><relation active="#struct-160" type="direct"></relation><relation name="UMR7503" active="#struct-441569" type="indirect"></relation><relation active="#struct-300009" type="indirect"></relation><relation active="#struct-300291" type="indirect"></relation><relation active="#struct-300292" type="indirect"></relation><relation active="#struct-300293" type="indirect"></relation><relation active="#struct-2496" type="direct"></relation></listRelation><tutelles><tutelle active="#struct-160" type="direct"><org type="laboratory" xml:id="struct-160" status="OLD"><orgName>Laboratoire Lorrain de Recherche en Informatique et ses Applications</orgName><orgName type="acronym">LORIA</orgName><desc><address><addrLine>Campus Scientifique BP 239 54506 Vandoeuvre-lès-Nancy Cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.loria.fr</ref></desc><listRelation><relation name="UMR7503" active="#struct-441569" type="direct"></relation><relation active="#struct-300009" type="direct"></relation><relation active="#struct-300291" type="direct"></relation><relation active="#struct-300292" type="direct"></relation><relation active="#struct-300293" type="direct"></relation></listRelation></org></tutelle><tutelle name="UMR7503" active="#struct-441569" type="indirect"><org type="institution" xml:id="struct-441569" status="VALID"><idno type="ISNI">0000000122597504</idno><idno type="IdRef">02636817X</idno><orgName>Centre National de la Recherche Scientifique</orgName><orgName type="acronym">CNRS</orgName><date type="start">1939-10-19</date><desc><address><country key="FR"></country></address><ref type="url">http://www.cnrs.fr/</ref></desc></org></tutelle><tutelle active="#struct-300009" type="indirect"><org type="institution" xml:id="struct-300009" status="VALID"><orgName>Institut National de Recherche en Informatique et en Automatique</orgName><orgName type="acronym">Inria</orgName><desc><address><addrLine>Domaine de VoluceauRocquencourt - BP 10578153 Le Chesnay Cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.inria.fr/en/</ref></desc></org></tutelle><tutelle active="#struct-300291" type="indirect"><org type="institution" xml:id="struct-300291" status="OLD"><orgName>Université Henri Poincaré - Nancy 1</orgName><orgName type="acronym">UHP</orgName><date type="end">2011-12-31</date><desc><address><addrLine>24-30 rue Lionnois, BP 60120, 54 003 NANCY cedex, France</addrLine><country key="FR"></country></address></desc></org></tutelle><tutelle active="#struct-300292" type="indirect"><org type="institution" xml:id="struct-300292" status="OLD"><orgName>Université Nancy 2</orgName><date type="end">2011-12-31</date><desc><address><addrLine>91 avenue de la Libération, BP 454, 54001 Nancy cedex</addrLine><country key="FR"></country></address></desc></org></tutelle><tutelle active="#struct-300293" type="indirect"><org type="institution" xml:id="struct-300293" status="OLD"><orgName>Institut National Polytechnique de Lorraine</orgName><orgName type="acronym">INPL</orgName><date type="end">2011-12-31</date><desc><address><country key="FR"></country></address></desc></org></tutelle><tutelle active="#struct-2496" type="direct"><org type="laboratory" xml:id="struct-2496" status="OLD"><orgName>INRIA Lorraine</orgName><desc><address><addrLine>615 rue du Jardin Botanique 54600 Villers-lès-Nancy</addrLine><country key="FR"></country></address><ref type="url">http://www.inria.fr/centre-de-recherche-inria/nancy-grand-est</ref></desc><listRelation><relation active="#struct-300009" type="direct"></relation></listRelation></org></tutelle></tutelles></hal:affiliation><country>France</country><placeName><settlement type="city">Nancy</settlement><region type="region" nuts="2">Grand Est</region><region type="old region" nuts="2">Lorraine (région)</region></placeName><orgName type="university">Université Nancy 2</orgName><orgName type="institution" wicri:auto="newGroup">Université de Lorraine</orgName><placeName><settlement type="city">Nancy</settlement><region type="region" nuts="2">Grand Est</region><region type="old region" nuts="2">Lorraine (région)</region></placeName><orgName type="university">Institut national polytechnique de Lorraine</orgName><orgName type="institution" wicri:auto="newGroup">Université de Lorraine</orgName></affiliation></author><author><name sortKey="Elisseeff, Andre" sort="Elisseeff, Andre" uniqKey="Elisseeff A" first="André" last="Elisseeff">André Elisseeff</name><affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-6875" status="VALID"><orgName>IBM [Yorktown]</orgName><orgName type="acronym">IBM</orgName><desc><address><addrLine>IBM TJ WATSON RESEARCH CENTER Taconic Parkway & Route 134 PO Box 218 Yorktown Heights, NY, 10592</addrLine><country key="US"></country></address><ref type="url">http://www.watson.ibm.com/index.shtml</ref></desc><listRelation><relation active="#struct-300665" type="direct"></relation></listRelation><tutelles><tutelle active="#struct-300665" type="direct"><org type="institution" xml:id="struct-300665" status="VALID"><orgName>IBM</orgName><desc><address><country key="US"></country></address></desc></org></tutelle></tutelles></hal:affiliation><country>États-Unis</country></affiliation></author><author><name sortKey="Zelus, Dominique" sort="Zelus, Dominique" uniqKey="Zelus D" first="Dominique" last="Zelus">Dominique Zelus</name></author></titleStmt><publicationStmt><idno type="wicri:source">HAL</idno><idno type="RBID">Hal:inria-00099587</idno><idno type="halId">inria-00099587</idno><idno type="halUri">https://hal.inria.fr/inria-00099587</idno><idno type="url">https://hal.inria.fr/inria-00099587</idno><date when="2003">2003</date><idno type="wicri:Area/Hal/Corpus">001299</idno><idno type="wicri:Area/Hal/Curation">001299</idno><idno type="wicri:Area/Hal/Checkpoint">005500</idno><idno type="wicri:explorRef" wicri:stream="Hal" wicri:step="Checkpoint">005500</idno></publicationStmt><sourceDesc><biblStruct><analytic><title xml:lang="en">Bounds on the Risk for M-SVMs</title><author><name sortKey="Guermeur, Yann" sort="Guermeur, Yann" uniqKey="Guermeur Y" first="Yann" last="Guermeur">Yann Guermeur</name><affiliation wicri:level="1"><hal:affiliation type="researchteam" xml:id="struct-2356" status="OLD"><idno type="RNSR">200321395X</idno><orgName>Computational models in molecular biology</orgName><orgName type="acronym">MODBIO</orgName><desc><address><country key="FR"></country></address><ref type="url">http://www.inria.fr/equipes/modbio</ref></desc><listRelation><relation active="#struct-160" type="direct"></relation><relation name="UMR7503" active="#struct-441569" type="indirect"></relation><relation active="#struct-300009" type="indirect"></relation><relation active="#struct-300291" type="indirect"></relation><relation active="#struct-300292" type="indirect"></relation><relation active="#struct-300293" type="indirect"></relation><relation active="#struct-2496" type="direct"></relation></listRelation><tutelles><tutelle active="#struct-160" type="direct"><org type="laboratory" xml:id="struct-160" status="OLD"><orgName>Laboratoire Lorrain de Recherche en Informatique et ses Applications</orgName><orgName type="acronym">LORIA</orgName><desc><address><addrLine>Campus Scientifique BP 239 54506 Vandoeuvre-lès-Nancy Cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.loria.fr</ref></desc><listRelation><relation name="UMR7503" active="#struct-441569" type="direct"></relation><relation active="#struct-300009" type="direct"></relation><relation active="#struct-300291" type="direct"></relation><relation active="#struct-300292" type="direct"></relation><relation active="#struct-300293" type="direct"></relation></listRelation></org></tutelle><tutelle name="UMR7503" active="#struct-441569" type="indirect"><org type="institution" xml:id="struct-441569" status="VALID"><idno type="ISNI">0000000122597504</idno><idno type="IdRef">02636817X</idno><orgName>Centre National de la Recherche Scientifique</orgName><orgName type="acronym">CNRS</orgName><date type="start">1939-10-19</date><desc><address><country key="FR"></country></address><ref type="url">http://www.cnrs.fr/</ref></desc></org></tutelle><tutelle active="#struct-300009" type="indirect"><org type="institution" xml:id="struct-300009" status="VALID"><orgName>Institut National de Recherche en Informatique et en Automatique</orgName><orgName type="acronym">Inria</orgName><desc><address><addrLine>Domaine de VoluceauRocquencourt - BP 10578153 Le Chesnay Cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.inria.fr/en/</ref></desc></org></tutelle><tutelle active="#struct-300291" type="indirect"><org type="institution" xml:id="struct-300291" status="OLD"><orgName>Université Henri Poincaré - Nancy 1</orgName><orgName type="acronym">UHP</orgName><date type="end">2011-12-31</date><desc><address><addrLine>24-30 rue Lionnois, BP 60120, 54 003 NANCY cedex, France</addrLine><country key="FR"></country></address></desc></org></tutelle><tutelle active="#struct-300292" type="indirect"><org type="institution" xml:id="struct-300292" status="OLD"><orgName>Université Nancy 2</orgName><date type="end">2011-12-31</date><desc><address><addrLine>91 avenue de la Libération, BP 454, 54001 Nancy cedex</addrLine><country key="FR"></country></address></desc></org></tutelle><tutelle active="#struct-300293" type="indirect"><org type="institution" xml:id="struct-300293" status="OLD"><orgName>Institut National Polytechnique de Lorraine</orgName><orgName type="acronym">INPL</orgName><date type="end">2011-12-31</date><desc><address><country key="FR"></country></address></desc></org></tutelle><tutelle active="#struct-2496" type="direct"><org type="laboratory" xml:id="struct-2496" status="OLD"><orgName>INRIA Lorraine</orgName><desc><address><addrLine>615 rue du Jardin Botanique 54600 Villers-lès-Nancy</addrLine><country key="FR"></country></address><ref type="url">http://www.inria.fr/centre-de-recherche-inria/nancy-grand-est</ref></desc><listRelation><relation active="#struct-300009" type="direct"></relation></listRelation></org></tutelle></tutelles></hal:affiliation><country>France</country><placeName><settlement type="city">Nancy</settlement><region type="region" nuts="2">Grand Est</region><region type="old region" nuts="2">Lorraine (région)</region></placeName><orgName type="university">Université Nancy 2</orgName><orgName type="institution" wicri:auto="newGroup">Université de Lorraine</orgName><placeName><settlement type="city">Nancy</settlement><region type="region" nuts="2">Grand Est</region><region type="old region" nuts="2">Lorraine (région)</region></placeName><orgName type="university">Institut national polytechnique de Lorraine</orgName><orgName type="institution" wicri:auto="newGroup">Université de Lorraine</orgName></affiliation></author><author><name sortKey="Elisseeff, Andre" sort="Elisseeff, Andre" uniqKey="Elisseeff A" first="André" last="Elisseeff">André Elisseeff</name><affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-6875" status="VALID"><orgName>IBM [Yorktown]</orgName><orgName type="acronym">IBM</orgName><desc><address><addrLine>IBM TJ WATSON RESEARCH CENTER Taconic Parkway & Route 134 PO Box 218 Yorktown Heights, NY, 10592</addrLine><country key="US"></country></address><ref type="url">http://www.watson.ibm.com/index.shtml</ref></desc><listRelation><relation active="#struct-300665" type="direct"></relation></listRelation><tutelles><tutelle active="#struct-300665" type="direct"><org type="institution" xml:id="struct-300665" status="VALID"><orgName>IBM</orgName><desc><address><country key="US"></country></address></desc></org></tutelle></tutelles></hal:affiliation><country>États-Unis</country></affiliation></author><author><name sortKey="Zelus, Dominique" sort="Zelus, Dominique" uniqKey="Zelus D" first="Dominique" last="Zelus">Dominique Zelus</name></author></analytic><series><title level="j">Applied Stochastic Models in Business and Industry</title><idno type="ISSN">1524-1904</idno><imprint><date type="datePub">2003</date></imprint></series></biblStruct></sourceDesc></fileDesc><profileDesc><textClass><keywords scheme="mix" xml:lang="fr"><term>bornes sur l'erreur en généralisation</term><term>extended vc dimensions</term><term>generalization error bounds</term><term>large margin classifiers</term><term>multi-class support vector machines (m-svms)</term><term>svm multi-classes (m-svms)</term><term>systèmes discriminants à grande marge</term><term>vc dimensions étendues</term></keywords></textClass></profileDesc></teiHeader><front><div type="abstract" xml:lang="en">Vapnik's statistical learning theory has mainly been developed for two types of problems: pattern recognition (computation of dichotomies) and regression (estimation of real-valued functions). Only in recent years has multi-class discriminant analysis been studied independently. Extending several standard results, among which a famous theorem by Bartlett, we have derived distribution-free uniform strong laws of large numbers devoted to multi-class large margin discriminant models. The capacity measure appearing in the confidence interval, a covering number, has been bounded from above in terms of a new generalized VC dimension. In this paper, the aforementioned theorems are applied to the architecture shared by all the multi-class SVMs proposed so far, which provides us with a simple theoretical framework to study them, compare their performance and design new machines.</div></front></TEI><hal api="V3"><titleStmt><title xml:lang="en">Bounds on the Risk for M-SVMs</title><author role="aut"><persName><forename type="first">Yann</forename><surname>Guermeur</surname></persName><email>Yann.Guermeur@loria.fr</email><idno type="halauthor">130342</idno><orgName ref="#struct-364475"></orgName><affiliation ref="#struct-2356"></affiliation></author><author role="aut"><persName><forename type="first">André</forename><surname>Elisseeff</surname></persName><email></email><idno type="halauthor">130799</idno><orgName ref="#struct-364792"></orgName><affiliation ref="#struct-6875"></affiliation></author><author role="aut"><persName><forename type="first">Dominique</forename><surname>Zelus</surname></persName><email></email><idno type="halauthor">130800</idno><orgName ref="#struct-364793"></orgName></author><editor role="depositor"><persName><forename>Publications</forename><surname>Loria</surname></persName><email>publications@loria.fr</email></editor></titleStmt><editionStmt><edition n="v1" type="current"><date type="whenSubmitted">2006-09-26 09:39:00</date><date type="whenModified">2016-05-19 01:09:33</date><date type="whenReleased">2006-09-28 15:22:46</date><date type="whenProduced">2003</date></edition><respStmt><resp>contributor</resp><name key="108626"><persName><forename>Publications</forename><surname>Loria</surname></persName><email>publications@loria.fr</email></name></respStmt></editionStmt><publicationStmt><distributor>CCSD</distributor><idno type="halId">inria-00099587</idno><idno type="halUri">https://hal.inria.fr/inria-00099587</idno><idno type="halBibtex">guermeur:inria-00099587</idno><idno type="halRefHtml">Applied Stochastic Models in Business and Industry, Wiley, 2003</idno><idno type="halRef">Applied Stochastic Models in Business and Industry, Wiley, 2003</idno></publicationStmt><seriesStmt><idno type="stamp" n="INRIA">INRIA - Institut National de Recherche en Informatique et en Automatique</idno><idno type="stamp" n="CNRS">CNRS - Centre national de la recherche scientifique</idno><idno type="stamp" n="INPL">Institut National Polytechnique de Lorraine</idno><idno type="stamp" n="LORIA2">Publications du LORIA</idno><idno type="stamp" n="LORIA">LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications</idno><idno type="stamp" n="INRIA-NANCY-GRAND-EST">INRIA Nancy - Grand Est</idno><idno type="stamp" n="UNIV-LORRAINE">Université de Lorraine</idno><idno type="stamp" n="INRIA-LORRAINE">INRIA Nancy - Grand Est</idno><idno type="stamp" n="LABO-LORIA-SET" p="LORIA">LABO-LORIA-SET</idno></seriesStmt><notesStmt><note type="commentary">Article dans revue scientifique avec comité de lecture. internationale.</note><note type="audience" n="2">International</note><note type="popular" n="0">No</note><note type="peer" n="1">Yes</note></notesStmt><sourceDesc><biblStruct><analytic><title xml:lang="en">Bounds on the Risk for M-SVMs</title><author role="aut"><persName><forename type="first">Yann</forename><surname>Guermeur</surname></persName><email>Yann.Guermeur@loria.fr</email><idno type="halAuthorId">130342</idno><orgName ref="#struct-364475"></orgName><affiliation ref="#struct-2356"></affiliation></author><author role="aut"><persName><forename type="first">André</forename><surname>Elisseeff</surname></persName><idno type="halAuthorId">130799</idno><orgName ref="#struct-364792"></orgName><affiliation ref="#struct-6875"></affiliation></author><author role="aut"><persName><forename type="first">Dominique</forename><surname>Zelus</surname></persName><idno type="halAuthorId">130800</idno><orgName ref="#struct-364793"></orgName></author></analytic><monogr><idno type="localRef">A03-R-263 || guermeur03c</idno><idno type="halJournalId" status="VALID">10667</idno><idno type="issn">1524-1904</idno><idno type="eissn">1526-4025</idno><title level="j">Applied Stochastic Models in Business and Industry</title><imprint><publisher>Wiley</publisher><date type="datePub">2003</date></imprint></monogr></biblStruct></sourceDesc><profileDesc><langUsage><language ident="en">English</language></langUsage><textClass><keywords scheme="author"><term xml:lang="fr">svm multi-classes (m-svms)</term><term xml:lang="fr">extended vc dimensions</term><term xml:lang="fr">multi-class support vector machines (m-svms)</term><term xml:lang="fr">generalization error bounds</term><term xml:lang="fr">large margin classifiers</term><term xml:lang="fr">bornes sur l'erreur en généralisation</term><term xml:lang="fr">systèmes discriminants à grande marge</term><term xml:lang="fr">vc dimensions étendues</term></keywords><classCode scheme="halDomain" n="info.info-oh">Computer Science [cs]/Other [cs.OH]</classCode><classCode scheme="halTypology" n="ART">Journal articles</classCode></textClass><abstract xml:lang="en">Vapnik's statistical learning theory has mainly been developed for two types of problems: pattern recognition (computation of dichotomies) and regression (estimation of real-valued functions). Only in recent years has multi-class discriminant analysis been studied independently. Extending several standard results, among which a famous theorem by Bartlett, we have derived distribution-free uniform strong laws of large numbers devoted to multi-class large margin discriminant models. The capacity measure appearing in the confidence interval, a covering number, has been bounded from above in terms of a new generalized VC dimension. In this paper, the aforementioned theorems are applied to the architecture shared by all the multi-class SVMs proposed so far, which provides us with a simple theoretical framework to study them, compare their performance and design new machines.</abstract></profileDesc></hal></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Wicri/Lorraine/explor/InforLorV4/Data/Hal/Checkpoint
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 005500 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Hal/Checkpoint/biblio.hfd -nk 005500 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Wicri/Lorraine
|area= InforLorV4
|flux= Hal
|étape= Checkpoint
|type= RBID
|clé= Hal:inria-00099587
|texte= Bounds on the Risk for M-SVMs
}}
| This area was generated with Dilib version V0.6.33. |  |