Serveur d'exploration sur l'OCR

Attention, ce site est en cours de développement !
Attention, site généré par des moyens informatiques à partir de corpus bruts.
Les informations ne sont donc pas validées.

Reducing the Effect of Out-Voting Problem in Ensemble Based Incremental Support Vector Machines

Identifieur interne : 000E31 ( Istex/Corpus ); précédent : 000E30; suivant : 000E32

Reducing the Effect of Out-Voting Problem in Ensemble Based Incremental Support Vector Machines

Auteurs : Zeki Erdem ; Robi Polikar ; Fikret Gurgen ; Nejat Yumusak

Source :

RBID : ISTEX:7155B31BC88BB2678B987C67811112604D551617

Abstract

Abstract: Although Support Vector Machines (SVMs) have been successfully applied to solve a large number of classification and regression problems, they suffer from the catastrophic forgetting phenomenon. In our previous work, integrating the SVM classifiers into an ensemble framework using Learn++ (SVMLearn++) [1], we have shown that the SVM classifiers can in fact be equipped with the incremental learning capability. However, Learn++ suffers from an inherent out-voting problem: when asked to learn new classes, an unnecessarily large number of classifiers are generated to learn the new classes. In this paper, we propose a new ensemble based incremental learning approach using SVMs that is based on the incremental Learn++.MT algorithm. Experiments on the real-world and benchmark datasets show that the proposed approach can reduce the number of SVM classifiers generated, thus reduces the effect of out-voting problem. It also provides performance improvements over previous approach.

Url:
DOI: 10.1007/11550907_96

Links to Exploration step

ISTEX:7155B31BC88BB2678B987C67811112604D551617

Le document en format XML

<record>
<TEI wicri:istexFullTextTei="biblStruct">
<teiHeader>
<fileDesc>
<titleStmt>
<title xml:lang="en">Reducing the Effect of Out-Voting Problem in Ensemble Based Incremental Support Vector Machines</title>
<author>
<name sortKey="Erdem, Zeki" sort="Erdem, Zeki" uniqKey="Erdem Z" first="Zeki" last="Erdem">Zeki Erdem</name>
<affiliation>
<mods:affiliation>Information Technologies Institute, TUBITAK Marmara Research Center, 41470, Gebze – Kocaeli, Turkey</mods:affiliation>
</affiliation>
<affiliation>
<mods:affiliation>Computer Engineering Department, Sakarya University, 54187, Esentepe, Sakarya, Turkey</mods:affiliation>
</affiliation>
<affiliation>
<mods:affiliation>E-mail: zeki.erdem@bte.mam.gov.tr</mods:affiliation>
</affiliation>
</author>
<author>
<name sortKey="Polikar, Robi" sort="Polikar, Robi" uniqKey="Polikar R" first="Robi" last="Polikar">Robi Polikar</name>
<affiliation>
<mods:affiliation>Electrical and Computer Engineering Department, Rowan University, 210 Mullica Hill Rd., 08028, Glassboro, NJ, USA</mods:affiliation>
</affiliation>
<affiliation>
<mods:affiliation>E-mail: polikar@rowan.edu</mods:affiliation>
</affiliation>
</author>
<author>
<name sortKey="Gurgen, Fikret" sort="Gurgen, Fikret" uniqKey="Gurgen F" first="Fikret" last="Gurgen">Fikret Gurgen</name>
<affiliation>
<mods:affiliation>Computer Engineering Department, Bogazici University, 80815, Bebek, Istanbul, Turkey</mods:affiliation>
</affiliation>
<affiliation>
<mods:affiliation>E-mail: gurgen@boun.edu.tr</mods:affiliation>
</affiliation>
</author>
<author>
<name sortKey="Yumusak, Nejat" sort="Yumusak, Nejat" uniqKey="Yumusak N" first="Nejat" last="Yumusak">Nejat Yumusak</name>
<affiliation>
<mods:affiliation>Computer Engineering Department, Sakarya University, 54187, Esentepe, Sakarya, Turkey</mods:affiliation>
</affiliation>
<affiliation>
<mods:affiliation>E-mail: nyumusak@sakarya.edu.tr</mods:affiliation>
</affiliation>
</author>
</titleStmt>
<publicationStmt>
<idno type="wicri:source">ISTEX</idno>
<idno type="RBID">ISTEX:7155B31BC88BB2678B987C67811112604D551617</idno>
<date when="2005" year="2005">2005</date>
<idno type="doi">10.1007/11550907_96</idno>
<idno type="url">https://api.istex.fr/document/7155B31BC88BB2678B987C67811112604D551617/fulltext/pdf</idno>
<idno type="wicri:Area/Istex/Corpus">000E31</idno>
</publicationStmt>
<sourceDesc>
<biblStruct>
<analytic>
<title level="a" type="main" xml:lang="en">Reducing the Effect of Out-Voting Problem in Ensemble Based Incremental Support Vector Machines</title>
<author>
<name sortKey="Erdem, Zeki" sort="Erdem, Zeki" uniqKey="Erdem Z" first="Zeki" last="Erdem">Zeki Erdem</name>
<affiliation>
<mods:affiliation>Information Technologies Institute, TUBITAK Marmara Research Center, 41470, Gebze – Kocaeli, Turkey</mods:affiliation>
</affiliation>
<affiliation>
<mods:affiliation>Computer Engineering Department, Sakarya University, 54187, Esentepe, Sakarya, Turkey</mods:affiliation>
</affiliation>
<affiliation>
<mods:affiliation>E-mail: zeki.erdem@bte.mam.gov.tr</mods:affiliation>
</affiliation>
</author>
<author>
<name sortKey="Polikar, Robi" sort="Polikar, Robi" uniqKey="Polikar R" first="Robi" last="Polikar">Robi Polikar</name>
<affiliation>
<mods:affiliation>Electrical and Computer Engineering Department, Rowan University, 210 Mullica Hill Rd., 08028, Glassboro, NJ, USA</mods:affiliation>
</affiliation>
<affiliation>
<mods:affiliation>E-mail: polikar@rowan.edu</mods:affiliation>
</affiliation>
</author>
<author>
<name sortKey="Gurgen, Fikret" sort="Gurgen, Fikret" uniqKey="Gurgen F" first="Fikret" last="Gurgen">Fikret Gurgen</name>
<affiliation>
<mods:affiliation>Computer Engineering Department, Bogazici University, 80815, Bebek, Istanbul, Turkey</mods:affiliation>
</affiliation>
<affiliation>
<mods:affiliation>E-mail: gurgen@boun.edu.tr</mods:affiliation>
</affiliation>
</author>
<author>
<name sortKey="Yumusak, Nejat" sort="Yumusak, Nejat" uniqKey="Yumusak N" first="Nejat" last="Yumusak">Nejat Yumusak</name>
<affiliation>
<mods:affiliation>Computer Engineering Department, Sakarya University, 54187, Esentepe, Sakarya, Turkey</mods:affiliation>
</affiliation>
<affiliation>
<mods:affiliation>E-mail: nyumusak@sakarya.edu.tr</mods:affiliation>
</affiliation>
</author>
</analytic>
<monogr></monogr>
<series>
<title level="s">Lecture Notes in Computer Science</title>
<imprint>
<date>2005</date>
</imprint>
<idno type="ISSN">0302-9743</idno>
<idno type="eISSN">1611-3349</idno>
</series>
<idno type="istex">7155B31BC88BB2678B987C67811112604D551617</idno>
<idno type="DOI">10.1007/11550907_96</idno>
<idno type="ChapterID">96</idno>
<idno type="ChapterID">Chap96</idno>
</biblStruct>
</sourceDesc>
<seriesStmt>
<idno type="doi">10.1007/11550907_163</idno>
</seriesStmt>
</fileDesc>
<profileDesc>
<textClass></textClass>
<langUsage>
<language ident="en">en</language>
</langUsage>
</profileDesc>
</teiHeader>
<front>
<div type="abstract" xml:lang="en">Abstract: Although Support Vector Machines (SVMs) have been successfully applied to solve a large number of classification and regression problems, they suffer from the catastrophic forgetting phenomenon. In our previous work, integrating the SVM classifiers into an ensemble framework using Learn++ (SVMLearn++) [1], we have shown that the SVM classifiers can in fact be equipped with the incremental learning capability. However, Learn++ suffers from an inherent out-voting problem: when asked to learn new classes, an unnecessarily large number of classifiers are generated to learn the new classes. In this paper, we propose a new ensemble based incremental learning approach using SVMs that is based on the incremental Learn++.MT algorithm. Experiments on the real-world and benchmark datasets show that the proposed approach can reduce the number of SVM classifiers generated, thus reduces the effect of out-voting problem. It also provides performance improvements over previous approach.</div>
</front>
</TEI>
<istex>
<corpusName>springer</corpusName>
<author>
<json:item>
<name>Zeki Erdem</name>
<affiliations>
<json:string>Information Technologies Institute, TUBITAK Marmara Research Center, 41470, Gebze – Kocaeli, Turkey</json:string>
<json:string>Computer Engineering Department, Sakarya University, 54187, Esentepe, Sakarya, Turkey</json:string>
<json:string>E-mail: zeki.erdem@bte.mam.gov.tr</json:string>
</affiliations>
</json:item>
<json:item>
<name>Robi Polikar</name>
<affiliations>
<json:string>Electrical and Computer Engineering Department, Rowan University, 210 Mullica Hill Rd., 08028, Glassboro, NJ, USA</json:string>
<json:string>E-mail: polikar@rowan.edu</json:string>
</affiliations>
</json:item>
<json:item>
<name>Fikret Gurgen</name>
<affiliations>
<json:string>Computer Engineering Department, Bogazici University, 80815, Bebek, Istanbul, Turkey</json:string>
<json:string>E-mail: gurgen@boun.edu.tr</json:string>
</affiliations>
</json:item>
<json:item>
<name>Nejat Yumusak</name>
<affiliations>
<json:string>Computer Engineering Department, Sakarya University, 54187, Esentepe, Sakarya, Turkey</json:string>
<json:string>E-mail: nyumusak@sakarya.edu.tr</json:string>
</affiliations>
</json:item>
</author>
<language>
<json:string>eng</json:string>
</language>
<abstract>Abstract: Although Support Vector Machines (SVMs) have been successfully applied to solve a large number of classification and regression problems, they suffer from the catastrophic forgetting phenomenon. In our previous work, integrating the SVM classifiers into an ensemble framework using Learn++ (SVMLearn++) [1], we have shown that the SVM classifiers can in fact be equipped with the incremental learning capability. However, Learn++ suffers from an inherent out-voting problem: when asked to learn new classes, an unnecessarily large number of classifiers are generated to learn the new classes. In this paper, we propose a new ensemble based incremental learning approach using SVMs that is based on the incremental Learn++.MT algorithm. Experiments on the real-world and benchmark datasets show that the proposed approach can reduce the number of SVM classifiers generated, thus reduces the effect of out-voting problem. It also provides performance improvements over previous approach.</abstract>
<qualityIndicators>
<score>5.435</score>
<pdfVersion>1.6</pdfVersion>
<pdfPageSize>430 x 660 pts</pdfPageSize>
<refBibsNative>false</refBibsNative>
<keywordCount>0</keywordCount>
<abstractCharCount>995</abstractCharCount>
<pdfWordCount>2207</pdfWordCount>
<pdfCharCount>13805</pdfCharCount>
<pdfPageCount>6</pdfPageCount>
<abstractWordCount>144</abstractWordCount>
</qualityIndicators>
<title>Reducing the Effect of Out-Voting Problem in Ensemble Based Incremental Support Vector Machines</title>
<genre.original>
<json:string>OriginalPaper</json:string>
</genre.original>
<chapterId>
<json:string>96</json:string>
<json:string>Chap96</json:string>
</chapterId>
<genre>
<json:string>conference [eBooks]</json:string>
</genre>
<serie>
<editor>
<json:item>
<name>David Hutchison</name>
<affiliations>
<json:string>Lancaster University, UK</json:string>
</affiliations>
</json:item>
<json:item>
<name>Takeo Kanade</name>
<affiliations>
<json:string>Carnegie Mellon University, Pittsburgh, PA, USA</json:string>
</affiliations>
</json:item>
<json:item>
<name>Josef Kittler</name>
<affiliations>
<json:string>University of Surrey, Guildford, UK</json:string>
</affiliations>
</json:item>
<json:item>
<name>Jon M. Kleinberg</name>
<affiliations>
<json:string>Cornell University, Ithaca, NY, USA</json:string>
</affiliations>
</json:item>
<json:item>
<name>Friedemann Mattern</name>
<affiliations>
<json:string>ETH Zurich, Switzerland</json:string>
</affiliations>
</json:item>
<json:item>
<name>John C. Mitchell</name>
<affiliations>
<json:string>Stanford University, CA, USA</json:string>
</affiliations>
</json:item>
<json:item>
<name>Moni Naor</name>
<affiliations>
<json:string>Weizmann Institute of Science, Rehovot, Israel</json:string>
</affiliations>
</json:item>
<json:item>
<name>Oscar Nierstrasz</name>
<affiliations>
<json:string>University of Bern, Switzerland</json:string>
</affiliations>
</json:item>
<json:item>
<name>C. Pandu Rangan</name>
<affiliations>
<json:string>Indian Institute of Technology, Madras, India</json:string>
</affiliations>
</json:item>
<json:item>
<name>Bernhard Steffen</name>
<affiliations>
<json:string>University of Dortmund, Germany</json:string>
</affiliations>
</json:item>
<json:item>
<name>Madhu Sudan</name>
<affiliations>
<json:string>Massachusetts Institute of Technology, MA, USA</json:string>
</affiliations>
</json:item>
<json:item>
<name>Demetri Terzopoulos</name>
<affiliations>
<json:string>New York University, NY, USA</json:string>
</affiliations>
</json:item>
<json:item>
<name>Dough Tygar</name>
<affiliations>
<json:string>University of California, Berkeley, CA, USA</json:string>
</affiliations>
</json:item>
<json:item>
<name>Moshe Y. Vardi</name>
<affiliations>
<json:string>Rice University, Houston, TX, USA</json:string>
</affiliations>
</json:item>
<json:item>
<name>Gerhard Weikum</name>
<affiliations>
<json:string>Max-Planck Institute of Computer Science, Saarbruecken, Germany</json:string>
</affiliations>
</json:item>
</editor>
<issn>
<json:string>0302-9743</json:string>
</issn>
<language>
<json:string>unknown</json:string>
</language>
<eissn>
<json:string>1611-3349</json:string>
</eissn>
<title>Lecture Notes in Computer Science</title>
<copyrightDate>2005</copyrightDate>
</serie>
<host>
<editor>
<json:item>
<name>Włodzisław Duch</name>
<affiliations>
<json:string>Department of Informatics, Nicolaus Copernicus University, Toruń, Poland</json:string>
<json:string>E-mail: wduch@is.umk.pl</json:string>
</affiliations>
</json:item>
<json:item>
<name>Janusz Kacprzyk</name>
<affiliations>
<json:string>Systems Research Institute, Polish Academy of Sciences, ul. Newelska 6, 01–447, Warsaw, Poland</json:string>
<json:string>E-mail: kacprzyk@ibspan.waw.pl</json:string>
</affiliations>
</json:item>
<json:item>
<name>Erkki Oja</name>
<affiliations>
<json:string>Adaptive Informatics Research Centre, Helsinki University of Technology, P.O. Box 5400, 02015, HUT, Finland</json:string>
<json:string>E-mail: Erkki.Oja@hut.fi</json:string>
</affiliations>
</json:item>
<json:item>
<name>Sławomir Zadrożny</name>
<affiliations>
<json:string>Systems Research Institute, Polish Academy of Sciences, ul. Newelska 6, 01-447, Warsaw, Poland</json:string>
<json:string>E-mail: zadrozny@ibspan.waw.pl</json:string>
</affiliations>
</json:item>
</editor>
<subject>
<json:item>
<value>Computer Science</value>
</json:item>
<json:item>
<value>Computer Science</value>
</json:item>
<json:item>
<value>Computation by Abstract Devices</value>
</json:item>
<json:item>
<value>Artificial Intelligence (incl. Robotics)</value>
</json:item>
<json:item>
<value>Pattern Recognition</value>
</json:item>
<json:item>
<value>Information Systems Applications (incl.Internet)</value>
</json:item>
<json:item>
<value>Database Management</value>
</json:item>
<json:item>
<value>Neurosciences</value>
</json:item>
</subject>
<isbn>
<json:string>978-3-540-28755-1</json:string>
</isbn>
<language>
<json:string>unknown</json:string>
</language>
<eissn>
<json:string>1611-3349</json:string>
</eissn>
<title>Artificial Neural Networks: Formal Models and Their Applications – ICANN 2005</title>
<genre.original>
<json:string>Proceedings</json:string>
</genre.original>
<bookId>
<json:string>978-3-540-28756-8</json:string>
</bookId>
<volume>3697</volume>
<pages>
<last>612</last>
<first>607</first>
</pages>
<issn>
<json:string>0302-9743</json:string>
</issn>
<genre>
<json:string>Book Series</json:string>
</genre>
<eisbn>
<json:string>978-3-540-28756-8</json:string>
</eisbn>
<copyrightDate>2005</copyrightDate>
<doi>
<json:string>10.1007/11550907</json:string>
</doi>
</host>
<publicationDate>2005</publicationDate>
<copyrightDate>2005</copyrightDate>
<doi>
<json:string>10.1007/11550907_96</json:string>
</doi>
<id>7155B31BC88BB2678B987C67811112604D551617</id>
<fulltext>
<json:item>
<original>true</original>
<mimetype>application/pdf</mimetype>
<extension>pdf</extension>
<uri>https://api.istex.fr/document/7155B31BC88BB2678B987C67811112604D551617/fulltext/pdf</uri>
</json:item>
<json:item>
<original>false</original>
<mimetype>application/zip</mimetype>
<extension>zip</extension>
<uri>https://api.istex.fr/document/7155B31BC88BB2678B987C67811112604D551617/fulltext/zip</uri>
</json:item>
<istex:fulltextTEI uri="https://api.istex.fr/document/7155B31BC88BB2678B987C67811112604D551617/fulltext/tei">
<teiHeader>
<fileDesc>
<titleStmt>
<title level="a" type="main" xml:lang="en">Reducing the Effect of Out-Voting Problem in Ensemble Based Incremental Support Vector Machines</title>
<respStmt xml:id="ISTEX-API" resp="Références bibliographiques récupérées via GROBID" name="ISTEX-API (INIST-CNRS)"></respStmt>
</titleStmt>
<publicationStmt>
<authority>ISTEX</authority>
<publisher>Springer Berlin Heidelberg</publisher>
<pubPlace>Berlin, Heidelberg</pubPlace>
<availability>
<p>SPRINGER</p>
</availability>
<date>2005</date>
</publicationStmt>
<sourceDesc>
<biblStruct type="inbook">
<analytic>
<title level="a" type="main" xml:lang="en">Reducing the Effect of Out-Voting Problem in Ensemble Based Incremental Support Vector Machines</title>
<author>
<persName>
<forename type="first">Zeki</forename>
<surname>Erdem</surname>
</persName>
<email>zeki.erdem@bte.mam.gov.tr</email>
<affiliation>Information Technologies Institute, TUBITAK Marmara Research Center, 41470, Gebze – Kocaeli, Turkey</affiliation>
<affiliation>Computer Engineering Department, Sakarya University, 54187, Esentepe, Sakarya, Turkey</affiliation>
</author>
<author>
<persName>
<forename type="first">Robi</forename>
<surname>Polikar</surname>
</persName>
<email>polikar@rowan.edu</email>
<affiliation>Electrical and Computer Engineering Department, Rowan University, 210 Mullica Hill Rd., 08028, Glassboro, NJ, USA</affiliation>
</author>
<author>
<persName>
<forename type="first">Fikret</forename>
<surname>Gurgen</surname>
</persName>
<email>gurgen@boun.edu.tr</email>
<affiliation>Computer Engineering Department, Bogazici University, 80815, Bebek, Istanbul, Turkey</affiliation>
</author>
<author>
<persName>
<forename type="first">Nejat</forename>
<surname>Yumusak</surname>
</persName>
<email>nyumusak@sakarya.edu.tr</email>
<affiliation>Computer Engineering Department, Sakarya University, 54187, Esentepe, Sakarya, Turkey</affiliation>
</author>
</analytic>
<monogr>
<title level="m">Artificial Neural Networks: Formal Models and Their Applications – ICANN 2005</title>
<title level="m" type="sub">15th International Conference, Warsaw, Poland, September 11-15, 2005. Proceedings, Part II</title>
<idno type="pISBN">978-3-540-28755-1</idno>
<idno type="eISBN">978-3-540-28756-8</idno>
<idno type="pISSN">0302-9743</idno>
<idno type="eISSN">1611-3349</idno>
<idno type="DOI">10.1007/11550907</idno>
<idno type="BookID">978-3-540-28756-8</idno>
<idno type="BookTitleID">126371</idno>
<idno type="BookSequenceNumber">3697</idno>
<idno type="BookVolumeNumber">3697</idno>
<idno type="BookChapterCount">163</idno>
<editor>
<persName>
<forename type="first">Włodzisław</forename>
<surname>Duch</surname>
</persName>
<email>wduch@is.umk.pl</email>
<affiliation>Department of Informatics, Nicolaus Copernicus University, Toruń, Poland</affiliation>
</editor>
<editor>
<persName>
<forename type="first">Janusz</forename>
<surname>Kacprzyk</surname>
</persName>
<email>kacprzyk@ibspan.waw.pl</email>
<affiliation>Systems Research Institute, Polish Academy of Sciences, ul. Newelska 6, 01–447, Warsaw, Poland</affiliation>
</editor>
<editor>
<persName>
<forename type="first">Erkki</forename>
<surname>Oja</surname>
</persName>
<email>Erkki.Oja@hut.fi</email>
<affiliation>Adaptive Informatics Research Centre, Helsinki University of Technology, P.O. Box 5400, 02015, HUT, Finland</affiliation>
</editor>
<editor>
<persName>
<forename type="first">Sławomir</forename>
<surname>Zadrożny</surname>
</persName>
<email>zadrozny@ibspan.waw.pl</email>
<affiliation>Systems Research Institute, Polish Academy of Sciences, ul. Newelska 6, 01-447, Warsaw, Poland</affiliation>
</editor>
<imprint>
<publisher>Springer Berlin Heidelberg</publisher>
<pubPlace>Berlin, Heidelberg</pubPlace>
<date type="published" when="2005"></date>
<biblScope unit="volume">3697</biblScope>
<biblScope unit="page" from="607">607</biblScope>
<biblScope unit="page" to="612">612</biblScope>
</imprint>
</monogr>
<series>
<title level="s">Lecture Notes in Computer Science</title>
<editor>
<persName>
<forename type="first">David</forename>
<surname>Hutchison</surname>
</persName>
<affiliation>Lancaster University, UK</affiliation>
</editor>
<editor>
<persName>
<forename type="first">Takeo</forename>
<surname>Kanade</surname>
</persName>
<affiliation>Carnegie Mellon University, Pittsburgh, PA, USA</affiliation>
</editor>
<editor>
<persName>
<forename type="first">Josef</forename>
<surname>Kittler</surname>
</persName>
<affiliation>University of Surrey, Guildford, UK</affiliation>
</editor>
<editor>
<persName>
<forename type="first">Jon</forename>
<forename type="first">M.</forename>
<surname>Kleinberg</surname>
</persName>
<affiliation>Cornell University, Ithaca, NY, USA</affiliation>
</editor>
<editor>
<persName>
<forename type="first">Friedemann</forename>
<surname>Mattern</surname>
</persName>
<affiliation>ETH Zurich, Switzerland</affiliation>
</editor>
<editor>
<persName>
<forename type="first">John</forename>
<forename type="first">C.</forename>
<surname>Mitchell</surname>
</persName>
<affiliation>Stanford University, CA, USA</affiliation>
</editor>
<editor>
<persName>
<forename type="first">Moni</forename>
<surname>Naor</surname>
</persName>
<affiliation>Weizmann Institute of Science, Rehovot, Israel</affiliation>
</editor>
<editor>
<persName>
<forename type="first">Oscar</forename>
<surname>Nierstrasz</surname>
</persName>
<affiliation>University of Bern, Switzerland</affiliation>
</editor>
<editor>
<persName>
<forename type="first">C.</forename>
<surname>Pandu Rangan</surname>
</persName>
<affiliation>Indian Institute of Technology, Madras, India</affiliation>
</editor>
<editor>
<persName>
<forename type="first">Bernhard</forename>
<surname>Steffen</surname>
</persName>
<affiliation>University of Dortmund, Germany</affiliation>
</editor>
<editor>
<persName>
<forename type="first">Madhu</forename>
<surname>Sudan</surname>
</persName>
<affiliation>Massachusetts Institute of Technology, MA, USA</affiliation>
</editor>
<editor>
<persName>
<forename type="first">Demetri</forename>
<surname>Terzopoulos</surname>
</persName>
<affiliation>New York University, NY, USA</affiliation>
</editor>
<editor>
<persName>
<forename type="first">Dough</forename>
<surname>Tygar</surname>
</persName>
<affiliation>University of California, Berkeley, CA, USA</affiliation>
</editor>
<editor>
<persName>
<forename type="first">Moshe</forename>
<forename type="first">Y.</forename>
<surname>Vardi</surname>
</persName>
<affiliation>Rice University, Houston, TX, USA</affiliation>
</editor>
<editor>
<persName>
<forename type="first">Gerhard</forename>
<surname>Weikum</surname>
</persName>
<affiliation>Max-Planck Institute of Computer Science, Saarbruecken, Germany</affiliation>
</editor>
<biblScope>
<date>2005</date>
</biblScope>
<idno type="pISSN">0302-9743</idno>
<idno type="eISSN">1611-3349</idno>
<idno type="seriesId">558</idno>
</series>
<idno type="istex">7155B31BC88BB2678B987C67811112604D551617</idno>
<idno type="DOI">10.1007/11550907_96</idno>
<idno type="ChapterID">96</idno>
<idno type="ChapterID">Chap96</idno>
</biblStruct>
</sourceDesc>
</fileDesc>
<profileDesc>
<creation>
<date>2005</date>
</creation>
<langUsage>
<language ident="en">en</language>
</langUsage>
<abstract xml:lang="en">
<p>Abstract: Although Support Vector Machines (SVMs) have been successfully applied to solve a large number of classification and regression problems, they suffer from the catastrophic forgetting phenomenon. In our previous work, integrating the SVM classifiers into an ensemble framework using Learn++ (SVMLearn++) [1], we have shown that the SVM classifiers can in fact be equipped with the incremental learning capability. However, Learn++ suffers from an inherent out-voting problem: when asked to learn new classes, an unnecessarily large number of classifiers are generated to learn the new classes. In this paper, we propose a new ensemble based incremental learning approach using SVMs that is based on the incremental Learn++.MT algorithm. Experiments on the real-world and benchmark datasets show that the proposed approach can reduce the number of SVM classifiers generated, thus reduces the effect of out-voting problem. It also provides performance improvements over previous approach.</p>
</abstract>
<textClass>
<keywords scheme="Book Subject Collection">
<list>
<label>SUCO11645</label>
<item>
<term>Computer Science</term>
</item>
</list>
</keywords>
</textClass>
<textClass>
<keywords scheme="Book Subject Group">
<list>
<label>I</label>
<label>I16013</label>
<label>I21017</label>
<label>I2203X</label>
<label>I18040</label>
<label>I18024</label>
<label>B18006</label>
<item>
<term>Computer Science</term>
</item>
<item>
<term>Computation by Abstract Devices</term>
</item>
<item>
<term>Artificial Intelligence (incl. Robotics)</term>
</item>
<item>
<term>Pattern Recognition</term>
</item>
<item>
<term>Information Systems Applications (incl.Internet)</term>
</item>
<item>
<term>Database Management</term>
</item>
<item>
<term>Neurosciences</term>
</item>
</list>
</keywords>
</textClass>
</profileDesc>
<revisionDesc>
<change when="2005">Published</change>
<change xml:id="refBibs-istex" who="#ISTEX-API" when="2016-3-19">References added</change>
</revisionDesc>
</teiHeader>
</istex:fulltextTEI>
<json:item>
<original>false</original>
<mimetype>text/plain</mimetype>
<extension>txt</extension>
<uri>https://api.istex.fr/document/7155B31BC88BB2678B987C67811112604D551617/fulltext/txt</uri>
</json:item>
</fulltext>
<metadata>
<istex:metadataXml wicri:clean="Springer, Publisher found" wicri:toSee="no header">
<istex:xmlDeclaration>version="1.0" encoding="UTF-8"</istex:xmlDeclaration>
<istex:docType PUBLIC="-//Springer-Verlag//DTD A++ V2.4//EN" URI="http://devel.springer.de/A++/V2.4/DTD/A++V2.4.dtd" name="istex:docType"></istex:docType>
<istex:document>
<Publisher>
<PublisherInfo>
<PublisherName>Springer Berlin Heidelberg</PublisherName>
<PublisherLocation>Berlin, Heidelberg</PublisherLocation>
</PublisherInfo>
<Series>
<SeriesInfo SeriesType="Series" TocLevels="0">
<SeriesID>558</SeriesID>
<SeriesPrintISSN>0302-9743</SeriesPrintISSN>
<SeriesElectronicISSN>1611-3349</SeriesElectronicISSN>
<SeriesTitle Language="En">Lecture Notes in Computer Science</SeriesTitle>
</SeriesInfo>
<SeriesHeader>
<EditorGroup>
<Editor AffiliationIDS="Aff1">
<EditorName DisplayOrder="Western">
<GivenName>David</GivenName>
<FamilyName>Hutchison</FamilyName>
</EditorName>
</Editor>
<Editor AffiliationIDS="Aff2">
<EditorName DisplayOrder="Western">
<GivenName>Takeo</GivenName>
<FamilyName>Kanade</FamilyName>
</EditorName>
</Editor>
<Editor AffiliationIDS="Aff3">
<EditorName DisplayOrder="Western">
<GivenName>Josef</GivenName>
<FamilyName>Kittler</FamilyName>
</EditorName>
</Editor>
<Editor AffiliationIDS="Aff4">
<EditorName DisplayOrder="Western">
<GivenName>Jon</GivenName>
<GivenName>M.</GivenName>
<FamilyName>Kleinberg</FamilyName>
</EditorName>
</Editor>
<Editor AffiliationIDS="Aff5">
<EditorName DisplayOrder="Western">
<GivenName>Friedemann</GivenName>
<FamilyName>Mattern</FamilyName>
</EditorName>
</Editor>
<Editor AffiliationIDS="Aff6">
<EditorName DisplayOrder="Western">
<GivenName>John</GivenName>
<GivenName>C.</GivenName>
<FamilyName>Mitchell</FamilyName>
</EditorName>
</Editor>
<Editor AffiliationIDS="Aff7">
<EditorName DisplayOrder="Western">
<GivenName>Moni</GivenName>
<FamilyName>Naor</FamilyName>
</EditorName>
</Editor>
<Editor AffiliationIDS="Aff8">
<EditorName DisplayOrder="Western">
<GivenName>Oscar</GivenName>
<FamilyName>Nierstrasz</FamilyName>
</EditorName>
</Editor>
<Editor AffiliationIDS="Aff9">
<EditorName DisplayOrder="Western">
<GivenName>C.</GivenName>
<FamilyName>Pandu Rangan</FamilyName>
</EditorName>
</Editor>
<Editor AffiliationIDS="Aff10">
<EditorName DisplayOrder="Western">
<GivenName>Bernhard</GivenName>
<FamilyName>Steffen</FamilyName>
</EditorName>
</Editor>
<Editor AffiliationIDS="Aff11">
<EditorName DisplayOrder="Western">
<GivenName>Madhu</GivenName>
<FamilyName>Sudan</FamilyName>
</EditorName>
</Editor>
<Editor AffiliationIDS="Aff12">
<EditorName DisplayOrder="Western">
<GivenName>Demetri</GivenName>
<FamilyName>Terzopoulos</FamilyName>
</EditorName>
</Editor>
<Editor AffiliationIDS="Aff13">
<EditorName DisplayOrder="Western">
<GivenName>Dough</GivenName>
<FamilyName>Tygar</FamilyName>
</EditorName>
</Editor>
<Editor AffiliationIDS="Aff14">
<EditorName DisplayOrder="Western">
<GivenName>Moshe</GivenName>
<GivenName>Y.</GivenName>
<FamilyName>Vardi</FamilyName>
</EditorName>
</Editor>
<Editor AffiliationIDS="Aff15">
<EditorName DisplayOrder="Western">
<GivenName>Gerhard</GivenName>
<FamilyName>Weikum</FamilyName>
</EditorName>
</Editor>
<Affiliation ID="Aff1">
<OrgName>Lancaster University</OrgName>
<OrgAddress>
<Country>UK</Country>
</OrgAddress>
</Affiliation>
<Affiliation ID="Aff2">
<OrgName>Carnegie Mellon University</OrgName>
<OrgAddress>
<City>Pittsburgh</City>
<State>PA</State>
<Country>USA</Country>
</OrgAddress>
</Affiliation>
<Affiliation ID="Aff3">
<OrgName>University of Surrey</OrgName>
<OrgAddress>
<City>Guildford</City>
<Country>UK</Country>
</OrgAddress>
</Affiliation>
<Affiliation ID="Aff4">
<OrgName>Cornell University</OrgName>
<OrgAddress>
<City>Ithaca</City>
<State>NY</State>
<Country>USA</Country>
</OrgAddress>
</Affiliation>
<Affiliation ID="Aff5">
<OrgName>ETH Zurich</OrgName>
<OrgAddress>
<Country>Switzerland</Country>
</OrgAddress>
</Affiliation>
<Affiliation ID="Aff6">
<OrgName>Stanford University</OrgName>
<OrgAddress>
<City>CA</City>
<Country>USA</Country>
</OrgAddress>
</Affiliation>
<Affiliation ID="Aff7">
<OrgName>Weizmann Institute of Science</OrgName>
<OrgAddress>
<City>Rehovot</City>
<Country>Israel</Country>
</OrgAddress>
</Affiliation>
<Affiliation ID="Aff8">
<OrgName>University of Bern</OrgName>
<OrgAddress>
<Country>Switzerland</Country>
</OrgAddress>
</Affiliation>
<Affiliation ID="Aff9">
<OrgName>Indian Institute of Technology</OrgName>
<OrgAddress>
<City>Madras</City>
<Country>India</Country>
</OrgAddress>
</Affiliation>
<Affiliation ID="Aff10">
<OrgName>University of Dortmund</OrgName>
<OrgAddress>
<Country>Germany</Country>
</OrgAddress>
</Affiliation>
<Affiliation ID="Aff11">
<OrgName>Massachusetts Institute of Technology</OrgName>
<OrgAddress>
<City>MA</City>
<Country>USA</Country>
</OrgAddress>
</Affiliation>
<Affiliation ID="Aff12">
<OrgName>New York University</OrgName>
<OrgAddress>
<City>NY</City>
<Country>USA</Country>
</OrgAddress>
</Affiliation>
<Affiliation ID="Aff13">
<OrgName>University of California</OrgName>
<OrgAddress>
<City>Berkeley</City>
<State>CA</State>
<Country>USA</Country>
</OrgAddress>
</Affiliation>
<Affiliation ID="Aff14">
<OrgName>Rice University</OrgName>
<OrgAddress>
<City>Houston</City>
<State>TX</State>
<Country>USA</Country>
</OrgAddress>
</Affiliation>
<Affiliation ID="Aff15">
<OrgName>Max-Planck Institute of Computer Science</OrgName>
<OrgAddress>
<City>Saarbruecken</City>
<Country>Germany</Country>
</OrgAddress>
</Affiliation>
</EditorGroup>
</SeriesHeader>
<Book Language="En">
<BookInfo BookProductType="Proceedings" ContainsESM="No" Language="En" MediaType="eBook" NumberingDepth="2" NumberingStyle="ContentOnly" OutputMedium="All" TocLevels="0">
<BookID>978-3-540-28756-8</BookID>
<BookTitle>Artificial Neural Networks: Formal Models and Their Applications – ICANN 2005</BookTitle>
<BookSubTitle>15th International Conference, Warsaw, Poland, September 11-15, 2005. Proceedings, Part II</BookSubTitle>
<BookVolumeNumber>3697</BookVolumeNumber>
<BookSequenceNumber>3697</BookSequenceNumber>
<BookDOI>10.1007/11550907</BookDOI>
<BookTitleID>126371</BookTitleID>
<BookPrintISBN>978-3-540-28755-1</BookPrintISBN>
<BookElectronicISBN>978-3-540-28756-8</BookElectronicISBN>
<BookChapterCount>163</BookChapterCount>
<BookCopyright>
<CopyrightHolderName>Springer-Verlag Berlin Heidelberg</CopyrightHolderName>
<CopyrightYear>2005</CopyrightYear>
</BookCopyright>
<BookSubjectGroup>
<BookSubject Code="I" Type="Primary">Computer Science</BookSubject>
<BookSubject Code="I16013" Priority="1" Type="Secondary">Computation by Abstract Devices</BookSubject>
<BookSubject Code="I21017" Priority="2" Type="Secondary">Artificial Intelligence (incl. Robotics)</BookSubject>
<BookSubject Code="I2203X" Priority="3" Type="Secondary">Pattern Recognition</BookSubject>
<BookSubject Code="I18040" Priority="4" Type="Secondary">Information Systems Applications (incl.Internet)</BookSubject>
<BookSubject Code="I18024" Priority="5" Type="Secondary">Database Management</BookSubject>
<BookSubject Code="B18006" Priority="6" Type="Secondary">Neurosciences</BookSubject>
<SubjectCollection Code="SUCO11645">Computer Science</SubjectCollection>
</BookSubjectGroup>
<BookContext>
<SeriesID>558</SeriesID>
</BookContext>
</BookInfo>
<BookHeader>
<EditorGroup>
<Editor AffiliationIDS="Aff16">
<EditorName DisplayOrder="Western">
<GivenName>Włodzisław</GivenName>
<FamilyName>Duch</FamilyName>
</EditorName>
<Contact>
<Email>wduch@is.umk.pl</Email>
</Contact>
</Editor>
<Editor AffiliationIDS="Aff17">
<EditorName DisplayOrder="Western">
<GivenName>Janusz</GivenName>
<FamilyName>Kacprzyk</FamilyName>
</EditorName>
<Contact>
<Email>kacprzyk@ibspan.waw.pl</Email>
</Contact>
</Editor>
<Editor AffiliationIDS="Aff18">
<EditorName DisplayOrder="Western">
<GivenName>Erkki</GivenName>
<FamilyName>Oja</FamilyName>
</EditorName>
<Contact>
<Email>Erkki.Oja@hut.fi</Email>
</Contact>
</Editor>
<Editor AffiliationIDS="Aff19">
<EditorName DisplayOrder="Western">
<GivenName>Sławomir</GivenName>
<FamilyName>Zadrożny</FamilyName>
</EditorName>
<Contact>
<Email>zadrozny@ibspan.waw.pl</Email>
</Contact>
</Editor>
<Affiliation ID="Aff16">
<OrgDivision>Department of Informatics</OrgDivision>
<OrgName>Nicolaus Copernicus University</OrgName>
<OrgAddress>
<City>Toruń</City>
<Country>Poland</Country>
</OrgAddress>
</Affiliation>
<Affiliation ID="Aff17">
<OrgDivision>Systems Research Institute</OrgDivision>
<OrgName>Polish Academy of Sciences</OrgName>
<OrgAddress>
<Street>ul. Newelska 6</Street>
<Postcode>01–447</Postcode>
<City>Warsaw</City>
<Country>Poland</Country>
</OrgAddress>
</Affiliation>
<Affiliation ID="Aff18">
<OrgDivision>Adaptive Informatics Research Centre</OrgDivision>
<OrgName>Helsinki University of Technology</OrgName>
<OrgAddress>
<Postbox>P.O. Box 5400</Postbox>
<Postcode>02015</Postcode>
<City>HUT</City>
<Country>Finland</Country>
</OrgAddress>
</Affiliation>
<Affiliation ID="Aff19">
<OrgDivision>Systems Research Institute</OrgDivision>
<OrgName>Polish Academy of Sciences</OrgName>
<OrgAddress>
<Street>ul. Newelska 6</Street>
<Postcode>01-447</Postcode>
<City>Warsaw</City>
<Country>Poland</Country>
</OrgAddress>
</Affiliation>
</EditorGroup>
</BookHeader>
<Part ID="Part12">
<PartInfo TocLevels="0">
<PartID>12</PartID>
<PartSequenceNumber>12</PartSequenceNumber>
<PartTitle>Support Vector Machines and Kernel-Based Methods</PartTitle>
<PartChapterCount>14</PartChapterCount>
<PartContext>
<SeriesID>558</SeriesID>
<BookTitle>Artificial Neural Networks: Formal Models and Their Applications – ICANN 2005</BookTitle>
</PartContext>
</PartInfo>
<Chapter ID="Chap96" Language="En">
<ChapterInfo ChapterType="OriginalPaper" ContainsESM="No" NumberingDepth="2" NumberingStyle="ContentOnly" TocLevels="0">
<ChapterID>96</ChapterID>
<ChapterDOI>10.1007/11550907_96</ChapterDOI>
<ChapterSequenceNumber>96</ChapterSequenceNumber>
<ChapterTitle Language="En">Reducing the Effect of Out-Voting Problem in Ensemble Based Incremental Support Vector Machines</ChapterTitle>
<ChapterFirstPage>607</ChapterFirstPage>
<ChapterLastPage>612</ChapterLastPage>
<ChapterCopyright>
<CopyrightHolderName>Springer-Verlag Berlin Heidelberg</CopyrightHolderName>
<CopyrightYear>2005</CopyrightYear>
</ChapterCopyright>
<ChapterGrants Type="Regular">
<MetadataGrant Grant="OpenAccess"></MetadataGrant>
<AbstractGrant Grant="OpenAccess"></AbstractGrant>
<BodyPDFGrant Grant="Restricted"></BodyPDFGrant>
<BodyHTMLGrant Grant="Restricted"></BodyHTMLGrant>
<BibliographyGrant Grant="Restricted"></BibliographyGrant>
<ESMGrant Grant="Restricted"></ESMGrant>
</ChapterGrants>
<ChapterContext>
<SeriesID>558</SeriesID>
<PartID>12</PartID>
<BookID>978-3-540-28756-8</BookID>
<BookTitle>Artificial Neural Networks: Formal Models and Their Applications – ICANN 2005</BookTitle>
</ChapterContext>
</ChapterInfo>
<ChapterHeader>
<AuthorGroup>
<Author AffiliationIDS="Aff20 Aff23">
<AuthorName DisplayOrder="Western">
<GivenName>Zeki</GivenName>
<FamilyName>Erdem</FamilyName>
</AuthorName>
<Contact>
<Email>zeki.erdem@bte.mam.gov.tr</Email>
</Contact>
</Author>
<Author AffiliationIDS="Aff21">
<AuthorName DisplayOrder="Western">
<GivenName>Robi</GivenName>
<FamilyName>Polikar</FamilyName>
</AuthorName>
<Contact>
<Email>polikar@rowan.edu</Email>
</Contact>
</Author>
<Author AffiliationIDS="Aff22">
<AuthorName DisplayOrder="Western">
<GivenName>Fikret</GivenName>
<FamilyName>Gurgen</FamilyName>
</AuthorName>
<Contact>
<Email>gurgen@boun.edu.tr</Email>
</Contact>
</Author>
<Author AffiliationIDS="Aff23">
<AuthorName DisplayOrder="Western">
<GivenName>Nejat</GivenName>
<FamilyName>Yumusak</FamilyName>
</AuthorName>
<Contact>
<Email>nyumusak@sakarya.edu.tr</Email>
</Contact>
</Author>
<Affiliation ID="Aff20">
<OrgDivision>Information Technologies Institute</OrgDivision>
<OrgName>TUBITAK Marmara Research Center</OrgName>
<OrgAddress>
<Postcode>41470</Postcode>
<City>Gebze – Kocaeli</City>
<Country>Turkey</Country>
</OrgAddress>
</Affiliation>
<Affiliation ID="Aff21">
<OrgDivision>Electrical and Computer Engineering Department</OrgDivision>
<OrgName>Rowan University</OrgName>
<OrgAddress>
<Street>210 Mullica Hill Rd.</Street>
<City>Glassboro</City>
<State>NJ</State>
<Postcode>08028</Postcode>
<Country>USA</Country>
</OrgAddress>
</Affiliation>
<Affiliation ID="Aff22">
<OrgDivision>Computer Engineering Department</OrgDivision>
<OrgName>Bogazici University</OrgName>
<OrgAddress>
<City>Bebek</City>
<Postcode>80815</Postcode>
<State>Istanbul</State>
<Country>Turkey</Country>
</OrgAddress>
</Affiliation>
<Affiliation ID="Aff23">
<OrgDivision>Computer Engineering Department</OrgDivision>
<OrgName>Sakarya University</OrgName>
<OrgAddress>
<City>Esentepe</City>
<Postcode>54187</Postcode>
<State>Sakarya</State>
<Country>Turkey</Country>
</OrgAddress>
</Affiliation>
</AuthorGroup>
<Abstract ID="Abs1" Language="En">
<Heading>Abstract</Heading>
<Para>Although Support Vector Machines (SVMs) have been successfully applied to solve a large number of classification and regression problems, they suffer from the
<Emphasis Type="Italic">catastrophic forgetting</Emphasis>
phenomenon. In our previous work, integrating the SVM classifiers into an ensemble framework using Learn++ (SVMLearn++) [1], we have shown that the SVM classifiers can in fact be equipped with the incremental learning capability. However, Learn++ suffers from an inherent
<Emphasis Type="Italic">out-voting</Emphasis>
problem: when asked to learn new classes, an unnecessarily large number of classifiers are generated to learn the new classes. In this paper, we propose a new ensemble based incremental learning approach using SVMs that is based on the incremental Learn++.MT algorithm. Experiments on the real-world and benchmark datasets show that the proposed approach can reduce the number of SVM classifiers generated, thus reduces the effect of
<Emphasis Type="Italic">out-voting</Emphasis>
problem. It also provides performance improvements over previous approach.</Para>
</Abstract>
<ArticleNote Type="Misc">
<SimplePara>An erratum to this chapter can be found at
<ExternalRef>
<RefSource>
<Literal>http://dx.doi.org/10.1007/11550907_163</Literal>
</RefSource>
<RefTarget Address="http://dx.doi.org/10.1007/11550907_163" TargetType="URL"></RefTarget>
</ExternalRef>
.</SimplePara>
</ArticleNote>
</ChapterHeader>
<NoBody></NoBody>
</Chapter>
</Part>
</Book>
</Series>
</Publisher>
</istex:document>
</istex:metadataXml>
<mods version="3.6">
<titleInfo lang="en">
<title>Reducing the Effect of Out-Voting Problem in Ensemble Based Incremental Support Vector Machines</title>
</titleInfo>
<titleInfo type="alternative" contentType="CDATA" lang="en">
<title>Reducing the Effect of Out-Voting Problem in Ensemble Based Incremental Support Vector Machines</title>
</titleInfo>
<name type="personal">
<namePart type="given">Zeki</namePart>
<namePart type="family">Erdem</namePart>
<affiliation>Information Technologies Institute, TUBITAK Marmara Research Center, 41470, Gebze – Kocaeli, Turkey</affiliation>
<affiliation>Computer Engineering Department, Sakarya University, 54187, Esentepe, Sakarya, Turkey</affiliation>
<affiliation>E-mail: zeki.erdem@bte.mam.gov.tr</affiliation>
<role>
<roleTerm type="text">author</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Robi</namePart>
<namePart type="family">Polikar</namePart>
<affiliation>Electrical and Computer Engineering Department, Rowan University, 210 Mullica Hill Rd., 08028, Glassboro, NJ, USA</affiliation>
<affiliation>E-mail: polikar@rowan.edu</affiliation>
<role>
<roleTerm type="text">author</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Fikret</namePart>
<namePart type="family">Gurgen</namePart>
<affiliation>Computer Engineering Department, Bogazici University, 80815, Bebek, Istanbul, Turkey</affiliation>
<affiliation>E-mail: gurgen@boun.edu.tr</affiliation>
<role>
<roleTerm type="text">author</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Nejat</namePart>
<namePart type="family">Yumusak</namePart>
<affiliation>Computer Engineering Department, Sakarya University, 54187, Esentepe, Sakarya, Turkey</affiliation>
<affiliation>E-mail: nyumusak@sakarya.edu.tr</affiliation>
<role>
<roleTerm type="text">author</roleTerm>
</role>
</name>
<typeOfResource>text</typeOfResource>
<genre type="conference [eBooks]" displayLabel="OriginalPaper"></genre>
<originInfo>
<publisher>Springer Berlin Heidelberg</publisher>
<place>
<placeTerm type="text">Berlin, Heidelberg</placeTerm>
</place>
<dateIssued encoding="w3cdtf">2005</dateIssued>
<copyrightDate encoding="w3cdtf">2005</copyrightDate>
</originInfo>
<language>
<languageTerm type="code" authority="rfc3066">en</languageTerm>
<languageTerm type="code" authority="iso639-2b">eng</languageTerm>
</language>
<physicalDescription>
<internetMediaType>text/html</internetMediaType>
</physicalDescription>
<abstract lang="en">Abstract: Although Support Vector Machines (SVMs) have been successfully applied to solve a large number of classification and regression problems, they suffer from the catastrophic forgetting phenomenon. In our previous work, integrating the SVM classifiers into an ensemble framework using Learn++ (SVMLearn++) [1], we have shown that the SVM classifiers can in fact be equipped with the incremental learning capability. However, Learn++ suffers from an inherent out-voting problem: when asked to learn new classes, an unnecessarily large number of classifiers are generated to learn the new classes. In this paper, we propose a new ensemble based incremental learning approach using SVMs that is based on the incremental Learn++.MT algorithm. Experiments on the real-world and benchmark datasets show that the proposed approach can reduce the number of SVM classifiers generated, thus reduces the effect of out-voting problem. It also provides performance improvements over previous approach.</abstract>
<relatedItem type="otherVersion">
<titleInfo>
<title>An erratum to this chapter can be found at http://dx.doi.org/10.1007/11550907_163 .</title>
</titleInfo>
<identifier type="doi">10.1007/11550907_163</identifier>
<identifier type="URL">http://dx.doi.org/10.1007/11550907_163</identifier>
</relatedItem>
<relatedItem type="host">
<titleInfo>
<title>Artificial Neural Networks: Formal Models and Their Applications – ICANN 2005</title>
<subTitle>15th International Conference, Warsaw, Poland, September 11-15, 2005. Proceedings, Part II</subTitle>
</titleInfo>
<name type="personal">
<namePart type="given">Włodzisław</namePart>
<namePart type="family">Duch</namePart>
<affiliation>Department of Informatics, Nicolaus Copernicus University, Toruń, Poland</affiliation>
<affiliation>E-mail: wduch@is.umk.pl</affiliation>
<role>
<roleTerm type="text">editor</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Janusz</namePart>
<namePart type="family">Kacprzyk</namePart>
<affiliation>Systems Research Institute, Polish Academy of Sciences, ul. Newelska 6, 01–447, Warsaw, Poland</affiliation>
<affiliation>E-mail: kacprzyk@ibspan.waw.pl</affiliation>
<role>
<roleTerm type="text">editor</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Erkki</namePart>
<namePart type="family">Oja</namePart>
<affiliation>Adaptive Informatics Research Centre, Helsinki University of Technology, P.O. Box 5400, 02015, HUT, Finland</affiliation>
<affiliation>E-mail: Erkki.Oja@hut.fi</affiliation>
<role>
<roleTerm type="text">editor</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Sławomir</namePart>
<namePart type="family">Zadrożny</namePart>
<affiliation>Systems Research Institute, Polish Academy of Sciences, ul. Newelska 6, 01-447, Warsaw, Poland</affiliation>
<affiliation>E-mail: zadrozny@ibspan.waw.pl</affiliation>
<role>
<roleTerm type="text">editor</roleTerm>
</role>
</name>
<genre type="Book Series" displayLabel="Proceedings"></genre>
<originInfo>
<copyrightDate encoding="w3cdtf">2005</copyrightDate>
<issuance>monographic</issuance>
</originInfo>
<subject>
<genre>Book Subject Collection</genre>
<topic authority="SpringerSubjectCodes" authorityURI="SUCO11645">Computer Science</topic>
</subject>
<subject>
<genre>Book Subject Group</genre>
<topic authority="SpringerSubjectCodes" authorityURI="I">Computer Science</topic>
<topic authority="SpringerSubjectCodes" authorityURI="I16013">Computation by Abstract Devices</topic>
<topic authority="SpringerSubjectCodes" authorityURI="I21017">Artificial Intelligence (incl. Robotics)</topic>
<topic authority="SpringerSubjectCodes" authorityURI="I2203X">Pattern Recognition</topic>
<topic authority="SpringerSubjectCodes" authorityURI="I18040">Information Systems Applications (incl.Internet)</topic>
<topic authority="SpringerSubjectCodes" authorityURI="I18024">Database Management</topic>
<topic authority="SpringerSubjectCodes" authorityURI="B18006">Neurosciences</topic>
</subject>
<identifier type="DOI">10.1007/11550907</identifier>
<identifier type="ISBN">978-3-540-28755-1</identifier>
<identifier type="eISBN">978-3-540-28756-8</identifier>
<identifier type="ISSN">0302-9743</identifier>
<identifier type="eISSN">1611-3349</identifier>
<identifier type="BookTitleID">126371</identifier>
<identifier type="BookID">978-3-540-28756-8</identifier>
<identifier type="BookChapterCount">163</identifier>
<identifier type="BookVolumeNumber">3697</identifier>
<identifier type="BookSequenceNumber">3697</identifier>
<identifier type="PartChapterCount">14</identifier>
<part>
<date>2005</date>
<detail type="part">
<title>Support Vector Machines and Kernel-Based Methods</title>
</detail>
<detail type="volume">
<number>3697</number>
<caption>vol.</caption>
</detail>
<extent unit="pages">
<start>607</start>
<end>612</end>
</extent>
</part>
<recordInfo>
<recordOrigin>Springer-Verlag Berlin Heidelberg, 2005</recordOrigin>
</recordInfo>
</relatedItem>
<relatedItem type="series">
<titleInfo>
<title>Lecture Notes in Computer Science</title>
</titleInfo>
<name type="personal">
<namePart type="given">David</namePart>
<namePart type="family">Hutchison</namePart>
<affiliation>Lancaster University, UK</affiliation>
<role>
<roleTerm type="text">editor</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Takeo</namePart>
<namePart type="family">Kanade</namePart>
<affiliation>Carnegie Mellon University, Pittsburgh, PA, USA</affiliation>
<role>
<roleTerm type="text">editor</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Josef</namePart>
<namePart type="family">Kittler</namePart>
<affiliation>University of Surrey, Guildford, UK</affiliation>
<role>
<roleTerm type="text">editor</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Jon</namePart>
<namePart type="given">M.</namePart>
<namePart type="family">Kleinberg</namePart>
<affiliation>Cornell University, Ithaca, NY, USA</affiliation>
<role>
<roleTerm type="text">editor</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Friedemann</namePart>
<namePart type="family">Mattern</namePart>
<affiliation>ETH Zurich, Switzerland</affiliation>
<role>
<roleTerm type="text">editor</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">John</namePart>
<namePart type="given">C.</namePart>
<namePart type="family">Mitchell</namePart>
<affiliation>Stanford University, CA, USA</affiliation>
<role>
<roleTerm type="text">editor</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Moni</namePart>
<namePart type="family">Naor</namePart>
<affiliation>Weizmann Institute of Science, Rehovot, Israel</affiliation>
<role>
<roleTerm type="text">editor</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Oscar</namePart>
<namePart type="family">Nierstrasz</namePart>
<affiliation>University of Bern, Switzerland</affiliation>
<role>
<roleTerm type="text">editor</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">C.</namePart>
<namePart type="family">Pandu Rangan</namePart>
<affiliation>Indian Institute of Technology, Madras, India</affiliation>
<role>
<roleTerm type="text">editor</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Bernhard</namePart>
<namePart type="family">Steffen</namePart>
<affiliation>University of Dortmund, Germany</affiliation>
<role>
<roleTerm type="text">editor</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Madhu</namePart>
<namePart type="family">Sudan</namePart>
<affiliation>Massachusetts Institute of Technology, MA, USA</affiliation>
<role>
<roleTerm type="text">editor</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Demetri</namePart>
<namePart type="family">Terzopoulos</namePart>
<affiliation>New York University, NY, USA</affiliation>
<role>
<roleTerm type="text">editor</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Dough</namePart>
<namePart type="family">Tygar</namePart>
<affiliation>University of California, Berkeley, CA, USA</affiliation>
<role>
<roleTerm type="text">editor</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Moshe</namePart>
<namePart type="given">Y.</namePart>
<namePart type="family">Vardi</namePart>
<affiliation>Rice University, Houston, TX, USA</affiliation>
<role>
<roleTerm type="text">editor</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Gerhard</namePart>
<namePart type="family">Weikum</namePart>
<affiliation>Max-Planck Institute of Computer Science, Saarbruecken, Germany</affiliation>
<role>
<roleTerm type="text">editor</roleTerm>
</role>
</name>
<originInfo>
<copyrightDate encoding="w3cdtf">2005</copyrightDate>
<issuance>serial</issuance>
</originInfo>
<identifier type="ISSN">0302-9743</identifier>
<identifier type="eISSN">1611-3349</identifier>
<identifier type="SeriesID">558</identifier>
<recordInfo>
<recordOrigin>Springer-Verlag Berlin Heidelberg, 2005</recordOrigin>
</recordInfo>
</relatedItem>
<identifier type="istex">7155B31BC88BB2678B987C67811112604D551617</identifier>
<identifier type="DOI">10.1007/11550907_96</identifier>
<identifier type="ChapterID">96</identifier>
<identifier type="ChapterID">Chap96</identifier>
<accessCondition type="use and reproduction" contentType="copyright">Springer-Verlag Berlin Heidelberg, 2005</accessCondition>
<recordInfo>
<recordContentSource>SPRINGER</recordContentSource>
<recordOrigin>Springer-Verlag Berlin Heidelberg, 2005</recordOrigin>
</recordInfo>
</mods>
</metadata>
<enrichments>
<istex:refBibTEI uri="https://api.istex.fr/document/7155B31BC88BB2678B987C67811112604D551617/enrichments/refBib">
<teiHeader></teiHeader>
<text>
<front></front>
<body></body>
<back>
<listBibl>
<biblStruct xml:id="b0">
<analytic>
<title level="a" type="main">Ensemble of SVMs Classifier for Incremental Learning</title>
<author>
<persName>
<forename type="first">Z</forename>
<surname>Erdem</surname>
</persName>
</author>
<author>
<persName>
<forename type="first">R</forename>
<surname>Polikar</surname>
</persName>
</author>
<author>
<persName>
<forename type="first">F</forename>
<surname>Gurgen</surname>
</persName>
</author>
<author>
<persName>
<forename type="first">N</forename>
<surname>Yumusak</surname>
</persName>
</author>
</analytic>
<monogr>
<title level="m">Proc. of 6th Int. Workshop on Multiple Classifier Systems (MCS 2005)</title>
<meeting>. of 6th Int. Workshop on Multiple Classifier Systems (MCS 2005)
<address>
<addrLine>Seaside, CA, USA</addrLine>
</address>
</meeting>
<imprint>
<publisher>Springer-Verlag</publisher>
<date type="published" when="2005-06"></date>
<biblScope unit="page" from="246" to="256"></biblScope>
</imprint>
</monogr>
</biblStruct>
<biblStruct xml:id="b1">
<analytic>
<title level="a" type="main">Learn++: An incremental learning algorithm for supervised neural networks</title>
<author>
<persName>
<forename type="first">R</forename>
<surname>Polikar</surname>
</persName>
</author>
<author>
<persName>
<forename type="first">L</forename>
<surname>Udpa</surname>
</persName>
</author>
<author>
<persName>
<forename type="first">S</forename>
<surname>Udpa</surname>
</persName>
</author>
<author>
<persName>
<forename type="first">V</forename>
<surname>Honavar</surname>
</persName>
</author>
</analytic>
<monogr>
<title level="j">IEEE Transactions on Systems, Man, and Cybernetics. Part C: Applications and Reviews</title>
<imprint>
<biblScope unit="volume">314</biblScope>
<biblScope unit="page" from="497" to="508"></biblScope>
<date type="published" when="2001"></date>
</imprint>
</monogr>
</biblStruct>
<biblStruct xml:id="b2">
<analytic>
<title level="a" type="main">Evolving Connectionist Systems: Methods and Applications in Bioinformatics</title>
<author>
<persName>
<forename type="first">N</forename>
<surname>Kasabov</surname>
</persName>
</author>
</analytic>
<monogr>
<title level="j">Brain Study and Intelligent Machines</title>
<imprint>
<publisher>Springer Verlag</publisher>
<publisher>Springer Verlag</publisher>
<date type="published" when="2002"></date>
</imprint>
</monogr>
</biblStruct>
<biblStruct xml:id="b3">
<analytic>
<title level="a" type="main">Incremental Support Vector Machine Learning: a Local Approach</title>
<author>
<persName>
<forename type="first">L</forename>
<surname>Ralaivola</surname>
</persName>
</author>
<author>
<persName>
<forename type="first">F</forename>
<surname>Alché-Buc</surname>
</persName>
</author>
</analytic>
<monogr>
<title level="m">Proceedings of ICANN'01</title>
<meeting>ICANN'01
<address>
<addrLine>Vienna, Austria</addrLine>
</address>
</meeting>
<imprint>
<date type="published" when="2001"></date>
</imprint>
</monogr>
</biblStruct>
<biblStruct xml:id="b4">
<analytic>
<title level="a" type="main">SVM Incremental Learning, Adaptation and Optimization</title>
<author>
<persName>
<forename type="first">C</forename>
<forename type="middle">P</forename>
<surname>Diehl</surname>
</persName>
</author>
<author>
<persName>
<forename type="first">G</forename>
<surname>Cauwenberghs</surname>
</persName>
</author>
</analytic>
<monogr>
<title level="m">Proc. IEEE Int. Joint Conf. Neural Networks (IJCNN 2003)</title>
<meeting>. IEEE Int. Joint Conf. Neural Networks (IJCNN 2003)
<address>
<addrLine>Portland OR</addrLine>
</address>
</meeting>
<imprint>
<date type="published" when="2003"></date>
</imprint>
</monogr>
</biblStruct>
<biblStruct xml:id="b5">
<analytic>
<title></title>
<author>
<persName>
<forename type="first">M</forename>
<surname>Muhlbaier</surname>
</persName>
</author>
<author>
<persName>
<forename type="first">A</forename>
<surname>Topalis</surname>
</persName>
</author>
<author>
<persName>
<forename type="first">R</forename>
<surname>Polikar</surname>
</persName>
</author>
<author>
<persName>
<forename type="first">Learn++</forename>
</persName>
</author>
</analytic>
<monogr>
<title level="m">MT: A New Approach to Incremental Learning, 5th Int. Workshop on Multiple Classifier Systems</title>
<meeting>
<address>
<addrLine>Cagliari, Italy</addrLine>
</address>
</meeting>
<imprint>
<publisher>Springer LINS</publisher>
<date type="published" when="2004-06"></date>
<biblScope unit="page" from="52" to="61"></biblScope>
</imprint>
</monogr>
</biblStruct>
<biblStruct xml:id="b6">
<analytic>
<title></title>
<author>
<persName>
<forename type="first">V</forename>
<surname>Vapnik</surname>
</persName>
</author>
</analytic>
<monogr>
<title level="m">Statistical Learning Theory</title>
<meeting>
<address>
<addrLine>New York</addrLine>
</address>
</meeting>
<imprint>
<publisher>Wiley</publisher>
<date type="published" when="1998"></date>
</imprint>
</monogr>
</biblStruct>
<biblStruct xml:id="b7">
<monogr>
<title level="m" type="main">An Introduction to Support Vector Machines and Other Kernel-based Learning Methods</title>
<author>
<persName>
<forename type="first">N</forename>
<surname>Cristianini</surname>
</persName>
</author>
<author>
<persName>
<forename type="first">J</forename>
<surname>Shawe-Taylor</surname>
</persName>
</author>
<imprint>
<date type="published" when="2000"></date>
<publisher>Cambridge University Press</publisher>
</imprint>
</monogr>
</biblStruct>
<biblStruct xml:id="b8">
<monogr>
<title level="m" type="main">LIBSVM: A library for support vector machines</title>
<author>
<persName>
<forename type="first">C.-C</forename>
<surname>Chang</surname>
</persName>
</author>
<author>
<persName>
<forename type="first">C</forename>
<forename type="middle">J</forename>
<surname>Lin</surname>
</persName>
</author>
<imprint></imprint>
</monogr>
</biblStruct>
</listBibl>
</back>
</text>
</istex:refBibTEI>
</enrichments>
</istex>
</record>

Pour manipuler ce document sous Unix (Dilib)

EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/OcrV1/Data/Istex/Corpus
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000E31 | SxmlIndent | more

Ou

HfdSelect -h $EXPLOR_AREA/Data/Istex/Corpus/biblio.hfd -nk 000E31 | SxmlIndent | more

Pour mettre un lien sur cette page dans le réseau Wicri

{{Explor lien
   |wiki=    Ticri/CIDE
   |area=    OcrV1
   |flux=    Istex
   |étape=   Corpus
   |type=    RBID
   |clé=     ISTEX:7155B31BC88BB2678B987C67811112604D551617
   |texte=   Reducing the Effect of Out-Voting Problem in Ensemble Based Incremental Support Vector Machines
}}

Wicri

This area was generated with Dilib version V0.6.32.
Data generation: Sat Nov 11 16:53:45 2017. Site generation: Mon Mar 11 23:15:16 2024