A New Look at the Power Method for Fast Subspace Tracking
Identifieur interne : 001A66 ( Istex/Curation ); précédent : 001A65; suivant : 001A67A New Look at the Power Method for Fast Subspace Tracking
Auteurs : Yingbo Hua [États-Unis] ; Yong Xiang [États-Unis] ; Tianping Chen [États-Unis] ; Karim Abed-Meraim [États-Unis] ; Yongfeng Miao [États-Unis]Source :
- Digital Signal Processing [ 1051-2004 ] ; 1999.
English descriptors
- KwdEn :
- Algorithm, Arbitrary initializations, Asymmetric square root, Convergence, Convergent, Converges, Covariance, Covariance matrix, Eigenvalue, Eigenvector, Exponential convergence property, Ieee, Ieee trans, Initial matrix, Iteration, Leakage factor, Malase, Matrix, Mild condition, Natural power method, Neural networks, Novel information criterion, Orthogonality, Orthonormal, Other methods, Past method, Performance comparison, Power method, Previous estimate, Principal component, Principal components, Principal eigenvector, Principal subspace, Projection approximation, Projection approximation subspace, Random vectors, Right side, Second term, Signal process, Signal processing, Small step size, Step size, Subspace, Trans, Unitary, Unitary matrix, Unitary rotation, Vector sequence, Weight matrix, Weight vector.
- Teeft :
- Algorithm, Arbitrary initializations, Asymmetric square root, Convergence, Convergent, Converges, Covariance, Covariance matrix, Eigenvalue, Eigenvector, Exponential convergence property, Ieee, Ieee trans, Initial matrix, Iteration, Leakage factor, Malase, Matrix, Mild condition, Natural power method, Neural networks, Novel information criterion, Orthogonality, Orthonormal, Other methods, Past method, Performance comparison, Power method, Previous estimate, Principal component, Principal components, Principal eigenvector, Principal subspace, Projection approximation, Projection approximation subspace, Random vectors, Right side, Second term, Signal process, Signal processing, Small step size, Step size, Subspace, Trans, Unitary, Unitary matrix, Unitary rotation, Vector sequence, Weight matrix, Weight vector.
Abstract
Abstract: A class of fast subspace tracking methods such as the Oja method, the projection approximation subspace tracking (PAST) method, and the novel information criterion (NIC) method can be viewed as power-based methods. Unlike many non-power-based methods such as the Given's rotation based URV updating method and the operator restriction algorithm, the power-based methods with arbitrary initial conditions are convergent to the principal subspace of a vector sequence under a mild assumption. This paper elaborates on a natural version of the power method. The natural power method is shown to have the fastest convergence rate among the power-based methods. Three types of implementations of the natural power method are presented in detail, which require respectively O(n2p), O(np2), and O(np) flops of computation at each iteration (update), where n is the dimension of the vector sequence and p is the dimension of the principal subspace. All of the three implementations are shown to be globally convergent under a mild assumption. The O(np) implementation of the natural power method is shown to be superior to the O(np) equivalent of the Oja, PAST, and NIC methods. Like all power-based methods, the natural power method can be easily modified via subspace deflation to track the principal components and, hence, the rank of the principal subspace.
Url:
DOI: 10.1006/dspr.1999.0348
Links toward previous steps (curation, corpus...)
- to stream Istex, to step Corpus: Pour aller vers cette notice dans l'étape Curation :001A66
Links to Exploration step
ISTEX:8D466ECAD72E743D9FE3DA85A7B0FD04D49B3508Le document en format XML
<record><TEI wicri:istexFullTextTei="biblStruct"><teiHeader><fileDesc><titleStmt><title xml:lang="en">A New Look at the Power Method for Fast Subspace Tracking</title>
<author><name sortKey="Hua, Yingbo" sort="Hua, Yingbo" uniqKey="Hua Y" first="Yingbo" last="Hua">Yingbo Hua</name>
<affiliation wicri:level="1"><mods:affiliation>Department of Electrical and Electronic Engineering, University of Melbourne, Parkville, Victoria, 3052, Australia, Fudan University, China, Paris, France, California , USA</mods:affiliation>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea>Department of Electrical and Electronic Engineering, University of Melbourne, Parkville, Victoria, 3052, Australia, Fudan University, China, Paris, France, California </wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Xiang, Yong" sort="Xiang, Yong" uniqKey="Xiang Y" first="Yong" last="Xiang">Yong Xiang</name>
<affiliation wicri:level="1"><mods:affiliation>Department of Electrical and Electronic Engineering, University of Melbourne, Parkville, Victoria, 3052, Australia, Fudan University, China, Paris, France, California , USA</mods:affiliation>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea>Department of Electrical and Electronic Engineering, University of Melbourne, Parkville, Victoria, 3052, Australia, Fudan University, China, Paris, France, California </wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Chen, Tianping" sort="Chen, Tianping" uniqKey="Chen T" first="Tianping" last="Chen">Tianping Chen</name>
<affiliation wicri:level="1"><mods:affiliation>University of Melbourne, Parkville, Victoria, 3052, Australia, Department of Mathematics, Fudan University, China, Paris, France, California , USA</mods:affiliation>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea>University of Melbourne, Parkville, Victoria, 3052, Australia, Department of Mathematics, Fudan University, China, Paris, France, California </wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Abed Meraim, Karim" sort="Abed Meraim, Karim" uniqKey="Abed Meraim K" first="Karim" last="Abed-Meraim">Karim Abed-Meraim</name>
<affiliation wicri:level="1"><mods:affiliation>University of Melbourne, Parkville, Victoria, 3052, Australia, Fudan University, China, Telecom, Paris, France, California , USA</mods:affiliation>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea>University of Melbourne, Parkville, Victoria, 3052, Australia, Fudan University, China, Telecom, Paris, France, California </wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Miao, Yongfeng" sort="Miao, Yongfeng" uniqKey="Miao Y" first="Yongfeng" last="Miao">Yongfeng Miao</name>
<affiliation wicri:level="1"><mods:affiliation>University of Melbourne, Parkville, Victoria, 3052, Australia, Fudan University, China, Paris, France, U.S. Wireless Corp. California , USA</mods:affiliation>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea>University of Melbourne, Parkville, Victoria, 3052, Australia, Fudan University, China, Paris, France, U.S. Wireless Corp. California </wicri:regionArea>
</affiliation>
</author>
</titleStmt>
<publicationStmt><idno type="wicri:source">ISTEX</idno>
<idno type="RBID">ISTEX:8D466ECAD72E743D9FE3DA85A7B0FD04D49B3508</idno>
<date when="1999" year="1999">1999</date>
<idno type="doi">10.1006/dspr.1999.0348</idno>
<idno type="url">https://api.istex.fr/document/8D466ECAD72E743D9FE3DA85A7B0FD04D49B3508/fulltext/pdf</idno>
<idno type="wicri:Area/Istex/Corpus">001A66</idno>
<idno type="wicri:explorRef" wicri:stream="Istex" wicri:step="Corpus" wicri:corpus="ISTEX">001A66</idno>
<idno type="wicri:Area/Istex/Curation">001A66</idno>
</publicationStmt>
<sourceDesc><biblStruct><analytic><title level="a" type="main" xml:lang="en">A New Look at the Power Method for Fast Subspace Tracking</title>
<author><name sortKey="Hua, Yingbo" sort="Hua, Yingbo" uniqKey="Hua Y" first="Yingbo" last="Hua">Yingbo Hua</name>
<affiliation wicri:level="1"><mods:affiliation>Department of Electrical and Electronic Engineering, University of Melbourne, Parkville, Victoria, 3052, Australia, Fudan University, China, Paris, France, California , USA</mods:affiliation>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea>Department of Electrical and Electronic Engineering, University of Melbourne, Parkville, Victoria, 3052, Australia, Fudan University, China, Paris, France, California </wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Xiang, Yong" sort="Xiang, Yong" uniqKey="Xiang Y" first="Yong" last="Xiang">Yong Xiang</name>
<affiliation wicri:level="1"><mods:affiliation>Department of Electrical and Electronic Engineering, University of Melbourne, Parkville, Victoria, 3052, Australia, Fudan University, China, Paris, France, California , USA</mods:affiliation>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea>Department of Electrical and Electronic Engineering, University of Melbourne, Parkville, Victoria, 3052, Australia, Fudan University, China, Paris, France, California </wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Chen, Tianping" sort="Chen, Tianping" uniqKey="Chen T" first="Tianping" last="Chen">Tianping Chen</name>
<affiliation wicri:level="1"><mods:affiliation>University of Melbourne, Parkville, Victoria, 3052, Australia, Department of Mathematics, Fudan University, China, Paris, France, California , USA</mods:affiliation>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea>University of Melbourne, Parkville, Victoria, 3052, Australia, Department of Mathematics, Fudan University, China, Paris, France, California </wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Abed Meraim, Karim" sort="Abed Meraim, Karim" uniqKey="Abed Meraim K" first="Karim" last="Abed-Meraim">Karim Abed-Meraim</name>
<affiliation wicri:level="1"><mods:affiliation>University of Melbourne, Parkville, Victoria, 3052, Australia, Fudan University, China, Telecom, Paris, France, California , USA</mods:affiliation>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea>University of Melbourne, Parkville, Victoria, 3052, Australia, Fudan University, China, Telecom, Paris, France, California </wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Miao, Yongfeng" sort="Miao, Yongfeng" uniqKey="Miao Y" first="Yongfeng" last="Miao">Yongfeng Miao</name>
<affiliation wicri:level="1"><mods:affiliation>University of Melbourne, Parkville, Victoria, 3052, Australia, Fudan University, China, Paris, France, U.S. Wireless Corp. California , USA</mods:affiliation>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea>University of Melbourne, Parkville, Victoria, 3052, Australia, Fudan University, China, Paris, France, U.S. Wireless Corp. California </wicri:regionArea>
</affiliation>
</author>
</analytic>
<monogr></monogr>
<series><title level="j">Digital Signal Processing</title>
<title level="j" type="abbrev">YDSPR</title>
<idno type="ISSN">1051-2004</idno>
<imprint><publisher>ELSEVIER</publisher>
<date type="published" when="1999">1999</date>
<biblScope unit="volume">9</biblScope>
<biblScope unit="issue">4</biblScope>
<biblScope unit="page" from="297">297</biblScope>
<biblScope unit="page" to="314">314</biblScope>
</imprint>
<idno type="ISSN">1051-2004</idno>
</series>
</biblStruct>
</sourceDesc>
<seriesStmt><idno type="ISSN">1051-2004</idno>
</seriesStmt>
</fileDesc>
<profileDesc><textClass><keywords scheme="KwdEn" xml:lang="en"><term>Algorithm</term>
<term>Arbitrary initializations</term>
<term>Asymmetric square root</term>
<term>Convergence</term>
<term>Convergent</term>
<term>Converges</term>
<term>Covariance</term>
<term>Covariance matrix</term>
<term>Eigenvalue</term>
<term>Eigenvector</term>
<term>Exponential convergence property</term>
<term>Ieee</term>
<term>Ieee trans</term>
<term>Initial matrix</term>
<term>Iteration</term>
<term>Leakage factor</term>
<term>Malase</term>
<term>Matrix</term>
<term>Mild condition</term>
<term>Natural power method</term>
<term>Neural networks</term>
<term>Novel information criterion</term>
<term>Orthogonality</term>
<term>Orthonormal</term>
<term>Other methods</term>
<term>Past method</term>
<term>Performance comparison</term>
<term>Power method</term>
<term>Previous estimate</term>
<term>Principal component</term>
<term>Principal components</term>
<term>Principal eigenvector</term>
<term>Principal subspace</term>
<term>Projection approximation</term>
<term>Projection approximation subspace</term>
<term>Random vectors</term>
<term>Right side</term>
<term>Second term</term>
<term>Signal process</term>
<term>Signal processing</term>
<term>Small step size</term>
<term>Step size</term>
<term>Subspace</term>
<term>Trans</term>
<term>Unitary</term>
<term>Unitary matrix</term>
<term>Unitary rotation</term>
<term>Vector sequence</term>
<term>Weight matrix</term>
<term>Weight vector</term>
</keywords>
<keywords scheme="Teeft" xml:lang="en"><term>Algorithm</term>
<term>Arbitrary initializations</term>
<term>Asymmetric square root</term>
<term>Convergence</term>
<term>Convergent</term>
<term>Converges</term>
<term>Covariance</term>
<term>Covariance matrix</term>
<term>Eigenvalue</term>
<term>Eigenvector</term>
<term>Exponential convergence property</term>
<term>Ieee</term>
<term>Ieee trans</term>
<term>Initial matrix</term>
<term>Iteration</term>
<term>Leakage factor</term>
<term>Malase</term>
<term>Matrix</term>
<term>Mild condition</term>
<term>Natural power method</term>
<term>Neural networks</term>
<term>Novel information criterion</term>
<term>Orthogonality</term>
<term>Orthonormal</term>
<term>Other methods</term>
<term>Past method</term>
<term>Performance comparison</term>
<term>Power method</term>
<term>Previous estimate</term>
<term>Principal component</term>
<term>Principal components</term>
<term>Principal eigenvector</term>
<term>Principal subspace</term>
<term>Projection approximation</term>
<term>Projection approximation subspace</term>
<term>Random vectors</term>
<term>Right side</term>
<term>Second term</term>
<term>Signal process</term>
<term>Signal processing</term>
<term>Small step size</term>
<term>Step size</term>
<term>Subspace</term>
<term>Trans</term>
<term>Unitary</term>
<term>Unitary matrix</term>
<term>Unitary rotation</term>
<term>Vector sequence</term>
<term>Weight matrix</term>
<term>Weight vector</term>
</keywords>
</textClass>
<langUsage><language ident="en">en</language>
</langUsage>
</profileDesc>
</teiHeader>
<front><div type="abstract" xml:lang="en">Abstract: A class of fast subspace tracking methods such as the Oja method, the projection approximation subspace tracking (PAST) method, and the novel information criterion (NIC) method can be viewed as power-based methods. Unlike many non-power-based methods such as the Given's rotation based URV updating method and the operator restriction algorithm, the power-based methods with arbitrary initial conditions are convergent to the principal subspace of a vector sequence under a mild assumption. This paper elaborates on a natural version of the power method. The natural power method is shown to have the fastest convergence rate among the power-based methods. Three types of implementations of the natural power method are presented in detail, which require respectively O(n2p), O(np2), and O(np) flops of computation at each iteration (update), where n is the dimension of the vector sequence and p is the dimension of the principal subspace. All of the three implementations are shown to be globally convergent under a mild assumption. The O(np) implementation of the natural power method is shown to be superior to the O(np) equivalent of the Oja, PAST, and NIC methods. Like all power-based methods, the natural power method can be easily modified via subspace deflation to track the principal components and, hence, the rank of the principal subspace.</div>
</front>
</TEI>
</record>
Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Wicri/Asie/explor/AustralieFrV1/Data/Istex/Curation
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 001A66 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Istex/Curation/biblio.hfd -nk 001A66 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien |wiki= Wicri/Asie |area= AustralieFrV1 |flux= Istex |étape= Curation |type= RBID |clé= ISTEX:8D466ECAD72E743D9FE3DA85A7B0FD04D49B3508 |texte= A New Look at the Power Method for Fast Subspace Tracking }}
This area was generated with Dilib version V0.6.33. |