A stochastic gradient adaptive filter with gradient adaptive step size
- 1 June 1993
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Signal Processing
- Vol. 41 (6), 2075-2087
- https://doi.org/10.1109/78.218137
Abstract
The step size of this adaptive filter is changed according to a gradient descent algorithm designed to reduce the squared estimation error during each iteration. An approximate analysis of the performance of the adaptive filter when its inputs are zero mean, white, and Gaussian noise and the set of optimal coefficients are time varying according to a random-walk model is presented. The algorithm has very good convergence speed and low steady-state misadjustment. The tracking performance of these algorithms in nonstationary environments is relatively insensitive to the choice of the parameters of the adaptive filter and is very close to the best possible performance of the least mean square (LMS) algorithm for a large range of values of the step size of the adaptation algorithm. Several simulation examples demonstrating the good properties of the adaptive filters as well as verifying the analytical results are also presented.<>Keywords
This publication has 12 references indexed in Scilit:
- Stochastic gradient adaptive filters with gradient adaptive step sizesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Convergence analysis of an algorithm for blind equalizationIEEE Transactions on Communications, 1991
- A new convergence factor for adaptive filtersIEEE Transactions on Circuits and Systems, 1989
- Adaptive algorithms with an automatic gain control featureIEEE Transactions on Circuits and Systems, 1988
- Improved convergence analysis of stochastic gradient adaptive filters using the sign algorithmIEEE Transactions on Acoustics, Speech, and Signal Processing, 1987
- Dual Sign Algorithm for Adaptive FilteringIEEE Transactions on Communications, 1986
- Tracking properties and steady-state performance of RLS adaptive filter algorithmsIEEE Transactions on Acoustics, Speech, and Signal Processing, 1986
- A variable step (VS) adaptive filter algorithmIEEE Transactions on Acoustics, Speech, and Signal Processing, 1986
- Convergence analysis of LMS filters with uncorrelated Gaussian dataIEEE Transactions on Acoustics, Speech, and Signal Processing, 1985
- Stationary and nonstationary learning characteristics of the LMS adaptive filterProceedings of the IEEE, 1976