| Generalized Stochastic Gradient Learning ∗ (2005) | |||||||||||||
Abstract | |||||||||||||
| We study the properties of generalized stochastic gradient (GSG) learning in forwardlooking models. We examine how the conditions for stability of standard stochastic gradient (SG) learning both differ from and are related to E-stability, which governs stability under least squares learning. SG algorithms are sensitive to units of measurement and we show that there is a transformation of variables for which E-stability governs SG stability. GSG algorithms with constant gain have a deeper justification in terms of parameter drift, robustness and risk sensitivity. Key words: adaptive learning, E-stability, recursive least squares, robust estimation | |||||||||||||
Details der Publikation | |||||||||||||
| |||||||||||||