A recursive algorithm based on the extended Kalman filter for the training of feedforward neural models

Abstract : The Extended Kalman Filter (EKF) is a well known tool for the recursive parameter estimation of static and dynamic nonlinear models. In particular, the EKF has been applied to the estimation of the weights of feedforward and recurrent neural network models, i.e. to their training, and shown to be more efficient than recursive and non recursive first-order training algorithms; nevertheless, these first applications to the training of neural networks did not fully exploit the potentials of the EKF. In this paper, we analyze the specific influence of the EKF parameters for modeling problems, and propose a variant of this algorithm for the training of feedforward neural models which proves to be very efficient as compared to non recursive second-order algorithms. We test the proposed EKF algorithm on several static and dynamic modeling problems, some of them being benchmark problems, and which bring out the properties of the proposed algorithm.
Complete list of metadatas

Cited literature [13 references]  Display  Hide  Download

https://hal-espci.archives-ouvertes.fr/hal-00797391
Contributor : Isabelle Rivals <>
Submitted on : Wednesday, March 6, 2013 - 11:51:29 AM
Last modification on : Thursday, July 4, 2019 - 11:00:07 AM
Long-term archiving on : Friday, June 7, 2013 - 3:58:49 AM

File

1998kalm.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-00797391, version 1

Collections

Citation

Isabelle Rivals, Léon Personnaz. A recursive algorithm based on the extended Kalman filter for the training of feedforward neural models. Neurocomputing, Elsevier, 1998, 20 (1-3), pp.279-294. ⟨hal-00797391⟩

Share

Metrics

Record views

468

Files downloads

1563