A novel optimal tracking control scheme for a class of discrete-time nonlinear systems using generalised policy iteration adaptive dynamic programming algorithm

Qiao Lin, Qinglai Wei, Derong Liu

Research output: Journal PublicationArticlepeer-review

33 Citations (Scopus)

Abstract

In this paper, a novel iterative adaptive dynamic programming (ADP) algorithm, called generalised policy iteration ADP algorithm, is developed to solve optimal tracking control problems for discrete-time nonlinear systems. The idea is to use two iteration procedures, including an i-iteration and a j-iteration, to obtain the iterative tracking control laws and the iterative value functions. By system transformation, we first convert the optimal tracking control problem into an optimal regulation problem. Then the generalised policy iteration ADP algorithm, which is a general idea of interacting policy and value iteration algorithms, is introduced to deal with the optimal regulation problem. The convergence and optimality properties of the generalised policy iteration algorithm are analysed. Three neural networks are used to implement the developed algorithm. Finally, simulation examples are given to illustrate the performance of the present algorithm.

Original languageEnglish
Pages (from-to)525-534
Number of pages10
JournalInternational Journal of Systems Science
Volume48
Issue number3
DOIs
Publication statusPublished - 17 Feb 2017
Externally publishedYes

Keywords

  • Adaptive dynamic programming
  • affine nonlinear systems
  • discrete-time
  • generalised policy iteration
  • neural network
  • tracking control

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Theoretical Computer Science
  • Computer Science Applications

Fingerprint

Dive into the research topics of 'A novel optimal tracking control scheme for a class of discrete-time nonlinear systems using generalised policy iteration adaptive dynamic programming algorithm'. Together they form a unique fingerprint.

Cite this