| 摘要: |
|
| 关键词: |
| DOI： |
| Received:August 01, 2010Revised:April 09, 2011 |
| 基金项目:This work was partly supported by the National Natural Science Foundation of China (No.60904037, 60921061, 61034002), and the Beijing Natural Science Foundation (No. 4102061). |
|
| Finite horizon optimal control of discrete-time nonlinear systems with unfixed initial state using adaptive dynamic programming |
| Qinglai WEI,Derong LIU |
| (Key Laboratory of Complex Systems and Intelligence Science, Institute of Automation, Chinese Academy of Sciences) |
| Abstract: |
| In this paper, we aim to solve the finite horizon optimal control problem for a class of discrete-time nonlinear systems with unfixed initial state using adaptive dynamic programming (ADP) approach. A new ε-optimal control algorithm based on the iterative ADP approach is proposed which makes the performance index function converge iteratively to the greatest lower bound of all performance indices within an error according to ε within finite time. The optimal number of control steps can also be obtained by the proposed ε-optimal control algorithm for the situation where the initial state of the system is unfixed. Neural networks are used to approximate the performance index function and compute the optimal control policy, respectively, for facilitating the implementation of the ε-optimal control algorithm. Finally, a simulation example is given to show the results of the proposed method. |
| Key words: Adaptive dynamic programming Unfixed initial state Optimal control Finite time Neural networks |
