“清华信息大讲堂”第十六讲
报告题目：Adaptive Dynamic Programming - A New Tool for Learning Control
报 告 人：Prof. Derong Liu
报告时间：2007年3月21日下午15:30-17:30
报告地点：信息大楼（FIT）1-312
主办单位：大阳城国际娱乐官网
联 系 人: 孙富春 62796858
报告摘要:
Adaptive Dynamic Programming (ADP) has received increasing attention recently. ADP scheme is a design that approximates dynamic programming in the general case, i.e., approximates optimal control over time in noisy, nonlinear environments. There are many engineering problems in practice which can be formulated as cost maximization or minimization problems. Dynamic programming is a very useful tool in solving these problems. However, it is often computationally untenable to run dynamic programming due to the backward numerical process required for its solutions. Over the years, progress has been made to provide approximate solutions to dynamic programming. The idea is to approximate dynamic programming solutions by using neural networks to approximate the cost function. The methodology is a very useful tool for building intelligent agents/controllers in almost any environment. This talk will review the theorectical development of ADP. Details about the training of the neural networks used in the present design will also be presented. The pole balancing (inverted pendulum) problem will be used as the benchmark in this presentation to show the applicability of ADP.
报告人介绍：
Derong Liu received the Ph.D. degree in electrical engineering from the University of Notre Dame, Notre Dame, IN, in 1994. From 1993 to 1995, he was a Staff Fellow with General Motors Research and Development Center, Warren, MI. From 1995 to 1999, he was an Assistant Professor in the Department of Electrical and Computer Engineering, Stevens Institute of Technology, Hoboken, NJ. He joined the University of Illinois at Chicago in 1999, where he is now a Full Professor of Electrical and Computer Engineering and of Computer Science. Since 2005, he has been Director of Graduate Studies in the Department of Electrical and Computer Engineering at the University of Illinois at Chicago. He is coauthor of Dynamical Systems with Saturation Nonlinearities: Analysis and Design (New York: Springer-Verlag, 1994) (with A. N. Michel), Qualitative Analysis and Synthesis of Recurrent Neural Networks (New York: Marcel Dekker, 2002) (with A. N. Michel), and Fuzzy Modeling and Fuzzy Control (Boston: Birkhauser, 2006) (with H. Zhang). He is coeditor of Stability and Control of Dynamical ystems with Applications (Boston, MA: Birkhauser, 2003) (with P. J. Antsaklis) and Advances in Computational Intelligence: Theory and pplications (Singapore: World Scientific, 2006) (with F. Y. Wang). He is an Associate Editor of Automatica. Dr. Liu was a member of the Conference Editorial Board of the IEEE Control Systems Society (1995-2000) and an Associate Editor of the IEEE Transactions on Circuits and Systems-I: Fundamental Theory and Applications (1997-1999), the IEEE Transactions on Signal Processing (2001-2003), and the IEEE Transactions on Neural Networks (2004-2006). Since 2004, he has been the Editor of the IEEE Computational Intelligence Society's Electronic Letter; and since 2006, he has been the Letters Editor of the IEEE Transactions on Neural Networks and an Associate Editor of the IEEE Computational Intelligence Magazine. He is Program Chair for the 2007 IEEE International Symposium on Approximate Dynamic Programming and Reinforcement Learning; the 21st IEEE International Symposium on Intelligent Control (2006); and the 2006 International Conference on Networking, Sensing and Control. He is the General Chair for the 2007 International Symposium on Neural Networks to be held in Nanjing, China. He is an elected AdCom member of the IEEE Computational Intelligence Society (2006-2009), Chair of the Chicago Chapter of the IEEE Computational Intelligence Society, and Chair of the IEEE Circuits and Systems Society's Technical Committee on Neural Systems and Applications. He received the Michael J. Birck Fellowship from the University of Notre Dame (1990), the Harvey N. Davis Distinguished Teaching Award from Stevens Institute of Technology (1997), the Faculty Early Career Development (CAREER) award from the National Science Foundation (1999), and the University Scholar Award from University of Illinois (2006-2009). He is a Fellow of the IEEE.
