IEEE HomeSearch IEEEShop IEEEIEEE Web AccountContact IEEE
IEEE Computational Intelligence Society
     f=0127

IEEE CIS > Technical Activities

Adaptive Dynamic Programming and Reinforcement Learning TC

Name

This organization is known as the Adaptive Dynamic Programming and Reinforcement Learning Technical Committee (ADPRLTC) of the Computational Intelligence Society (CIS) of the Institute of Electrical and Electronic Engineers, Inc. (IEEE).


Purpose and Scope

The purpose of the ADPRLTC is to promote the research, development, education, and understanding of adaptive dynamic programming and reinforcement learning methods, including both theoretical and experimental approaches.


Membership

The ADPRLTC members are appointed by the CIS President with the agreement of the ADPRLTC Chair for a one-year term. The term of service expires at the end of the calendar year for which they have been appointed.


Officers

The ADPRLTC Chair is appointed by the CIS President with the agreement of the CIS EXCOM for a one-year term. The term of service expires at the end of the calendar year for which the ADPRLTC Chair has been appointed. No more than two consecutive full terms are permitted.


Funding

There is no membership fee for joining the ADPRLTC. Funding for the committee shall be provided by the CIS in the annual budget request. Once approved by the CIS ExCom and AdCom, funds will be available to support the ADPRLTC activities. The Chair shall be responsible for the appropriate use of the approved funds with supporting documentation.


Activities

The ADPRLTC shall engage in various activities in order to promote adaptive dynamic programming and reinforcement learning as a viable technology, including but not limited to the following: Identify and promote new areas of research, propose special sessions to the CIS-sponsored conference organizers, participate in paper review and selection for CIS-sponsored conferences and publications, coordinate with the International Neural Network Society for the International Joint Conference on Neural Networks in which ADPRL is also active, recommend candidates to different Award Committees such as for the best papers published in the Transactions on Neural Networks, promote IEEE Senior Members and Fellows program, collaborate on production of tutorials and book series, maintain the Committee¡¦s website, facilitate local chapters activities and organize specialized workshops or meetings. The ADPRLTC will assist in soliciting conference proposals and actively work with the organizers of CIS-sponsored conferences to insure their technical excellence.


Meetings

Meetings will be called by the Chair once or twice a year, usually in conjunction with the CIS AdCom meetings and the world congress on computational intelligence (WCCI) or the symposium series on computational intelligence (SSCI), or as requested by the ADPRLTC members. Sufficient advance notice of the meetings will be given to the members, as well as to other interested parties. The Chair shall prepare an agenda before the meeting, and shall prepare minutes for distribution after the meeting.


Amendments

This Charter becomes official after at least 2/3 core members present at The Committee Meeting approves it. Subsequent changes and amendments also require 2/3 majority vote.


Members

Marco WieringMarco Wiering, Chair
Department of Artificial Intelligence
University of Groningen
Groningen, Nijenborgh 9
9700AK, Netherlands
phone: 31(0)50-3636956
fax: 31(0)50-3636687
email: m.a.wiering .a_t. rug.nl
www: www.ai.rug.nl/~mwiering
Huaguang ZhangHuaguang Zhang, Vice Chair
Department of Electrical Engineering
Northeastern University
Wenhua Road 3-11#, Heping District
Shenyang, Liaoning 110819, China
phone: +86-24-83687762
fax: +86-24-83689605
email: hgzhang .a_t. ieee.org
www: www.eai.neu.edu.cn/zhanghuaguang1.asp
Damien ErnstDamien Ernst, Vice Chair
Systems and Modeling Research Unit
University of Liege
Institut Montefiore
Liege B-4000, Belgium
phone: +32 4 366 9518
fax: +32 4 366 2984
email: dernst .a_t. ulg.ac.be
www: www.montefiore.ulg.ac.be/~ernst/
Charles W. AndersonCharles W. Anderson
USA
email: anderson .a_t. cs.colostate.edu
Robert BabuskaRobert Babuska
Delft Center for Systems and Control
Delft University of Technology
Mekelweg 2, 2628 CD Delft
Delft 2600 GA, The Netherlands
phone: +31 15 2785117
fax: +31 15 2786679
email: r.babuska .a_t. tudelft.nl
www: www.dcsc.tudelft.nl/~babuska/
Andrew G. BartoAndrew G. Barto
University of Massachusetts at Amherst
USA
email: barto .a_t. cs.umass.edu
Anna BazzanAnna Bazzan
Instituto de Informatica
Porto Alegre, RS
Brazil
email: bazzan .a_t. inf.ufrgs.br
www: www.inf.ufrgs.br/~bazzan/
Dimitri BertsekasDimitri Bertsekas
USA
email: dimitrib .a_t. mit.edu
Lucian BusoniuLucian Busoniu
Team SequeL
INRIA Lille - Nord Europe
40 avenue Halley
59650 Villeneuve d'Ascq, France
phone: +33 (0)3 59577881
email: lucian .a_t. busoniu.net
www: busoniu.net/
El-Sayed M. El-AlfyEl-Sayed M. El-Alfy
College of Computer Sciences and Engineering
King Fahd University of Petroleum and Minerals
P.O. Box 371
Dhahran 31261, Saui Arbia
phone: +9663-860-1930
fax: +9663-860-2174
email: alfy .a_t. kfupm.edu.sa
www: faculty.kfupm.edu.sa/ics/alfy
Silvia FerrariSilvia Ferrari
Department of Mechanical Engineering & Materials Science
Duke University
Box 90300, Durham, NC 27708-0005
USA
phone: 919-660-5484
fax: 919-660-8963
email: sferrari .a_t. duke.edu
www: fred.mems.duke.edu/silviaferrari.html
Abhijit GosaviAbhijit Gosavi
Engineering Management and Systems Engineering
Missouri University of Science and Technology
219 Engineering Management
Rolla, MO 65409-0370, USA
phone: (573) 341-4624
fax: (573) 341-6567
email: gosavia .a_t. mst.edu
www: http://web.mst.edu/~gosavia/
Zeng-Guang HouZeng-Guang Hou
Institute of Automation
The Chinese Academy of Sciences
P.O. Box 2728
Beijing 100190, China
phone: +86 (10) 6256 5502
fax: +86 (10) 6256 5502
email: zengguang.hou .a_t. ia.ac.cn
www: compsys.ia.ac.cn/~hou/
George G. LendarisGeorge G. Lendaris
Department of Electrical and Computer Engineering
Portland State University
P.O. Box 751
Portland, OR 97207, USA
phone: 503-725-4988
fax: 503-725-8489
email: lendaris .a_t. sysc.pdx.edu
www: www.sysc.pdx.edu/faculty/Lendaris/lendaris.html
Frank LewisFrank Lewis
Department of Electrical Engineering
University of Texas at Arlington
416 Yates Street
Arlington, TX 76011, USA
phone: 817-272-5972
fax: 817-272-5989
email: lewis .a_t. uta.edu
www: arri.uta.edu/acs/bios/lewis.htm
Derong LiuDerong Liu
Institute of Automation
Chinese Academy of Sciences
Beijing 100190, China
Department of Electrical and Computer Engineering
University of Illinois
Chicago, IL 60607, USA
email: ieeetnnls .a_t. gmail.com
www: www.ece.uic.edu/~derong/
Haibo HeHaibo He
Department of Electrical, Computer, and Biomedical Engineering
University of Rhode Island
Kelley A223
Kingston, RI 02881, USA
phone: 401-874-5844
fax: 401-782-6422
email: he .a_t. ele.uri.edu
www: www.ele.uri.edu/faculty/he/
Hisashi HandaHisashi Handa
Graduate School of Natural Science and Technology Okayama University
Tsushima-Naka 3-1-1, Okayama 700-8530, Japan
phone: (+81)-86-251-8250
fax: (+81)-86-251-8250
email: handa .a_t. sdc.it.okayama-u.ac.jp
www: www.sdc.it.okayama-u.ac.jp/~handa/indexE.html
Marcus HutterMarcus Hutter
Research School of Information Sciences and Engineering
Australian National University
Corner of North and Daley Road
Canberra ACT 0200, Australia
phone: +61(0)2 612 51605
fax: +61(0)2 612 58651
email: marcus.hutter .a_t. anu.edu.au
www: www.hutter1.net
Zhong-Ping JiangZhong-Ping Jiang
Electrical & Computer Engineering
Polytechnic Institute of NYU
6 MetroTech Center
Brooklyn, NY 11201, USA
phone: (718)260-3646
email: zjiang .a_t. control.poly.edu
www: eeweb.poly.edu/faculty/jiang/
Ana Maria MadureiraAna Maria Madureira
Computer Science Department
ISEP-IPP
Rua Dr. Bernardino de Almeida, 431
4200-072 Porto, Portugal
phone: +351 22 9734561
fax: +351 22 9734561
email: amd .a_t. isep.ipp.pt
www: www.dei.isep.ipp.pt/~anamadur
Remi MunosRemi Munos
France
email: remi.munos .a_t. inria.fr
Koichi MoriyamaKoichi Moriyama
The Institute of Scientific and Industrial Research
Osaka University
8-1 Mihogaoka
Osaka 567-0047, Japan
email: koichi .a_t. ai.sanken.osaka-u.ac.jp
www: www.ai.sanken.osaka-u.ac.jp/en/index.php?Koichi Moriyama
Ann NowéAnn Nowé
Computer Science Department
Vrije Universiteit Brussel
Pleinlaan 2
Brussels 1050, Belgium
phone: +32 2 629 38 61
fax: 32 2 629 37 08
email: ann.nowe .a_t. vub.ac.be
www: como.vub.ac.be/members:ann_nowe
Kazuhiro OhkuraKazuhiro Ohkura
Mechanical Systems Engineering
Hiroshima University
1-4-1, Kagamiyama
Hiroshima, Higashi-Hiroshima 739-8527, Japan
phone: +81-82-424-7550
email: kohkura .a_t. hiroshima.u.ac.jp
www: www.ohk.hiroshima-u.ac.jp/~ohkura/
Jan PetersJan Peters
Department for Empirical Inference and Machine Learning
Max-Planck-Institute for Biological Cybernetics
Spemannstrasse 38
Tubingen 72076, Germany
phone: +49 7071 601585
fax: +49 7071 601552
email: Jan.peters .a_t. tuebingen.mpg.de
www: www.kyb.mpg.de/~jpeters
Warren PowellWarren Powell
USA
email: powell .a_t. princeton.edu
Philippe PreuxPhilippe Preux
France
email: philippe.preux .a_t. univ-lille3.fr
Danil ProkhorovDanil Prokhorov
Toyota Technical Center, Michigan
1555 Woodridge Avenue
Ann Arbor, MI 48105, USA
email: dvprokhorov .a_t. gmail.com
www: home.comcast.net/~dvp/
Jagannathan SarangapaniJagannathan Sarangapani
Electrical and Computer Engineering
Missouri university of Science and Technology
1870 Miner Circle
Rolla, MO 65409, USA
phone: (573)341-6775
fax: (573)341-4532
email: sarangap .a_t. mst.edu
www: web.mst.edu/~sarangap/
Stefan SchaalStefan Schaal
Computer Science, Neuroscience , and Biomedical Engineering
University of Southern California
3710 S. McClintock Ave
Los Angeles, California 90089-2905, USA
phone: 310 740 1976
fax: 213 740 1510
email: sschaal .a_t. usc.edu
www: www-clmc.usc.edu/~sschaal/
Jennie SiJennie Si
Department of Electrical Engineering
Arizona State University
Tempe, AZ 85287, USA
phone: (+1 480) 965 6133
fax: (+1 480) 965 2811
email: si .a_t. asu.edu
www: www.fulton.asu.edu/~jenniesi/
Csaba SzepesvariCsaba Szepesvari
Cadana
email: szepesva .a_t. cs.ualberta.ca
Emanuel TodorovEmanuel Todorov
USA
email: todorov .a_t. cogsci.ucsd.edu
Yasutake TakahashiYasutake Takahashi
Department of Human & Artificial Intelligent Systems
University of Fukui
3-9-1 Bunkyo
Fukui 910-8507, Japan
phone: +81-776-27-8540
fax: +81-776-27-8540
email: yasutake .a_t. ir.his.u-fukui.ac.jp
www: www.ir.his.u-fukui.ac.jp/en/yasutake/
Athanasios V. VasilakosAthanasios V. Vasilakos
Department of Computer and Telecommunications Eng
University of Western Macedonia,Greece
Krinis 3
N.Erythraia, Greece 14671, Greece
phone: +30 6977449705
email: vasilako .a_t. ath.forthnet.gr
Ganesh Kumar VenayagamoorthyGanesh Kumar Venayagamoorthy
Real-Time Power and Intelligent Systems Laboratory
Missouri University of Science and Technology
Rolla
Missouri, USA
email: gkumar .a_t. ieee.org
Draguna VrabieDraguna Vrabie
Automation and Robotics Research Institute
University of Texas at Arlington
7300 Jack Newell Blvd. S.
Fort Worth, TX 76118, USA
phone: 817-272-5971
fax: 817-272-5938
email: dvrabie .a_t. uta.edu
www: www.uta.edu/ra/real/editprofile.php?pid=2889
Paul WerbosPaul Werbos
National Science Foundation
4201 Wilson Boulevard, Room 675
Arlington, VA 22230, USA
phone: (+1 703) 292 8339
fax: (+1 703) 292 9147
email: pwerbos .a_t. nsf.gov
www: www.nsf.gov/staff/staff_bio.jsp?lan=pwerbos
Shimon WhitesonShimon Whiteson
Department of Computer Science
University of Amsterdam
Science Park 107
Amsterdam 1098 XG, Netherlands
phone: +31 (0)20.525.8701
fax: +31 (0)20.525.7490
email: s.a.whiteson .a_t. uva.nl
www: staff.science.uva.nl/~whiteson/Shimon_Whiteson/Home.html
Bernard WidrowBernard Widrow
Department of Electrical Engineering
Stanford University
860 Lathrop Drive
Stanford, CA 94305, USA
phone: (+1 650) 857 9151
fax: (+1 650) 857 1783
email: widrow .a_t. stanford.edu
www: www-isl.stanford.edu/~widrow
Donald C. WunschDonald C. Wunsch
Dept. of Electrical and Computer Engineering
Missouri University of Science & Technology
301 W. 16th St, 131 EECH
Rolla MO 65409, USA
phone: 573-341-4521
fax: 573-341-4532
email: wunsch .a_t. ieee.org
www: www.linkedin.com/in/wunsch
Xin XuXin Xu
Institute of Automation
National University of Defense Technology
Changsha 410073, China
email: xinxu .a_t. nudt.edu.cn
www: jilsa.net/xinxu.html/

Task Forces

    Currect Task Forces:
  • Applications of ADP and RL, Chair: Draguna Vrabie, Vice-chair: Zhong-Ping Jiang
  • Reinforcement Learning and Function Approximation, Chair: Robert Babuska, Vice-chair: Damien Ernst
  • Robot Reinforcement Learning, Chair: Jan Peters, Vice-chair: Stefan Schaal