Publication
Using reward-weighted imitation for robot Reinforcement Learning
Jan Peters; Jens Kober
In: 2009 IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL 2009) Proceedings. IEEE Symposium on Adaptive Dynamic Programming And Reinforcement Learning (ADPRL-2009), March 30 - April 2, Nashville, TN, USA, Pages 226-232, IEEE Symposium Series on Computational Intelligence, ISBN 978-1-4244-2761-1, IEEE, 2009.
Abstract
Reinforcement Learning is an essential ability for robots to learn new motor skills. Nevertheless, few methods scale into the domain of anthropomorphic robotics. In order to improve in terms of efficiency, the problem is reduced onto reward-weighted imitation. By doing so, we are able to generate a framework for policy learning which both unifies previous reinforcement learning approaches and allows the derivation of novel algorithms. We show our two most relevant applications both for motor primitive learning (e.g., a complex Ball-in-a-Cup task using a real Barrett WAM robot arm) and learning task-space control.