Optimization of a Compact Model for the Compliant Humanoid Robot COMAN Using Reinforcement Learning
Pages 76 - 85
Abstract
COMAN is a compliant humanoid robot. The introduction of passive compliance in some of its joints affects the dynamics of the whole system. Unlike traditional stiff robots, there is a deflection of the joint angle with respect to the desired one whenever an external torque is applied. Following a bottom up approach, the dynamic equations of the joints are defined first. Then, a new model which combines the inverted pendulum approach with a three-dimensional (Cartesian) compliant model at the level of the center of mass is proposed. This compact model is based on some assumptions that reduce the complexity but at the same time affect the precision. To address this problem, additional parameters are inserted in the model equation and an optimization procedure is performed using reinforcement learning. The optimized model is experimentally validated on the COMAN robot using several ZMP-based walking gaits.
References
[1]
1. Hirose, M., Y. Haikawa, T. Takenaka, K. Hirai. Development of Humanoid Robot ASIMO. - In: Proc. IEEE/RSJ IROS’2001, Workshop2.
[2]
2. Hirai, K., M. Hirose, Y. Haikawa, T. Takenaka. The Development of Honda Humanoid Robot. - In: Proc. of IEEE ICRA’1998, 1321-1326.
[3]
3. Akachi, K., K. Kaneko, N Kanehira, S. Ota, G. Miyamori, M. Hirata, S. Kajita, F. Kanehiro. Development of Humanoid Robot HRP-3P. - In: Proc. of IEEERAS Int. Conf. on Humanoid Robots, 50-55.
[4]
4. Ogura, Y., H. Aikawa, K. Shimomura, A. Morishima, H. Lim, A. Takanishi. Development of a New Humanoid Robot WABIAN-2. - In: Proc. of IEEE ICRA’2006, 76-81.
[5]
5. Tsagarakis, N. G., G. Metta, G. Sandini, D. Vernon, R. Beira, F. Becchi, L. Righetti, J. S. Victor, A. J. Ijspeert, M. C. Carrozza, D. G. Caldwell. iCub: The Design and Realization of an Open Humanoid Platform for Cognitive and Neuroscience Research. - Advanced Robotics, Vol. 21, 2007, No 10, 1151-1175.
[6]
6. Tsagarakis, N. G., B. Vanderborght, M. Laffranchi, D. G. Caldwell. The Mechanical Design of the New Lower Body for the Child Humanoid Robot “iCub”. - In: IEEE/RSJ International Conference on Intelligent Robots and Systems, 2009, 4962-4968.
[7]
7. Tsagarakis, N. G., F. Becchi, M. Singlair, G. Metta, D. G. Caldwell, G. Sandini. Lower Body Realization of the Baby Humanoid-“iCub”. - In: IEEE/RSJ International Conference on Intelligent Robots and Systems, 2007, 3616-3622.
[8]
8. Lohmeier, S., T. Buschmann, H. Ulbrich, F. Pfeiffer. Modular Joint Design for Performance Enhanced Humanoid Robot LOLA. - In: Proc. of IEEE ICRA’2006, 88-93.
[9]
9. Yamaguchi, J., E. Soga, S. Inoue, A. Takanishi. Development of a Bipedal Humanoid Robot - Control Method of Whole Body Cooperative Dynamic Biped Walking. - In: Proc. of IEEE ICRA’1999, 368-374.
[10]
10. Park, I. W., J. Y. Kim, J. Lee, J. H. Oh. Mechanical Design of the Humanoid Robot Platform HUBO. - Journal of Advanced Robotics, Vol. 21, 2007, No 11, 1305-1322.
[11]
11. Tsagarakis, N. G., M. Singlair, F. Becchi, G. Metta, G. Sandini, D. Caldwell. Lower Body Design of the “iCub” a Human-Baby Like Crawling Robot. - IEEE Humanoids, 2006, 450-455.
[12]
12. Tsagarakis, N., Z. Li, J. Saglia, D. G. Caldwell. The Design of the Lower Body of the Compliant Humanoid Robot “cCub”. - In: IEEE ICRA’2011.
[13]
13. Tsagarakis, N., M. Laffranchi, B. Vanderborght, D. Caldwell. A Compact Soft Actuator Unit for Small Scale Human Friendly Robots. - In: IEEE ICRA’2009, 4356-4362.
[14]
14. Spong, M. Modeling and Control of Elastic Joint Robots. - Trans. ASME : J. Dyn. Syst., Meas., Control, Vol. 109, 1987, 310-319.
[15]
15. Colasanto, L., N. G. Tsagarakis, D. G. Caldwell. A Compact Model for the Compliant Humanoid Robot COMAN. - In: IEEE International Conference on Biomedical Robotics and Biomechatronics, Rome, Italy, 2012.
[16]
16. Chen, S., J. Kao. Simulation of Conservative Congruence Transformation Conservative Properties in Joint and Cartesian Spaces. - In: IEEE International Conference on Intelligent Robotics and Automation, 2001, 3356-3363.
[17]
17. Kajita, S., M. Morisawa, K. Miura, S. Nakaoka, K. Harada, K. Kaneko, F. Kanehiro, K. Yokoi. Biped Walking Stabilization Based on Linear Inverted Pendulum Tracking. - In: IEEE/RSJ International Conference on Intelligent Robots and Systems, Taipei, Taiwan, 2010, 4489-4496.
[18]
18. Kajita, S., F. Kanehiro, K. Kaneko, K. Fujiwara, K. Harada H. Hirukava, K. Yokoi. Biped Walking Pattern Generation by using Preview Control of Zero-Moment Point. - In: IEEE/RSJ International Conference on Intelligent Robots and Systems, Las Vegas, USA, 2003, 1620-1626.
[19]
19. Kober, J., J. Peters. Learning Motor Primitives for Robotics. - In: Proc. IEEE Intl. Conf. on Robotics and Automation (ICRA), May 2009, 2112-2118.
[20]
20. Kormushev, P., B. Ugurlu, S. Calinon, N. G. Tsagarakis, D. G. Caldwell. Bipedal Walking Energy Minimization by Reinforcement Learning With Evolving Policy Parameterization. - In: Proc. IEEE/RSJ Intl. Conf. on Intelligent Robots and Systems (IROS), San Francisco, USA, September 2011, 318-324.
Index Terms
- Optimization of a Compact Model for the Compliant Humanoid Robot COMAN Using Reinforcement Learning
Index terms have been assigned to the content through auto-classification.
Recommendations
Development of a Leg Part of a Humanoid Robot—Development of aBiped Walking Robot Adapting to the Humans‘ Normal LivingFloor
The authors are engaged in studies of biped walking robots from the following two viewpoints. One is a viewpoint as a human science. The other is a viewpoint towards the development of humanoid robots.
In this paper, the authors introduce an ...
On Global Optimization of Walking Gaits for the Compliant Humanoid Robot, COMAN Using Reinforcement Learning
AbstractIn ZMP trajectory generation using simple models, often a considerable amount of trials and errors are involved to obtain locally stable gaits by manually tuning the gait parameters. In this paper a 15 degrees of Freedom dynamic model of a ...
Vision-Based Humanoid Robot Navigation in a Featureless Environment
MCPR 2015: Proceedings of the 7th Mexican Conference on Pattern Recognition - Volume 9116One of the most basic tasks for any autonomous mobile robot is that of safely navigating from one point to another e.g. service robots should be able to find their way in different kinds of environments. Typically, vision is used to find landmarks in ...
Comments
Information & Contributors
Information
Published In
1 September 2012
186 pages
This content is open access.
Publisher
Walter de Gruyter GmbH
Berlin, Germany
Publication History
Published: 01 September 2012
Author Tags
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 01 Dec 2024
Other Metrics
Citations
View Options
View options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in