The accurate modeling of real-world systems and physical interactions is a common challenge towards the resolution of robotics tasks. Machine learning approaches have demonstrated significant results in the modeling of complex systems (e.g., articulated robot structures, cable stretch, fluid dynamics), or to learn robotics tasks (e.g., grasping, reaching) from raw...
[Read More]
OptLayer - practical constrained optimization for deep reinforcement learning in the real world
T.-H. Pham, G. De Magistris, R. Tachibana, IEEE International Conference on Robotics and Automation (ICRA), 2018
While deep reinforcement learning techniques have recently produced considerable achievements on many decision-making problems, their use in robotics has largely been limited to simulated worlds or restricted motions, since unconstrained trial-and-error interactions in the real world can have undesirable consequences for the robot or its environment. To overcome such limitations,...
[Read More]
MaestROB: a robotics framework for integrated orchestration of low-level control and high-level reasoning
A. Munawar, G. De Magistris, T.-H. Pham, D. Kimura, M. Tatsubori, T. Moriyama, R. Tachibana, G. Booch, IEEE International Conference on Robotics and Automation (ICRA), 2018
This paper describes a framework called MaestROB. It is designed to make the robots perform complex tasks with high precision by simple high-level instructions given by natural language or demonstration. To realize this, it handles a hierarchical structure by using the knowledge stored in the forms of ontology and rules...
[Read More]
Hand-object contact force estimation from markerless visual tracking
T.-H. Pham, N. Kyriazis, A. A. Argyros, A. Kheddar, IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 2017
We consider the problem of estimating realistic contact forces during manipulation, backed with ground-truth measurements, using vision alone. Interaction forces are usually measured by mounting force transducers onto the manipulated objects or the hands. Those are costly, cumbersome, and alter the objects’ physical properties and their perception by the human...
[Read More]
Multi-contact interaction force sensing from whole-body motion capture
T.-H. Pham, S. Caron, A. Kheddar, IEEE Transactions on Industrial Informatics (TII), 2017
We present a novel technique that unobtrusively estimates interaction forces exerted by human participants in multi-contact interaction with rigid environments. Our method uses motion capture only, thus circumventing the need to setup cumbersome force transducers at all potential contacts between the human body and the environment. This problem is particularly...
[Read More]