Information on a publication
Title |
A Probabilistic Programming by Demonstration Framework Handling Constraints in Joint Space and Task Space |
Authors |
Calinon, S. and Billard, A. |
Year of publication |
2008 |
Place of publication |
In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Nice, France, pp. 367-372. |
We present a probabilistic architecture for solving generically the problem of extracting the task constraints through a Programming by Demonstration (PbD) framework and for generalizing the acquired knowledge to various situations. We propose an approach based on Gaussian Mixture Regression (GMR) to find automatically a controller for the robot reproducing the essential characteristics of the skill by handling simultaneously constraints in joint space and in task space. Experiments with two 5-DOFs Katana robots are then presented with two manipulation tasks consisting of handling and displacing a set of objects.
@inproceedings{Calinon08IROS,
author="S. Calinon and A. Billard",
title="A Probabilistic Programming by Demonstration Framework Handling Skill Constraints in Joint Space and Task Space",
booktitle="Proc. {IEEE/RSJ} Intl Conf. on Intelligent Robots and Systems ({IROS})",
year="2008",
month="September",
location="Nice, France"
pages="367--372"
}
Incremental learning of a motion with two Katana robotic arms
from Neuronics.
Two demonstrations are provided to show to the
robots how to pour some liquid from a bottle into a glass. Then,
the user moves manually one of the robot while the other robot
follows as best as possible the learned motion in a flexible
manner.
Video credit: Florent D'halluin.
to play the video and on 
to view the video in fullscreen mode)
Joint/task constraints v2.0 - Matlab sourcecode
Download
Download Joint/task constraints sourcecode as a zipped file
Usage
Unzip the file and run 'demo1' in Matlab.
References
- Calinon, S. (2009) Robot Programming by Demonstration: A Probabilistic Approach. EPFL/CRC Press.
- Calinon, S. and Billard, A. (2008) A Probabilistic Programming by Demonstration Framework Handling Constraints in Joint Space and Task Space. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 367-372.
Demo 1 - Demonstration of the use of Gaussian Mixture Regression (GMR) and inverse kinematics to reproduce a task by considering constraints both in joint space and in task space
This program shows the simulation of a robotic arm composed of 2 links and moving in 2D space.
Several demonstrations of a skill are provided, by
starting from different initial positions. The skill consists of moving
each joint sequentially and then writing the alphabet letter 'N' at a
specific position in the 2D space.
Constraints in joint space and in task space are represented
through Gaussian Mixture Models (GMMs) and Gaussian Mixture Regression
(GMR). By using an inverse kinematics process based on a pseudo-inverse
Jacobian, the constraints in task space are then projected in joint
space. By considering the projected constraints with the ones originally
encoded in joint space, an optimal controller is found for the
reproduction of the task. We see through this example that the system is
able to generalize the learned skill to new robotic arms (different links
lengths) and to new initial positions of the robot.