The French National Research Agency Projects for science

Voir cette page en français

ANR funded project

Interactions des mondes physiques, de l'humain et du monde numérique (DS0707) 2014


SOMBRERO is a project of social robotics endowing humanoid robots with socio-communicative skills. The project focuses on multimodal behavior of the upper body (speech, gaze, facial expressions, head movements, gestures of the arms and hands, body posture) to manage face-to-face and situated interaction with a human partner. The originality of SOMBRERO is to learn behaviors via immersive tele-operation (or beaming). This technique allows a human driver to perceive, understand, learn and act remotely on the physical world through a robotic incarnation. This innovative strategy addresses four challenges:
1 Telepresence. Immersive teleoperation of robot companions for home caring allows health professionals or social workers to sporadically interact with their patients/clients without disrupting their daily activities. This alliance between companion robotics and therapeutic robotics has awakened the interest of insurance companies.
2 Learning behaviors. Beaming enables the interaction between the human pilot and his/her human partner. It forces the pilot to find behavioral strategies adapted to the affordances of its robotic incarnation. Machine learning techniques will retrieve multimodal data from the behavioral memory of the remotely tele-operated robot and extract the laws governing perception/decision/action loops appropriate to the situation, the task and the human partner.
3 Active perception. Context-sensitive and situated behaviors are based on the exploration and understanding of the audiovisual scene by the robot. This exploration will take into account the robot’s capacity to act and predict the actions of its human partner. SOMBRERO and develop two very hot research themes: active perception and analysis of social signals.
4 Behavioral profiles. The beaming approach allows a thoughtful assessment of the acceptability of social robots by simulating the multimodal behavior of robots with advanced social and communication skills. SOMBRERO will also identify usage patterns of a technology at the boundary between technology and humanity.
SOMBRERO will develop a beaming platform for two state of the art humanoid robots: Roméo from Aldebaran and the iCub2 at GIPSA-Lab. The consortium associates four research laboratories in Science and Information Technology (LIG, GIPSA-Lab and Lab-STICC) and Humanities and Social Sciences (LIP) with Aldebaran Robotics, a world leader in humanoid robotics.



GIPSA-Lab Grenoble Images Parole Signal Automatique

Lab-STICC Laboratoire des sciences techniques de l'information, de la communication et de la connaissance

LIG Laboratoire d'Informatique de Grenoble

LIP Laboratoire Interuniversitaire de Psychologie

ANR grant: 698 911 euros
Beginning and duration: octobre 2014 - 42 mois


ANR Programme: Interactions des mondes physiques, de l'humain et du monde numérique (DS0707) 2014

Project ID: ANR-14-CE27-0014

Project coordinator:
Monsieur Gérard BAILLY (Grenoble Images Parole Signal Automatique)


Back to the previous page


The project coordinator is the author of this abstract and is therefore responsible for the content of the summary. The ANR disclaims all responsibility in connection with its content.