Engaging human-to-robot attention using conversational gestures and lip-synchronization

Felipe Cid Burgos; Luis Jesús Manso Fernández-Arguelles; Luis V. Calderita; Agustín Sánchez; Pedro Núñez Trujillo

doi:10.14198/jopha.2012.6.1.02

Engaging human-to-robot attention using conversational gestures and lip-synchronization

Felipe Cid Burgos, Luis Jesús Manso Fernández-Arguelles, Luis V. Calderita, Agustín Sánchez, Pedro Núñez Trujillo

College of Engineering and Physical Sciences

Research output: Contribution to journal › Article › peer-review

Abstract

Human-Robot Interaction (HRI) is one of the most important subfields of social robotics. In several applications,text-to-speech (TTS) techniques are used by robots to provide feedback to humans. In this respect, a natural synchronization between the synthetic voice and the mouth of the robot could contribute to improve the interaction experience. This paper presents an algorithm for synchronizing Text-To-Speech systems with robotic mouths. The proposed approach estimates the appropriate aperture of the mouth based on the entropy of the synthetic audio stream provided by the TTS system. The paper also describes the cost-efficient robotic head which has been used in the experiments and introduces the use of conversational gestures for engaging Human-Robot Interaction. The system,which has been implemented in C++ and can perform in real-time, is freely available as part of the RoboComp open-source robotics framework. Finally, the paper presents the results of the opinion poll that has been conducted in order to evaluate the interaction experience

Original language	English
Pages (from-to)	3-10
Journal	Journal of Physical Agents (JoPha)
Volume	6
Issue number	1
DOIs	https://doi.org/10.14198/jopha.2012.6.1.02
Publication status	Published - 1 Jan 2012

Bibliographical note

This item is licensed under a Creative Commons License CC BY-SA 3.0.

Funding: This work has been partially supported by the Junta de
Extremadura project IB10062 and by the Spanish Ministry of
Science and Innovation with grant IPT-430000-2010-002.

Keywords

Robotics head
Lip Synchronization
Human Robot Interaction

Access to Document

10.14198/jopha.2012.6.1.02Licence: CC BY-SA 3.0

JoPha_6_1_02
This item is licensed under a Creative Commons License CC BY-SA 3.0
Final published version, 3.3 MBLicence: CC BY-SA 3.0

Cite this

@article{9df9b3ffbcaf451081a2e3adaa53dc65,

title = "Engaging human-to-robot attention using conversational gestures and lip-synchronization",

abstract = "Human-Robot Interaction (HRI) is one of the most important subfields of social robotics. In several applications,text-to-speech (TTS) techniques are used by robots to provide feedback to humans. In this respect, a natural synchronization between the synthetic voice and the mouth of the robot could contribute to improve the interaction experience. This paper presents an algorithm for synchronizing Text-To-Speech systems with robotic mouths. The proposed approach estimates the appropriate aperture of the mouth based on the entropy of the synthetic audio stream provided by the TTS system. The paper also describes the cost-efficient robotic head which has been used in the experiments and introduces the use of conversational gestures for engaging Human-Robot Interaction. The system,which has been implemented in C++ and can perform in real-time, is freely available as part of the RoboComp open-source robotics framework. Finally, the paper presents the results of the opinion poll that has been conducted in order to evaluate the interaction experience",

keywords = "Robotics head, Lip Synchronization, Human Robot Interaction",

author = "Burgos, {Felipe Cid} and Fern{\'a}ndez-Arguelles, {Luis Jes{\'u}s Manso} and Calderita, {Luis V.} and Agust{\'i}n S{\'a}nchez and Trujillo, {Pedro N{\'u}{\~n}ez}",

note = "This item is licensed under a Creative Commons License CC BY-SA 3.0. Funding: This work has been partially supported by the Junta de Extremadura project IB10062 and by the Spanish Ministry of Science and Innovation with grant IPT-430000-2010-002.",

year = "2012",

month = jan,

day = "1",

doi = "10.14198/jopha.2012.6.1.02",

language = "English",

volume = "6",

pages = "3--10",

number = "1",

}

TY - JOUR

T1 - Engaging human-to-robot attention using conversational gestures and lip-synchronization

AU - Burgos, Felipe Cid

AU - Fernández-Arguelles, Luis Jesús Manso

AU - Calderita, Luis V.

AU - Sánchez, Agustín

AU - Trujillo, Pedro Núñez

N1 - This item is licensed under a Creative Commons License CC BY-SA 3.0. Funding: This work has been partially supported by the Junta de Extremadura project IB10062 and by the Spanish Ministry of Science and Innovation with grant IPT-430000-2010-002.

PY - 2012/1/1

Y1 - 2012/1/1

N2 - Human-Robot Interaction (HRI) is one of the most important subfields of social robotics. In several applications,text-to-speech (TTS) techniques are used by robots to provide feedback to humans. In this respect, a natural synchronization between the synthetic voice and the mouth of the robot could contribute to improve the interaction experience. This paper presents an algorithm for synchronizing Text-To-Speech systems with robotic mouths. The proposed approach estimates the appropriate aperture of the mouth based on the entropy of the synthetic audio stream provided by the TTS system. The paper also describes the cost-efficient robotic head which has been used in the experiments and introduces the use of conversational gestures for engaging Human-Robot Interaction. The system,which has been implemented in C++ and can perform in real-time, is freely available as part of the RoboComp open-source robotics framework. Finally, the paper presents the results of the opinion poll that has been conducted in order to evaluate the interaction experience

AB - Human-Robot Interaction (HRI) is one of the most important subfields of social robotics. In several applications,text-to-speech (TTS) techniques are used by robots to provide feedback to humans. In this respect, a natural synchronization between the synthetic voice and the mouth of the robot could contribute to improve the interaction experience. This paper presents an algorithm for synchronizing Text-To-Speech systems with robotic mouths. The proposed approach estimates the appropriate aperture of the mouth based on the entropy of the synthetic audio stream provided by the TTS system. The paper also describes the cost-efficient robotic head which has been used in the experiments and introduces the use of conversational gestures for engaging Human-Robot Interaction. The system,which has been implemented in C++ and can perform in real-time, is freely available as part of the RoboComp open-source robotics framework. Finally, the paper presents the results of the opinion poll that has been conducted in order to evaluate the interaction experience

KW - Robotics head

KW - Lip Synchronization

KW - Human Robot Interaction

UR - http://ljmanso.com/files/Engaging_Human-robot_Attention_Using_Conversational_Gestures_and_Lip-synchronization.pdf

U2 - 10.14198/jopha.2012.6.1.02

DO - 10.14198/jopha.2012.6.1.02

M3 - Article

SN - 1888-0258

VL - 6

SP - 3

EP - 10

JO - Journal of Physical Agents (JoPha)

JF - Journal of Physical Agents (JoPha)

IS - 1

ER -

Engaging human-to-robot attention using conversational gestures and lip-synchronization

Abstract

Bibliographical note

Keywords

Access to Document

Other files and links

Fingerprint

Cite this