Towards the development of affective facial expression recognition for human-robot interaction

Diego Resende Faria, Mario Vieira, Fernanda C.C. Faria

Research output: Chapter in Book/Report/Conference proceedingConference publication

Abstract

Affective facial expression is a key feature of non-verbal behavior and is considered as a symptom of an internal emotional state. Emotion recognition plays an important role in social communication: human-human and also for human-robot interaction. This work aims at the development of a framework able to recognise human emotions through facial expression for human-robot interaction. Simple features based on facial landmarks distances and angles are extracted to feed a dynamic probabilistic classification framework. The public online dataset Karolinska Directed Emotional Faces (KDEF) [12] is used to learn seven different emotions (e.g. Angry, fearful, disgusted, happy, sad, surprised, and neutral) performed by seventy subjects. Offline and on-the-fly tests were carried out: leave-one-out cross validation tests using the dataset and on-the-fly tests during human-robot interactions. Preliminary results show that the proposed framework can correctly recognise human facial expressions with potential to be used in human-robot interaction scenarios.

Original languageEnglish
Title of host publicationACM PETRA'17: 10th International Conference on PErvasive Technologies Related to Assistive Environments (NOTION: Human Behaviour Monitoring, Interpretation and Understanding)
Place of PublicationNew York, NY (US)
PublisherACM
Pages300-304
Number of pages5
ISBN (Electronic)978-1-4503-5227-7
DOIs
Publication statusPublished - 21 Jun 2017
Event10th ACM International Conference on PErvasive Technologies Related to Assistive Environments, PETRA 2017 - Island of Rhodes, Greece
Duration: 21 Jun 201723 Jun 2017

Conference

Conference10th ACM International Conference on PErvasive Technologies Related to Assistive Environments, PETRA 2017
CountryGreece
CityIsland of Rhodes
Period21/06/1723/06/17

Bibliographical note

-

Keywords

  • affective facial expressions
  • emotion recognition
  • human-robot interaction

Fingerprint Dive into the research topics of 'Towards the development of affective facial expression recognition for human-robot interaction'. Together they form a unique fingerprint.

  • Cite this

    Faria, D. R., Vieira, M., & Faria, F. C. C. (2017). Towards the development of affective facial expression recognition for human-robot interaction. In ACM PETRA'17: 10th International Conference on PErvasive Technologies Related to Assistive Environments (NOTION: Human Behaviour Monitoring, Interpretation and Understanding) (pp. 300-304). ACM. https://doi.org/10.1145/3056540.3076199