Automatic Detection of Human Interactions from RGB-D Data for Social Activity Classification

Claudio Coppola, Serhan Cosar, Diego R. Faria, Nicola Bellotto

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We present a system for temporal detection of social interactions. Many of the works until now have succeeded in recognising activities from clipped videos in datasets, but for robotic applications, it is important to be able to move to
more realistic data. For this reason, the proposed approach temporally detects intervals where individual or social activity is occurring. Recognition of human activities is a key feature for analysing the human behaviour. In particular, recognition of social activities is useful to trigger human-robot interactions
or to detect situations of potential danger. Based on that, this research has three goals: (1) define a new set of descriptors, which are able to characterise human interactions; (2) develop a computational model to segment temporal intervals with
social interaction or individual behaviour; (3) provide a public
dataset with RGB-D data with continuous stream of individual
activities and social interactions. Results show that the proposed
approach attained relevant performance with temporal
segmentation of social activities.
Original languageEnglish
Title of host publicationIEEE RO-MAN'17: IEEE International Symposium on Robot and Human Interactive Communication, Lisbon, Portugal
PublisherIEEE
ISBN (Electronic)978-1-5386-3518-6
ISBN (Print) 978-1-5386-3519-3
DOIs
Publication statusE-pub ahead of print - 14 Dec 2017

Fingerprint

Robotics
Robots

Bibliographical note

© 2017 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.

Cite this

Coppola, C., Cosar, S., Faria, D. R., & Bellotto, N. (2017). Automatic Detection of Human Interactions from RGB-D Data for Social Activity Classification. In IEEE RO-MAN'17: IEEE International Symposium on Robot and Human Interactive Communication, Lisbon, Portugal IEEE. https://doi.org/10.1109/ROMAN.2017.8172405
Coppola, Claudio ; Cosar, Serhan ; Faria, Diego R. ; Bellotto, Nicola. / Automatic Detection of Human Interactions from RGB-D Data for Social Activity Classification. IEEE RO-MAN'17: IEEE International Symposium on Robot and Human Interactive Communication, Lisbon, Portugal. IEEE, 2017.
@inproceedings{1be7e41073584c44b5154a7d339ccec9,
title = "Automatic Detection of Human Interactions from RGB-D Data for Social Activity Classification",
abstract = "We present a system for temporal detection of social interactions. Many of the works until now have succeeded in recognising activities from clipped videos in datasets, but for robotic applications, it is important to be able to move tomore realistic data. For this reason, the proposed approach temporally detects intervals where individual or social activity is occurring. Recognition of human activities is a key feature for analysing the human behaviour. In particular, recognition of social activities is useful to trigger human-robot interactionsor to detect situations of potential danger. Based on that, this research has three goals: (1) define a new set of descriptors, which are able to characterise human interactions; (2) develop a computational model to segment temporal intervals withsocial interaction or individual behaviour; (3) provide a publicdataset with RGB-D data with continuous stream of individualactivities and social interactions. Results show that the proposedapproach attained relevant performance with temporalsegmentation of social activities.",
author = "Claudio Coppola and Serhan Cosar and Faria, {Diego R.} and Nicola Bellotto",
note = "{\circledC} 2017 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.",
year = "2017",
month = "12",
day = "14",
doi = "10.1109/ROMAN.2017.8172405",
language = "English",
isbn = "978-1-5386-3519-3",
booktitle = "IEEE RO-MAN'17: IEEE International Symposium on Robot and Human Interactive Communication, Lisbon, Portugal",
publisher = "IEEE",
address = "United States",

}

Coppola, C, Cosar, S, Faria, DR & Bellotto, N 2017, Automatic Detection of Human Interactions from RGB-D Data for Social Activity Classification. in IEEE RO-MAN'17: IEEE International Symposium on Robot and Human Interactive Communication, Lisbon, Portugal. IEEE. https://doi.org/10.1109/ROMAN.2017.8172405

Automatic Detection of Human Interactions from RGB-D Data for Social Activity Classification. / Coppola, Claudio; Cosar, Serhan; Faria, Diego R.; Bellotto, Nicola.

IEEE RO-MAN'17: IEEE International Symposium on Robot and Human Interactive Communication, Lisbon, Portugal. IEEE, 2017.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Automatic Detection of Human Interactions from RGB-D Data for Social Activity Classification

AU - Coppola, Claudio

AU - Cosar, Serhan

AU - Faria, Diego R.

AU - Bellotto, Nicola

N1 - © 2017 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.

PY - 2017/12/14

Y1 - 2017/12/14

N2 - We present a system for temporal detection of social interactions. Many of the works until now have succeeded in recognising activities from clipped videos in datasets, but for robotic applications, it is important to be able to move tomore realistic data. For this reason, the proposed approach temporally detects intervals where individual or social activity is occurring. Recognition of human activities is a key feature for analysing the human behaviour. In particular, recognition of social activities is useful to trigger human-robot interactionsor to detect situations of potential danger. Based on that, this research has three goals: (1) define a new set of descriptors, which are able to characterise human interactions; (2) develop a computational model to segment temporal intervals withsocial interaction or individual behaviour; (3) provide a publicdataset with RGB-D data with continuous stream of individualactivities and social interactions. Results show that the proposedapproach attained relevant performance with temporalsegmentation of social activities.

AB - We present a system for temporal detection of social interactions. Many of the works until now have succeeded in recognising activities from clipped videos in datasets, but for robotic applications, it is important to be able to move tomore realistic data. For this reason, the proposed approach temporally detects intervals where individual or social activity is occurring. Recognition of human activities is a key feature for analysing the human behaviour. In particular, recognition of social activities is useful to trigger human-robot interactionsor to detect situations of potential danger. Based on that, this research has three goals: (1) define a new set of descriptors, which are able to characterise human interactions; (2) develop a computational model to segment temporal intervals withsocial interaction or individual behaviour; (3) provide a publicdataset with RGB-D data with continuous stream of individualactivities and social interactions. Results show that the proposedapproach attained relevant performance with temporalsegmentation of social activities.

U2 - 10.1109/ROMAN.2017.8172405

DO - 10.1109/ROMAN.2017.8172405

M3 - Conference contribution

SN - 978-1-5386-3519-3

BT - IEEE RO-MAN'17: IEEE International Symposium on Robot and Human Interactive Communication, Lisbon, Portugal

PB - IEEE

ER -

Coppola C, Cosar S, Faria DR, Bellotto N. Automatic Detection of Human Interactions from RGB-D Data for Social Activity Classification. In IEEE RO-MAN'17: IEEE International Symposium on Robot and Human Interactive Communication, Lisbon, Portugal. IEEE. 2017 https://doi.org/10.1109/ROMAN.2017.8172405