Automatic Detection of Human Interactions from RGB-D Data for Social Activity Classification

Claudio Coppola, Serhan Cosar, Diego R. Faria, Nicola Bellotto

Research output: Chapter in Book/Published conference outputConference publication


We present a system for temporal detection of social interactions. Many of the works until now have succeeded in recognising activities from clipped videos in datasets, but for robotic applications, it is important to be able to move to
more realistic data. For this reason, the proposed approach temporally detects intervals where individual or social activity is occurring. Recognition of human activities is a key feature for analysing the human behaviour. In particular, recognition of social activities is useful to trigger human-robot interactions
or to detect situations of potential danger. Based on that, this research has three goals: (1) define a new set of descriptors, which are able to characterise human interactions; (2) develop a computational model to segment temporal intervals with
social interaction or individual behaviour; (3) provide a public
dataset with RGB-D data with continuous stream of individual
activities and social interactions. Results show that the proposed
approach attained relevant performance with temporal
segmentation of social activities.
Original languageEnglish
Title of host publicationIEEE RO-MAN'17: IEEE International Symposium on Robot and Human Interactive Communication, Lisbon, Portugal
ISBN (Electronic)978-1-5386-3518-6
ISBN (Print) 978-1-5386-3519-3
Publication statusE-pub ahead of print - 14 Dec 2017

Publication series

Name2017 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN)
ISSN (Electronic)1944-9437

Bibliographical note

© 2017 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.


Dive into the research topics of 'Automatic Detection of Human Interactions from RGB-D Data for Social Activity Classification'. Together they form a unique fingerprint.

Cite this