The Effects of Explicit and Implicit Interaction on User Experiences in a Mixed Reality Installation: The Synthetic Oracle

Sergi Bermúdez I Badia, Aleksander Valjamae, Fabio Manzi, Ulysses Bernardet, Anna Mura, Jônatas Manzolli, Paul F. M. J Verschure

Research output: Contribution to journalArticle

Abstract

Virtual and mixed reality environments (VMRE) often imply full-body human-computer interaction scenarios. We used a public multimodal mixed reality installation, the Synthetic Oracle, and a between-groups design to study the effects of implicit (e.g., passively walking) or explicit (e.g., pointing) interaction modes on the users' emotional and engagement experiences, and we assessed it using questionnaires. Additionally, real-time arm motion data was used to categorize the user behavior and to provide interaction possibilities for the explicit interaction group. The results show that the online behavior classification corresponded well to the users' interaction mode. In addition, contrary to the explicit interaction, the engagement ratings from implicit users were positively correlated with a valence but were uncorrelated with arousal ratings. Interestingly, arousal levels were correlated with different behaviors displayed by the visitors depending on the interaction mode. Hence, this study confirms that the activity level and behavior of users modulates their experience, and that in turn, the interaction mode modulates their behavior. Thus, these results show the importance of the selected interaction mode when designing users' experiences in VMRE.
Original languageEnglish
Pages (from-to)277-285
JournalPresence: Teleoperators and Virtual Environments
Volume18
Issue number4
DOIs
Publication statusPublished - 1 Aug 2009

Fingerprint

Human computer interaction

Bibliographical note

© 2009 by the Massachusetts Institute of Technology

Cite this

Badia, S. B. I., Valjamae, A., Manzi, F., Bernardet, U., Mura, A., Manzolli, J., & Verschure, P. F. M. J. (2009). The Effects of Explicit and Implicit Interaction on User Experiences in a Mixed Reality Installation: The Synthetic Oracle. Presence: Teleoperators and Virtual Environments, 18(4), 277-285. https://doi.org/10.1162/pres.18.4.277
Badia, Sergi Bermúdez I ; Valjamae, Aleksander ; Manzi, Fabio ; Bernardet, Ulysses ; Mura, Anna ; Manzolli, Jônatas ; Verschure, Paul F. M. J. / The Effects of Explicit and Implicit Interaction on User Experiences in a Mixed Reality Installation: The Synthetic Oracle. In: Presence: Teleoperators and Virtual Environments. 2009 ; Vol. 18, No. 4. pp. 277-285.
@article{65e7aa7952b644adb8d6da5fadf7570c,
title = "The Effects of Explicit and Implicit Interaction on User Experiences in a Mixed Reality Installation: The Synthetic Oracle",
abstract = "Virtual and mixed reality environments (VMRE) often imply full-body human-computer interaction scenarios. We used a public multimodal mixed reality installation, the Synthetic Oracle, and a between-groups design to study the effects of implicit (e.g., passively walking) or explicit (e.g., pointing) interaction modes on the users' emotional and engagement experiences, and we assessed it using questionnaires. Additionally, real-time arm motion data was used to categorize the user behavior and to provide interaction possibilities for the explicit interaction group. The results show that the online behavior classification corresponded well to the users' interaction mode. In addition, contrary to the explicit interaction, the engagement ratings from implicit users were positively correlated with a valence but were uncorrelated with arousal ratings. Interestingly, arousal levels were correlated with different behaviors displayed by the visitors depending on the interaction mode. Hence, this study confirms that the activity level and behavior of users modulates their experience, and that in turn, the interaction mode modulates their behavior. Thus, these results show the importance of the selected interaction mode when designing users' experiences in VMRE.",
author = "Badia, {Sergi Berm{\'u}dez I} and Aleksander Valjamae and Fabio Manzi and Ulysses Bernardet and Anna Mura and J{\^o}natas Manzolli and Verschure, {Paul F. M. J}",
note = "{\circledC} 2009 by the Massachusetts Institute of Technology",
year = "2009",
month = "8",
day = "1",
doi = "10.1162/pres.18.4.277",
language = "English",
volume = "18",
pages = "277--285",
number = "4",

}

Badia, SBI, Valjamae, A, Manzi, F, Bernardet, U, Mura, A, Manzolli, J & Verschure, PFMJ 2009, 'The Effects of Explicit and Implicit Interaction on User Experiences in a Mixed Reality Installation: The Synthetic Oracle', Presence: Teleoperators and Virtual Environments, vol. 18, no. 4, pp. 277-285. https://doi.org/10.1162/pres.18.4.277

The Effects of Explicit and Implicit Interaction on User Experiences in a Mixed Reality Installation: The Synthetic Oracle. / Badia, Sergi Bermúdez I; Valjamae, Aleksander; Manzi, Fabio; Bernardet, Ulysses; Mura, Anna; Manzolli, Jônatas; Verschure, Paul F. M. J.

In: Presence: Teleoperators and Virtual Environments, Vol. 18, No. 4, 01.08.2009, p. 277-285.

Research output: Contribution to journalArticle

TY - JOUR

T1 - The Effects of Explicit and Implicit Interaction on User Experiences in a Mixed Reality Installation: The Synthetic Oracle

AU - Badia, Sergi Bermúdez I

AU - Valjamae, Aleksander

AU - Manzi, Fabio

AU - Bernardet, Ulysses

AU - Mura, Anna

AU - Manzolli, Jônatas

AU - Verschure, Paul F. M. J

N1 - © 2009 by the Massachusetts Institute of Technology

PY - 2009/8/1

Y1 - 2009/8/1

N2 - Virtual and mixed reality environments (VMRE) often imply full-body human-computer interaction scenarios. We used a public multimodal mixed reality installation, the Synthetic Oracle, and a between-groups design to study the effects of implicit (e.g., passively walking) or explicit (e.g., pointing) interaction modes on the users' emotional and engagement experiences, and we assessed it using questionnaires. Additionally, real-time arm motion data was used to categorize the user behavior and to provide interaction possibilities for the explicit interaction group. The results show that the online behavior classification corresponded well to the users' interaction mode. In addition, contrary to the explicit interaction, the engagement ratings from implicit users were positively correlated with a valence but were uncorrelated with arousal ratings. Interestingly, arousal levels were correlated with different behaviors displayed by the visitors depending on the interaction mode. Hence, this study confirms that the activity level and behavior of users modulates their experience, and that in turn, the interaction mode modulates their behavior. Thus, these results show the importance of the selected interaction mode when designing users' experiences in VMRE.

AB - Virtual and mixed reality environments (VMRE) often imply full-body human-computer interaction scenarios. We used a public multimodal mixed reality installation, the Synthetic Oracle, and a between-groups design to study the effects of implicit (e.g., passively walking) or explicit (e.g., pointing) interaction modes on the users' emotional and engagement experiences, and we assessed it using questionnaires. Additionally, real-time arm motion data was used to categorize the user behavior and to provide interaction possibilities for the explicit interaction group. The results show that the online behavior classification corresponded well to the users' interaction mode. In addition, contrary to the explicit interaction, the engagement ratings from implicit users were positively correlated with a valence but were uncorrelated with arousal ratings. Interestingly, arousal levels were correlated with different behaviors displayed by the visitors depending on the interaction mode. Hence, this study confirms that the activity level and behavior of users modulates their experience, and that in turn, the interaction mode modulates their behavior. Thus, these results show the importance of the selected interaction mode when designing users' experiences in VMRE.

UR - https://www.mitpressjournals.org/doi/abs/10.1162/pres.18.4.277

U2 - 10.1162/pres.18.4.277

DO - 10.1162/pres.18.4.277

M3 - Article

VL - 18

SP - 277

EP - 285

IS - 4

ER -

Badia SBI, Valjamae A, Manzi F, Bernardet U, Mura A, Manzolli J et al. The Effects of Explicit and Implicit Interaction on User Experiences in a Mixed Reality Installation: The Synthetic Oracle. Presence: Teleoperators and Virtual Environments. 2009 Aug 1;18(4):277-285. https://doi.org/10.1162/pres.18.4.277