Embodied interaction with complex neuronal data in mixed-reality

Alberto Betella*, Rodrigo Carvalho, Jesus Sanchez-Palencia, Ulysses Bernardet, Paul F.M.J. Verschure

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The study of natural and artificial phenomena generates massive amounts of data in many areas of research. This data is frequently left unused due to the lack of tools to effectively extract, analyze and understand it. Visual representation techniques can play a key role in helping to discover patterns and meaning within this data. Neuroscience is one of the scientific fields that generates the most extensive datasets. For this reason we built a 3D real-time visualization system to graphically represent the massive connectivity of neuronal network models in the eXperience Induction Machine (XIM). The XIM is an immersive space equipped with a number of sensors and effectors that we constructed to conduct experiments in mixed-reality. Using this infrastructure we developed an embodied interaction framework that allows the user to move freely in the space and navigate through the neuronal system. We conducted an empirical evaluation of the impact of different navigation mappings on the understanding of a neuronal dataset. Our results revealed that different navigation mappings affect the structural understanding of the system and the involvement with the data presented.

Original languageEnglish
Title of host publicationProceedings of the 2012 Virtual Reality International Conference, VRIC'12
PublisherACM
ISBN (Print)9781450312431
DOIs
Publication statusPublished - 28 Mar 2012
Event2012 Virtual Reality International Conference, VRIC'12 - Laval, France
Duration: 28 Mar 201230 Mar 2012

Conference

Conference2012 Virtual Reality International Conference, VRIC'12
CountryFrance
CityLaval
Period28/03/1230/03/12

Fingerprint

Navigation
Visualization
Sensors
Experiments

Keywords

  • complex datasets
  • embodied interaction
  • iqr
  • mixed-reality
  • navigation
  • neuronal networks
  • visualization
  • XIM

Cite this

Betella, A., Carvalho, R., Sanchez-Palencia, J., Bernardet, U., & Verschure, P. F. M. J. (2012). Embodied interaction with complex neuronal data in mixed-reality. In Proceedings of the 2012 Virtual Reality International Conference, VRIC'12 [3] ACM. https://doi.org/10.1145/2331714.2331718
Betella, Alberto ; Carvalho, Rodrigo ; Sanchez-Palencia, Jesus ; Bernardet, Ulysses ; Verschure, Paul F.M.J. / Embodied interaction with complex neuronal data in mixed-reality. Proceedings of the 2012 Virtual Reality International Conference, VRIC'12. ACM, 2012.
@inproceedings{601d26f62fff4931b801c751ee2274b1,
title = "Embodied interaction with complex neuronal data in mixed-reality",
abstract = "The study of natural and artificial phenomena generates massive amounts of data in many areas of research. This data is frequently left unused due to the lack of tools to effectively extract, analyze and understand it. Visual representation techniques can play a key role in helping to discover patterns and meaning within this data. Neuroscience is one of the scientific fields that generates the most extensive datasets. For this reason we built a 3D real-time visualization system to graphically represent the massive connectivity of neuronal network models in the eXperience Induction Machine (XIM). The XIM is an immersive space equipped with a number of sensors and effectors that we constructed to conduct experiments in mixed-reality. Using this infrastructure we developed an embodied interaction framework that allows the user to move freely in the space and navigate through the neuronal system. We conducted an empirical evaluation of the impact of different navigation mappings on the understanding of a neuronal dataset. Our results revealed that different navigation mappings affect the structural understanding of the system and the involvement with the data presented.",
keywords = "complex datasets, embodied interaction, iqr, mixed-reality, navigation, neuronal networks, visualization, XIM",
author = "Alberto Betella and Rodrigo Carvalho and Jesus Sanchez-Palencia and Ulysses Bernardet and Verschure, {Paul F.M.J.}",
year = "2012",
month = "3",
day = "28",
doi = "10.1145/2331714.2331718",
language = "English",
isbn = "9781450312431",
booktitle = "Proceedings of the 2012 Virtual Reality International Conference, VRIC'12",
publisher = "ACM",
address = "United States",

}

Betella, A, Carvalho, R, Sanchez-Palencia, J, Bernardet, U & Verschure, PFMJ 2012, Embodied interaction with complex neuronal data in mixed-reality. in Proceedings of the 2012 Virtual Reality International Conference, VRIC'12., 3, ACM, 2012 Virtual Reality International Conference, VRIC'12, Laval, France, 28/03/12. https://doi.org/10.1145/2331714.2331718

Embodied interaction with complex neuronal data in mixed-reality. / Betella, Alberto; Carvalho, Rodrigo; Sanchez-Palencia, Jesus; Bernardet, Ulysses; Verschure, Paul F.M.J.

Proceedings of the 2012 Virtual Reality International Conference, VRIC'12. ACM, 2012. 3.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Embodied interaction with complex neuronal data in mixed-reality

AU - Betella, Alberto

AU - Carvalho, Rodrigo

AU - Sanchez-Palencia, Jesus

AU - Bernardet, Ulysses

AU - Verschure, Paul F.M.J.

PY - 2012/3/28

Y1 - 2012/3/28

N2 - The study of natural and artificial phenomena generates massive amounts of data in many areas of research. This data is frequently left unused due to the lack of tools to effectively extract, analyze and understand it. Visual representation techniques can play a key role in helping to discover patterns and meaning within this data. Neuroscience is one of the scientific fields that generates the most extensive datasets. For this reason we built a 3D real-time visualization system to graphically represent the massive connectivity of neuronal network models in the eXperience Induction Machine (XIM). The XIM is an immersive space equipped with a number of sensors and effectors that we constructed to conduct experiments in mixed-reality. Using this infrastructure we developed an embodied interaction framework that allows the user to move freely in the space and navigate through the neuronal system. We conducted an empirical evaluation of the impact of different navigation mappings on the understanding of a neuronal dataset. Our results revealed that different navigation mappings affect the structural understanding of the system and the involvement with the data presented.

AB - The study of natural and artificial phenomena generates massive amounts of data in many areas of research. This data is frequently left unused due to the lack of tools to effectively extract, analyze and understand it. Visual representation techniques can play a key role in helping to discover patterns and meaning within this data. Neuroscience is one of the scientific fields that generates the most extensive datasets. For this reason we built a 3D real-time visualization system to graphically represent the massive connectivity of neuronal network models in the eXperience Induction Machine (XIM). The XIM is an immersive space equipped with a number of sensors and effectors that we constructed to conduct experiments in mixed-reality. Using this infrastructure we developed an embodied interaction framework that allows the user to move freely in the space and navigate through the neuronal system. We conducted an empirical evaluation of the impact of different navigation mappings on the understanding of a neuronal dataset. Our results revealed that different navigation mappings affect the structural understanding of the system and the involvement with the data presented.

KW - complex datasets

KW - embodied interaction

KW - iqr

KW - mixed-reality

KW - navigation

KW - neuronal networks

KW - visualization

KW - XIM

UR - http://www.scopus.com/inward/record.url?scp=84865009381&partnerID=8YFLogxK

UR - https://dl.acm.org/citation.cfm?doid=2331714.2331718

U2 - 10.1145/2331714.2331718

DO - 10.1145/2331714.2331718

M3 - Conference contribution

AN - SCOPUS:84865009381

SN - 9781450312431

BT - Proceedings of the 2012 Virtual Reality International Conference, VRIC'12

PB - ACM

ER -

Betella A, Carvalho R, Sanchez-Palencia J, Bernardet U, Verschure PFMJ. Embodied interaction with complex neuronal data in mixed-reality. In Proceedings of the 2012 Virtual Reality International Conference, VRIC'12. ACM. 2012. 3 https://doi.org/10.1145/2331714.2331718