Distinct neural mechanisms and temporal constraints govern a cascade of audiotactile interactions

Johanna M Zumer; Thomas P White; Uta Noppeney

doi:10.1101/446112

Distinct neural mechanisms and temporal constraints govern a cascade of audiotactile interactions

Johanna M Zumer, Thomas P White, Uta Noppeney

School of Psychology

Research output: Preprint or Working paper › Preprint

Abstract

Synchrony is a crucial cue indicating whether sensory signals are caused by single or independent sources. In order to be integrated and produce multisensory behavioural benefits, signals must co-occur within a temporal integration window (TIW). Yet, the underlying neural determinants and mechanisms of integration across asynchronies remain unclear. This psychophysics and electroencephalography study investigated the temporal constraints of behavioural response facilitation and neural interactions for evoked response potentials (ERP), inter-trial coherence (ITC), and time-frequency (TF) power. Participants were presented with noise bursts, ‘taps to the face’, and their audiotactile (AT) combinations at seven asynchronies: 0, ±20, ±70, and ±500 ms. Behaviourally we observed an inverted U-shape function for AT response facilitation, which was maximal for synchronous AT stimulation and declined within a ≤70 ms TIW. For ERPs, we observed AT interactions at 110 ms for near-synchronous stimuli within a ≤20 ms TIW and at 400 ms within a ≤70 ms TIW consistent with behavioural response facilitation. By contrast, AT interactions for theta ITC and ERPs at 200 ms post-stimulus were selective for ±70 ms asynchrony, potentially mediated via phase resetting. Finally, interactions for induced theta power and alpha/beta power rebound emerged at 800-1100 ms across several asynchronies including even 500 ms auditory leading asynchrony. In sum, we observed neural interactions that were confined to or extending beyond the behavioural TIW or specific for ±70 ms asynchrony. This diversity of temporal profiles and constraints demonstrates that multisensory integration unfolds in a cascade of interactions that are governed by distinct neural mechanisms.

Original language	English
DOIs	https://doi.org/10.1101/446112
Publication status	Published - 18 Oct 2018

Bibliographical note

The copyright holder for this preprint is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license.

Funding: FP7 ERC Starting Grant multsens (U.N.) and FP7 Marie Curie IntraEuropean Fellowship ISMINO (J.M.Z. and U.N.). We thank Christoph Braun and Elisa Leonardelli for assistance with the tactile device and Mate Aller for assistance with EEG and stimulus setup.

Access to Document

10.1101/446112Licence: CC BY-NC-ND 3.0

Distinct neural mechanisms and temporal constraints govern a cascade of audiotactile interactionsSubmitted manuscript, 3.11 MBLicence: CC BY-NC-ND 3.0

Cite this

@techreport{96e4b6ec314343f7a84064413520e0cc,

title = "Distinct neural mechanisms and temporal constraints govern a cascade of audiotactile interactions",

abstract = "Synchrony is a crucial cue indicating whether sensory signals are caused by single or independent sources. In order to be integrated and produce multisensory behavioural benefits, signals must co-occur within a temporal integration window (TIW). Yet, the underlying neural determinants and mechanisms of integration across asynchronies remain unclear. This psychophysics and electroencephalography study investigated the temporal constraints of behavioural response facilitation and neural interactions for evoked response potentials (ERP), inter-trial coherence (ITC), and time-frequency (TF) power. Participants were presented with noise bursts, {\textquoteleft}taps to the face{\textquoteright}, and their audiotactile (AT) combinations at seven asynchronies: 0, ±20, ±70, and ±500 ms. Behaviourally we observed an inverted U-shape function for AT response facilitation, which was maximal for synchronous AT stimulation and declined within a ≤70 ms TIW. For ERPs, we observed AT interactions at 110 ms for near-synchronous stimuli within a ≤20 ms TIW and at 400 ms within a ≤70 ms TIW consistent with behavioural response facilitation. By contrast, AT interactions for theta ITC and ERPs at 200 ms post-stimulus were selective for ±70 ms asynchrony, potentially mediated via phase resetting. Finally, interactions for induced theta power and alpha/beta power rebound emerged at 800-1100 ms across several asynchronies including even 500 ms auditory leading asynchrony. In sum, we observed neural interactions that were confined to or extending beyond the behavioural TIW or specific for ±70 ms asynchrony. This diversity of temporal profiles and constraints demonstrates that multisensory integration unfolds in a cascade of interactions that are governed by distinct neural mechanisms.",

author = "Zumer, {Johanna M} and White, {Thomas P} and Uta Noppeney",

note = "The copyright holder for this preprint is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license. Funding: FP7 ERC Starting Grant multsens (U.N.) and FP7 Marie Curie IntraEuropean Fellowship ISMINO (J.M.Z. and U.N.). We thank Christoph Braun and Elisa Leonardelli for assistance with the tactile device and Mate Aller for assistance with EEG and stimulus setup.",

year = "2018",

month = oct,

day = "18",

doi = "10.1101/446112",

language = "English",

type = "WorkingPaper",

}

TY - UNPB

T1 - Distinct neural mechanisms and temporal constraints govern a cascade of audiotactile interactions

AU - Zumer, Johanna M

AU - White, Thomas P

AU - Noppeney, Uta

N1 - The copyright holder for this preprint is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license. Funding: FP7 ERC Starting Grant multsens (U.N.) and FP7 Marie Curie IntraEuropean Fellowship ISMINO (J.M.Z. and U.N.). We thank Christoph Braun and Elisa Leonardelli for assistance with the tactile device and Mate Aller for assistance with EEG and stimulus setup.

PY - 2018/10/18

Y1 - 2018/10/18

N2 - Synchrony is a crucial cue indicating whether sensory signals are caused by single or independent sources. In order to be integrated and produce multisensory behavioural benefits, signals must co-occur within a temporal integration window (TIW). Yet, the underlying neural determinants and mechanisms of integration across asynchronies remain unclear. This psychophysics and electroencephalography study investigated the temporal constraints of behavioural response facilitation and neural interactions for evoked response potentials (ERP), inter-trial coherence (ITC), and time-frequency (TF) power. Participants were presented with noise bursts, ‘taps to the face’, and their audiotactile (AT) combinations at seven asynchronies: 0, ±20, ±70, and ±500 ms. Behaviourally we observed an inverted U-shape function for AT response facilitation, which was maximal for synchronous AT stimulation and declined within a ≤70 ms TIW. For ERPs, we observed AT interactions at 110 ms for near-synchronous stimuli within a ≤20 ms TIW and at 400 ms within a ≤70 ms TIW consistent with behavioural response facilitation. By contrast, AT interactions for theta ITC and ERPs at 200 ms post-stimulus were selective for ±70 ms asynchrony, potentially mediated via phase resetting. Finally, interactions for induced theta power and alpha/beta power rebound emerged at 800-1100 ms across several asynchronies including even 500 ms auditory leading asynchrony. In sum, we observed neural interactions that were confined to or extending beyond the behavioural TIW or specific for ±70 ms asynchrony. This diversity of temporal profiles and constraints demonstrates that multisensory integration unfolds in a cascade of interactions that are governed by distinct neural mechanisms.

AB - Synchrony is a crucial cue indicating whether sensory signals are caused by single or independent sources. In order to be integrated and produce multisensory behavioural benefits, signals must co-occur within a temporal integration window (TIW). Yet, the underlying neural determinants and mechanisms of integration across asynchronies remain unclear. This psychophysics and electroencephalography study investigated the temporal constraints of behavioural response facilitation and neural interactions for evoked response potentials (ERP), inter-trial coherence (ITC), and time-frequency (TF) power. Participants were presented with noise bursts, ‘taps to the face’, and their audiotactile (AT) combinations at seven asynchronies: 0, ±20, ±70, and ±500 ms. Behaviourally we observed an inverted U-shape function for AT response facilitation, which was maximal for synchronous AT stimulation and declined within a ≤70 ms TIW. For ERPs, we observed AT interactions at 110 ms for near-synchronous stimuli within a ≤20 ms TIW and at 400 ms within a ≤70 ms TIW consistent with behavioural response facilitation. By contrast, AT interactions for theta ITC and ERPs at 200 ms post-stimulus were selective for ±70 ms asynchrony, potentially mediated via phase resetting. Finally, interactions for induced theta power and alpha/beta power rebound emerged at 800-1100 ms across several asynchronies including even 500 ms auditory leading asynchrony. In sum, we observed neural interactions that were confined to or extending beyond the behavioural TIW or specific for ±70 ms asynchrony. This diversity of temporal profiles and constraints demonstrates that multisensory integration unfolds in a cascade of interactions that are governed by distinct neural mechanisms.

UR - https://www.biorxiv.org/content/10.1101/446112v1

U2 - 10.1101/446112

DO - 10.1101/446112

M3 - Preprint

BT - Distinct neural mechanisms and temporal constraints govern a cascade of audiotactile interactions

ER -

Distinct neural mechanisms and temporal constraints govern a cascade of audiotactile interactions

Abstract

Bibliographical note

Access to Document

Other files and links

Fingerprint

Cite this