Uni- and multisensory brain areas are synchronised across spectators when watching unedited dance recordings

Corinne Jola, Phil McAleer, Marie-Hélène Grosbras, Scott A. Love, Gordon Morison, Frank E. Pollick

Research output: Contribution to journalArticle

25 Citations (Scopus)
15 Downloads (Pure)

Abstract

The superior temporal sulcus (STS) and gyrus (STG) are commonly identified to be functionally relevant for multisensory integration of audiovisual (AV) stimuli. However, most neuroimaging studies on AV integration used stimuli of short duration in explicit evaluative tasks. Importantly though, many of our AV experiences are of a long duration and ambiguous. It is unclear if the enhanced activity in audio, visual, and AV brain areas would also be synchronised over time across subjects when they are exposed to such multisensory stimuli. We used intersubject correlation to investigate which brain areas are synchronised across novices for uni- and multisensory versions of a 6-min 26-s recording of an unfamiliar, unedited Indian dance recording (Bharatanatyam). In Bharatanatyam, music and dance are choreographed together in a highly intermodal-dependent manner. Activity in the middle and posterior STG was significantly correlated between subjects and showed also significant enhancement for AV integration when the functional magnetic resonance signals were contrasted against each other using a general linear model conjunction analysis. These results extend previous studies by showing an intermediate step of synchronisation for novices: while there was a consensus across subjects’ brain activity in areas relevant for unisensory processing and AV integration of related audio and visual stimuli, we found no evidence for synchronisation of higher level cognitive processes, suggesting these were idiosyncratic.
Original languageEnglish
Pages (from-to)265-284
Number of pages20
Journali-Perception
Volume4
Issue number4
Early online date1 Jan 2013
DOIs
Publication statusPublished - 1 Jun 2013

Fingerprint

Brain
Temporal Lobe
Synchronization
Music
Neuroimaging
Linear Models
Magnetic Resonance Spectroscopy
Magnetic resonance
Processing

Cite this

Jola, Corinne ; McAleer, Phil ; Grosbras, Marie-Hélène ; Love, Scott A. ; Morison, Gordon ; Pollick, Frank E. / Uni- and multisensory brain areas are synchronised across spectators when watching unedited dance recordings. In: i-Perception. 2013 ; Vol. 4, No. 4. pp. 265-284.
@article{46df18068884488db5f176b4ecb5ce8a,
title = "Uni- and multisensory brain areas are synchronised across spectators when watching unedited dance recordings",
abstract = "The superior temporal sulcus (STS) and gyrus (STG) are commonly identified to be functionally relevant for multisensory integration of audiovisual (AV) stimuli. However, most neuroimaging studies on AV integration used stimuli of short duration in explicit evaluative tasks. Importantly though, many of our AV experiences are of a long duration and ambiguous. It is unclear if the enhanced activity in audio, visual, and AV brain areas would also be synchronised over time across subjects when they are exposed to such multisensory stimuli. We used intersubject correlation to investigate which brain areas are synchronised across novices for uni- and multisensory versions of a 6-min 26-s recording of an unfamiliar, unedited Indian dance recording (Bharatanatyam). In Bharatanatyam, music and dance are choreographed together in a highly intermodal-dependent manner. Activity in the middle and posterior STG was significantly correlated between subjects and showed also significant enhancement for AV integration when the functional magnetic resonance signals were contrasted against each other using a general linear model conjunction analysis. These results extend previous studies by showing an intermediate step of synchronisation for novices: while there was a consensus across subjects’ brain activity in areas relevant for unisensory processing and AV integration of related audio and visual stimuli, we found no evidence for synchronisation of higher level cognitive processes, suggesting these were idiosyncratic.",
author = "Corinne Jola and Phil McAleer and Marie-H{\'e}l{\`e}ne Grosbras and Love, {Scott A.} and Gordon Morison and Pollick, {Frank E.}",
year = "2013",
month = "6",
day = "1",
doi = "10.1068/i0536",
language = "English",
volume = "4",
pages = "265--284",
journal = "i-Perception",
issn = "2041-6695",
publisher = "Pion Ltd.",
number = "4",

}

Jola, C, McAleer, P, Grosbras, M-H, Love, SA, Morison, G & Pollick, FE 2013, 'Uni- and multisensory brain areas are synchronised across spectators when watching unedited dance recordings', i-Perception, vol. 4, no. 4, pp. 265-284. https://doi.org/10.1068/i0536

Uni- and multisensory brain areas are synchronised across spectators when watching unedited dance recordings. / Jola, Corinne; McAleer, Phil; Grosbras, Marie-Hélène; Love, Scott A.; Morison, Gordon; Pollick, Frank E.

In: i-Perception, Vol. 4, No. 4, 01.06.2013, p. 265-284.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Uni- and multisensory brain areas are synchronised across spectators when watching unedited dance recordings

AU - Jola, Corinne

AU - McAleer, Phil

AU - Grosbras, Marie-Hélène

AU - Love, Scott A.

AU - Morison, Gordon

AU - Pollick, Frank E.

PY - 2013/6/1

Y1 - 2013/6/1

N2 - The superior temporal sulcus (STS) and gyrus (STG) are commonly identified to be functionally relevant for multisensory integration of audiovisual (AV) stimuli. However, most neuroimaging studies on AV integration used stimuli of short duration in explicit evaluative tasks. Importantly though, many of our AV experiences are of a long duration and ambiguous. It is unclear if the enhanced activity in audio, visual, and AV brain areas would also be synchronised over time across subjects when they are exposed to such multisensory stimuli. We used intersubject correlation to investigate which brain areas are synchronised across novices for uni- and multisensory versions of a 6-min 26-s recording of an unfamiliar, unedited Indian dance recording (Bharatanatyam). In Bharatanatyam, music and dance are choreographed together in a highly intermodal-dependent manner. Activity in the middle and posterior STG was significantly correlated between subjects and showed also significant enhancement for AV integration when the functional magnetic resonance signals were contrasted against each other using a general linear model conjunction analysis. These results extend previous studies by showing an intermediate step of synchronisation for novices: while there was a consensus across subjects’ brain activity in areas relevant for unisensory processing and AV integration of related audio and visual stimuli, we found no evidence for synchronisation of higher level cognitive processes, suggesting these were idiosyncratic.

AB - The superior temporal sulcus (STS) and gyrus (STG) are commonly identified to be functionally relevant for multisensory integration of audiovisual (AV) stimuli. However, most neuroimaging studies on AV integration used stimuli of short duration in explicit evaluative tasks. Importantly though, many of our AV experiences are of a long duration and ambiguous. It is unclear if the enhanced activity in audio, visual, and AV brain areas would also be synchronised over time across subjects when they are exposed to such multisensory stimuli. We used intersubject correlation to investigate which brain areas are synchronised across novices for uni- and multisensory versions of a 6-min 26-s recording of an unfamiliar, unedited Indian dance recording (Bharatanatyam). In Bharatanatyam, music and dance are choreographed together in a highly intermodal-dependent manner. Activity in the middle and posterior STG was significantly correlated between subjects and showed also significant enhancement for AV integration when the functional magnetic resonance signals were contrasted against each other using a general linear model conjunction analysis. These results extend previous studies by showing an intermediate step of synchronisation for novices: while there was a consensus across subjects’ brain activity in areas relevant for unisensory processing and AV integration of related audio and visual stimuli, we found no evidence for synchronisation of higher level cognitive processes, suggesting these were idiosyncratic.

U2 - 10.1068/i0536

DO - 10.1068/i0536

M3 - Article

VL - 4

SP - 265

EP - 284

JO - i-Perception

JF - i-Perception

SN - 2041-6695

IS - 4

ER -