Authors: Aleksandra Ćwiek (ZAS), Šárka Kadavá (ZAS), Susanne Fuchs (ZAS), Wim Pouw (Donders & MPI) – DOI: 10.000/xxxxx
(1) Production experiment of adults producing novel gestures and vocalizations
Download data from external database: https://data.donders.ru.nl
Description: Production experiment of adults producing novel gestures and vocalizations. Having selected 45 concepts (15 for each modality, as assessed in Experiment 1a), we recorded the natural statistics of concepts realized as gestures only, vocalizations only, and gesture-vocal utterances (see ‘sample from the data’ below). In a block design, the participants had the task of producing 15 concepts with gestures only, 15 concepts with vocalizations, and 15 concepts multimodally. A between-subject design was used to avoid spillover effects, i.e. none of the concepts was repeated by the same participant. Concepts were assigned randomly to participants. The recorded audio and video data was used to examine the natural statistics of acoustic and gesture characteristics in unimodal conditions compared to multimodal productions.
Sample from the audiovisual data:
– EMBEDDED VIDEO OF THE SAMPLE DATA –
Sample from other ther associated data: Motion tracking (link to CSV), Gesture annotations (link to ELAN file)
Population: N = 40 (w = 20, non-binary = 2), age 18-65, normal-hearing and normal-seeing
Original data type: MP4 (20 hours of video; 20 GB), WAV (20 hours of audio; 2 GB)
Extended datatypes:
Patrick Louis Rohrer, Ingrid Vilà-Giménez, Júlia Florit-Pons, Núria Esteve-Gibert, Ada Ren, Stefanie Shattuck-Hufnagel & Pilar Prieto: MultiModal MultiDimensional (M3D) annotation.
Šárka Kadavá, Patrick Louis Rohrer & Wim Pouw: Motion tracking (MediaPipe) + summary dataset of kinematic features of M3D gestures.
Associated publications:
Kadavá, Š., Ćwiek, A., Fuchs, S., & Pouw, W. (2023): Gesture and speech alignment in novel signals. Cognitive Science.
Roher, P., Prieto, P., Kügler, F., Kadavá, Š., & Ćwiek, A. (2023): Can we rely on automatic gesture measures? A comparison of form analysis between video-based motion tracking and M3D. Gesture.
DOI: 10.000/yyyy
DOI: 10.000/zzzz
DOI: 10.000/aaaa
DOI: 10.000/bbbb
Get access to this data set: The data set is fully open access under the CC-BY-4.0 license. By agreeing to the terms and condition of the CC-BY-4.0 license, you agree to citing this dataset in any publications and presentations (also including DOIs).
Contact: data-network@vicom.info
(2) Perception experiment of adults’ comprehension of novel gestures and vocalizations
Download data from external database: https://data.donders.ru.nl
Description: Perception experiment of adults’ comprehension of novel gestures and vocalizations. Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum.
Population: N = 234 (f = 102, non-binary = 17), age 18-65
Original datatype: CSV (12 MB)
Sample from the CSV table:
– EMBEDDED SAMPLE OF CSV –
Extended datatypes:
No extended datatypes yet.
Associated publications:
No associated publications yet.
Get access to this data set: The data set is embargoed until March 24, 2023. After that date, it will be fully open access under the CC-BY-4.0 license. By agreeing to the terms and conditions of the CC-BY-4.0 license, you agree to citing this dataset in any publications and presentations (also including DOIs).
Contact: data-network@vicom.info