Managers of this collection (in alphabetical order):
Aleksandra Ćwiek (Leibniz-Centre General Linguistics, Berlin)
Susanne Fuchs (Leibniz-Centre General Linguistics, Berlin)
Šárka Kadavá (Leibniz-Centre General Linguistics, Berlin)
Wim Pouw (Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen)
(1) Production experiment of Polish native speakers producing counting-out rhymes
Download data from an external database (Open Science Framework):
https://osf.io/2abtd/
Size: 460 MB
Description:
Polish native speakers were asked to perform six Polish counting-out rhymes in different conditions. The counting-out game involves rhythmically uttering a rhyme while pointing at the other players of the game. It is typically played by children, for example by randomly choosing a person that will do something. An example of a counting-out rhyme in English is:
Eeny, meeny, miny, moe,
Catch a tiger by the toe.
If he hollers, let him go,
Eeny, meeny, miny, moe.
The experiment was a within-subjects design and involved a total of four movement- and one still condition. The movement conditions involved pointing with the left or the right hand at a self-paced “normal” speed, and an “enhanced” speed condition (i.e., four conditions in total: left-hand normal speed, left-hand fast speed, right-hand normal speed, right-hand fast speed). For the still condition, participants were asked to read the rhyme without any movement.
All participants were right-handed. Participants were unconstrained in their motion. They were asked to play the counting-out game with a teddy bear acting as another person with whom they were playing. The teddy bear was sitting on a chair about 1.5m away from the participant.
The movement of the participants was tracked with twelve Optitrack 13 motion capture cameras. Participants wore an Optitrack jacket, Optitrack gloves, and a headband with a total of 15 markers. An additional marker was placed at the nose of the teddy bear.
The study was designed to investigate speech-gesture coordination in a relatively natural setting. Motion conditions were varied to better understand their effect on speech. The data was originally collected by Katarzyna Stoltmann and Susanne Fuchs.
Sample from the motion data:
Sample from other associated data:
Meta information:
Participants
- Polish native speakers living in Berlin for no longer than 6 months (most of them were in Berlin for an Erasmus exchange)
- N = 11 (female = 8, male = 3)
- Age: 21-27 years, mean = 24.1
- All participants right-handed
- no self-reported speech, language, or hearing disorders
- [link to file]
Location and period data collection:
- Motion capture lab at Leibniz-Centre General Linguistics, Berlin (Schützenstraße 18, 10117 Berlin), 2017
Experiment
- CSV: randomization of conditions [link to file]
- CSV: marker description [link to file]
- CSV: description of the x, y, z coordinate system [link to file]
Data collection methods:
- Motion capture: Twelve Optitrack Prime 13 cameras, 200 Hz sampling rate; recorded with Motive Version 1.9.0
- Acoustic data (WAV format): 44.1 kHz recorded with a Sennheiser cardioid microphone
Original data type:
- Motion data: C3D files (200 MB)
- Acoustic data: WAV files (560 MB) (the original audio files cannot be shared due to the lack of consent)
Extended datatypes:
- CSV: converted C3D motion files (208 MB) [link to README file]
- TextGrids: annotated speech units, pauses (manual), syllables (automatic using WebMaus, manually checked, and adjusted if necessary) (5 MB) [link to README file]
Associated publications:
- Stoltmann, Katarzyna, & Fuchs, Susanne (2017). Syllable-pointing gesture coordination in Polish counting out rhymes: The effect of speech rate. Journal of Multimodal Communication Studies, 4(1-2), 63-68.
- Stoltmann, Katarzyna, & Fuchs, Susanne (2017). The influence of handedness and pointing direction on deictic gestures and speech interaction: Evidence from motion capture data on Polish counting-out rhymes. In Proceedings of AVSP (pp. 21-25).
- Kadavá, Šárka, Aleksandra Ćwiek, Katarzyna Stoltmann, Susanne Fuchs & Wim Pouw (accepted to ICPhS 2023). Is gesture-speech physics at work in rhythmic pointing? Evidence from Polish counting-out rhymes.
- Ćwiek, Aleksandra, Šárka Kadavá, Katarzyna Stoltmann, Wim Pouw & Susanne Fuchs (submitted to GESPIN 2023). When Gestures Enter the Game, Prosody Breaks the Rules.
Get access to this data set: The data set is fully open access under the CC-BY-4.0 license. By agreeing to the terms and conditions of the CC-BY-4.0 license, you agree to cite this dataset in any publications and presentations (also including DOIs).
Contact: Šárka Kadavá <kadava@leibniz-zas.de>