Data from Project “On the FLExibility and Stability of gesture-speecH coordination (FLESH): Evidence from production, comprehension, and imitation”

Managers of this collection (in alphabetical order):
Aleksandra Ćwiek (Leibniz-Centre General Linguistics, Berlin)
Susanne Fuchs (Leibniz-Centre General Linguistics, Berlin)
Šárka Kadavá (Leibniz-Centre General Linguistics, Berlin)
Wim Pouw (Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen)

(1) Production experiment of Polish native speakers producing counting-out rhymes

Download data from an external database (Open Science Framework):

Size:  460 MB


Polish native speakers were asked to perform six Polish counting-out rhymes in different conditions. The counting-out game involves rhythmically uttering a rhyme while pointing at the other players of the game. It is typically played by children, for example by randomly choosing a person that will do something. An example of a counting-out rhyme in English is:

Eeny, meeny, miny, moe,
Catch a tiger by the toe.
If he hollers, let him go,
Eeny, meeny, miny, moe.

The experiment was a within-subjects design and involved a total of four movement- and one still condition. The movement conditions involved pointing with the left or the right hand at a self-paced “normal” speed, and an “enhanced” speed condition (i.e., four conditions in total: left-hand normal speed, left-hand fast speed, right-hand normal speed, right-hand fast speed). For the still condition, participants were asked to read the rhyme without any movement. 

All participants were right-handed. Participants were unconstrained in their motion. They were asked to play the counting-out game with a teddy bear acting as another person with whom they were playing. The teddy bear was sitting on a chair about 1.5m away from the participant. 

The movement of the participants was tracked with twelve Optitrack 13 motion capture cameras. Participants wore an Optitrack jacket, Optitrack gloves, and a headband with a total of 15 markers. An additional marker was placed at the nose of the teddy bear.

The study was designed to investigate speech-gesture coordination in a relatively natural setting. Motion conditions were varied to better understand their effect on speech. The data was originally collected by Katarzyna Stoltmann and Susanne Fuchs.

Sample from the motion data:

Sample from other associated data:


Meta information:


  • Polish native speakers living in Berlin for no longer than 6 months (most of them were in Berlin for an Erasmus exchange)
  • N = 11 (female = 8, male = 3)
  • Age: 21-27 years, mean = 24.1
  • All participants right-handed
  • no self-reported speech, language, or hearing disorders
  • [link to file]

Location and period data collection:

  • Motion capture lab at Leibniz-Centre General Linguistics, Berlin (Schützenstraße 18, 10117 Berlin), 2017


Data collection methods: 

  • Motion capture: Twelve Optitrack Prime 13 cameras, 200 Hz sampling rate; recorded with  Motive Version 1.9.0
  • Acoustic data (WAV format): 44.1 kHz recorded with a Sennheiser cardioid microphone

Original data type: 

  • Motion data: C3D files (200 MB)
  • Acoustic data: WAV files (560 MB) (the original audio files cannot be shared due to the lack of consent)

Extended datatypes:

  • CSV: converted C3D motion files (208 MB) [link to README file]
  • TextGrids: annotated speech units, pauses (manual), syllables (automatic using WebMaus, manually checked, and adjusted if necessary) (5 MB)  [link to README file]

Associated publications:

  • Kadavá, Šárka, Aleksandra Ćwiek, Katarzyna Stoltmann, Susanne Fuchs & Wim Pouw (accepted to ICPhS 2023). Is gesture-speech physics at work in rhythmic pointing? Evidence from Polish counting-out rhymes.
  • Ćwiek, Aleksandra, Šárka Kadavá, Katarzyna Stoltmann, Wim Pouw & Susanne Fuchs (submitted to GESPIN 2023). When Gestures Enter the Game, Prosody Breaks the Rules.

Get access to this data set: The data set is fully open access under the CC-BY-4.0 license. By agreeing to the terms and conditions of the CC-BY-4.0 license, you agree to cite this dataset in any publications and presentations (also including DOIs).

Contact: Šárka Kadavá <>