November 16—18, 2022
Forschungskolleg Humanwissenschaften
Am Wingertsberg 4, 61348 Bad Homburg vor der Höhe
The languages of the workshop were English and ASL/IS. Interpretation between English and ASL/IS was provided.
Plenary presentation
After the Multimodal Revolution
by Philippe Schlenker (Institut Jean-Nicod, CNRS; New York University)
Abstract: The ViCom project is one of the most striking results of a recent ‘multimodal revolution’ in linguistics: sign languages on the one hand and gestures on the other are now getting integrated to all aspects of linguistic research. I’ll discuss three challenges for this program. One pertains to the theoretical integration of iconic and logical phenomena in language. In particular, can explicit Logical Forms be offered that combine a logical and an iconic component? The second challenge pertains to the sign/gesture connection. Goldin-Meadow and Brentari 2017 famously argued that sign with iconicity should be compared to speech with gestures rather than to speech alone. Some commonalities between signs and gestures are definitely due to iconicity, but others (e.g. pointing) might have a grammatical source. A full understanding of these commonalities has yet to be obtained. The third challenge pertains to the situation of gestures within language: are they fully integrated by virtue of being ‘first class citizens of the linguistic world’, or does language have a productive way to integrate diverse visual forms, including non-linguistic ones such as pictures and visual animations?
Workshop on legal issues
by Pawel Kamocki (IDS Mannheim)
Abstract: Visual communication data are affected by numerous legal issues, ranging from intellectual property rights to personal data protection. Collecting, managing and sharing such data requires some understanding of the key concepts of copyright and related rights, the GDPR, as well as FAIR and Open Science standards. Acquiring such knowledge is not an easy task, given that the relevant fields of law are constantly evolving to adapt to technological developments and user expectations. The workshop will provide an introduction to legal issues affecting visual communication data in the European Union, taking into account recent and upcoming law reforms. The speaker is a researcher trained in both IT law and linguistics, and has over a decade of experience with handling legal issues in language data.
Workshop on the ViCom data network organized
by Aleksandra Ćwiek, Susanne Fuchs & Wim Pouw (ViCom FLESH project)
Abstract: The need for and importance of open science principles has been particularly increasing over the course of last years. Open science practices are open access to research output, computational reproducibility of research, and the sharing of data as much as possible. In this session, we want to familiarize you with our ideas for the creation of an OA audiovisual database. ViCom is undoubtedly a data-rich priority programme that provides a unique opportunity of collecting in one place a multitude of data types with various methodological backgrounds. The ViCom consortium also harbors a great deal of intellectual capital that could enrich datasets collected by individual projects through collaboration between projects. An open database will allow for safely sharing data, having protocols in place to be “as open as possible as closed as necessary,” and it would allow a fertile ground to forge a collaborative network within ViCom. Furthermore, it ensures that the resources invested in ViCom projects will yield maximal utility, as our data, scripts, and annotation methods can be reused within and outside ViCom for many years to come. During our session, we would like to pitch to you a general idea for this database, including a proposal of the infrastructure. We would like to encourage a discussion of possible challenges that may be unique to a particular subfield and how we could overcome them together, for example by showing you some tools for data anonymization. Most importantly we would like to provide an infrastructure that will foster collaborative science and inspire you to collaborate on creating this database
Report on ViCom’s kickoff meeting, November 2022
From November 16th to 18th, the first annual ViCom meeting kicked off our Priority Program, ViCom. Set at the Forschungskolleg Humanwissenschaften in Bad Homburg, the meeting started with a brief introduction of the new priority program by the two coordinators, Cornelia Ebert and Markus Steinbach, and welcome notes by Prof. Matthias Lutz-Bachmann (Director of the Forschungskolleg Humanwissenschaften), Ulrich Schielein (CIO Goethe University), Prof. Rembert Hüser (Dean of the Faculty of Modern Languages) and Dr. Helga Weyerts-Schweda (Program Director of the German Research Foundation, DFG). Afterwards, all 19 projects presented their research topics and methodologies. The pretty long day was ceremoniously concluded with a reception at the Forschungskolleg, which offered the opportunity to continue the discussion in an informal setting. At the end of the day, all participants walked away with the impression that ViCom offers an enormous breadth of topics, and an impressive line-up of projects.
The second day started with a plenary presentation of ViCom measures implemented to support collaboration and exchange.
Afterwards, the project members split up into working groups tackling various aspects of the priority program. At the end of constructive discussions in the working groups, not only did we know what people are planning to do in the first phase – but, in addition, we had already developed a good idea as to how to proceed and support each other to reach common goals. The second day was concluded with an inspiring plenary presentation on the multimodal revolution in linguistics, given by our first Mercator Fellow, Philippe Schlenker.
Two more workshops were scheduled for the third day. While the first workshop discussed legal issues related to multimodal data, the second workshop introduced the ViCom Data Network and ethical aspects of empirical studies in the field of visual communication. Furthermore, the constitutive meeting of ViCom’s steering committee took place. The members of the steering committee discussed, among other things, how the central project can support ViCom projects to cooperate across the distances between our cities, to apply for funding for workshops, to apply for funding relating to gender, family, and mental health issues and to present their results in a uniform way, to sharpen ViCom’s profile.
We thank the Forschungskolleg Humanwissenschaften for their kind support.