GESPIN 2023: Conference Program

Last update: September 14, 2023

Return to homepage

Please direct any questions about the schedule to Ezgi Mamus ()


Wednesday, Sept 13
08:50 -09:20 Registration
09:20 - 09:30 Opening Ceremony
09:30-10:30 Keynote 1Room: 163 (MPI)
Chair: Wim Pouw

The role of bones, joints and muscles for speech and gesture in interaction

Susanne Fuchs
10:30 - 10:50
Coffee Break
10:50 - 11:10 Oral Session 1Room: 163 (MPI)
Chair: Giulio Severijnen
When gestures enter the game, prosody breaks the rules
Aleksandra Ćwiek, Šárka Kadavá, Katarzyna Stoltmann, Wim Pouw and Susanne Fuchs
11:10 - 11:30 Pragmatic gestures and prosody
Gaëlle Ferré
11:30 - 11:50 Visual articulatory gestures guide audiovisual speech perception of lexical stress but only in noise
Ivy Mok, Ronny Bujok and Hans-Rutger Bosker
11:50 - 12:10 Refining the pragmatic synchrony rule: Interactions between prosody and gesture in the marking of discourse referents
Patrick Louis Rohrer and Pilar Prieto
12:10 - 13:30
Lunch BreakThe Refter (Erasmus Building)
13:30 - 13:50 Oral Session 2Room: 163 (MPI)
Chair: Luise Böttcher
Multimodal detection and classification of head movements in face-to-face conversations: Exploring models, features and their interaction
Manex Agirrezabal, Patrizia Paggio, Costanza Navarretta and Bart Jongejan
13:50 - 14:10 Phonetics of head nods in German Sign Language (DGS)
Anastasia Bauer, Anna Kuder and Marc Schulder
14:10 - 14:30 !CANCELLED! Gestural enhancement of degraded speech comprehension in Autism Spectrum Disorder
Sara Mazzini, Noor Seijdel and Linda Drijvers
14:30 - 14:50 Speaker gaze as a response mobilization cue in face-to-face conversation
Alexandra Emmendorfer and Judith Holler
14:50 - 16:10


Coffee Break and Poster Session 1MPI 1st and 2nd floors


16:10 - 16:30 Oral Session 3Room: 163 (MPI)
Chair: Ronny Bujok
Behavior Generation Model for Socially Interactive Agents
Mireille Fares, Nicolas Obin and Catherine Pelachaud
16:30 - 16:50 What do gestures reveal about the encoding of causality in Spanish?
Andrea Ariño-Bizarro, Asli Özyürek and Iraide Ibarretxe-Antuñano
16:50 - 17:10 Contextual factors driving co-speech gesture production: Insights from the ECOLANG corpus
Ed Donnellan, Yan Gu, Beata Grzyb and Gabriella Vigliocco
17:10 - 17:30 A summary of the GENEA Challenge 2022 on speech-to-gesture generation
Pieter Wolfert, Taras Kucherenko, Youngwoo Yoon, Teodor Nikolov, Mihail Tsakov and Gustav Eje Henter
18:00 - 20:00
Thursday, Sept 14
09:30-10:30 Keynote 2Room: 163 (MPI)
Chair: Asli Özyürek

Prosody as a key force in the development of the gesture-speech relationships

Núria Esteve-Gibert
10:30 - 10:50
Coffee Break
10:50 - 11:10 Oral Session 4Room: 163 (MPI)
Chair: Marlijn ter Bekke
The strong relevance of gestures for verbal language development in monolingual and bilingual children
Letizia Volpin, Robin Segerer and Katrin Skoruppa
11:10 - 11:30 Narrative structure scores in 7- to 9-year-old children are positively linked to fluent referential iconic gesture use and vocabulary knowledge
Ingrid Vilà-Giménez and Pilar Prieto
11:30 - 11:50 Do visual speech cues facilitate infants’ neural tracking of speech?
Melis Çetinçelik, Antonia Jordan, Caroline F. Rowland and Tineke M. Snijders
11:50 - 12:10 Bilinguals’ use of gestures when they are disfluent
Burcu Arslan, Can Avcı, Ali Yilmaztekin, Fatmanur Yılmaz, Mehmet Kaya and Tilbe Göksun
12:10 - 13:30
Lunch BreakThe Refter (Erasmus Building)
13:30 - 14:30 Keynote 3Room: 163 (MPI)
Chair: James Trujillo

Sweet songs and hot dances—mechanistic and evolutionary perspectives on multimodal signaling in non-human animals

Franz Goller
14:30 - 15:50


Coffee Break and Poster Session 2MPI 1st and 2nd floors


15:50 - 16:10 Oral Session 5Room: 163 (MPI)
Chair: Šárka Kadavá
A neurobiological perspective on the evolutionary origins of multimodal communication
Elizabeth Qing Zhang, Edward Ruoyang Shi and Michael Pleyer
16:10 - 16:30 Extra-linguistic cues in chimpanzees vocal communication
Chiara Zulberti, Joseph Mine, Gal Badihi, Simon Townsend and Catherine Hobaiter
16:30 - 16:50 Understanding the multimodal nature of deictic reference
Gozdem Arikan, Peter Boddy and Kenny Coventry
16:50 - 17:10 Perception and production of acoustical contrasts for pharyngeal fricatives in non-native learners: a training effect supported by embodied-based training
Marie Joe Kfoury, Axelle Calcus and Brigitte Charlier
18:30 - 21:30
Friday, Sept 15
09:30 - 10:30 Workshop 1Room: 236
Detecting and Analyzing Gesture-Speech Mismatches

Hedda Lausberg
Workshop 2Room: 163
The MultiDimensional annotation of co-speech gesture: The why and how of applying

Patrick Louis Rohrer
Workshop 3Room: 336
Red Hen Data and Tools

Cristóbal Pagán Cánovas, Peter Uhrig & Anna Wilson
10:30 - 11:00 Coffee Break
11:00 - 12:10

Workshop 1Room: 236
Detecting and Analyzing Gesture-Speech Mismatches

Hedda Lausberg




Workshop 2Room: 163
The MultiDimensional annotation of co-speech gesture: The why and how of applying

Patrick Louis Rohrer




Workshop 3Room: 336
Red Hen Data and Tools

Cristóbal Pagán Cánovas, Peter Uhrig & Anna Wilson



12:10 - 13:30
Lunch BreakThe Refter (Erasmus Building)
13:30 - 14:30 Keynote 4Room: 163 (MPI)
Chair: Judith Holler

Processing co-speech gestures: a neural perspective

Yifei He
14:30 - 14:50 Coffee Break
14:50 - 15:10 Oral Session 6Room: 163 (MPI)
Chair: Ezgi Mamus
Audience effects and production demands on timing relationships between representational gestures and speech
Ed Donnellan, Yumeng Wang, Levent Emir Özder, Hillarie Man, Kellie Fraser, Amara Jiménez Cañizares, Beata Grzyb, Yan Gu and Gabriella Vigliocco
15:10 - 15:30 Temporal overlap between gestures and speech in post-stroke aphasia: Is there a compensatory effect?
Han Zhang and Wolfram Hinzen
15:30 - 15:50 How communicative efficiency and speaker social cognitive ability shape silent gesture production
Jiahao Yang and Sotaro Kita
15:50 - 16:10 The correlation underlines multimodal communication: investigating the trade-off and communicative efficiency hypotheses
Yanran Zhang and Yan Gu
16:10 - 16:20 Closing Ceremony