Does Listener Gaze in Face-to-Face Interaction Follow the Entropy Rate Constancy Principle: An Empirical Study

Yu Wang, Hendrik Buschmeier


Abstract
It is generally assumed that language (written and spoken) follows the entropy rate constancy (ERC) principle, which states that the information density of a text is constant over time. Recently, this has also been found for nonverbal gestures used in monologue, but it is still unclear whether the ERC principle also applies to listeners’ nonverbal signals. We focus on listeners’ gaze behaviour extracted from video-recorded conversations and trained a transformer-based neural sequence model to process the gaze data of the dialogues and compute its information density. We also compute the information density of the corresponding speech using a pre-trained language model. Our results show (1) that listeners’ gaze behaviour in dialogues roughly follows the ERC principle, as well as (2) a congruence between information density of speech and listeners’ gaze behaviour.
Anthology ID:
2023.findings-emnlp.1026
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2023
Month:
December
Year:
2023
Address:
Singapore
Editors:
Houda Bouamor, Juan Pino, Kalika Bali
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
15372–15379
Language:
URL:
https://aclanthology.org/2023.findings-emnlp.1026
DOI:
10.18653/v1/2023.findings-emnlp.1026
Bibkey:
Cite (ACL):
Yu Wang and Hendrik Buschmeier. 2023. Does Listener Gaze in Face-to-Face Interaction Follow the Entropy Rate Constancy Principle: An Empirical Study. In Findings of the Association for Computational Linguistics: EMNLP 2023, pages 15372–15379, Singapore. Association for Computational Linguistics.
Cite (Informal):
Does Listener Gaze in Face-to-Face Interaction Follow the Entropy Rate Constancy Principle: An Empirical Study (Wang & Buschmeier, Findings 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.findings-emnlp.1026.pdf