Natural Language Decompositions of Implicit Content Enable Better Text Representations

Alexander Hoyle, Rupak Sarkar, Pranav Goel, Philip Resnik


Abstract
When people interpret text, they rely on inferences that go beyond the observed language itself. Inspired by this observation, we introduce a method for the analysis of text that takes implicitly communicated content explicitly into account. We use a large language model to produce sets of propositions that are inferentially related to the text that has been observed, then validate the plausibility of the generated content via human judgments. Incorporating these explicit representations of implicit content proves useful in multiple problem settings that involve the human interpretation of utterances: assessing the similarity of arguments, making sense of a body of opinion data, and modeling legislative behavior. Our results suggest that modeling the meanings behind observed language, rather than the literal text alone, is a valuable direction for NLP and particularly its applications to social science.
Anthology ID:
2023.emnlp-main.815
Original:
2023.emnlp-main.815v1
Version 2:
2023.emnlp-main.815v2
Volume:
Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
Month:
December
Year:
2023
Address:
Singapore
Editors:
Houda Bouamor, Juan Pino, Kalika Bali
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
13188–13214
Language:
URL:
https://aclanthology.org/2023.emnlp-main.815
DOI:
10.18653/v1/2023.emnlp-main.815
Bibkey:
Cite (ACL):
Alexander Hoyle, Rupak Sarkar, Pranav Goel, and Philip Resnik. 2023. Natural Language Decompositions of Implicit Content Enable Better Text Representations. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 13188–13214, Singapore. Association for Computational Linguistics.
Cite (Informal):
Natural Language Decompositions of Implicit Content Enable Better Text Representations (Hoyle et al., EMNLP 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.emnlp-main.815.pdf
Video:
 https://aclanthology.org/2023.emnlp-main.815.mp4