Symbolic Planning and Code Generation for Grounded Dialogue

Justin Chiu, Wenting Zhao, Derek Chen, Saujas Vaduguru, Alexander Rush, Daniel Fried


Abstract
Large language models (LLMs) excel at processing and generating text and code. However, LLMs have had limited applicability in grounded task-oriented dialogue as they are difficult to steer toward task objectives and fail to handle novel grounding. We present a modular and interpretable grounded dialogue system that addresses these shortcomings by composing LLMs with a symbolic planner and grounded code execution. Our system, consists of a reader and planner: the reader leverages an LLM to convert partner utterances into executable code, calling functions that perform grounding. The translated code’s output is stored to track dialogue state, while a symbolic planner determines the next appropriate response. We evaluate our system’s performance on the demanding OneCommon dialogue task, involving collaborative reference resolution on abstract images of scattered dots. Our system substantially outperforms the previous state-of-the-art, including improving task success in human evaluations from 56% to 69% in the most challenging setting.
Anthology ID:
2023.emnlp-main.460
Volume:
Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
Month:
December
Year:
2023
Address:
Singapore
Editors:
Houda Bouamor, Juan Pino, Kalika Bali
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
7426–7436
Language:
URL:
https://aclanthology.org/2023.emnlp-main.460
DOI:
10.18653/v1/2023.emnlp-main.460
Bibkey:
Cite (ACL):
Justin Chiu, Wenting Zhao, Derek Chen, Saujas Vaduguru, Alexander Rush, and Daniel Fried. 2023. Symbolic Planning and Code Generation for Grounded Dialogue. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 7426–7436, Singapore. Association for Computational Linguistics.
Cite (Informal):
Symbolic Planning and Code Generation for Grounded Dialogue (Chiu et al., EMNLP 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.emnlp-main.460.pdf
Video:
 https://aclanthology.org/2023.emnlp-main.460.mp4