Kodai Takahashi


2014

pdf bib
Multimodal dialogue segmentation with gesture post-processing
Kodai Takahashi | Masashi Inoue
Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14)

We investigate an automatic dialogue segmentation method using both verbal and non-verbal modalities. Dialogue contents are used for the initial segmentation of dialogue; then, gesture occurrences are used to remove the incorrect segment boundaries. A unique characteristic of our method is to use verbal and non-verbal information separately. We use a three-party dialogue that is rich in gesture as data. The transcription of the dialogue is segmented into topics without prior training by using the TextTiling and U00 algorithm. Some candidates for segment boundaries - where the topic continues - are irrelevant. Those boundaries can be found and removed by locating gestures that stretch over the boundary candidates. This ltering improves the segmentation accuracy of text-only segmentation.
Search
Co-authors
Venues