Semantically-Informed Regressive Encoder Score

Vasiliy Viskov, George Kokush, Daniil Larionov, Steffen Eger, Alexander Panchenko


Abstract
Machine translation is natural language generation (NLG) problem of translating source text from one language to another. As every task in machine learning domain it requires to have evaluation metric. The most obvious one is human evaluation but it is expensive in case of money and time consumption. In last years with appearing of pretrained transformer architectures and large language models (LLMs) state-of-the-art results in automatic machine translation evaluation got a huge quality step in terms of correlation with expert assessment. We introduce MRE-Score, seMantically-informed Regression Encoder Score, the approach with constructing automatic machine translation evaluation system based on regression encoder and contrastive pretraining for downstream problem.
Anthology ID:
2023.wmt-1.69
Volume:
Proceedings of the Eighth Conference on Machine Translation
Month:
December
Year:
2023
Address:
Singapore
Editors:
Philipp Koehn, Barry Haddow, Tom Kocmi, Christof Monz
Venue:
WMT
SIG:
SIGMT
Publisher:
Association for Computational Linguistics
Note:
Pages:
815–821
Language:
URL:
https://aclanthology.org/2023.wmt-1.69
DOI:
10.18653/v1/2023.wmt-1.69
Bibkey:
Cite (ACL):
Vasiliy Viskov, George Kokush, Daniil Larionov, Steffen Eger, and Alexander Panchenko. 2023. Semantically-Informed Regressive Encoder Score. In Proceedings of the Eighth Conference on Machine Translation, pages 815–821, Singapore. Association for Computational Linguistics.
Cite (Informal):
Semantically-Informed Regressive Encoder Score (Viskov et al., WMT 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.wmt-1.69.pdf