Loading...
Machine Translation in the Era of Large Language Models: A Survey of Historical and Emerging Problems
Ataman, Duygu Birch, Alexandra Habash, Nizar Federico, Marcello Koehn, Philipp Cho, Kyunghyun
Ataman, Duygu
Birch, Alexandra
Habash, Nizar
Federico, Marcello
Koehn, Philipp
Cho, Kyunghyun
Supervisor
Department
Natural Language Processing
Embargo End Date
Type
Journal article
Date
2025
License
Language
English
Collections
Research Projects
Organizational Units
Journal Issue
Abstract
Historically regarded as one of the most challenging tasks presented to achieve complete artificial intelligence (AI), machine translation (MT) research has seen continuous devotion over the past decade, resulting in cutting-edge architectures for the modeling of sequential information. While the majority of statistical models traditionally relied on the idea of learning from parallel translation examples, recent research exploring self-supervised and multi-task learning methods extended the capabilities of MT models, eventually allowing the creation of general-purpose large language models (LLMs). In addition to versatility in providing translations useful across languages and domains, LLMs can in principle perform any natural language processing (NLP) task given sufficient amount of task-specific examples. While LLMs now reach a point where they can both replace and augment traditional MT models, the extent of their advantages and the ways in which they leverage translation capabilities across multilingual NLP tasks remains a wide area for exploration. In this literature survey, we present an introduction to the current position of MT research with a historical look at different modeling approaches to MT, how these might be advantageous for the solution of particular problems, and which problems are solved or remain open in regard to recent developments. We also discuss the connection of MT models leading to the development of prominent LLM architectures, how they continue to support LLM performance across different tasks by providing a means for cross-lingual knowledge transfer, and the redefinition of the task with the possibilities that LLM technology brings.
Citation
D. Ataman, A. Birch, N. Habash, M. Federico, P. Koehn, and K. Cho, “Machine Translation in the Era of Large Language Models:A Survey of Historical and Emerging Problems,” Information 2025, Vol. 16, Page 723, vol. 16, no. 9, p. 723, Aug. 2025, doi: 10.3390/INFO16090723
Source
Information
Conference
Keywords
Machine Translation, Large Language Models, Generative Artificial Intelligence, Multilinguality
Subjects
Source
Publisher
MDPI