Preliminary Ranking of WMT25 General Machine Translation Systems

Tom Kocmi, Eleftherios Avramidis, Rachel Bawden, Ondřej Bojar, Konstantin Dranch +23 more
8/11/2025
cs.CL

No confident code implementation found for this paper. 1 possible match can be shown below.

Abstract

We present the preliminary rankings of machine translation (MT) systems submitted to the WMT25 General Machine Translation Shared Task, as determined by automatic evaluation metrics. Because these rankings are derived from automatic evaluation, they may exhibit a bias toward systems that employ re-ranking techniques, such as Quality Estimation or Minimum Bayes Risk decoding. The official WMT25 ranking will be based on human evaluation, which is more reliable and will supersede these results. The official WMT25 ranking will be based on human evaluation, which is more reliable and will supersede these results. The purpose of releasing these findings now is to assist task participants with their system description papers; not to provide final findings.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 1 weaker match is hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Cite this paper

@article{kocmi2025preliminary,
  title  = {Preliminary Ranking of WMT25 General Machine Translation Systems},
  author = {Tom Kocmi and Eleftherios Avramidis and Rachel Bawden and Ondřej Bojar and Konstantin Dranch and Anton Dvorkovich and Sergey Dukanov and Natalia Fedorova and Mark Fishel and Markus Freitag and Thamme Gowda and Roman Grundkiewicz and Barry Haddow and Marzena Karpinska and Philipp Koehn and Howard Lakougna and Jessica Lundin and Kenton Murray and Masaaki Nagata and Stefano Perrella and Lorenzo Proietti and Martin Popel and Maja Popović and Parker Riley and Mariya Shmatova and Steinþór Steingrímsson and Lisa Yankovskaya and Vilém Zouhar},
  year   = {2025},
  eprint = {2508.14909},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2508.14909v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2508.14909.svg)](https://codeofpaper.com/paper/2508.14909)

Discussion