Skip to main content Skip to main navigation

Publication

Findings of the WMT 2024 Biomedical Translation Shared Task: Test Sets on Abstract Level

Mariana Neves; Cristian Grozea; Philippe Thomas; Roland Roller; Rachel Bawden; Aurélie Névéol; Steffen Castle; Vanessa Bonato; Giorgio Maria Du Nunzio; Federica Vezzani; Maika Vicente Navarro; Lana Yeganova; Antonio Jimeno Yepes
In: Proceedings of the Ninth Conference on Machine Translation. Conference on Machine Translation (WMT-2024), HAL, 2024.

Abstract

We present the results of the ninth edition of the Biomedical Translation Task at WMT’24. We released test sets for six language pairs, namely, French, German, Italian, Portuguese, Russian, and Spanish, from and into English. Each test set consists of 50 abstracts from PubMed. Differently from previous years, we did not split abstracts into sentences. We received submissions from five teams, and for almost all language directions. We used a baseline/comparison system based on Llama 3.1 and share the source code at https://github.com/cgrozea/wmt24biomed-ref.

More links