Observing the Learning Curve of Neural Machine Translation with regard to Linguistic Phenomena

Patrick Stadler, Vivien Macketanz, Eleftherios Avramidis

In: Proceedings of the ACL-IJCNLP 2021 Student Research Workshop. ACL Student Research Workshop (ACL-IJCNLP-SRW-2021) located at ACL-IJCNLP 2021 August 6 Virtual Association of Computational Linguistics 8/2021.


In this paper we present our observations and evaluations by observing the linguistic performance of the system on several steps on the training process of various English-to-German Neural Machine Translation models. The linguistic performance is measured through a semi-automatic process using a test suite. Among several linguistic observations, we find that the translation quality of some linguistic categories decreased within the recorded iterations. Additionally, we notice some drops of the translation quality of certain categories when using a larger corpus.


Weitere Links

Stadler_Macketanz_Avramidis_-_Learning_Curve_of_NMT_with_regard_to_Linguistic_Phenomena.pdf (pdf, 566 KB )

German Research Center for Artificial Intelligence
Deutsches Forschungszentrum für Künstliche Intelligenz