Publication
Interoperability in MT Quality Estimation or wrapping useful stuff in various ways
Eleftherios Avramidis
In: Proceedings of the LREC 2016 Workshop on Translation Evaluation: From Fragmented Tools and Data Sets to an Integrated Ecosystem. International Conference on Language Resources and Evaluation (LREC-2016), LREC-2016 Workshop on Translation Evaluation: From Fragmented Tools and Data Sets to an Integrated Ecosystem, located at Tenth International Conference on Language Resources and Evaluation, May 24, Portoro¸, Slovenia, Pages 1-6, Language Science Press, 5/2016.
Abstract
The situation on the interoperability of Natural Language Processing software is outlined through a use-case on Quality Estimation of Machine Translation output. The focus is on the development efforts for the QUALITATIVE tool, so that it integrates a multitude of state-of-the-art external tools into one single Python program, through an interoperable framework. The presentation includes 9 approaches taken to connect 25 external components, developed in various programming languages. The conclusion is that the current landscape lacks important interoperability principles and that developers should be encouraged to equip their programs with some of the standard interaction interfaces.