Publication
CoNLL 2017 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies
Daniel Zeman; Martin Popel; Milan Straka; Jan Hajic; Joakim Nivre; Filip Ginter; Juhani Luotolahti; Sampo Pyysalo; Slav Petrov; Martin Potthast; Francis Tyers; Elena Badmaeva; Memduh Gokirmak; Anna Nedoluzhko; Silvie Cinkova; Jan Hajic jr.; Jaroslava Hlavacova; Václava Kettnerová; Zdenka Uresova; Jenna Kanerva; Stina Ojala; Anna Missilä; Christopher D. Manning; Sebastian Schuster; Dima Taji Siva Reddy; Nizar Habash; Herman Leung; Marie-Catherine de Marneffe; Manuela Sanguinetti; Maria Simi; Hiroshi Kanayama; Valeria dePaiva; Kira Droganova; Héctor Martínez Alonso; Çağrı Çöltekin; Umut Sulubacak; Hans Uszkoreit; Vivien Macketanz; Aljoscha Burchardt; Kim Harris; Katrin Marheinecke; Georg Rehm; Tolga Kayadelen; Mohammed Attia; Ali Elkahky; Zhuoran Yu; Emily Pitler; Saran Lertpradit; Michael Mandl; Jesse Kirchner; Hector Fernandez Alcalde; Jana Strnadová; Esha Banerjee; Ruli Manurung; Antonio Stella; Atsuko Shimada; Sookyoung Kwak; Gustavo Mendonca; Tatiana Lando; Rattima Nitisaroj; Josie Li
In: Proceedings of the CoNLL 2017 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies. Conference on Computational Natural Language Learning (CoNLL-2017), The SIGNLL Conference on Computational Natural Language Learning, August 3-4, Vancouver, BC, Canada, Pages 1-19, Association for Computational Linguistics, 2017.
Abstract
The Conference on Computational Natu- ral Language Learning (CoNLL) features a shared task, in which participants train and test their learning systems on the same data sets. In 2017, one of two tasks was devoted to learning dependency parsers for a large number of languages, in a real- world setting without any gold-standard annotation on input. All test sets followed a unified annotation scheme, namely that of Universal Dependencies. In this paper, we define the task and evaluation method- ology, describe data preparation, report and analyze the main results, and provide a brief categorization of the different ap- proaches of the participating systems.