Publication
Diagnostic Evaluation of Shallow Parsing Through an Annotated Reference Corpus
Judith Klein; Stephan Busemann; Thierry Declerck
In: Proceedings of the Workshop on Evaluation in Speech and Language Technology. Workshop on Evaluation in Speech and Language Technology (SALT), June 17-18, Sheffield, United Kingdom, Pages 121-128, 1997.
Abstract
This paper describes the development of a diagnostic tool, implemented as an annotated e-mail database, for the evaluation of the analysis component of a German dialogue system, which has been realized as a NL front end to autonomous agent systems for appointment scheduling that use e-mail as their communication means. A shallow-parsing approach has been adopted as the NL server's module. Methodology and measures applied for the evaluation must be understood in the context of the role played by the NL component within the overall system.