Evaluating Natural Language Processing Systems: An Analysis and ReviewSpringer Science & Business Media, 1995 - 228 Seiten This comprehensive state-of-the-art book is the first devoted to the important and timely issue of evaluating NLP systems. It addresses the whole area of NLP system evaluation, including aims and scope, problems and methodology. The authors provide a wide-ranging and careful analysis of evaluation concepts, reinforced with extensive illustrations; they relate systems to their environments and develop a framework for proper evaluation. The discussion of principles is completed by a detailed review of practice and strategies in the field, covering both systems for specific tasks, like translation, and core language processors. The methodology lessons drawn from the analysis and review are applied in a series of example cases. A comprehensive bibliography, a subject index, and term glossary are included. |
Inhalt
Introduction | 1 |
Work and Strategies | 65 |
General developments | 125 |
Conclusions on evaluation to date | 189 |
19 | 220 |
Andere Ausgaben - Alle anzeigen
Evaluating Natural Language Processing Systems Karen Sparck Jones,Julia R. Galliers Keine Leseprobe verfügbar - 2014 |
Häufige Begriffe und Wortgruppen
ALPAC analysis answers application Artificial Intelligence assessment ATIS benchmark black box box evaluation characterisation comparative comparison component Computer Conference consider context corpora corpus DARPA evaluations database query defined dialogue document domain emphasise environment variables evaluation methodology example expert system extrinsic factors function general-purpose glass box goal human illustrated individual input instance interactive interface involved l-system language processing lexical lexicon linguistic machine translation material Message Understanding Conference MT system natural language Natural Language Processing NLP evaluation NLP system NLP task notion objective operational output parser parsing particular PlanS point of view problems processor purpose reference relation relevant Report retrieval S&LP Section semantic sentences setup Sparck Jones specific speech speech processing speech recognition subsystem Sundheim syntactic system evaluation system performance SYSTRAN template test and evaluation test collections test data test suites Text Retrieval Conference tion TREC Treebank types Workshop
Verweise auf dieses Buch
Natural Language Processing for Online Applications: Text Retrieval ... Peter Jackson,Isabelle Moulinier Eingeschränkte Leseprobe - 2007 |
Translation Engines: Techniques for Machine Translation Arturo Trujillo Eingeschränkte Leseprobe - 1999 |