Hostname: page-component-cd9895bd7-7cvxr Total loading time: 0 Render date: 2024-12-26T08:42:19.158Z Has data issue: false hasContentIssue false
  • English
  • Français

Validating the TEMAA LE evaluation methodology: a case study on Danish spelling checkers

Published online by Cambridge University Press:  01 September 1998

PATRIZIA PAGGIO  and
NANCY L. UNDERWOOD
PATRIZIA PAGGIO
Affiliation:
Center for Sprogteknologi, Njalsgade 80, 2300 Copenhagen S, Denmark. Email: patrizia@cst.ku.dk
NANCY L. UNDERWOOD
Affiliation:
Center for Sprogteknologi, Njalsgade 80, 2300 Copenhagen S, Denmark. E-mail: nancy@cst.ku.dk
Get access Rights & Permissions [Opens in a new window]

Abstract

This paper describes the work carried out at the Center for Sprogteknologi in Copenhagen to validate the LE evaluation methodology developed by the LRE project TEMAA. TEMAA has developed a framework for the evaluation of LE products, implemented in a Parameterisable Testbed (PTB). The framework allows for a modular, formal and exible description of user requirements and objects of evaluation, it accommodates test methods of various kind and provides a methodology for assessing test results in the light of the requirements expressed by different user types. While the fundamentals of the TEMAA framework are meant to apply to adequacy evaluation of LE products in general, a detailed methodology has been worked out for the evaluation of spelling and grammar checkers, and applied to the concrete evaluation of Danish and Italian spelling checkers. The main focus of this paper is on showing that the general methodology provides a valid model for designing and carrying out a concrete evaluation, as in the case study on Danish spelling checkers.

Type
Research Article
Information
Natural Language Engineering , Volume 4 , Issue 3 , September 1998 , pp. 211 - 228
Copyright
© 1998 Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

This paper reports on work carried out within the LRE (Language Research and Engineering) project TEMAA (A Testbed Study of Evaluation Methodologies: Authoring Aids). TEMAA was a collaborative project at Center for Sprogteknologi (CST), Copenhagen; Institut Dalle Molle pour les études sémantiques et cognitives (ISSCO), Geneva; Stichting Taaltechnologie (STT), Utrecht; Language Technology Group (LTG), Edinburgh; and Claris Ireland, Dublin. More information about the project can be obtained by contacting the authors at CST.