Hostname: page-component-cd9895bd7-jn8rn Total loading time: 0 Render date: 2024-12-26T08:28:15.416Z Has data issue: false hasContentIssue false

A test of the leaf-ancestor metric for parse accuracy

Published online by Cambridge University Press:  25 November 2003

GEOFFREY SAMPSON
Affiliation:
School of Cognitive and Computing Sciences, University of Sussex, Falmer, Brighton BN1 9QH, UK e-mail: geoffs@cogs.susx.ac.uk
ANNA BABARCZY
Affiliation:
School of Cognitive and Computing Sciences, University of Sussex, Falmer, Brighton BN1 9QH, UK e-mail: annab@cogs.susx.ac.uk

Abstract

The GEIG metric for quantifying the accuracy of parsing became influential through the Parseval programme, but many researchers have seen it as unsatisfactory. The Leaf-Ancestor (LA) metric, first developed in the 1980s, arguably comes closer to formalizing our intuitive concept of relative parse accuracy. We support this claim via an experiment that contrasts the performance of alternative metrics on the same body of automatically-parsed examples. The LA metric has the further virtue of providing straightforward indications of the location of parsing errors.

Type
Papers
Copyright
© 2003 Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)