Temporal Evaluation

Naushad UzZaman and James Allen
University of Rochester


Abstract

In this paper we propose a new method for evaluating systems that extract temporal information from text. It uses temporal closure to reward relations that are equivalent but distinct. Our metric measures the overall performance of systems with a single score, making comparison between different systems straightforward. Our approach is easy to implement, intuitive, accurate, scalable and computationally inexpensive.




Full paper: http://www.aclweb.org/anthology/P/P11/P11-2061.pdf