Báo cáo khoa học: "Dependency-based Evaluation for Automatic Summaries" pot

... understudy to skilled human judges which substitutes for them when there is need for quick or frequent evaluations. 1 1 Introduction 1.1 Rationale Human evaluations of machine translation (MT) weigh ... Section 3, we evaluate the performance of BLEU. In Section 4, we describe a human evaluation experiment. In Section 5, we compare our baseline metric performance with human evaluations....

Ngày tải lên: 23/03/2014, 20:20

... 2007. c 2007 Association for Computational Linguistics Text Analysis for Automatic Image Annotation Koen Deschacht and Marie-Francine Moens Interdisciplinary Centre for Law & IT Department ... growing bulk of un- structured information such as text, images and video, a situation witnessed in many domains (news, biomedical information, intelligence information, business documents,...

Ngày tải lên: 23/03/2014, 18:20

... (Shieber et al., 1995), where items are called formula schemata, deduc- tion steps are inference rules, hypothesis are ax- ioms and final items are goal formulas. A parsing schema can be generalized ... taken place in the node N r and therefore further adjunctions on the same node are forbidden. A value of false indicates that no adjunction was performed on that node. In this case,...

Ngày tải lên: 22/02/2014, 03:20

... initially to be uniform 2. for several iterations do: a. set up a count( , ) table with zero entries b. for = 1 to Q[ ,1] = b( boundary) c. for = 2 to for = 1 to Q[ , ] = 0 for = 1 to Q[ , ] += ... 1 to Q[ , ] += Q[ , ] b( ) s( ) d. for = 1 to R[ , ] = b(boundary ) e. for = to 1 for = 1 to R[ , ] = 0 for = 1 to R[ , ] += R[ , ] b( ) s( ) f. for = 1 to for = 1 to count( ,...

Ngày tải lên: 08/03/2014, 02:21

... syntac- tic information for transforming constituency tree- banks to dependency structures (Nivre et al., 2007) or richer syntactic representations (e.g., Hocken- maier and Steedman, 2007). For the ... as annotated in PARC 700 De- pendency Bank (see section 5). Automatic methods for identifying heads are therefore of interest, both for practical and more fundamental linguistic reaso...

Ngày tải lên: 08/03/2014, 21:20

... performed with only coarse-grained semantic in- formation about individual words. For example, a system could utilize word frequency and a word cooccurrence matrix in order to perform informa- ... semantic informa- tion. Word sense disambiguation for the bases and derived forms that could not be resolved using part- of-speech tags was not performed. However, there exist systems fo...

Ngày tải lên: 17/03/2014, 09:20

... words. We adopted standard 10-fold cross validation for evaluation: 9/10 of the whole dataset was used for training (training set), and 1/10 for testing (test set). To train a reranking model ... shown for increasing values of n. The trends for CLANG and GEOQUERY are different: small values of n show significant im- provements for CLANG, while a larger n is needed to improve resul...

Ngày tải lên: 23/03/2014, 18:20

... tree. This fact is desirable for progralnming languages. For natural languages, however, it is sometimes necessary for a parser to produce more than one parse tree. For example, consider the ... if natural languages are not context-free, a fairly comprehensive grammar for a subset of natural language suflicient for practical systems can be written in context.free phrase stru...

Ngày tải lên: 24/03/2014, 01:21

... logical form. ~ l~'ocsedings, 191h Annual Meeting of th, e Association for Computational Linguistics, Stanford, July 1981. 117-124. PARTEE, Baabara Hall (1973). "Some transformational ... logical form." P~oceedin~s, ~O~h Annual Meeting of the Association for Computational Linguistics, Toronto, June 1982. i-8. SCHANK, Roger Carl (editor) (1975). Conceptual infor...

Ngày tải lên: 31/03/2014, 17:20

... Therefore, there is a great need for reliable automatic metrics that can perform evaluation in a fast and consistent manner. In this paper, we explore one such evaluation metric, DEPEVAL(summ), ... none of the versions performs best across the board; their different character- istics might render them better suited either for models or for automatic systems, but not for both a...

Ngày tải lên: 23/03/2014, 16:21