... pair- wise comparisons of competing systems over a test set of several inputs and 70% for ranking summaries of a specific input. 1 Introduction Efforts for the development of automatic text sum- marizers ... of systems, ignoring the linguistic quality of the system out- put. Part of the reason for this imbalance is the existence of ROUGE (Lin and Hovy, 2003; Lin, 2004), t...
Ngày tải lên: 16/03/2014, 23:20
... relative to the size of the corpus. 184 Theoretical Evaluation of Estimation Methods for Data-Oriented Parsing Willem Zuidema Institute for Logic, Langu age and Computation University of Amsterdam Plantage ... simple com- binations of the frequencies f 1 . . . f 4 . Observa- tions of these frequencies therefore do not add any extra information, and the problem of fi nd- ing t...
Ngày tải lên: 17/03/2014, 22:20
Báo cáo khoa học: "An Evaluation of METAL: the LRC Machine Translation System" ppt
... extensive use of transformations to modify structure or perform certain tests. Transformations may be used in the TEST, CONSTR, INTEr, and Transfer phases of the rules, transformations may ... optional enumeration of each constituent); a series of restrictions, which test the appropriateness of individual constituents on the right-hand side of the rule; TESTs, which enfor...
Ngày tải lên: 01/04/2014, 00:20
Báo cáo khoa học: "Discriminative Pruning of Language Models for Chinese Word Segmentation" ppt
... kinds of parameters are involved: bigram probability P m (w y |w x ) for seen bigram w x w y in training corpus, unigram probability P m (w) and backoff coefficient α m (w) for any word w. For ... criterion is based on performance variation of word segmentation. Second, the model of desired size is achieved by adding valuable bigrams to a base model, instead of by prunin...
Ngày tải lên: 17/03/2014, 04:20
Báo cáo khoa học: "EMPIRICAL STUDIES OF DISCOURSE REPRESENTATIONS FOR NATURAL LANGUAGE INTERFACES" ppt
... validity of the formulated rules. Perhaps present day analysis of the structure of language in dialogues (including our own) is too much influenced of the traditional linguistic analysis of isolated ... in the sys- tem performance, i.e. finding subsets for which we can computationally handle complete linguistic and conceptual coverage. This points to the need for theori...
Ngày tải lên: 18/03/2014, 02:20
Báo cáo khoa học: "The role of positive feedback in Intelligent Tutoring Systems" ppt
... following defi- nition of student activity has been adopted: student activity = # of turns − # of short turns session length Turns are the sequences of uninterrupted speech of the student. Short ... effect of positive feedback is positive, but the effect of negative feedback is nega- tive, as can be seen by the sign of the β value. 4 A tutoring system for linked lists A new I...
Ngày tải lên: 31/03/2014, 00:20
Tài liệu Báo cáo khoa học: "Automatic Evaluation of Sentence-Level Fluency Andrew Mutton∗" pdf
... letters for correct spelling, good grammar, rhythm and flow, appropriateness of tone, and several other specific characteristics of good text. In terms of automatic evaluation, we are not aware of any ... metric. Results are given for correlation of GLEU against sequence sizes for all data (Table 2) and for the human trial data set (Table 4); and also for correlation of G...
Ngày tải lên: 20/02/2014, 12:20
Tài liệu Báo cáo khoa học: "Automatic Evaluation of Machine Translation Quality Using Longest Common Subsequence and Skip-Bigram Statistics" doc
... section, we present the evaluations of ROUGE-L, ROUGE-S, and compare their per- formance with other automatic evaluation meas- ures. 5 Evaluations One of the goals of developing automatic ... first computed averages of the adequacy and fluency scores of each system assigned by human evalua- tors. For the input of automatic evaluation meth- ods, we created three evaluat...
Ngày tải lên: 20/02/2014, 16:20
Tài liệu Báo cáo khoa học: "Human Evaluation of a German Surface Realisation Ranker" docx
... Reiter. 2006. Comparing auto- matic and human evaluation of NLG systems. In Proceedings of the 11th Conference of the European Chapter of the Association for Computational Lin- guistics, pages 313–320, ... Oslo. 120 Proceedings of the 12th Conference of the European Chapter of the ACL, pages 112–120, Athens, Greece, 30 March – 3 April 2009. c 2009 Association for Computat...
Ngày tải lên: 22/02/2014, 02:20
Báo cáo khoa học: "Ecological Evaluation of Persuasive Messages Using Google AdWords" pdf
... measure- ments for identifying the performance of each single ad (its persuasiveness, from our point of view): • CTR, Click Through Rate: measures the num- ber of clicks divided by the number of impres- sions ... unthinkable before this opportunity for studies on persuasion appeared. The motivation for this work was exploration of the impact of short persuasive messages, s...
Ngày tải lên: 07/03/2014, 18:20