Automatic evaluation of machine translation, paraphrase generation, and summarization a linear programming based analysis

... weights Variants of TESLA are devised for many different evaluation tasks: TESLAM, TESLA-B, and TESLA-F for the machine translation evaluation of European languages, TESLA-CELAB for the machine translation ... chapter reviews the current state of the art in the various natural language automatic evaluation tasks, including machine translation evaluation and its appli...

Ngày tải lên: 10/09/2015, 09:08

... automatic evaluation methods for machine translation, ROUGE-L based on longest common subsequence (LCS) statistics between a candidate translation and a set of reference translations Longest common subsequence ... two sequences X and Y, the longest common subsequence (LCS) of X and Y is a common subsequence with maximum length We can find the LCS of tw...

Ngày tải lên: 20/02/2014, 16:20

... output of ChineseEnglish MT systems References E.H Hovy 1999 Toward finely differentiated evaluation metrics for machine translation In Proceedings of the Eagles Workshop on Standards and Evaluation, ... Human Evaluation Figure shows a linear regression of the monolingual group scores as a function of the BLEU score over two reference translations for the systems The high co...

Ngày tải lên: 23/03/2014, 20:20

... using the human reference translations and the output of the MT system at a given point in time Using the same set of features, we expect the accuracy of the classifiers to go down over time as the ... sampling the initial datasets Thanks also to John Platt for helpful discussion on parameter setting for the SVM tools, and to the members of the MSR NLP grou...

Ngày tải lên: 31/03/2014, 04:20

... (B) Literal Translation Figure 3: Examples of Generated Rules for Japanese-to-English Translation (A) from Non-literal Translation by Split Construction (B) from Literal Translation translations ... effect of literalness in MT knowledge construction, we constructed knowledge by using the methods described in Section and evaluated the MT quality of the resulting English-...

Ngày tải lên: 08/03/2014, 21:20

... reference translation segmented into words: Translation: 多少_钱_的_伞_吗_？ Reference: 这些_雨伞_多少_钱_？ The word “伞” is a synonym for the word “雨 伞”, and both words are translations of the English word “umbrella” ... character-level metrics more suitable for the automatic evaluation of Chinese translation output Conclusion In this paper, we conducted a detailed study of...

Ngày tải lên: 17/03/2014, 00:20

... goal of our experimental evaluation is to analyze the effectiveness of a variety of paraphrase generation techniques, ranging from simple to sophisticated Our evaluation focuses on generating paraphrases ... Our evaluation helps develop a better understanding of the strengths and weaknesses of each type of approach The evaluation also brings to light additional propert...

Ngày tải lên: 30/03/2014, 21:20

... ORGANIZATIONs, and LOCATIONs Indicators of linguistic quality Multiple factors in uence the linguistic quality of text in general, including: word choice, the reference form of entities, and local coherence ... rankings of content The development of automatic linguistic quality measurements will allow researchers to optimize both content and linguistic quality 5.2...

Ngày tải lên: 16/03/2014, 23:20

... portion of correct MT results Focusing on the number of the rules, the rule set of the simple feedback cleaning is clearly a locally optimal solution, since the number of rules is more than that of ... procedure of cross -cleaning is as follows Feature English Japanese # of Sentences 149,882 # of Words 868,087 984,197 # of Sentences 10,145 # of Words 59,533 67,554 #...

Ngày tải lên: 08/03/2014, 04:22

... would appear likely to be of some use Summary and Conclusions Evaluation of the quality of machine translations by means of a test of reading comprehension and by judgments of sentence clarity, was ... translated by humans While tests of reading comprehension provide a more direct measure of the usefulness of translations than judgments of sentenc...

Ngày tải lên: 19/02/2014, 19:20

... understand which factors are predictive of good fluency The distribution of fluency scores in the dataset is rather skewed, with the majority of the sentences rated as being of average fluency as ... assess the content of the sentence compared to a human gold-standard Yet, the assessments of the two aspects were often the same—readability /fluency o...

Ngày tải lên: 22/02/2014, 02:20

... 2006 Comparing automatic and human evaluation of NLG systems In Proceedings of EACL 2006, pages 313–320, Trento, Italy Amanda Stent, Matthew Marge, and Mohit Singhai 2005 Evaluating evaluation methods ... of NAACL-03, pages 61–63, NJ, USA Karolina Owczarzak, Josef van Genabith, and Andy Way 2008 Evaluating machine translation with LFG dependencies Machine Translation, 21:9...

Ngày tải lên: 23/03/2014, 17:20

... constituent, such as a name, which could lead to boundary errors in tagging English names We have therefore used an alternative method to fetch the source language information for information extraction, ... from using source language information In the nist05 data, we find 1893 named entities in the English NER output (target language part) and 1968 named entities in...

Ngày tải lên: 31/03/2014, 00:20

... mapped For mnemonic reasons these pointers normally take the form of the lexical stem of the translation equivalent or gloss, but this is purely a convenience for the user, and should not obscure their ... reference to translation: the optimum grain-size for lexical entries, the division of information about separate languages, and the level of abstraction ap...

Ngày tải lên: 01/04/2014, 00:20

... grammar, rhythm and flow, appropriateness of tone, and several other specific characteristics of good text In terms of automatic evaluation, we are not aware of any technique that measures only fluency ... PoStag In the first of these, we constructed a rough approximation of typical sentence grammar structure by taking bigrams over part -of- speech tags.6 Then, given a string of Po...

Ngày tải lên: 20/02/2014, 12:20