automatic evaluation of machine translation quality using ngram cooccurrence statistics

... Proceedings of the 2nd International Conference on Language Resources and Evaluation, Athens, Greece. NIST. 2002. Automatic Evaluation of Machine Translation Quality using N-gram Co- Occurrence Statistics. ... Quantitative Quality Measure for Machine Translation System. In Proceedings of COLING-92, Nantes, France. Thompson, H. S. 1991. Automatic Evaluation of Translation Quality: Outline of Methodology ... 3 Combination: C(4,2) = 4!/(2!*2!) = 6. Automatic Evaluation of Machine Translation Quality Using Longest Com- mon Subsequence and Skip-Bigram Statistics Chin-Yew Lin and Franz Josef Och...

Ngày tải lên: 20/02/2014, 16:20

... objective translations for the rule writer. Therefore, the rewritten translations were acquired by translating trained sentences by TDMT. 157 Automatic Construction of Machine Translation Knowledge Using ... words in the target language and the mean number of translation words, both values of the rewritten translations are lower than those of the original translations. This is because 1 When TDMT translates ... trans./word 4.21 Rewritten Translations  Original Translations Table 1: Comparison of TDMT Training Translations and Original Translations the rule writers rewrote translations to make tar- get...

Ngày tải lên: 08/03/2014, 21:20

Ngày tải lên: 23/03/2014, 20:20

Ngày tải lên: 31/03/2014, 04:20

... MT quality would certainly improve further. 7 Discussion 7.1 Other Automatic Evaluation Methods The idea of feedback cleaning is independent of BLEU. Some automatic evaluation methods of MT quality ... Yanagida. 2001. An au- tomatic evaluation method of translation quality using translation answer candidates queried from a parallel corpus. In Proceedings of Machine Translation Sum- mit VIII, pages ... current topic of machine translation is automatic evaluation of MT quality (Papineni et al., 2002; Yasuda et al., 2001; Akiba et al., 2001). These methods aim to replace subjective evaluation in...

Ngày tải lên: 08/03/2014, 04:22

... essential for automatic evaluation of Chinese translation output. Our analysis suggests several key reasons behind this finding. 2 Chinese Translation Evaluation Automatic MT evaluation aims ... Fordyce, Philipp Koehn, Christof Monz and Josh Schroeder, 2007. (Meta-) Evaluation of Machine Translation. Proceedings of the Second Workshop on Statistical Machine Translation, pages 136-158, ... for Machine Translation Performance. Proceedings of the Third Workshop on Statistical Machine Translation, pages 224-232, Columbus, Ohio, USA. George Doddington, 2002. Automatic Evaluation of...

Ngày tải lên: 17/03/2014, 00:20

... year of evaluation to the next. 5.2 Evaluation of rankings We examine the predictive power of our features for each of the five linguistic quality questions in two settings. In system-level evaluation, ... sentence ordering. In Proceedings of ACL, pages 545–552. C.Y. Lin and E. Hovy. 2003. Automatic evaluation of summaries using n-gram co-occurrence statistics. In Proceedings of NAACL/HLT, page 78. C.Y. ... of systems, ignoring the linguistic quality of the system out- put. Part of the reason for this imbalance is the existence of ROUGE (Lin and Hovy, 2003; Lin, 2004), the system for automatic evaluation...

Ngày tải lên: 16/03/2014, 23:20

Ngày tải lên: 13/08/2014, 15:21

Ngày tải lên: 05/09/2013, 16:10

... though not necessarily accurate, translations, EVALUATION OF MACHINE TRANSLATIONS 7 [Mechanical Translation, vol. 8, No. 2, February 1965] Evaluation of Machine Translations by Reading Comprehension ... judgments of the clarity of meaning of indivi- dual sentences. The approach through testing of reading comprehension provides a direct test of at least one aspect of the quality of translation. ... combination of several methods, including the two investigated here, would appear likely to be of some use. Summary and Conclusions Evaluation of the quality of machine translations by means of a...

Ngày tải lên: 19/02/2014, 19:20

... Evaluation of Ma- chine Translation. Technical Report RC22176, IBM. Joseph Turian, Luke Shen, and I. Dan Melamed. 2003. Evalua- tion of Machine Translation and its evaluation. In Proceedings of MT ... characterising an aspect of text quality that is not related to its content source but to the use of language itself. It is a goal of this paper to provide an automatic evaluation method for fluency ... grammar, rhythm and flow, appropriateness of tone, and several other specific characteristics of good text. In terms of automatic evaluation, we are not aware of any technique that measures only fluency...

Ngày tải lên: 20/02/2014, 12:20

... system translation in terms of all error mea- sures. We also checked how many sentences in the consensus translation of the test corpus are differ- ent from the 5 original translations. 185 out of ... uniform probability distribution – it is necessary to penal- ize translations of low quality. 3.4 Spanish-English Translation The improvements in translation quality are also significant on the TC-STAR EPPS Spanish- English ... your|$ coffee|coffee or|or $|tea reordering I|$ would|would you|you like|like have|$ some|$ coffee|coffee $|or tea|tea $ would you like $ $ coffee or tea confusion $ would you have $ $ coffee or...

Ngày tải lên: 22/02/2014, 02:20

... human and machine translations. ã Distinguish uent machine translations from poor machine translations. ã Distinguish the better (in terms of uency) translation among two translations of the same ... Proceedings of HLT/NAACL’04. S. Corston-Oliver, M. Gamon, and C. Brockett. 2001. A machine learning approach to the automatic eval- uation of machine translation. In Proceedings of 39th Annual Meeting of ... in the context of machine translation for preliminary in- vestigations of fluency. Nevertheless, our findings are also potentially beneficial for sentence-level evaluation of machine translation. 2...

Ngày tải lên: 22/02/2014, 02:20

... language to the target language by using machine translation services. However, though machine translation techniques have been advanced a lot, the machine translation quality is far from satisfactory, ... evaluation results will be described together in Section 5. 4 Machine Translation Quality Predic- tion 4.1 Methodology In this study, machine translation (MT) quality reflects both the translation ... 2.1 Machine Translation Quality Prediction Machine translation evaluation aims to assess the correctness and quality of the translation. Usu- ally, the human reference translation is provided,...

Ngày tải lên: 07/03/2014, 22:20

... Principles of context-based machine translation evaluation. Machine Translation, 17(1):43–75. Masaki Murata, Kiyotaka Uchimoto, Qing Ma, Toshiyuki Kanamaru, and Hitoshi Isahara. 2005. Analysis of machine ... ref- erence translation. 1 Introduction Machine translation evaluation is a difficult task, since there is not only one correct translation of a sentence, but many equally good translation options. Often, ... highlights parts of the MT output that it suspects are non-grammatical. Even though the main purpose of BLAST is for error annotation of machine translation output, the freedom in the use of error typologies...

Ngày tải lên: 07/03/2014, 22:20

... I(T n ), whereas the main problem of machine translation is the algorithmiza- tion of this process of extraction. The introduction into the theory of translation of this logical construct—the ... process of human translation (and therefore of analysis in the course of translation from one natural language into another, for such translation could be treated as a combination of successive translations ... extent of the knowledge of language in general which is necessary from the point of view of theoretical linguistics with the extent of knowledge of language necessary for the achievement of translation...

Ngày tải lên: 16/03/2014, 19:20

... trying to get a set of core verbs as proto- types of classes based on certain statistics and genus verb sense nets (the latter is being con- structed by G. Stein). A primary set of core verbs ... word list of LDOCE, then gradually ex- panding them to all the verbs defined in LDOCE. There are various subtasks associated with this work: 1. Dynamically adjusting classifications of relational ... endurance. An example of an initial representation for break is: ((+) (u-) (0)) break ((-) (u-) (0)), where (+) stands for active, (-) for passive, (u -) for indexing of the internal environment,...

Ngày tải lên: 17/03/2014, 08:20

Ngày tải lên: 23/03/2014, 17:20

Ngày tải lên: 23/03/2014, 17:20

Ngày tải lên: 31/03/2014, 00:20