automatic evaluation of machine translation quality using ngram co occurrence statistics

... Proceedings of the 2nd International Conference on Language Resources and Evaluation, Athens, Greece. NIST. 2002. Automatic Evaluation of Machine Translation Quality using N-gram Co- Occurrence Statistics. ... Quantitative Quality Measure for Machine Translation System. In Proceedings of COLING-92, Nantes, France. Thompson, H. S. 1991. Automatic Evaluation of Translation Quality: Outline of Methodology ... skip-bigrams: 3 Combination: C(4,2) = 4!/(2!*2!) = 6. Automatic Evaluation of Machine Translation Quality Using Longest Com- mon Subsequence and Skip-Bigram Statistics Chin-Yew Lin...

Ngày tải lên: 20/02/2014, 16:20

... checks. These translations are all correct. Actually, the corpus of Takezawa et al. (2002) contains ten dif- ferent translations of this source sentence. When we construct MT knowledge from corpora that contain ... show that most context/situation-dependent translations are non-literal. MT knowledge constructed from context/situation-dependent translations cause incorrect target sentences, which may contain omissions ... effect of literalness in MT knowledge construction, we constructed knowl- edge by using the methods described in Section 5 and evaluated the MT quality of the resulting English-to-Japanese translation. 6.1...

Ngày tải lên: 08/03/2014, 21:20

Ngày tải lên: 23/03/2014, 20:20

Ngày tải lên: 31/03/2014, 04:20

... Corpus BLEU Score Evaluation Corpus BLEU Score Number of Rules Figure 5: Relationship between Number of Itera- tions and BLEU Scores/Number of Rules 2. Subjective Quality A total of 510 sentences ... test corpus BLEU score and the subjective 2 In this experiment, it took about 80 hours until convergence using a Pentium 4 2-GHz computer. Feedback Cleaning of Machine Translation Rules Using Automatic ... requires very large corpora in order to obtain a sufficient number of rules that are statistically confi- dent. Another current topic of machine translation is automatic evaluation of MT quality (Papineni...

Ngày tải lên: 08/03/2014, 04:22

... Doddington, 2002. Automatic Evaluation of Machine Translation Quality Using N-gram Co- occurrence Statistics. Proceedings of the Second International Conference on Human Language Technology ... for Machine Translation Performance. Proceedings of the Third Workshop on Statistical Machine Translation, pages 224-232, Columbus, Ohio, USA. George Doddington, 2002. Automatic Evaluation of ... Fordyce, Philipp Koehn, Christof Monz and Josh Schroeder, 2007. (Meta-) Evaluation of Machine Translation. Proceedings of the Second Workshop on Statistical Machine Translation, pages 136-158,...

Ngày tải lên: 17/03/2014, 00:20

... sentence ordering. In Proceedings of ACL, pages 545–552. C.Y. Lin and E. Hovy. 2003. Automatic evaluation of summaries using n-gram co- occurrence statistics. In Proceedings of NAACL/HLT, page 78. C.Y. ... more predictive of the linguistic quality of these summaries. 7 Conclusion We have presented an analysis of a wide variety of features for the linguistic quality of summaries. Continuity between ... EACL, pages 148–156. J.M. Conroy and H.T. Dang. 2008. Mind the gap: dan- gers of divorcing evaluations of summary content from linguistic quality. In Proceedings of COLING, pages 145–152. S....

Ngày tải lên: 16/03/2014, 23:20

Ngày tải lên: 13/08/2014, 15:21

Ngày tải lên: 05/09/2013, 16:10

... Summary and Conclusions Evaluation of the quality of machine translations by means of a test of reading comprehension and by judg- ments of sentence clarity, was investigated. Human translations ... necessarily accurate, translations, EVALUATION OF MACHINE TRANSLATIONS 7 [Mechanical Translation, vol. 8, No. 2, February 1965] Evaluation of Machine Translations by Reading Comprehension Tests ... both types of translations, while loss of context in a paragraph affects only machine trans- lations, is hardly surprising. The range of values of a set of stimuli along a judged continuum...

Ngày tải lên: 19/02/2014, 19:20

... characterising an aspect of text quality that is not related to its content source but to the use of language itself. It is a goal of this paper to provide an automatic evaluation method for fluency ... the Role of Bleu in Machine Translation Research. In Proceedings of EACL, pages 249–256. Jos´e Coch. 1996. Evaluating and comparing three text- production strategies. In Proceedings of the 16th ... Evaluation of Ma- chine Translation. Technical Report RC22176, IBM. Joseph Turian, Luke Shen, and I. Dan Melamed. 2003. Evalua- tion of Machine Translation and its evaluation. In Proceedings of MT...

Ngày tải lên: 20/02/2014, 12:20

... ),( )( )( )( ferencesRnRSngram ferencesRnRSngram clip ngramCount ngramCount nR where, as before, Count (ngram) is the number of n-gram counts, and Count clip (ngram) is the maximum number of co- occurrences of ngram ... framework for automatic evaluation of NLP applications using N-gram co- occurrence statistics. The automatic evaluation metrics proposed to date for Machine Translation and Automatic Summarization ... ∑∑ ∑∑ ∈∈ ∈∈ = }{),( }{),( )( )( )( CandidatesCnCSngram CandidatesCnCSngram clip ngramCount ngramCount nP where Count (ngram) is the number of n-gram counts, and Count clip (ngram) is the maximum number of co- occurrences of ngram in the candidate answer and its...

Ngày tải lên: 20/02/2014, 16:20

... your|$ coffee|coffee or|or $|tea reordering I|$ would|would you|you like|like have|$ some|$ coffee|coffee $|or tea|tea $ would you like $ $ coffee or tea confusion $ would you have $ $ coffee ... tea original 2. would you have tea or coffee hypotheses 3. would you like your coffee or 4. I have some coffee tea would you like alignment would|would you|you have|like coffee|coffee or|or tea|tea and would|would ... from the union of confu- 35 Table 7: Improvements in translation quality on the BTEC Italian-English task through comput- ing consensus translations from the output of two speech translation systems...

Ngày tải lên: 22/02/2014, 02:20

... human and machine translations. ã Distinguish uent machine translations from poor machine translations. ã Distinguish the better (in terms of uency) translation among two translations of the same ... done in the context of machine translation for preliminary in- vestigations of fluency. Nevertheless, our findings are also potentially beneficial for sentence-level evaluation of machine translation. 2 ... and C. Brockett. 2001. A machine learning approach to the automatic eval- uation of machine translation. In Proceedings of 39th Annual Meeting of the Association for Compu- tational Linguistics,...

Ngày tải lên: 22/02/2014, 02:20

... 2.1 Machine Translation Quality Prediction Machine translation evaluation aims to assess the correctness and quality of the translation. Usu- ally, the human reference translation is provided, ... by making use of both the machine translation quality score and the informativeness score; 4) The extracted Eng- lish summary is translated into Chinese summary by using machine translation ... Section 5. 4 Machine Translation Quality Predic- tion 4.1 Methodology In this study, machine translation (MT) quality reflects both the translation accuracy and the flu- ency of the translated...

Ngày tải lên: 07/03/2014, 22:20

... Principles of context-based machine translation evaluation. Machine Translation, 17(1):43–75. Masaki Murata, Kiyotaka Uchimoto, Qing Ma, Toshiyuki Kanamaru, and Hitoshi Isahara. 2005. Analysis of machine ... ref- erence translation. 1 Introduction Machine translation evaluation is a difficult task, since there is not only one correct translation of a sentence, but many equally good translation options. Often, ... developers. 2 MT Evaluation and Error Analysis Hovy et al. (2002) discussed the complexity of MT evaluation, and stressed the importance of adjusting evaluation to the purpose and context of the trans- lation....

Ngày tải lên: 07/03/2014, 22:20

... extraction of I(T n ), whereas the main problem of machine translation is the algorithmiza- tion of this process of extraction. The introduction into the theory of translation of this logical construct—the ... basic conclusion: the process of human translation (and therefore of analysis in the course of translation from one natural language into another, for such translation could be treated as a combination ... examination of the process of understanding and, conse- quently, on an examination of the process of generation in language communication (e.g., multiple synthesis) and of translation, that is, of...

Ngày tải lên: 16/03/2014, 19:20

... relational concepts (mainly reflected by verbs): we are trying to get a set of core verbs as proto- types of classes based on certain statistics and genus verb sense nets (the latter is being con- ... layer. 3. Dynamic creation of Cases. Initial rep- resentations in the context layer may be ad- justed and new Cases be created according to a set of contextual conditions (mainly when mismatches ... An Artificial Intelligence Approach to Machine Translation, in Computer Models o] Thoaght 6nd Language, R.Schaak and K.Colby (eds.), W.H.Freemaa Co. , 1973. 338 ...

Ngày tải lên: 17/03/2014, 08:20

Ngày tải lên: 23/03/2014, 17:20

Ngày tải lên: 23/03/2014, 17:20