robust machine translation evaluation with entailment features

... pages 297–305, Suntec, Singapore, 2-7 August 2009. c 2009 ACL and AFNLP Robust Machine Translation Evaluation with Entailment Features ∗ Sebastian Pad ´ o Stuttgart University pado@ims.uni-stuttgart.de Michel ... Evaluating machine translation with LFG dependencies. Machine Translation, 21(2):95– 119. Sebastian Pad ´ o, Michel Galley, Dan Jurafsky, and Christopher D. Manning. 2009. Textual entailment features ... 85 features of the four base- line models. It uses no entailment features. RTER uses the 70 entailment features described in Section 3.1, but no MTR features. MT+RTER uses all MTR and RTER features, combining...

Ngày tải lên: 20/02/2014, 07:20

... NIST MT evaluation exercise. In Proceedings of the NIST 2005 Machine Translation Evaluation Workshop. Christopher Culy and Susanne Z. Riehemann. 2003. The Limits of N-gram Translation Evaluation ... Linguistics (ACL). Ding Liu and Daniel Gildea. 2005. Syntactic Features for Evaluation of Machine Translation. In Proceed- ings of ACL Workshop on Intrinsic and Extrinsic Evaluation Measures for MT and/or Summarization, pages ... Genabith, and Andy Way. 2007. Labelled Dependencies in Machine Translation Evaluation. In Proceedings of the ACL Workshop on Statistical Machine Translation, pages 104–111. Kishore Papineni, Salim...

Ngày tải lên: 20/02/2014, 07:20

... topics from the n given topics with replacement. 2. Summarize the topics with the list of machine summarizers. 3. Evaluate the list of summaries from Step 2 with the two evaluation metrics under comparison. 4. ... Hwee Tou Ng. 2010. TESLA: Translation evaluation of sentences with linear-programming-based analysis. In Proceed- ings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, ... Association for Computational Linguistics Combining Coherence Models and Machine Translation Evaluation Metrics for Summarization Evaluation Ziheng Lin † , Chang Liu ‡ , Hwee Tou Ng ‡ and Min-Yen Kan ‡ † SAP...

Ngày tải lên: 07/03/2014, 18:20

... allowing users to post-edit machine translation output. However, nei- ther of these systems are able to take advantage of the user validated translations. 3 Interactive Machine Translation IMT can be ... Multi- lingual Analysis for Retrieval and Translation. G. Foster, P. Isabelle, and P. Plamondon. 1997. Target- text mediated interactive machine translation. Ma- chine Translation, 12(1):175–194. G. Foster, ... Special issue on new tools for human translators. Machine Translation, 12(1–2). P. Koehn. 2005. Europarl: A parallel corpus for statisti- cal machine translation. In Proc. of the MT Summit X, pages...

Ngày tải lên: 07/03/2014, 22:20

... (meta-) evaluation of machine translation. In Proceedingsof the Second Workshop on Statistical Machine Translation, ACL07, pages 136– 158. J. Gimenez and L. Marquez. 2007. Linguistic features for ... METEOR: An auto- matic metric for MT evaluationwith high levels of cor- relation with human judgments. In Proceedings of the Second Workshop on Statistical Machine Translation, ACL07, pages 228–231. R. ... standard metric for automatic evaluation of MT performance. To score a system translation, BLEU tabulates the number of n-gram matches of the system translation against one or more reference translations. Gener- ally,...

Ngày tải lên: 08/03/2014, 01:20

... expected, improves the adequacy evaluation without hurting the fluency evaluation. PROB improves both adequacy and fluency evaluation performance. The result that SIA works with PORTER-STEM and WordNet ... An automatic metric for mt evaluation with improved correlation with human judegments. In Proceed- ings of the ACL-04 workshop on Intrinsic and Ex- trinsic Evaluation Measures for Machine Transla- tion ... The mathematics of statistical machine translation: Pa- rameter estimation. Computational Linguistics, 19(2):263–311. G. Doddington. 2002. Automatic evaluation of machine translation quality using...

Ngày tải lên: 08/03/2014, 02:21

Ngày tải lên: 08/03/2014, 18:20

Ngày tải lên: 17/03/2014, 02:20

Ngày tải lên: 30/03/2014, 21:20

... made with high accuracy. Ma- chine translations can be distinguished from hu- man translations with accuracy of 87%; machine translations with low fluency can be distinguished from machine translations ... Distinguish human and machine translations. ã Distinguish uent machine translations from poor machine translations. ã Distinguish the better (in terms of uency) translation among two translations of ... syn- tactic phrasing features: distinguishing human from machine translations, distinguishing good machine translations from bad machine transla- tions, and pairwise ranking of sentences with dif- ferent...

Ngày tải lên: 22/02/2014, 02:20

... statistical machine translation. Machine Translation, pages 187-207. Nicola Ueffing, Gholamreza Haffari and Anoop Sarkar. 2008. Semi-supervised Model Adaptation for Statisti- cal Machine Translation. Machine ... the out-of-domain translation mod- el for domain-specific translation task. In detail, we build an adapted translation model in the following steps: ã Build a topic-specific translation model to quantify ... 8-14 July 2012. c 2012 Association for Computational Linguistics Translation Model Adaptation for Statistical Machine Translation with Monolingual Topic Information ∗ Jinsong Su 1,2 , Hua Wu 3 ,...

Ngày tải lên: 19/02/2014, 19:20

... probability of the translation "in order to avoid" is higher than that of the translation "can we avoid". Thus, our method selects the former as the translation. Although ... Papineni, Salim Roukos, Todd Ward, and Weijing Zhu. 2002. BLEU: A Method for Auto- matic Evaluation of Machine Translation. In Pro- ceedings of 40th annual meeting of the Association for Computational ... 11-16 July 2010. c 2010 Association for Computational Linguistics Improving Statistical Machine Translation with Monolingual Collocation Zhanyi Liu 1 , Haifeng Wang 2 , Hua Wu 2 , Sheng Li 1 ...

Ngày tải lên: 20/02/2014, 04:20

... training phrase-based translation models, which can be used directly in translation tasks or combined with base- line models. Experimental results on Chinese- English machine translation tasks show ... inter- polating the phrase table with the baseline phrase ta- ble, we observed improvement on Chinese-English machine translation tasks and the performance is comparable to system trained with larger manually collected ... 2011. c 2011 Association for Computational Linguistics Corpus Expansion for Statistical Machine Translation with Semantic Role Label Substitution Rules Qin Gao and Stephan Vogel Language Technologies...

Ngày tải lên: 20/02/2014, 04:20

... reference translations and showed that the weighted average metric correlating highly with human assessments. B LEU measures how well a machine translation overlaps with multiple human translations ... evaluate machine translations the machine translation community recently adopted an n-gram co-occurrence scoring proce- dure B LEU (Papineni et al. 2001). In two recent large-scale machine translation ... Recall of Machine Translation. In Proceedings of NAACL/HLT 2003, Edmonton, Canada. Nieòen S., F.J. Och, G, Leusch, H. Ney. 2000. An Evaluation Tool for Machine Translation: Fast Evaluation...

Ngày tải lên: 20/02/2014, 16:20

... for machine translation evaluation. In Proceedings of EMNLP 2004, pages 388–395, Barcelona, Spain, July. Arne Mauser, Sa ˇ sa Hasan, and Hermann Ney. 2009. Ex- tending statistical machine translation ... statistical machine translation. In Proceed- ings of AMTA. Sylvain Raybaud, Caroline Lavecchia, David Langlois, and Kamel Sma ă li. 2009. New condence measures for statistical machine translation. ... statistical machine translation: Parameter estimation. Computa- tional Linguistics, 19(2):263–311. Eugene Charniak, Kevin Knight, and Kenji Yamada. 2003. Syntax-based language models for statistical machine...

Ngày tải lên: 07/03/2014, 22:20

... automatically rank machine translation output. In Proceedings of Machine Translation Summit VIII, pages 15–20. Osamu Furuse and Hitoshi Iida. 1994. Constituent boundary parsing for example-based machine ... Yanagida. 2001. An au- tomatic evaluation method of translation quality using translation answer candidates queried from a parallel corpus. In Proceedings of Machine Translation Sum- mit VIII, pages ... Pentium 4 2-GHz computer. Feedback Cleaning of Machine Translation Rules Using Automatic Evaluation Kenji Imamura, Eiichiro Sumita ATR Spoken Language Translation Research Laboratories Seika-cho,...

Ngày tải lên: 08/03/2014, 04:22

... word-based alignment: ã Since the translation model can directly de- pict phrase reordering in translation, it is more accurate for translation between lan- guages with different word (phrase) ... can be illustrated with an example of the translation probability distri- bution of the English word 'T'. Table 3 shows the possible translations of 'T' with probability ... together with the 'ideal' align- ments for the sentences. Here the alignment parameters penalize the alignment of English words with their German translation equiva- lents because the translation...

Ngày tải lên: 08/03/2014, 06:20

... DEALING WITH CONJUNCTIONS IN A MACHINE TRANSLATION ENVIRONMENT Xiumlng HUANG Institute of Linguistics Chinese Academy ... ('and', 'or', and 'but'). The algorithm is part of an English-Chinese machine translation system which is in the course of construction. 0 INTRODUCTION Theoretical linguists ... (14) on the other: (12) Bob met Sue and Mar k in London. (13) I knew the man with the telescope and the woman with the umbrella. (14) Bob met Sue in Paris and Mary in London. As we stated...

Ngày tải lên: 08/03/2014, 18:20

Ngày tải lên: 08/03/2014, 18:20

Ngày tải lên: 17/03/2014, 07:20