incremental syntactic language models for phrase based translation

... Association for Computational Linguistics, pages 620–631, Portland, Oregon, June 19-24, 2011. c 2011 Association for Computational Linguistics Incremental Syntactic Language Models for Phrase- based Translation Lane ... are therefore a good mechanism for incorporat- ing syntax into phrase- based translation. We give a formal definition of one such linear- time syntactic language model, detail its re- lation to phrase- based ... n-gram LMs. Syntactic language models have also been explored with tree -based translation models. Charniak et al. (2003) use syntactic lan- guage models to rescore the output of a tree -based translation...

Ngày tải lên: 20/02/2014, 04:20

... performance of statistical translation systems. To solve this problem, this paper proposes a novel method for phrase- based SMT by using a pivot language. To perform translation between languages ... novel method for phrase- based SMT on language pairs with a small bilin- gual corpus by bringing in pivot languages. To per- form translation between L f and L e , we bring in a pivot language ... we train two translation models for L f -L p and L p -L e , respectively. Based on these two models, we build a pivot translation model for L f -L e, with L p as a pivot language. According...

Ngày tải lên: 08/03/2014, 02:21

... right, therefore CBMF is “VP-RC”. 3.3 The Integration of the SDB Model into Phrase- Based SMT We integrate the SDB model into phrase- based SMT to help decoder perform syntax-driven phrase translation. ... hli}@i2r.a-star.edu.sg Abstract Syntactic analysis influences the way in which the source sentence is translated. Previous efforts add syntactic constraints to phrase- based translation by directly rewarding/punishing ... baseline which is not syntactically informed. 1 Introduction The phrase- based approach is widely adopted in statistical machine translation (SMT). It segments a source sentence into a sequence of phrases,...

Ngày tải lên: 20/02/2014, 07:20

Ngày tải lên: 23/03/2014, 14:20

Ngày tải lên: 31/03/2014, 01:20

Ngày tải lên: 23/03/2014, 14:20

... Australia, July. Association for Computa- tional Linguistics. Jacob Andreas, Nizar Habash, and Owen Rambow. 2011. Fuzzy syntactic reordering for phrase- based statistical machine translation. In Proceedings ... USA, May 2 - May 7. Association for Computational Lin- guistics. Jakob Elming and Nizar Habash. 2009. Syntactic reordering for English-Arabic phrase- based machine translation. In Proceedings of ... discriminative reordering model for statisti- cal machine translation. In International Workshop on Spoken Language Translation (IWSLT), Paris, France. Kenji Yamada. 2002. A syntax -based translation model. Ph.D....

Ngày tải lên: 19/02/2014, 19:20

... toolkit for phrase- based and syntax -based machine translation. It is implemented in C++ and runs fast. Moreover, it supports several state-of-the-art models ranging from phrase- based models ... toolkit for phrase- based and syntax -based machine translation. The toolkit supports several state-of-the-art models developed in statistical machine translation, including the phrase- based ... state-of-the-art SMT models. Among these are: the phrase- based model, the hierarchical phrase- based model, and the syntax -based models that explicitly use syntactic information on either (both)...

Ngày tải lên: 19/02/2014, 20:20

... statistical machine translation: pa- rameter estimation. Comput. Linguist., 19(2):263– 311. David Chiang. 2005. A hierarchical phrase- based model for statistical machine translation. In ACL 145 ’05: ... Marcu. 2003. Statistical phrase- based translation. In NAACL ’03: Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology, ... FBIS. Here HPB refers to the base- line hierarchal phrase- based system, RWF means relaxed-well-formed constraint and WF represents the well-formed structure. System Dev02 Test04 Test05 HPB 0.3285...

Ngày tải lên: 20/02/2014, 04:20

... Question Retrieval 3.1 Phrase- Based Translation Model Phrase- based machine translation models (Koehn et al., 2003; D. Chiang, 2005; Och and Ney, 2004) have shown superior performance compared to word -based translation ... this paper, we propose a novel phrase- based translation model for question retrieval. Compared to the traditional word -based translation models, the phrase- based translation model is more effective ... infor- mation in modeling the translation of phrases as a whole. More precise translation can be determined for phrases than for words. It is thus reasonable to expect that using such phrase translation...

Ngày tải lên: 20/02/2014, 04:20

... Therefore, we do incorporation by performing par- tial matching for phrase translation before decod- ing. The advantage is that the main search algorithm need not be changed. For a source phrase  f, ... of the phrase- based statistical ma- chine translation (PBSMT) models (Marcu and Wong, 2002; Koehn et al., 2003) adopt full matching strategy for phrase translation, which means that a phrase ... corpus. We set the maximum length of the source phrase to 7, and record word alignment information in the phrase table. For the language model, we use the SRI Language Modeling Toolkit (Stolcke, 2002)...

Ngày tải lên: 08/03/2014, 01:20

Ngày tải lên: 08/03/2014, 21:20

Ngày tải lên: 23/03/2014, 14:20

Ngày tải lên: 23/03/2014, 16:20

Ngày tải lên: 23/03/2014, 16:20

Ngày tải lên: 31/03/2014, 01:20

Ngày tải lên: 20/02/2014, 07:20

... paradigm, where the syntactic language model has the task of modeling a distribution over strings in the lan- guage, in a very similar way to traditional n-gram language models. The Structured Language ... Previous Work Techniques for exploiting stochastic context-free grammars for language modeling have been ex- plored for more than a decade. Early approaches included algorithms for efficiently calculating ... Charniak. 2001. Immediate-head parsing for language models. In Proc. ACL. Ciprian Chelba and Frederick Jelinek. 1998. Exploiting syntac- tic structure for language modeling. In Proceedings of the 36th...

Ngày tải lên: 20/02/2014, 15:20

... words surrounding the word pair; Syntactic information: part-of-speech in- formation, syntactic constituent, sentence mood; Semantic information: disambiguation in- formation (e.g. from WordNet), ... Machine Translation The goal of the translation process in statisti- cal machine translation can be formulated as fol- lows: A source language string is to be translated into a target language ... the lexicon models used in statistical machine translation systems are only single-word based, thatis one word in the source language cor- responds to only one word in the target language. Those...

Ngày tải lên: 20/02/2014, 18:20

... contain the acoustic models, language model and lexicon, but the LM makes up for most of the size. The availability of data varies for the different languages, and therefore the FST sizes are ... data were selected for each language. The adaptation was thought to take place off-line on a server. 3.2.1 Data sets For each language, the adaptation takes place on two baseline models, which are ... 2007. Large language models in machine translation. In Proceedings of the 2007 Joint Conference on Empirical Meth- ods in Natural Language Processing and Com- putational Natural Language Learning...

Ngày tải lên: 22/02/2014, 02:20