a neural syntactic language model

... experiments on 1000- best lists from Moses using our syntactic language model as a feature. We did not find that the use of our syntactic language model made any statis- tically significant increases ... Korea, 8-14 July 2012. c 2012 Association for Computational Linguistics Large-Scale Syntactic Language Modeling with Treelets Adam Pauls Dan Klein Computer Science Division Uni...

Ngày tải lên: 19/02/2014, 19:20

... Human Language Technology Conference (HLT), 48-54. S. Khudanpur and J. Wu. 2000. Maximum entropy tech- niques for exploiting syntactic, semantic and colloca- tional dependencies in language modeling. ... SEMANTIZER of test document. The m-SLM performs competitively with its counterpart n-gram (n=m+1) on large scale corpus. In Table 3, for composite n-gram/m-SLM model (n...

Ngày tải lên: 20/02/2014, 04:20

... to incorporate large- scale n-gram language models in conjunction with incremental syntactic language models. The added decoding time cost of our syntactic language model is very high. By increasing ... Association for Computational Linguistics, pages 620–631, Portland, Oregon, June 19-24, 2011. c 2011 Association for Computational Linguistics Incremental Syntactic Langu...

Ngày tải lên: 20/02/2014, 04:20

... the AFNLP, pages 75 5–7 63, Suntec, Singapore, 2-7 August 2009. c 2009 ACL and AFNLP Discriminative Lexicon Adaptation for Improved Character Accuracy – A New Direction in Chinese Language Modeling Yi-cheng ... increased character accuracy to the relat ive increased MAP for the three lexicon adaptation ap- proaches are different. A key factor making...

Ngày tải lên: 20/02/2014, 07:20

... and Linda C. Bauman Peto. 1995. A hierarchical Dirichlet language model. Natural Lan- guage Engineering, 1(3):1–19. Y.W. Teh. 2006. A hierarchical Bayesian language model based on Pitman-Yor processes. ... n-grams: C(ab) − C(ab∗). A( ab) = max(1, K(C(ab) − C(ab∗))) A different K constant is chosen for each n-gram order. Using this formulation as an interpolated 5- gram language m...

Ngày tải lên: 20/02/2014, 09:20

... of N- gram language models based on LOUDS, a succinct data structure. LOUDS suc- cinctly represents a trie with M nodes as a 2M +1bit string. We compress it further for the N-gram language model ... (Talbot and Brants, 2008). 2 N -gram Language Model We assume a back-off N-gram language model in which the conditional probability Pr(w n |w n−1 1 ) for an arbitrary N-gram w n 1...

Ngày tải lên: 20/02/2014, 09:20

... Jelinek. 2000. Structured language modeling. Computer Speech and Language, 14(4):283–332. Ciprian Chelba. 2000. Exploiting Syntactic Structure for Nat- ural Language Modeling. Ph.D. thesis, The ... Previous Work Techniques for exploiting stochastic context-free grammars for language modeling have been ex- plored for more than a decade. Early approaches included algorit...

Ngày tải lên: 20/02/2014, 15:20

... features, as described below: a statistical language model and a measure of tense difficulty. 4.1 The language model The lexical difficulty of a text is quite an elaborate phenomenon to parameterise. The ... Association for Computational Linguistics Combining a Statistical Language Model with Logistic Regression to Predict the Lexical...

Ngày tải lên: 08/03/2014, 21:20

... Computational Linguistics Applying a Grammar-based Language Model to a Simplified Broadcast-News Transcription Task Tobias Kaufmann Speech Processing Group ETH Z ă urich Z ă urich, Switzerland kaufmann@tik.ee.ethz.ch Beat ... create an artificial recognition task with manageable complexity. Our primary aim was to design a task which allows us to investigate the propertie...

Ngày tải lên: 17/03/2014, 02:20

... USA, June 2008. c 2008 Association for Computational Linguistics A New String-to -Dependency Machine Translation Algorithm with a Target Dependency Language Model Libin Shen BBN Technologies Cambridge, ... 2003. Syntax- based language models for statistical machine transla- tion. In Proceedings of MT Summit IX. D. Chiang. 2005. A hierarchical phrase-based model f...

Ngày tải lên: 17/03/2014, 02:20

... Process Pitman-Yor processes are examples of nonpara- metric Bayesian models. Here we give a quick de- scription of the Pitman-Yor process in the context of a unigram language model; good tutorials on such ... cor- responding draw from G 0 ), or sits at a new table (assign the word to a new draw from G 0 ). 3 Hierarchical Pitman-Yor Language Models We describe an n-gram lang...

Ngày tải lên: 17/03/2014, 04:20

... (Charniak, 2001). For these reasons, we prefer enriching the syntactic dependencies by information from the left context. However, as mentioned in (Roark, 2001), one way of conditioning the probabilities ... the richer syntactic tags. Since the treebank parses allow us to annotate parent informa- tion onto the constituents, as Johnson did in (John- son, 1998), this richer predicti...

Ngày tải lên: 23/03/2014, 20:20

... sequences. In addition, the N -gram language model can be trained separately using a large amount of data, while the syntax-based model requires manual annotation for training. The standard method ... shown as Algo- rithm 1. Again it is reminiscent of a best-first parser (Caraballo and Charniak, 1998) in the use of an agenda and a chart, but is fundamentally dif- ferent due to the fact...

Ngày tải lên: 31/03/2014, 21:20

Ngày tải lên: 13/11/2014, 09:45