Báo cáo khoa học: "A Discriminative Language Model with Pseudo-Negative Samples" pptx

... training.3 Discriminative Language Model with Pseudo-Negative samplesWe propose a novel discriminative language model; a Discriminative Language Model with Pseudo-Negative samples (DLM-PN). In this model, pseudo-negative ... propose a novel discrim-inative language model, which can be ap-plied quite generally. Compared to thewell known N-gram language models, dis-criminative language models can achievemore accurate ... correctly.2 Previous workProbabilistic language models (PLMs) estimate theprobability of word strings or sentences. Amongthese models, N-gram language models (NLMs) arewidely used. NLMs approximate...

Tài liệu Báo cáo khoa học: "A Phonotactic Language Model for Spoken Language Identification" pptx

... statistical language modeling, and language identification. A typical LID system is illustrated in Figure 1 (Zissman, 1996), where language dependent voice tokenizers (VT) and lan-guage models ... Tokenization at different resolutions 2.2 n-gram Language Model With the sequence of tokens, we are able to es-timate an n-gram language model (LM) from the statistics. It is generally agreed ... voice feature frames and associates the seg-ments with acoustic or phonetic labels, called tokens; 2) A statistical language model which captures language dependent phonetic and phonotactic information...

Tài liệu Báo cáo khoa học: "A Structured Language Model" ppt

... Structured Language Model Ciprian Chelba The Johns Hopkins University CLSP, Barton Hall 320 3400 N. Charles Street, Baltimore, MD-21218 chelba@j hu. edu Abstract The paper presents a language model ... of long distance dependencies. The model as- signs probability to every joint sequence of words-binary-parse-structure with head- word annotation. The model, its proba- bilistic parametrization, ... goal of the proposed project is to develop a language model( LM) that uses syntactic structure. The principles that guided this propo§al were: • the model will develop syntactic knowledge as a...

Tài liệu Báo cáo khoa học: " A Declarative Language for Implementing Dynamic Programs∗" pptx

... induction, and ﬁnite-state modeling.1 IntroductionComputational linguistics has become a more experi-mental science. One often uses real-world data to testone’s formal models (grammatical, statistical, ... intensivework, given complex models or a large search space (asin modern statistical parsing and machine translation). Itis a major effort to break into the ﬁeld with a new system,and modifying ... to jump up a level of abstraction.We offer a new programming language, Dyna, that al-lows one to quickly and easily specify a model s com-binatorial structure. We also offer a compiler, dynac,that...

Báo cáo khoa học: " A Noisy-Channel Model for Document Compression" pptx

... constituents.3 A Noisy-Channel Model For a given document, we want to ﬁnd thesummary text that maximizes . UsingBayes rule, we ﬂip this so we end up maximizing. Thus, we are left with modelling twoprobability ... rule, reffered to as the noisy-channel model, is that we start with a summaryand add“noise” to it, yielding a longer document . Thenoise added in our model consists of words, phrasesand discourse ... tobuild a complete document compression system: thechannel model, the source model and the decoder.We describe each of these below.The source model assigns to a string the probabil-ity , the probability...

Tài liệu Báo cáo khoa học: "A Discriminative Syntactic Word Order Model for Machine Translation" pdf

... compare14First-pass models Model BLEU1 best 30 bestLang Model (Permutations) 58.8 71.2Lang Model (TargetProjective) 83.9 95.0Local Tree Order Model 75.8 87.3Local Tree Order Model + Lang Model 92.6 ... and target treelets.The baseline SMT model combines this treelettranslation model with other feature functions — atarget language model, a tree order model, lexicalweighting features to smooth ... −2). The trigram language model would not capture the position of“kore” with respect to “kaishou”, because the wordsare farther than three positions away.We use the language model and the local...

Tài liệu Báo cáo khoa học: "A Hybrid Hierarchical Model for Multi-Document Summarization" ppt

... problem basedon a two-step hybrid model: a generative model for hierarchical topic discovery and a regression model for inference. We investigate if a hierarchi-cal model can be adopted to discover ... hierarchical model and re-gression model to score sentences in new docu-ments, eliminating the need for building a genera-tive model for new document clusters.3 Summary-Focused Hierarchical Model Our ... baseline model. 5 Regression Model Each candidate sentence om, m = 1 |O| is rep-resented with a multi-dimensional vector of q fea-tures fm= {fm1, , fmq}. We build a regression model using...

Tài liệu Báo cáo khoa học: "A Unified Graph Model for Sentence-based Opinion Retrieval" pdf

... opinion re-trieval model in the framework of generative language modeling (Eguchi and Lavrenko, 2006). They modeled a collection of natural language documents or statements, each of which con-sisted ... the degree of each word pair through a graph-based model in the following section. 3.2 HITS Model We propose an opinion retrieval model based on HITS, a popular graph ranking algorithm ... tested the effect of the parameter  of our model. To demonstrate the effectiveness of our opinion re-trieval model, we compared its performance with the same of other approaches. In addition,...

Tài liệu Báo cáo khoa học: "A probabilistic generative model for an intermediate constituency-dependency representation" pptx

... dependent with respect to the par-ent3, and its adjacent left sister (null if not present)speciﬁed with the same level of details of B. The model applies only to dependent blocks4.The second model ... to the three models (BGM, BEM, WFM) speciﬁed in equations(2-4) and explained in the main text.3 A probabilistic Model for TDSThis section describes the probabilistic generative model which ... differentmodels before implementing a full-ﬂedged parser.3.1 Model descriptionIn order to compute the probability of a given TDSstructure, we make use of three separate proba-bilistic generative models,...

Tài liệu Báo cáo khoa học: "A Finite-State Model of Human Sentence Processing" docx

... sentence processing model is lim-ited to the DO/SC ambiguity, and the descriptionof their model is not clear. In addition, their model is far beyond a simple statistical model: the in-teraction ... Thisis a limitation of our model, and does not matchany previous empirical ﬁnding.5 DiscussionThe current study explores Corley and Crocker’s model( 2000) further on the model s account of hu-man ... proposed model. Although the model we used in the currentstudy is not a novelty, the current work largely dif-fers from the previous study in its scope of dataused and the interpretation of the model...

Xem thêm