Báo cáo khoa học: "STOCHASTIC MODELING OF LANGUAGE VIA SENTENCE SPACE PARTITIONING" potx

... STOCHASTIC MODELING OF LANGUAGE VIA SENTENCE SPACE PARTITIONING Alex Martelli IBM Rome Scientific Center via Giorgione 159, ROME (Italy) ABSTRACT In some computer applications of linguistics ... quotient space of the sentence space on a suitable equivalence relation; in other words, by using as, contexts of the language model, the equivalence classes in a pa...

Ngày tải lên: 01/04/2014, 00:20

Ngày tải lên: 23/03/2014, 17:20

... of a variety of language models trained from text or speech corpora of vari- ous genres and sizes. The largest available language models are based on written text: we investigate the effect of ... next two Sections in more detail. 5.2 Language Model Informally, the task of language model component of the noisy channel model is to assess fluency of the sentence with disfl...

Ngày tải lên: 20/02/2014, 04:20

... system consists of acoustic models of speech sounds and of a statistical language model (LM). The LM learns the probabilities of word sequences from text corpora available for training. The perfor- mance of ... Proceedings of the 12th Conference of the European Chapter of the ACL, pages 157–165, Athens, Greece, 30 March – 3 April 2009. c 2009 Association for Computational L...

Ngày tải lên: 22/02/2014, 02:20

... In Proceedings of the Annual Conference of the Association for Com- putational Linguistics. Andreas Stolcke. 2002. Srilm an extensible language modeling toolkit. In Proceedings of the Interna- tional ... sub- set of the block alignment patterns that serve as terminal productions of the ITG that restricts the output space of our model. These terminal pro- ductions cover up to...

Ngày tải lên: 07/03/2014, 22:20

... Lewis Microsoft Research Redmond, WA 98052, USA {bobmoore,wilewis}@microsoft.com Abstract We address the problem of selecting non- domain-specific language model training data to build auxiliary language ... domain- specific and non-domain-specifc language models, for each sentence of the text source used to produce the latter language model. We show that this produces better lan...

Ngày tải lên: 07/03/2014, 22:20

... of/ ) Figure 4 shows an abstract representation of a/) of an n-word sentence. When wk(1 < k <_ n) is the head of the sentence, any D of the sentence can be represented by a St(l, EOS) ... assume that there is always a marking tag, "EOS"(End of Sentence) , at the end of a sentence and it has the head word of the sentence as its own depen- dent(&q...

Ngày tải lên: 08/03/2014, 05:21

... Hans-Hennig von Gru ¨ nberg 1 1 Institute of Chemistry, University of Graz, Austria 2 Institute of Molecular Biosciences, University of Graz, Austria 3 Trinity Center of Bioengineering, Trinity College ... consequence of the sharing of a constant amount of LD between an increasing number of cells. From our measurements, and in agreement with published data [16,17], we found...

Ngày tải lên: 16/03/2014, 04:20

... F-Measure of 96.33%, number of bigrams decreases by up to 90%. # of bigrams % of KLD KLD 100,000 100% Step-10K 25,000 25% Step-5K 15,000 15% Step-2K 10,000 10% Table 1. Comparison of Number of ... pruning method of n-gram language model for Chinese word segmentation. To reduce the size of the language model that is used in a Chinese word segmenta- tion system,...

Ngày tải lên: 17/03/2014, 04:20

... the machine to guess at a sequence of words which constitute its best estimate of the meaning of the sentence in the foreign language. The simplest type of problem is "the uncon- scious ... clear that the success of the human in achieving a probability of .50 in anticipating the words in a sentence is largely due to his expe- rience and the real meanings of t...

Ngày tải lên: 23/03/2014, 13:20