a joint statistical model

... be divided into statistical algorithms and rule-based algorithms. Statistical algorithms generally use character n- gram (Eojeol 1 or Eumjeol 2 n-gram in Korean) (Kang and Woo, 2001; Kwon, ... it needs a word dictionary and takes long time for searching many character combinations. 61 4.2 Experiment Results and Analyses We used two separate Eumjeol n-grams as lan- guage models for ... single Jaso tran- 3 Jaso is a Korean character. 4 ‘Transition’ means the correct character is changed to other character due to some causes, such as typographical errors. sition case (나와욧Æ나와요...

Ngày tải lên: 20/02/2014, 12:20

... important subtask for many natural language processing applications, such as partial parsing, information retrieval and machine translation. A baseNP is a simple noun phrase that does not contain other ... pp.218-224. COLING-ACL’98 Lance A. Ramshaw and Michael P. Marcus ( In Press). Text chunking using transformation-based learning. In Natural Language Processing Using Very large Corpora. Kluwer. Originally appeared in ... Treebank II, and the definition of baseNP is the same as Ramshaw’s, Table 1 summarizes the average performance on both baseNP tagging and POS tagging, each section of the whole Penn Treebank was...

Ngày tải lên: 08/03/2014, 05:20

... system learns this as a non-transliteration but it is wrongly annotated as a transliteration in the gold standard. Arabic nouns have an article “al” attached to them which is translated in English as ... uses Hidden Markov Models (Nabende, 2010; Darwish, 2010; Jiampojamarn et al., 2010), Finite State Au- tomata (Noeman and Madkour, 2010) and Bayesian learning (Kahki et al., 2011) to learn transliteration pairs ... International Language Resources and Evaluation (LREC’10), Val- letta, Malta. Sittichai Jiampojamarn, Kenneth Dwyer, Shane Bergsma, Aditya Bhargava, Qing Dou, Mi-Young Kim, and Grzegorz Kondrak....

Ngày tải lên: 19/02/2014, 19:20

... a consensus translation technique to bootstrap parallel data using off-the-shelf translation sys- tems for training a hierarchical statistical transla- tion model for general domain instant ... SMS normalization. 2.3 SMS Normalization versus Text Para- phrasing Problem Others may regard SMS normalization as a para- phrasing problem. Broadly speaking, paraphrases capture core aspects ... minimal adaptation. One advantage of this pre-translation normalization is that the di- versity in different user groups and domains can be modeled separately without accessing and adapting...

Ngày tải lên: 20/02/2014, 12:20

... Boston, MA, May. Christoph Tillmann and Fei Xia. 2003. A Phrase-based Unigram Model for Statistical Machine Translation. In Companian Vol. of the Joint HLT and NAACL Confer- ence (HLT 03), pages ... paper, we present a block-based model for statis- tical machine translation. A block is a pair of phrases which are translations of each other. For example, Fig. 1 shows an Arabic-English translation ... set of candidates. This computational advantage is the main reason that we adopt the local model in this paper. 3.3 Global versus Local Models Both the global and the localized log-linear models...

Ngày tải lên: 20/02/2014, 15:20

... for cepstral mean normalisation (CMN) and cep- stral mean and variance normalisation (CMVN). Stage 2: A local-match distance matrix is then calculated by measuring the cosine distance be- Speech ... lan- guage and building a lexicon, whereas grammar is learnt via non -statistical methods later on. Sei- denberg et al. (2002) believe that learning grammar begins when statistical learning ... the computational and mathematical methods to those that model be- havioural data of human speech perception and production within five main areas: Front-end Processing: Research and devel- opment...

Ngày tải lên: 22/02/2014, 02:20

... propose a cascaded linear model for joint Chinese word segmentation and part- of-speech tagging. With a character-based perceptron as the core, combined with real- valued features such as language models, ... ap- proach of discriminative models treats segmentation as a labelling problem by assigning each character a boundary tag (Xue and Shen, 2003), Joint S&T can be conducted in a labelling fashion ... features as well as the character-based ones. We noticed that the templates related to word unigrams and bigrams bring to the feature space an enlargement much rapider than the character-base...

Ngày tải lên: 08/03/2014, 01:20

... co-occurrence analysis oper- ate over large corpora, which are typically unavail- able for a lost language. Finally, Knight and Yamada (1999) and Knight et al. (2006) describe a computational HMM- based ... structural sparsity constraints on character-level mappings. We assume that an ac- curate alphabetic mapping between related lan- guages will be sparse in the following way: each letter will map to a ... Publishers. Benjamin Snyder and Regina Barzilay. 2008. Cross- lingual propagation for morphological analysis. In Proceedings of the AAAI, pages 848–854. Wilfred Watson and Nicolas Wyatt, editors. 1999. Handbook...

Ngày tải lên: 17/03/2014, 00:20

... for Phrase-Based Translation. In Proc. ACL, pages 315-323. Kenji Yamada and Kevin Knight. 2001. A Syntax- based Statistical Translation Model. In Proc. ACL, pages 523-530. Le Zhang. 2006. Maximum ... Entropy Based Phrase Reordering Model for Statistical Machine Translation. In Proc. ACL- Coling, pages 521-528. Deyi Xiong, Min Zhang, Aiti Aw, and Haizhou Li. 2009. A Syntax-Driven Bracketing Model ... trans- lation in traditional phrase-based models (Koehn et al., 2003; Xiong et al., 2006), but also char- acterize the complicated long distance reordering similar to syntactic based statistical...

Ngày tải lên: 23/03/2014, 16:20

... Lexical Chain Features 4.1 Chain starts and ends We follow (Chan et al. 2007) to model the lexi- cal chain starts and ends at a story boundary with a statistical distribution. We apply a window ... consideration and statistically modeled. 2 Experimental Setup Experiments are conducted using data from the TDT-2 Voice of America Mandarin broadcast. In particular, we only use the data from ... terms and locating instances of time where the count of chain starts and ends (boun- dary strength) achieves local maxima. Chan et al. (2007) enhanced this approach through statistical modeling...

Ngày tải lên: 23/03/2014, 17:20

... Table 3: Examples of common character bigrams for each part of speech in the infrequent words character type sequence kanji katakana katakana-kanji kanji-hiragana hiragana kanji-katakana ... kanji-hiragana hiragana kanji-katakana kat akana-symbol-katakana number kanji-hiragana-kanji alphabet kanji-hir agana-kanji-hir agana hiragana-kanji percent 45.1% 11.4% 6.5% 5.6% ... different types of characters other than punc- tuation marks: kanji, hiragana, katakana, Roman alphabet, and Arabic numeral. Kanji which means 'Chinese character' is used for both...

Ngày tải lên: 23/03/2014, 19:20

Ngày tải lên: 30/03/2014, 17:20

Ngày tải lên: 30/03/2014, 21:20

Ngày tải lên: 31/03/2014, 03:20

Ngày tải lên: 31/03/2014, 04:20

Ngày tải lên: 20/06/2014, 01:20

Ngày tải lên: 20/06/2014, 20:20

Ngày tải lên: 21/06/2014, 17:20

Ngày tải lên: 05/09/2013, 16:30