Tài liệu Báo cáo khoa học: "WORD, PHRASE AND SENTENCE" pptx

... WORD, PHRASE AND SENTENCE Kob't F. Sinnnons Univ. of Texas, Austin Among the relative verities of natural language processing are the facts that morphemes and words are primary ... processing are the facts that morphemes and words are primary semantic units, and that their co-ocurrence in phrases and sentences provides cues for selecting sense meanings. In this session, ... analysis, with keyword scanning and statistical treatment of text and with semantic analysis at the single sentence level. Yet, with regard to most of the topics in this and other sessions, there...

Tài liệu Báo cáo khoa học: "Word Vectors and Two Kinds of Similarity" pptx

... number ofother nodes (Barab´asi and Albert, 1999). In the se-mantic networks, such “hub” nodes correspond tobasic and highly polysemous words such as make and money, and these words are likely to ... applicationsassociated with semantic processing (Widdows,2004) and for human modeling in cognitive sci-ence (G¨ardenfors, 2000; Landauer and Dumais,1997). There are also good reasons for studyinggeometric ... constructingword vectors and the type of similarity in a sys-tematic way. Especially this study addresses threemethods, LSA-based, cooccurrence-based, and dictionary-based methods, and two kinds of...

Tài liệu Báo cáo khoa học: "Word representations: A simple and general method for semi-supervised learning" doc

... results and Ta-ble 3 shows the ﬁnal NER F1 results. We compareto the state-of-the-art methods of Ando and Zhang(2005), Suzuki and Isozaki (2008), and forNER—Lin and Wu (2009). Tables 2 and 3 ... 81.44Brown+Gaz 93.25 89.41 82.71Lin and Wu (2009), 3.4B - 88.44 -Ando and Zhang (2005), 27M 93.15 89.31 -Suzuki and Isozaki (2008), 37M 93.66 89.36 -Suzuki and Isozaki (2008), 1B 94.48 89.92 ... models such as Ando and Zhang(2005), Suzuki and Isozaki (2008), and Suzukiet al. (2009) achieve state-of-the-art accuracy.However, these approaches dictate a particularchoice of model and training...

Tài liệu Báo cáo khoa học: "Word Alignment with Synonym Regularization" doc

... 1.031(Vo-gel et al., 1996; Och and Ney, 2003), and HM-BiTAM (Zhao and Xing, 2008) implemented byus. GIZA++ is an implementation of IBM-model4 and HMM, and HM-BiTAM corresponds to ζ =0 ... GIZA++ and HM-BiTAM with the SRH in the lines entitled “withSRH” in Table 1. The GIZA++ and HM-BiTAMwith the SRH slightly outperformed the standardGIZA++ and HM-BiTAM for the 10k and 100kdata ... yield high preci-sion and high recall in accordance with previouswork (Och and Ney, 2003; Zhao and Xing, 2006).We evaluated these results for precision, recall, F-measure and alignment error...

Tài liệu Báo cáo khoa học: "Better Filtration and Augmentation for Hierarchical Phrase-Based Translation Rules" pdf

... looking for phrasesthat contain other phrases and replacing the sub-phrases with nonterminal symbols, it gets hierar-chical rules. Hierarchical rules are more powerfulthan conventional phrases ... approach,p(e|f → f′) =count(e, f → f′)e′count(e′, f → f′)(1)Given a phrase pair f , e and word alignmenta, and the dependent relation of the source sen-tence dJ1(J is the length of ... allowed at the edge of phrases. Pa-rameters of head word trigger are estimated as de-scribed in Section 4. As a default, the maximuminitial phrase length is set to 10 and the maximumrule length...

Tài liệu Báo cáo khoa học: "Word to Sentence Level Emotion Tagging for Bengali Blogs" doc

... classification task on web blog corpora using Support Vector Machine (SVM) and Conditional Random Field (CRF) and the observed results have shown that the CRF classifiers outperform SVM ... module. Rest 200 and 100 sentences, verified by language ex-perts to perform evaluation have been considered as development and test data respectively. 4.1 Feature Selection and Training The ... emotion tag i in the sentence and Ni is the number of occurrences of that emotion tag in the sentence. STWi and STWj are the Sense_Tag_Weights for the emotion tags i and j respectively. Each sentence...

Tài liệu Báo cáo khoa học: "A Phrase-based Statistical Model for SMS Text Normalization" ppt

... special phenomena in SMS texts, e.g. the unique relaxed and creative writing style and the frequent use of unconventional and not yet standardized short-forms. Direct modeling of these special ... correction centralize on typographic and cognitive/orthographic errors (Kukich, 1992) and use approaches (M.D. Kernighan, Church and 2 http://www.etranslator.ro and http://www.transl8bit.com Gale, ... Leven-shtein 1966), specific word set confusions (Gold-ing and Roth, 1999) and pronunciation modeling (Brill and Moore, 2000; Toutanova and Moore, 2002). These models are mostly character-based...

Tài liệu Báo cáo khoa học: "Statistical phrase-based models for interactive computer-assisted translation" pdf

... models has beenproposed, the phrase- based (PB) approach (Tom´as and Casacuberta, 2001; Marcu and Wong, 2002;Zens et al., 2002). The principal innovation of the phrase- based alignment model ... p(˜s|˜t) estimates the probabil-ity of translating the phrase ˜t into the phrase ˜s.A phrase can be comprised of a single word (butempty phrases are not allowed). Thus, the con-ventional word ... of the target phrases,a hidden phrase level alignment variable, αK1, isintroduced. In this case, we assume that the target phrase in position k is produced only by the source phrase in position...

Tài liệu Báo cáo khoa học: "Word Alignment for Languages with Scarce Resources Using Bilingual Corpora of Other Language Pairs" pptx

... researchers build alignment links with bilingual corpora (Wu, 1997; Och and Ney, 2003; Cherry and Lin, 2003; Zhang and Gildea, 2005). In order to achieve satisfactory results, all of these ... corpora in L1-L3 and L2-L3 are available. Using these two additional bilingual corpora, we train two word alignment models for language pairs L1-L3 and L2-L3, respectively. And then, with ... resources and the other is based on the unlimited resources. The unlimited resource consists of a translation dictionary extracted from the alignment of Ro-manian and English WordNet. Lopez and...

Tài liệu Báo cáo khoa học: "Effective Phrase Translation Extraction from Alignment Models" ppt

... sentences, and the phrase ex-traction method does not have limits on the lengthof extracted target side phrase. For each source phrase ranging from positions to the target phrase is given by and , ... be moreaccurate. Now that the candidate pool has been gen-erated, it needs to be scored and pruned to reﬂect rel-ative conﬁdence between candidate translations and to remove spurious translations ... expense, and tend to be difﬁcult toscale to long sentences. Reasons to introduce phrase level translation knowledge sources have been ade-quately shown and conﬁrmed by (Och, Ney, 2000), and we...

Xem thêm