joint phrase alignment and extraction

... parameters s and d over all phrase pairs in the model, long phrase pairs are much more sparse 635 Figure 3: The phrase, block, and word alignments used in heuristic phrase extraction. 5.1 Heuristic Phrase ... model- based phrase extraction compared to heuristic phrase extraction. Using the alignments from HIER, we cre- ated phrase tables using model probabilities (MOD), and heuristic extraction on ... perform weight tuning and testing on specified development and test sets. We compare the accuracy of our proposed method of joint phrase alignment and extraction using the FLAT, HIER and HLEN models,...

Ngày tải lên: 20/02/2014, 04:20

... content extraction from comparable corpora. It consists of tools bundled in two workflows: (1) alignment of comparable documents and extraction of parallel sentences and (2) extraction and bilingual ... generated via word alignment using GIZA++ (Och and Ney, 2000) on parallel corpora. For each word in the source language, the top two translation candidates (based on the word alignment probability ... corpora by means of symmetrical word alignment and/ or by phrase generation (Koehn et al., 2003). Our toolkit exploits comparable corpora in order to find and extract comparable sentences for...

Ngày tải lên: 16/03/2014, 20:20

... tween bandwidth and largeur de bande can be obtained through the edge linking these two units (type 1), or through two edges, one from bandwidth to largeur de bande., and one from bandwidth ... from bandwidth to largeur and bande (type 3), 2. secondly, there may be conflicts between connections: in figure 1 both largeur de bande and tdldcommunications are linked to bandwidth ... multilingual terminology extraction. 3 Multilingual terminology extraction Several works describe methods to extract terms, or candidate terms, in English and/ or French (Justeson and Katz, 1995;...

Ngày tải lên: 17/03/2014, 07:20

Ngày tải lên: 21/06/2014, 19:20

... Extraction and Reordering Model We use a standard way to implement the phrase extraction module for the phrase- based model. That is, we extract all phrase- pairs that are consistent with word alignments. ... standard phrase- based decoding, decoding as parsing, decoding as tree-parsing, and forest-based decoding. z It is easy-to-use and fast. A new system can be built using only a few commands. ... word-to-word alignments, several easy-to-use toolkits are available, such as GIZA++ and Berkeley Aligner. sequence of commands. Given a number of sentence-pairs and the word alignments between...

Ngày tải lên: 19/02/2014, 20:20

... Daum ´ e III and Marcu, 2005; Finkel et al., 2006) and for specific problems such as language modeling and utterance classifica- tion (Saraclar and Roark, 2005) and labeling and chunking (Shimizu and Haas, ... open features in the joint segmentor and POS tagger. Acknowledgements We thank Hwee-Tou Ng and Mengqiu Wang for their helpful discussions and sharing of experimen- tal data, and the anonymous reviewers ... gen- erated candidates, the baseline POS tagger can keep 1/T for the next processing stage, while the joint model can keep only 1/2T , and has to discard the rest. Therefore, even when the candidate...

Ngày tải lên: 20/02/2014, 09:20

... Distributional Similarity Based on Word Alignment The alignment approach to synonym extraction is based on automatic word alignment. Context vec- tors are built from the alignments found in a paral- lel ... apposi- tion and prepositional complement. Examples are given in table 1. Details on the extraction can be found in van der Plas and Bouma (2005). The number of pairs (types) consisting of a word and a ... consideration. The alignment frequencies are used for weighting the features and for applying the frequency cutoff. In the following section we describe the data and resources used in our experiments and finally...

Ngày tải lên: 20/02/2014, 12:20

... framework (§5). 2.1 Alignment forests and alignment Alignment is the process of determining if and how a translation model generates a source, tar- get string pair. To compute an alignment under a ... reference Viterbi extraction k-best extraction max-translation extraction feature expectations intersection by parsing Alignment hypergraph feature expectations max posterior alignment Viterbi alignment Translation ... generic addition and multiplication operation, ⊕ and ⊗, and their identities 0 and 1. Multipli- cation and addition must be associative. Multi- plication must distribute over addition, and v ⊗ 0 9 ...

Ngày tải lên: 07/03/2014, 22:20

... dialogue act, and Overall indicates the performance over the entire set. P stands for precision, R for recall, and F for F-score. 3.3 Results Table 2 shows the performance of our approach and the two ... Research, Development, and Engineering Command (RDECOM). State- ments and opinions expressed do not necessarily re- flect the position or the policy of the United States Government, and no official endorsement ... Semantics and Pragmatics of Dialogue, page 43–50, Stockholm, Sweden, June. Oliver Bender, Klaus Macherey, Franz Josef Och, and Hermann Ney. 2003. Comparison of alignment tem- plates and maximum...

Ngày tải lên: 07/03/2014, 22:20

... factors. 888 parsing (Smith and Eisner, 2008) and may be able to address this issue. 7 Conclusions and Future Work We have proposed a discriminative model that jointly infers morphological properties and syntactic structures. ... Generating and Parsing Classical Greek. Literary and Linguistic Computing 6(4):243– 245. Yoav Goldberg and Reut Tsarfaty. 2008. A Single Gen- erative Model for Joint Morphological Segmentation and Syntactic ... at- tempted joint inference on morphology and syntax, and both considered phrase- structure trees for Mod- ern Hebrew (Cohen and Smith, 2007; Goldberg and Tsarfaty, 2008). The primary focus of...

Ngày tải lên: 17/03/2014, 00:20

... Adjectives and Nouns (which should agree on Gender and Number and definiteness), and between Subjects and Verbs (which should agree on Gender and Number). 3 PCFG-LA Grammar Estimation Klein and Manning ... include joint segmentation and parsing of Chinese, empty element prediction (see (Cai et al., 2011) for a successful application), and a princi- pled handling of multiword-expressions, idioms and named-entities. ... of constituents inside a phrase is relatively free. This is most notably apparent in the verbal phrases and sentential levels. In particular, while most sentences follow an SVO order, OVS and VSO configurations are...

Ngày tải lên: 17/03/2014, 00:20

... 2) When two word alignments are ready, we start from the intersection of the two word alignments, and then continuously add new links between backbone and hypothesis if and only if both ... Tables 3 and 4, we can see that the intersection word alignment- based expansion method improves the performance in all the dev and test sets for both tasks by 0.2-0.57 BLEU- score and the improvements ... combining multiple MT systems’ outputs, and hypothesis alignment is a key step. In this paper, we first compare four word alignment methods for hypothesis alignment under the confusion network...

Ngày tải lên: 17/03/2014, 01:20

... to chunk morphemes into base phrases and decide depen- dency relations of the phrases in a strict left-to- right manner. We show a pseudo code of the al- gorithm and evaluate its performance ... does both base phrase chunk- ing and dependency parsing simultane- ously in linear-time with a single scan of a sentence. In this paper, we show a pseudo code of the algorithm and evaluate its ... pages 49–52, Suntec, Singapore, 4 August 2009. c 2009 ACL and AFNLP A Unified Single Scan Algorithm for Japanese Base Phrase Chunking and Dependency Parsing Manabu Sassano Yahoo Japan Corporation Midtown...

Ngày tải lên: 17/03/2014, 02:20

... Introduction Learning in phrase alignment models generally re- quires computing either Viterbi phrase alignments or expectations of alignment links. For some re- stricted combinatorial spaces of alignments—those that ... practicality of the ILP approach, we show speed and search accuracy results for aligning phrases under a standard phrase translation model. 2 Phrase Alignment Problems Rather than focus on a particular ... all phrases have length at least one: j > i and l > k. 25 Both the conditional model of DeNero et al. (2006) and the joint model of Marcu and Wong (2002) operate in A, as does the phrase- based...

Ngày tải lên: 23/03/2014, 17:20

... issue [1]), and mechanisms for DNA strand exchange have been determined at atomic resolution (W. Kagawa and H. Kurumizaka, this issue [2]). However, before a pair of homologous DNA strands can interact ... for homologous alignment obtained from recent studies in the fission yeast Schizosaccharomyces pombe and the nematode Caenorhabditis elegans, and propose models for homologous recognition. Alignment ... FEBS MINIREVIEW From meiosis to postmeiotic events: Alignment and recognition of homologous chromosomes in meiosis Da-Qiao Ding 1 , Tokuko Haraguchi 1,2,3 and Yasushi Hiraoka 1,2,3 1 Kobe Advanced ICT...

Ngày tải lên: 29/03/2014, 08:20

Ngày tải lên: 03/04/2014, 12:42

Ngày tải lên: 16/04/2014, 11:04

Ngày tải lên: 17/04/2014, 09:43

Ngày tải lên: 06/05/2014, 08:53

Ngày tải lên: 01/06/2014, 13:57