applications of automatic evaluation methods

Ngày tải lên: 31/03/2014, 20:20

Ngày tải lên: 20/06/2014, 00:20

Ngày tải lên: 29/06/2014, 13:20

Ngày tải lên: 17/12/2013, 15:08

... grammar, rhythm and flow, appropriateness of tone, and several other specific characteristics of good text. In terms of automatic evaluation, we are not aware of any technique that measures only fluency ... Methods PoStag In the first of these, we constructed a rough approximation of typical sentence grammar structure by taking bigrams over part -of- speech tags. 6 Then, given a string of PoS tags of length n, t 1 . ... according to a mix of the initial method of Section 3.2, for calibration, and the new methods above. We again used a sentence length of 24, and sequence lengths for the initial method of l = 1, 8,...

Ngày tải lên: 20/02/2014, 12:20

... present the evaluations of ROUGE-L, ROUGE-S, and compare their per- formance with other automatic evaluation meas- ures. 5 Evaluations One of the goals of developing automatic evalua- tion ... Proceedings of COLING-92, Nantes, France. Thompson, H. S. 1991. Automatic Evaluation of Translation Quality: Outline of Methodology and Report on Pilot Experiment. In Proceedings of the Evaluator’s ... human evaluations. Therefore the first criterion to assess the usefulness of an automatic evaluation measure is to show that it correlates highly with human judgments in different evaluation...

Ngày tải lên: 20/02/2014, 16:20

... improve further. 7 Discussion 7.1 Other Automatic Evaluation Methods The idea of feedback cleaning is independent of BLEU. Some automatic evaluation methods of MT quality other than BLEU have been ... 2003. Appli- cations of automatic evaluation methods to measuring a capability of speech translation system. In Proceed- ings of the 10th Conference of the European Chap- ter of the Association ... Methods quality of the proposed methods (simple feedback cleaning and cross-cleaning) are considerably im- proved over those of the previous methods. Focusing on the subjective quality of the proposed methods, ...

Ngày tải lên: 08/03/2014, 04:22

... year of evaluation to the next. 5.2 Evaluation of rankings We examine the predictive power of our features for each of the five linguistic quality questions in two settings. In system-level evaluation, ... row of Table 1 that none of the system rankings based on these mea- sures of linguistic quality are significantly posi- tively correlated with system rankings of content. The development of automatic ... of systems, ignoring the linguistic quality of the system out- put. Part of the reason for this imbalance is the existence of ROUGE (Lin and Hovy, 2003; Lin, 2004), the system for automatic evaluation...

Ngày tải lên: 16/03/2014, 23:20

... essential for automatic evaluation of Chinese translation output. Our analysis suggests several key reasons behind this finding. 2 Chinese Translation Evaluation Automatic MT evaluation aims ... Todd Ward and Wei- Jing Zhu, 2002. BLEU: a Method for Automatic Evaluation of Machine Translation. Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, pages ... metrics more suitable for the automatic evaluation of Chinese translation output. 6 Conclusion In this paper, we conducted a detailed study of the relative merits of word-level versus character-level...

Ngày tải lên: 17/03/2014, 00:20

... al. (2005) investigate a number of automatic evalua- tion methods for generation in terms of adequacy and fluency on automatically generated English paraphrases. They find that the automatic metrics are ... evalua- tion of a string realisation system usually involves string comparisons between the output of the sys- tem and some gold standard set of strings. Typi- cally automatic metrics from the fields of ... adequacy, but not good measures of fluency, i.e. syntactic cor- rectness. In this paper, we carry out experiments to corre- late automatic evaluation of the output of a surface realisation ranking...

Ngày tải lên: 23/03/2014, 17:20

... gene- ration of trivial dialogue phrases through the ap- plication of a transfer-like genetic algorithm (GA) approach. We propose as well, the automatic eval- uation of the correctness 2 of the generated ... (2005),the size of indexable Web had become approx- imately 11.5 billion pages 9 The tuning of the thresholds of each n-gram type was preformed using the phrases of the Phrase DB 10 The evaluation ... conversation. The results of the human evaluation are shown in Table 3. In this evaluation, 26 out of the 80 phrases “accepted” by the system were considered “completely natural”, and 18 out of the 80 “ac- cepted”...

Ngày tải lên: 23/03/2014, 18:20

Ngày tải lên: 23/03/2014, 20:20

Ngày tải lên: 31/03/2014, 04:20

Ngày tải lên: 20/06/2014, 00:20

Ngày tải lên: 21/06/2014, 03:20

... DFT of the impulse response provides samples of this continuous curve. If youN/2 %1 make the DFT longer, the resolution improves, and you obtain a better idea of Chapter 9- Applications of the ... resulting in various patterns of tails. Chapter 9- Applications of the DFT 177 This leads us to the flat-top window, shown in Fig. 9-5d. In some applications the amplitude of a spectral peak must be ... noise reduces in proportion to the square-root of the number of segments. While 100 segments is typical, some applications might average millions of segments to bring out weak features. There...

Ngày tải lên: 13/09/2012, 09:49

... Theory and Applications of OFDM Ahmad R. S. Bahai and Burton R. Saltzberg Principles of Digital Transmission: With Wireless Applications Sergio Benedetto and Ezio Biglieri Simulation of Communication ... convolution of two signals of length N is a sequence of length N so the inter-block interference issue is resolved. Proper windowing of OFDM blocks, as shown later, is important to mitigate the effect of ... combination of transmit and receive filters, is Nyquist, with the roll-off factor assumed to be less than 1. Figure 1.7. OFDM modulation concept: Real and Imaginery components of an OFDM symbol...

Ngày tải lên: 02/03/2013, 16:58

... 3 4. Methods of the study 4 Part II: Development. Chapter 1: Theoretical background. I. An overview of English morpheme I.1. Definition of Morpheme 5 I.2. Type of morpheme 6 II. An overview of ... different form of the same word 19 English morpheme system Luong Thuan & Kim Phuong OUTLINE Part I: Introduction. 1. Rationale (reasons of the study) 3 2. Aims of the study 3 3. Scope of the study ... system Luong Thuan & Kim Phuong hội trưởng (president of association) đội trưởng (head of group) nhóm trưởng (head of group) tổ trưởng (head of small group) Many morphemes in this type may be...

Ngày tải lên: 08/04/2013, 09:31