a maximum similarity metric for machine translation evaluation
Báo cáo khoa học: "M AX S IM: A Maximum Similarity Metric for Machine Translation Evaluation" doc
Ngày tải lên :
08/03/2014, 01:20
... standard
metric for automatic evaluation of MT performance.
To score a system translation, BLEU tabulates the
number of n-gram matches of the system translation
against one or more reference translations. ... translation
tasks, and also measured the correlation (with hu-
man judgement) of 11 automatic MT evaluation
metrics. The workshop used a Europarl dataset and a
News Commentary dataset, where each ... chunking, named en-
tity tagging, and finally semantic role tagging need
to be performed.
2.3 ParaEval
The ParaEval metric (Zhou et al., 2006) uses a
large collection of paraphrases, automatically ex-
tracted...
- 8
- 248
- 0
Báo cáo khoa học: "Stochastic Iterative Alignment for Machine Translation Evaluation" doc
Ngày tải lên :
08/03/2014, 02:21
... 2005. Syntactic fea-
tures for evaluation of machine translation. In ACL
2005 Workshop on Intrinsic and Extrinsic Evalua-
tion Measures for Machine Translation and/or Sum-
marization.
Bo Pang, Kevin ... morphological processing and synonym ex-
traction tools are available for English, but are not
always available for other languages. In order to
take advantage of loose-sequence-based metrics
and avoid ... the Association for Com-
putational Linguistics (NAACL-03).
Kishore Papineni, Salim Roukos, Todd Ward, and Wei-
Jing Zhu. 2002. Bleu: a method for automatic eval-
uation of machine translation. ...
- 8
- 264
- 0
Tài liệu Báo cáo khoa học: "A Large Scale Distributed Syntactic, Semantic and Lexical Language Model for Machine Translation" doc
Ngày tải lên :
20/02/2014, 04:20
... Syntax-
based language models for statistical machine transla-
tion. MT Summit IX., Intl. Assoc. for Machine Trans-
lation.
C. Chelba and F. Jelinek. 1998. Exploiting syntactic
structure for language ... Language,
14(4):283-332.
D. Chiang. 2005. A hierarchical phrase-based model for
statistical machine translation. The 43th Annual Con-
ference on Association of Computational Linguistics
(ACL), ... Computational Linguistics (ACL),
311-318.
K. Papineni, S. Roukos, T. Ward, and W. Zhu. 2002.
Bleu: a method for automatic evaluation of machine
translation. The 40th Annual meeting of the Associa-
tion...
- 10
- 567
- 0
Tài liệu Báo cáo khoa học: "A Discriminative Syntactic Word Order Model for Machine Translation" pdf
Ngày tải lên :
20/02/2014, 12:20
... models for
statistical machine translation. In ACL.
D. Chiang. 2005. A hierarchical phrase-based model for statis-
tical machine translation. In ACL.
M. Collins. 2000. Discriminative reranking for ... Discriminative training and max-
imum entropy models for statistical machine translation. In
ACL.
F. J. Och and H. Ney. 2004. The alignment template approach
to statistical machine translation. ... inference and train-
ing of context-rich syntactic translation models. In ACL.
P. Koehn. 2004. Pharaoh: A beam search decoder for phrase-
based statistical machine translation models. In AMTA.
R....
- 8
- 404
- 0
Báo cáo khoa học: "Combining Coherence Models and Machine Translation Evaluation Metrics for Summarization Evaluation" doc
Ngày tải lên :
07/03/2014, 18:20
... promote research
on automatic evaluation of summary readability, the
Text Analysis Conference (TAC) (Owczarzak and
Dang, 2011) introduced a new subtask on readability
to its Automatically Evaluating ... between summariza-
tion and MT evaluation, we will adapt a state-of-
the-art MT evaluation metric to measure summary
content quality. To apply deep linguistic analysis,
we also enhance an existing ... TESLA: Translation evaluation of sentences
with linear-programming-based analysis. In Proceed-
ings of the Joint Fifth Workshop on Statistical Machine
Translation and MetricsMATR, Uppsala, Sweden....
- 9
- 351
- 0
Tài liệu Báo cáo khoa học: "Robust Machine Translation Evaluation with Entailment Features∗" pptx
Ngày tải lên :
20/02/2014, 07:20
... Regina Barzilay. 2006. Paraphras-
ing for automatic evaluation. In Proceedings of HLT-
NAACL, pages 455–462.
Phillip Koehn. 2005. Europarl: A parallel corpus for
statistical machine translation. ... divergences.
We have also clarified the relationship between MT
evaluation and textual entailment: The majority of
phenomena (but not all) that are relevant for RTE
are also informative for MT evaluation.
The ... Ma-
chine Translation, pages 70–106, Columbus, OH.
Yee Seng Chan and Hwee Tou Ng. 2008. MAXSIM: A
maximum similarity metric for machine translation
evaluation. In Proceedings of ACL-08: HLT, pages
55–62,...
- 9
- 467
- 0
Tài liệu Báo cáo khoa học: "The Contribution of Linguistic Features to Automatic Machine Translation Evaluation" docx
Ngày tải lên :
20/02/2014, 07:20
... combining metric ULC achieves
the same reliability as the best n-gram based met-
ric.
310
2 Previous Work on Machine
Translation Meta -Evaluation
Insofar as automatic evaluation metrics for ma-
chine translation ... Americas
(AMTA), pages 148–155.
Karolina Owczarzak, Josef van Genabith, and Andy
Way. 2007. Labelled Dependencies in Machine
Translation Evaluation. In Proceedings of the ACL
Workshop on Statistical Machine ... to a specific automatic
evaluation metric.
Table 4 shows OST values obtained for the best
metrics. In the table we have also included a ran-
dom, a maximum (always pick the best transla-
tion according...
- 9
- 514
- 0
Tài liệu Báo cáo khoa học: "Quadratic-Time Dependency Parsing for Machine Translation" pdf
Ngày tải lên :
20/02/2014, 07:20
... transla-
tion performance. In Proc. of the ACL Workshop on
Statistical Machine Translation, pages 224–232.
D. Chiang. 2005. A hierarchical phrase-based model
for statistical machine translation. ... alignment template
approach to statistical machine translation. Compu-
tational Linguistics, 30(4):417–449.
F. Och, D. Gildea, S. Khudanpur, A. Sarkar, K. Ya-
mada, A. Fraser, S. Kumar, L. Shen, ... dependency parsing for-
mulated as a maximum spanning tree problem
(McDonald et al., 2005b), which can be solved in
quadratic time, and then present its adaptation and
novel application to phrase-based...
- 9
- 514
- 0
Tài liệu Báo cáo khoa học: "Collecting a Why-question corpus for development and evaluation of an automatic QA-system" pdf
Ngày tải lên :
20/02/2014, 09:20
... excess of information. FAQ-pages tend to also
answer questions which are not asked, and also con-
tain practical examples. Human-powered answers
often contain unrelated information and discourse-
like ... each paid reward.
• Qualifications To improve the data quality,
a HIT can also be attached to certain tests,
“qualifications” that are either system-provided
or created by the requester. An example ... Takaaki Hori, and Sadaoki Furui. 2003.
Evaluation Methods for Automatic Speech Summa-
rization. In In Proc. EUROSPEECH, volume 4, pages
2825–2828, Geneva, Switzerland.
Valentin Jijkoun and Maarten...
- 9
- 610
- 1
Tài liệu Báo cáo khoa học: "Fast Decoding and Optimal Decoding for Machine Translation" doc
Ngày tải lên :
20/02/2014, 18:20
... program. Here we adapt a subtour elimination
strategy used in standard TSP. We create a binary
(0/1) integer variable for each pair of hotels
Fast Decoding and Optimal Decoding for Machine Translation
Ulrich ... Admiralty Way, Suite 1001 Stanford, CA 94305
Marina del Rey, CA 90292 jahr@cs.stanford.edu
germann,knight,marcu,kyamada @isi.edu
Abstract
A good decoding algorithm is critical
to the success of any ... transform a decoding problem in-
stance into a TSP instance? If so, we may take
great advantage of previous research into efficient
TSP algorithms. We may also take advantage of
existing software...
- 8
- 440
- 0
Tài liệu Báo cáo khoa học: "Phrase-Based Backoff Models for Machine Translation of Highly Inflected Languages" docx
Ngày tải lên :
22/02/2014, 02:20
... backoff model produced a
good translation, but the translation was a para-
phrase rather than an identical match to the ref-
erence translation. Since only a single reference
translation is available ... ton
Seattle, WA, USA
katrin@ee.washington.edu
Abstract
We propose a backoff model for phrase-
based machine translation that translates
unseen word forms in foreign-language
text by hierarchical ... p a ast¨aisiin sell-
aiseen lopputulokseen, ett a kyproksen kreikkalainen ja
turkkilainen v¨aest¨onosa voisivat yhdess a nauttia liittymisen
mukanaan tuomista eduista yhdistetyss a tasavallassa.
BASE:...
- 8
- 379
- 0
Tài liệu Báo cáo khoa học: "Resolution for Machine Translation of Telegraphic Messages" docx
Ngày tải lên :
22/02/2014, 03:20
... syntactic and semantic grammar as proposed
here has advantages over either a syntactic grammar or a lexi-
calized semantic grammar. Compared with a syntactic grammar,
the proposed grammar achieves ... Telegraphic Messages.
Pro-
ceedings of Speech and Natural Language Workshop,
DARPA.
Stephanie Seneff. 1992. TINA: A Natural Language System for
Spoken Language Applications.
Computational Linguistics, ... Secondly, after the most likely tag
for each word is assigned, contextual transformations are used to
improve the accuracy.
We have evaluated the tagger performance on the TEST Data
both before and...
- 8
- 365
- 0
Báo cáo khoa học: "Research Methodology for Machine Translation" pptx
Ngày tải lên :
07/03/2014, 18:20
... language): a list of all the
words in the language, each represented by one
form; grammatical and semantic information
may also appear. A dictionary changes as the
language expands and contracts. ... "large" are forms
of different words.
Glossary (of a corpus): a list of all the
forms that occur in a corpus; grammatical and
semantic information may also appear.
Dictionary (of a language): ... card (the translation text card)
contains glossary information (see Glossary
Development); the second card (the analytic
text card) contains analytic information (see
Translation and Analysis)....
- 8
- 281
- 0
Báo cáo khoa học: "Discriminative Modeling of Extraction Sets for Machine Translation" pptx
Ngày tải lên :
07/03/2014, 22:20
... inference is organized around search states
associated with a grammar symbol and a bispan;
augmenting grammar symbols also augments this
state space.
To parse quickly, we prune away search states
using ... links have a precise
interpretation that dictates what phrasal translation
rules can be extracted from a sentence pair. This
mapping allows us to train with existing annotated
data sets and use ... BLEU: A method for automatic
evaluation of machine translation. In Proceedings of
the Annual Conference of the Association for Com-
putational Linguistics.
Andreas Stolcke. 2002. Srilm an extensible...
- 11
- 420
- 0