0

automatic evaluation of machine translation quality

Tài liệu Báo cáo khoa học:

Tài liệu Báo cáo khoa học: "Automatic Evaluation of Machine Translation Quality Using Longest Common Subsequence and Skip-Bigram Statistics" doc

Báo cáo khoa học

... Quantitative Quality Measure for Machine Translation System. In Proceedings of COLING-92, Nantes, France. Thompson, H. S. 1991. Automatic Evaluation of Translation Quality: Outline of Methodology ... Research. In Proceedings of the 2nd International Conference on Language Resources and Evaluation, Athens, Greece. NIST. 2002. Automatic Evaluation of Machine Translation Quality using N-gram ... Recall of Machine Translation. In Proceedings of NAACL/HLT 2003, Edmonton, Canada. Nießen S., F.J. Och, G, Leusch, H. Ney. 2000. An Evaluation Tool for Machine Translation: Fast Evaluation...
  • 8
  • 442
  • 0
Báo cáo khoa học:

Báo cáo khoa học: "Automatic Construction of Machine Translation Knowledge Using Translation Literalness" docx

Báo cáo khoa học

... trans./word4.21Rewritten TranslationsOriginal TranslationsTable 1: Comparison of TDMT Training Translations and Original Translationsthe rule writers rewrote translations to make tar-get ... words in the target languageand the mean number of translation words, bothvalues of the rewritten translations are lower thanthose of the original translations. This is because1When TDMT translates ... the objective translationsfor the rule writer. Therefore, the rewritten translations wereacquired by translating trained sentences by TDMT.157 Automatic Construction of Machine Translation KnowledgeUsing...
  • 8
  • 345
  • 0
Báo cáo khoa học:

Báo cáo khoa học: "Automatic Evaluation of Chinese Translation Output: Word-Level or Character-Level" doc

Báo cáo khoa học

... essential for automatic evaluation of Chinese translation output. Our analysis suggests several key reasons behind this finding. 2 Chinese Translation Evaluation Automatic MT evaluation aims ... Fordyce, Philipp Koehn, Christof Monz and Josh Schroeder, 2007. (Meta-) Evaluation of Machine Translation. Proceedings of the Second Workshop on Statistical Machine Translation, pages 136-158, ... for Machine Translation Performance. Proceedings of the Third Workshop on Statistical Machine Translation, pages 224-232, Columbus, Ohio, USA. George Doddington, 2002. Automatic Evaluation of...
  • 6
  • 344
  • 1
Báo cáo khoa học:

Báo cáo khoa học: "Feedback Cleaning of Machine Translation Rules Using Automatic Evaluation" pot

Báo cáo khoa học

... MT quality wouldcertainly improve further.7 Discussion7.1 Other Automatic Evaluation MethodsThe idea of feedback cleaning is independent of BLEU. Some automatic evaluation methods of MT quality ... current topic of machine translation is automatic evaluation of MT quality (Papineni et al.,2002; Yasuda et al., 2001; Akiba et al., 2001). Thesemethods aim to replace subjective evaluation in ... Yanagida. 2001. An au-tomatic evaluation method of translation quality using translation answer candidates queried from a parallelcorpus. In Proceedings of Machine Translation Sum-mit VIII, pages...
  • 8
  • 313
  • 0
Báo cáo khoa học:

Báo cáo khoa học: "Automatic Evaluation of Linguistic Quality in Multi-Document Summarization" pptx

Báo cáo khoa học

... year of evaluation to the next.5.2 Evaluation of rankingsWe examine the predictive power of our featuresfor each of the five linguistic quality questions intwo settings. In system-level evaluation, ... of systems,ignoring the linguistic quality of the system out-put. Part of the reason for this imbalance is theexistence of ROUGE (Lin and Hovy, 2003; Lin,2004), the system for automatic evaluation ... to be more predictive of the linguistic quality of these summaries.7 ConclusionWe have presented an analysis of a wide variety of features for the linguistic quality of summaries.Continuity...
  • 11
  • 407
  • 0
Tài liệu Báo cáo khoa học:

Tài liệu Báo cáo khoa học: "Evaluation of Machine Translations by Reading Comprehension Tests and Subjective Judgments" doc

Báo cáo khoa học

... though not necessarily accurate, translations, EVALUATION OF MACHINE TRANSLATIONS 7 [Mechanical Translation, vol. 8, No. 2, February 1965] Evaluation of Machine Translations by Reading Comprehension ... judgments of the clarity of meaning of indivi- dual sentences. The approach through testing of reading comprehension provides a direct test of at least one aspect of the quality of translation. ... combination of several methods, including the two investigated here, would appear likely to be of some use. Summary and Conclusions Evaluation of the quality of machine translations by means of a...
  • 7
  • 684
  • 1
Tài liệu Báo cáo khoa học:

Tài liệu Báo cáo khoa học: "Automatic Evaluation of Sentence-Level Fluency Andrew Mutton∗" pdf

Báo cáo khoa học

... Evaluation of Ma-chine Translation. Technical Report RC22176, IBM.Joseph Turian, Luke Shen, and I. Dan Melamed. 2003. Evalua-tion of Machine Translation and its evaluation. In Proceedings of MT ... grammar, rhythm and flow,appropriateness of tone, and several other specificcharacteristics of good text.In terms of automatic evaluation, we are not aware of any technique that measures only fluency ... ‘fooled’ dependingon generation method, the machine learnerprovides a consistent estimator of fluency.1 IntroductionIntrinsic evaluation of the output of many languagetechnologies can be characterised...
  • 8
  • 507
  • 0
Tài liệu Báo cáo khoa học:

Tài liệu Báo cáo khoa học: "Predicting the fluency of text with shallow structural features: case studies of machine translation and human-written text" doc

Báo cáo khoa học

... human and machine translations.• Distinguish fluent machine translations frompoor machine translations.• Distinguish the better (in terms of fluency) translation among two translations of thesame ... Proceedings of HLT/NAACL’04.S. Corston-Oliver, M. Gamon, and C. Brockett. 2001.A machine learning approach to the automatic eval-uation of machine translation. In Proceedings of 39th Annual Meeting of ... in thecontext of machine translation for preliminary in-vestigations of fluency. Nevertheless, our findingsare also potentially beneficial for sentence-level evaluation of machine translation. 2...
  • 9
  • 438
  • 0
Báo cáo khoa học:

Báo cáo khoa học: "Cross-Language Document Summarization Based on Machine Translation Quality Prediction" pdf

Báo cáo khoa học

... evaluation results will be described together in Section 5. 4 Machine Translation Quality Predic-tion 4.1 Methodology In this study, machine translation (MT) quality reflects both the translation ... 2.1 Machine Translation Quality Prediction Machine translation evaluation aims to assess the correctness and quality of the translation. Usu-ally, the human reference translation is provided, ... to the target language by using machine translation services. However, though machine translation techniques have been advanced a lot, the machine translation quality is far from satisfactory,...
  • 10
  • 438
  • 0
Báo cáo khoa học:

Báo cáo khoa học: " A Tool for Error Analysis of Machine Translation Output" doc

Báo cáo khoa học

... Principles of context-based machine translation evaluation. Machine Translation, 17(1):43–75.Masaki Murata, Kiyotaka Uchimoto, Qing Ma, ToshiyukiKanamaru, and Hitoshi Isahara. 2005. Analysis of machine ... ref-erence translation. 1 Introduction Machine translation evaluation is a difficult task,since there is not only one correct translation of asentence, but many equally good translation options.Often, ... highlights parts of the MToutput that it suspects are non-grammatical.Even though the main purpose of BLAST is forerror annotation of machine translation output, thefreedom in the use of error typologies...
  • 6
  • 479
  • 0
Báo cáo khoa học:

Báo cáo khoa học: "Is the Generally Accepted Strategy of Machine-Translation Research Optimal?" ppt

Báo cáo khoa học

... I(Tn), whereas the main problem of machine translation is the algorithmiza- tion of this process of extraction. The introduction into the theory of translation of this logical construct—the ... process of human translation (and therefore of analysis in the course of translation from one natural language into another, for such translation could be treated as a combination of successive translations ... extent of the knowledge of language in general which is necessary from the point of view of theoretical linguistics with the extent of knowledge of language necessary for the achievement of translation...
  • 8
  • 379
  • 0
Báo cáo khoa học:

Báo cáo khoa học: "Case Revisited: In the Shadow of Automatic Processing of Machine-Readable Dictionaries" ppt

Báo cáo khoa học

... trying to get a set of core verbs as proto- types of classes based on certain statistics and genus verb sense nets (the latter is being con- structed by G. Stein). A primary set of core verbs ... word list of LDOCE, then gradually ex- panding them to all the verbs defined in LDOCE. There are various subtasks associated with this work: 1. Dynamically adjusting classifications of relational ... endurance. An example of an initial representation for break is: ((+) (u-) (0)) break ((-) (u-) (0)), where (+) stands for active, (-) for passive, (u -) for indexing of the internal environment,...
  • 2
  • 247
  • 0
Tài liệu Báo cáo khoa học:

Tài liệu Báo cáo khoa học: "The Contribution of Linguistic Features to Automatic Machine Translation Evaluation" docx

Báo cáo khoa học

... translation evaluation of cial results. In Of -cial release of automatic evaluation scores for allsubmissions, August.Chin-Yew Lin and Franz Josef Och. 2004. Automatic Evaluation of Machine Translation ... NIST MT evaluation exercise. InProceedings of the NIST 2005 Machine Translation Evaluation Workshop.Christopher Culy and Susanne Z. Riehemann. 2003.The Limits of N-gram Translation Evaluation ... In Proceedings of MT-SUMMIT IX, pages 1–8.George Doddington. 2002. Automatic Evaluation of Machine Translation Quality Using N-gram Co-Occurrence Statistics. In Proceedings of the 2nd In-ternational...
  • 9
  • 514
  • 0
Báo cáo khoa học:

Báo cáo khoa học: "Automatic Evaluation Method for Machine Translation using Noun-Phrase Chunking" pptx

Báo cáo khoa học

... Assessments of Machine Translation Quality. In Proc. of MT Summit IX, 63–70.Hiroshi Echizen-ya and Kenji Araki. 2007. Auto-matic Evaluation of Machine Translation basedon Recursive Acquisition of an ... andRobert Dale. 2007. GLEU: Automatic Eval-uation of Sentence-Level Fluency. In Proc. of ACL’07, 344–351.NIST. 2002. Automatic Evaluation of Machine Translation Quality Us-ing N-gram Co-Occurrence ... Mea-sure with Applications to Machine Translation Evaluation. In Proc. of MT Summit IX, 240–247.Chin-Yew Lin and Franz Josef Och. 2004. Auto-matic Evaluation of Machine Translation Qual-ity Using...
  • 10
  • 415
  • 0

Xem thêm