... Quantitative Quality Measure for Machine Translation System. In Proceedings of COLING-92, Nantes, France. Thompson, H. S. 1991. AutomaticEvaluationof Translation Quality: Outline of Methodology ... Research. In Proceedings of the 2nd International Conference on Language Resources and Evaluation, Athens, Greece. NIST. 2002. AutomaticEvaluationofMachine Translation Quality using N-gram ... Recall ofMachine Translation. In Proceedings of NAACL/HLT 2003, Edmonton, Canada. Nießen S., F.J. Och, G, Leusch, H. Ney. 2000. An Evaluation Tool for Machine Translation: Fast Evaluation...
... trans./word4.21Rewritten TranslationsOriginal TranslationsTable 1: Comparison of TDMT Training Translations and Original Translationsthe rule writers rewrote translations to make tar-get ... words in the target languageand the mean number oftranslation words, bothvalues of the rewritten translations are lower thanthose of the original translations. This is because1When TDMT translates ... the objective translationsfor the rule writer. Therefore, the rewritten translations wereacquired by translating trained sentences by TDMT.157 Automatic Construction ofMachineTranslation KnowledgeUsing...
... essential for automaticevaluationof Chinese translation output. Our analysis suggests several key reasons behind this finding. 2 Chinese TranslationEvaluation Automatic MT evaluation aims ... Fordyce, Philipp Koehn, Christof Monz and Josh Schroeder, 2007. (Meta-) EvaluationofMachine Translation. Proceedings of the Second Workshop on Statistical Machine Translation, pages 136-158, ... for MachineTranslation Performance. Proceedings of the Third Workshop on Statistical Machine Translation, pages 224-232, Columbus, Ohio, USA. George Doddington, 2002. AutomaticEvaluation of...
... MT quality wouldcertainly improve further.7 Discussion7.1 Other AutomaticEvaluation MethodsThe idea of feedback cleaning is independent of BLEU. Some automaticevaluation methods of MT quality ... current topic ofmachinetranslation is automatic evaluationof MT quality (Papineni et al.,2002; Yasuda et al., 2001; Akiba et al., 2001). Thesemethods aim to replace subjective evaluation in ... Yanagida. 2001. An au-tomatic evaluation method oftranslationquality using translation answer candidates queried from a parallelcorpus. In Proceedings ofMachineTranslation Sum-mit VIII, pages...
... year of evaluation to the next.5.2 Evaluationof rankingsWe examine the predictive power of our featuresfor each of the five linguistic quality questions intwo settings. In system-level evaluation, ... of systems,ignoring the linguistic qualityof the system out-put. Part of the reason for this imbalance is theexistence of ROUGE (Lin and Hovy, 2003; Lin,2004), the system for automaticevaluation ... to be more predictive of the linguistic qualityof these summaries.7 ConclusionWe have presented an analysis of a wide variety of features for the linguistic qualityof summaries.Continuity...
... though not necessarily accurate, translations, EVALUATION OFMACHINE TRANSLATIONS 7 [Mechanical Translation, vol. 8, No. 2, February 1965] Evaluation ofMachine Translations by Reading Comprehension ... judgments of the clarity of meaning of indivi- dual sentences. The approach through testing of reading comprehension provides a direct test of at least one aspect of the qualityof translation. ... combination of several methods, including the two investigated here, would appear likely to be of some use. Summary and Conclusions Evaluation of the qualityofmachine translations by means of a...
... Evaluationof Ma-chine Translation. Technical Report RC22176, IBM.Joseph Turian, Luke Shen, and I. Dan Melamed. 2003. Evalua-tion ofMachineTranslation and its evaluation. In Proceedings of MT ... grammar, rhythm and flow,appropriateness of tone, and several other specificcharacteristics of good text.In terms ofautomatic evaluation, we are not aware of any technique that measures only fluency ... ‘fooled’ dependingon generation method, the machine learnerprovides a consistent estimator of fluency.1 IntroductionIntrinsic evaluationof the output of many languagetechnologies can be characterised...
... human and machine translations.• Distinguish fluent machine translations frompoor machine translations.• Distinguish the better (in terms of fluency) translation among two translations of thesame ... Proceedings of HLT/NAACL’04.S. Corston-Oliver, M. Gamon, and C. Brockett. 2001.A machine learning approach to the automatic eval-uation ofmachine translation. In Proceedings of 39th Annual Meeting of ... in thecontext ofmachinetranslation for preliminary in-vestigations of fluency. Nevertheless, our findingsare also potentially beneficial for sentence-level evaluation ofmachine translation. 2...
... evaluation results will be described together in Section 5. 4 MachineTranslationQuality Predic-tion 4.1 Methodology In this study, machinetranslation (MT) quality reflects both the translation ... 2.1 MachineTranslationQuality Prediction Machine translationevaluation aims to assess the correctness and qualityof the translation. Usu-ally, the human reference translation is provided, ... to the target language by using machinetranslation services. However, though machinetranslation techniques have been advanced a lot, the machinetranslationquality is far from satisfactory,...
... Principles of context-based machinetranslation evaluation. Machine Translation, 17(1):43–75.Masaki Murata, Kiyotaka Uchimoto, Qing Ma, ToshiyukiKanamaru, and Hitoshi Isahara. 2005. Analysis of machine ... ref-erence translation. 1 Introduction Machine translationevaluation is a difficult task,since there is not only one correct translationof asentence, but many equally good translation options.Often, ... highlights parts of the MToutput that it suspects are non-grammatical.Even though the main purpose of BLAST is forerror annotation ofmachinetranslation output, thefreedom in the use of error typologies...
... I(Tn), whereas the main problem ofmachinetranslation is the algorithmiza- tion of this process of extraction. The introduction into the theory oftranslationof this logical construct—the ... process of human translation (and therefore of analysis in the course oftranslation from one natural language into another, for such translation could be treated as a combination of successive translations ... extent of the knowledge of language in general which is necessary from the point of view of theoretical linguistics with the extent of knowledge of language necessary for the achievement of translation...
... trying to get a set of core verbs as proto- types of classes based on certain statistics and genus verb sense nets (the latter is being con- structed by G. Stein). A primary set of core verbs ... word list of LDOCE, then gradually ex- panding them to all the verbs defined in LDOCE. There are various subtasks associated with this work: 1. Dynamically adjusting classifications of relational ... endurance. An example of an initial representation for break is: ((+) (u-) (0)) break ((-) (u-) (0)), where (+) stands for active, (-) for passive, (u -) for indexing of the internal environment,...
... translationevaluationof cial results. In Of -cial release ofautomaticevaluation scores for allsubmissions, August.Chin-Yew Lin and Franz Josef Och. 2004. Automatic EvaluationofMachineTranslation ... NIST MT evaluation exercise. InProceedings of the NIST 2005 MachineTranslation Evaluation Workshop.Christopher Culy and Susanne Z. Riehemann. 2003.The Limits of N-gram TranslationEvaluation ... In Proceedings of MT-SUMMIT IX, pages 1–8.George Doddington. 2002. Automatic Evaluation ofMachineTranslationQuality Using N-gram Co-Occurrence Statistics. In Proceedings of the 2nd In-ternational...
... Assessments ofMachine Translation Quality. In Proc. of MT Summit IX, 63–70.Hiroshi Echizen-ya and Kenji Araki. 2007. Auto-matic EvaluationofMachineTranslation basedon Recursive Acquisition of an ... andRobert Dale. 2007. GLEU: Automatic Eval-uation of Sentence-Level Fluency. In Proc. of ACL’07, 344–351.NIST. 2002. Automatic Evaluation ofMachineTranslationQuality Us-ing N-gram Co-Occurrence ... Mea-sure with Applications to MachineTranslation Evaluation. In Proc. of MT Summit IX, 240–247.Chin-Yew Lin and Franz Josef Och. 2004. Auto-matic EvaluationofMachineTranslation Qual-ity Using...