Tài liệu Báo cáo khoa học: "Guiding Statistical Word Alignment Models With Prior Knowledge" pdf

... incor-porate prior knowledge such as heuristicsor linguistic features in statistical generative word alignment models. Prior knowledgeplays a role of probabilistic soft constraintsbetween bilingual word ... NNj=1cijcilogcijci. With the entropy of a word, the likelihood of word w being tagged as a function word is approximated with w(1)= wand being tagged as a content word with w(0)= 1 − w.We ... as 1.In building word alignment models, a special“NULL” word is usually introduced to address tar-get words that align to no source words. Since thisphysically non-existing word is not in the...

Tài liệu Báo cáo khoa học: "Yet Another Word Alignment Tool" docx

... Ex-plorer.Figure 3: Alignment v isualization with Yawat. As the mouse is moved over a word, th e word and all words linked with it are highlighted. The highlighting is removed when the mouse leaves the word ... the term word alignment 1Yawat was ﬁrst presented at the 2007 Linguistic Annota-tion Workshop (Germann, 2007).to refer to any form of alignment that identiﬁes wordsor groups of words as ... ndard aga ins t which can-didate word alignments can be compared automati-cally. This human intervention works best with aninteractive, visual interface.2 Word alignment visualizationOver the...

Báo cáo khoa học: "Variational Inference for Grammar Induction with Prior Knowledge" pdf

... from the set. We experimented with a Dirichlet prior over the parameters and logis-tic normal priors over the parameters, and foundthe latter to still be favorable with our method, asin Cohen ... current positionand (b) connect words which are nearby (in stringdistance). We experiment with six mixture com-ponents: (1) RIGHTATTACH: Each word s parentis to the word s right. The root, therefore, ... or prior knowledge into a Bayesian model.We show that empirically, injecting prior knowl-edge improves performance on an unsupervisedChinese grammar induction task.2 Variational Mixtures with...

Tài liệu Báo cáo khoa học: "A Statistical Model for Unsupervised and Semi-supervised Transliteration Mining" pptx

... thatthe word- aligned list is missing some transliterationpairs because of word- alignment errors. We built an-other list by adding a word pair for every source word that cooccurs with a target word ... 2003). We extractall word pairs which occur as 1-to-1 alignments (likeSajjad et al. (2011)) and later refer to them as the word- aligned list. We compared the word- alignedlist with the NEWS10 reference ... MiningModelA source word and its corresponding target word canbe character-aligned in many ways. We refer to apossible alignment sequence which aligns a source word e and a target word f as “a”....

Tài liệu Báo cáo khoa học: "Improving Statistical Machine Translation with Monolingual Collocation" pdf

... probability of one -word cept. 3.2 Improving bi-directional bilingual word alignments In word alignment models implemented in GI-ZA++, only one-to-one and many-to-one word alignment links can ... system. 1 Introduction Statistical bilingual word alignment (Brown et al. 1993) is the base of most SMT systems. As com-pared to single -word alignment, multi -word alignment is more difficult ... corpus. 3 Improving Statistical Bilingual Word Alignment We use the collocation information to improve both one-directional and bi-directional bilingual word alignments. The alignment probabilities...

Tài liệu Báo cáo khoa học: "Fixed Length Word Suffix for Factored Statistical Machine Translation" pdf

...

Tài liệu Báo cáo khoa học: "A Statistical Analysis of Morphemes in Japanese Terminology" docx

... formation. With the correspondences between text and terminology, sentences and terms, and words and morphemes, the present work can be re- garded as parallel to the quantitative study of words ... morpheme-level permutations almost coincide, with no statistically significant difference. From this we can conclude that the binomial/Poisson assumption of the LNRE models in the previous section holds ... corporating new conceptual elements. 4.3 Application of LNRE Models Table 2 shows the results of the application of the LNRE models, for the models whose mean square errors of V(N) and V(1,N) are...

Tài liệu Báo cáo khoa học: "Guiding an HPSG Parser using Semantic and Pragmatic Expectations" pdf

... form which can be directly compared with constituents proposed within the HPSG parse. Consider the sentence "Robin promised to come at noon", with the following context: Sandy: ... embed within the signs a "clausally flattened" structures. Each HPSG verbal sign in the same clause structure shares the same clausal value. The clause value is a structure with labels ... the HPSG (Head Driven Phrase Structure Grammar) theory of grammar (Pollard and Sag, 1992). HPSG models all linguistic constituents in terms of part/a/ information structures called feature structures....

Tài liệu Báo cáo khoa học: "Generating statistical language models from interpretation grammars in dialogue systems" potx

... 1,300,000 words with a vocabulary of almost 50,000 words.2.3 The newspaper corpusWe have also used a corpus consisting of a col-lection of Swedish newspaper texts of 397 millionwords.1Additionally, ... newspaper corpus by extracting only thesentences including domain related words. With domain related words we mean typical words foran MP3 domain such as “music”, “mp3-player”,“song” etc. This ... perplexity with the tools SRI provides on the evaluation testset of 1700 utterances.In Table 1 we can see a dramatic perplexity re-duction with the mixed models compared to thesimplest of our models...

Tài liệu Báo cáo khoa học: Ngôn ngữ phương tiện giao tiếp công vụ pdf

... da dang, dupc sir dung vdi nhirng phong each khac nhau: van chuang - nghe thuat, chfnh luan, khoa hpe, binh chfnh - cdng vu; ft dting hoac khdng dting cic ttr mang tfnh khau ngir, dja phuong, ... ngii, cic tir ngii chuyen mdn hoi ciia nhieu ITnh vuc khie nhau (van boa, van hpe nghd thuat, khoa hpe, kT thuat, chinh tri, quan su, hanh chinh, phip luat, triet hpe, kinh te, ). Ve mat...

Xem thêm