build chinese language models
Tài liệu Báo cáo khoa học: "Incremental Syntactic Language Models for Phrase-based Translation" pptx
Ngày tải lên :
20/02/2014, 04:20
... to incorporate large-
scale n-gram language models in conjunction with
incremental syntactic language models.
The added decoding time cost of our syntactic
language model is very high. By increasing ... trans-
lation has effectively used n-gram word sequence
models as language models.
Modern phrase-based translation using large scale
n-gram language models generally performs well
in terms of lexical ... use
supertag n-gram LMs. Syntactic language models
have also been explored with tree-based translation
models. Charniak et al. (2003) use syntactic lan-
guage models to rescore the output of a...
- 12
- 510
- 0
Tài liệu Báo cáo khoa học: "The impact of language models and loss functions on repair disfluency detection" pptx
Ngày tải lên :
20/02/2014, 04:20
... language
models trained from text or speech corpora of vari-
ous genres and sizes. The largest available language
models are based on written text: we investigate the
effect of written text language models ... dif-
ferences among the different language models when
extended features are present are relatively small.
We assume that much of the information expressed
in the language models overlaps with the lexical ... information from
the external language models by defining a reranker
feature for each external language model. The value
of this feature is the log probability assigned by the
language model to the candidate...
- 9
- 609
- 0
Tài liệu Báo cáo khoa học: "An Empirical Investigation of Discounting in Cross-Domain Language Models" ppt
Ngày tải lên :
20/02/2014, 04:20
... of English
Bigrams. Computer Speech & Language, 5(1):19–54.
Joshua Goodman. 2001. A Bit of Progress in Language
Modeling. Computer Speech & Language, 15(4):403–
434.
Bo-June (Paul) Hsu ... Association for Computational Linguistics
An Empirical Investigation of Discounting
in Cross-Domain Language Models
Greg Durrett and Dan Klein
Computer Science Division
University of California, Berkeley
{gdurrett,klein}@cs.berkeley.edu
Abstract
We ... with the amount of growth being closely
correlated with the corpus divergence. Finally, we
build a language model exploiting a parametric form
of the growing discount and show perplexity gains...
- 6
- 444
- 0
Tài liệu Báo cáo khoa học: "Discriminative Lexicon Adaptation for Improved Character Accuracy – A New Direction in Chinese Language Modeling" pptx
Ngày tải lên :
20/02/2014, 07:20
... Experimental Results
4.1 Baseline Lexicon, Corpora and Language
Models
The baseline lexicon was automatically constructed
from a 300 MB Chinese news text corpus ranging
from 1997 to 1999 using ... set of output words and also the building
units in the language model (LM). Lexical words
offer local constraints to combine phonemes into
short chunks while the language model combines
phonemes ... order of language model.
open vocabulary ASR. Morphs are another possi-
bility, which are longer than graphemes but shorter
than words, in other western languages (Hirsim
¨
aki
et al., 2005).
Chinese...
- 9
- 466
- 0
Tài liệu Báo cáo khoa học: "Improved Smoothing for N-gram Language Models Based on Ordinary Counts" doc
Ngày tải lên :
20/02/2014, 09:20
... Kneser-Ney and
those methods.
1 Introduction
Statistical language models are potentially useful
for any language technology task that produces
natural -language text as a final (or intermediate)
output. ... perplexity of any known method
for estimating N-gram language models.
Kneser-Ney smoothing, however, requires
nonstandard N-gram counts for the lower-
order models used to smooth the highest-
order model. ... best approach when language
models based on ordinary counts are desired.
References
Chen, Stanley F., and Joshua Goodman. 1998.
An empirical study of smoothing techniques for
language modeling....
- 4
- 365
- 0
Tài liệu Báo cáo khoa học: "Reading Level Assessment Using Support Vector Machines and Statistical Language Models" pdf
Ngày tải lên :
20/02/2014, 15:20
... statistical language models.
In this paper, we also use support vector
machines to combine features from tradi-
tional reading level measures, statistical
language models, and other language pro-
cessing ... use scores from language models as
features in another classifier (e.g. an SVM). For ex-
ample, perplexity (P P) is an information-theoretic
measure often used to assess language models:
P P = 2
H(t|c)
, ... of syntax. Our approach uses n-
gram language models as a low-cost automatic ap-
proximation of both syntactic and semantic analy-
sis. Statistical language models (LMs) are used suc-
cessfully...
- 8
- 446
- 0
Tài liệu Báo cáo khoa học: "Generating statistical language models from interpretation grammars in dialogue systems" potx
Ngày tải lên :
22/02/2014, 02:20
... comparison of in-
grammar recognition performance.
3 Language modelling
To generate the different trigram language models
we used the SRI language modelling toolkit (Stol-
cke, 2002) with Good-Turing ... decades of statistical language
modeling: Where do we go from here? In Proceed-
ings of IEEE:88(8).
Rosenfeld R. 2000. Incorporating Linguistic Structure
into Statistical Language Models. In Philosophical
Transactions ... statistical language models (DM-SLMs)
by using GF to generate all utterances that are
specific to certain dialogue moves from our in-
terpretation grammar. In this way we can pro-
duce models that...
- 8
- 381
- 0
Tài liệu Báo cáo khoa học: "Web augmentation of language models for continuous speech recognition of SMS text messages" docx
Ngày tải lên :
22/02/2014, 02:20
... 2007. Large language
models in machine translation. In Proceedings
of the 2007 Joint Conference on Empirical Meth-
ods in Natural Language Processing and Com-
putational Natural Language Learning ... Kneser-
Ney smoothed n-gram models. IEEE Transac-
tions on Audio, Speech and Language Processing,
15(5):1617–1624.
A. Stolcke. 1998. Entropy-based pruning of backoff
language models. In Proc. DARPA ... 8 billion.
3 Speech Recognition Experiments
We have trained language models on the in-
domain data together with web data, and these
models have been used in speech recognition ex-
periments....
- 9
- 301
- 0
Báo cáo khoa học: "The use of formal language models in the typology of the morphology of Amerindian languages" potx
Ngày tải lên :
07/03/2014, 22:20
... grammars for modeling agglutination
in this language, but first we will present the for-
mer class of languages and its acceptor automata.
3.1 Linear context free languages and
two-taped nondeterministic ... 2010.
c
2010 Association for Computational Linguistics
The use of formal language models in the typology of the morphology of
Amerindian languages
Andr
´
es Osvaldo Porta
Universidad de Buenos Aires
hugporta@yahoo.com.ar
Abstract
The ... natural representa-
tion in terms of linear context-free languages.
2 Quichua Santiague
˜
no
The quichua santiague˜no is a language of the
Quechua language family. It is spoken in the San-
tiago del...
- 6
- 439
- 0
Báo cáo khoa học: "Faster and Smaller N -Gram Language Models" pptx
Ngày tải lên :
07/03/2014, 22:20
... novel language model
caching technique that improves the query
speed of our language models (and SRILM)
by up to 300%.
1 Introduction
For modern statistical machine translation systems,
language models ... with two different language models.
Our first language model, WMT2010, was a 5-
gram Kneser-Ney language model which stores
probability/back-off pairs as values. We trained this
language model on ... and Smaller N -Gram Language Models
Adam Pauls Dan Klein
Computer Science Division
University of California, Berkeley
{adpauls,klein}@cs.berkeley.edu
Abstract
N-gram language models are a major...
- 10
- 463
- 0
Báo cáo khoa học: "Enhancing Language Models in Statistical Machine Translation with Backward N-grams and Mutual Information Triggers" ppt
Ngày tải lên :
07/03/2014, 22:20
... lan-
guage models (Charniak et al., 2003; Shen et al.,
2008; Post and Gildea, 2008). Since our philoso-
phy is fundamentally different from them in that we
build contextually-informed language models ... or even trillions of English words,
huge language models are built in a distributed man-
ner (Zhang et al., 2006; Brants et al., 2007). Such
language models yield better translation results but
at ... direction digs deeply into monolin-
gual data to build linguistically-informed language
models. For example, Charniak et al. (2003) present
a syntax-based language model for machine transla-
tion which...
- 10
- 415
- 0
Báo cáo khoa học: "Randomized Language Models via Perfect Hash Functions" pptx
Ngày tải lên :
08/03/2014, 01:20
... (lossless) lan-
guages models and our randomized language model.
Note that the standard practice of measuring per-
plexity is not meaningful here since (1) for efficient
computation, the language model ... 2007.
Compressing trigram language models with golomb
coding. In Proceedings of EMNLP-CoNLL 2007,
Prague, Czech Republic, June.
P. Clarkson and R. Rosenfeld. 1997 . Statistical language
modeling using ... pruning of back-
off language models. In Proc. DARPA Broadcast News
Transcription and Understanding Workshop, pages
270–274.
D. Talbot and M. Osborne. 2007a. Randomised language
modelling for...
- 9
- 273
- 0
Báo cáo khoa học: "Generalized Algorithms for Constructing Statistical Language Models" pdf
Ngày tải lên :
08/03/2014, 04:22
... .
Class-based models. In many applications, it is nat-
ural and convenient to construct class-based language
models, that is models based on classes of words (Brown
et al., 1992). Such models are ... experi-
mental results demonstrating its efficiency.
Representation of language models by WFAs. Clas-
sical
-gram language models admit a natural representa-
tion by WFAs in which each state encodes ... re-
lated to the construction of language models. We present
new and efficient algorithms to address these more gen-
eral problems.
Counting. Classical language models are constructed
by deriving...
- 8
- 389
- 0
Báo cáo khoa học: "Cutting the Long Tail: Hybrid Language Models for Translation Style Adaptation" doc
Ngày tải lên :
08/03/2014, 21:20
... Monz. 2011. Statistical Machine Translation
with Local Language Models. In Proceedings of the
2011 Conference on Empirical Methods in Natural
Language Processing, pages 869–879, Edinburgh,
Scotland, ... (Tillmann, 2004; Koehn et al., 2005), two
word-based language models, distortion, word
and phrase penalties. The translation and re-
ordering models are obtained by combining mod-
els independently ... on Spoken Language Translation
(IWSLT), San Francisco, CA.
P. F. Brown, V. J. Della Pietra, P. V. deSouza, J. C. Lai,
and R. L. Mercer. 1992. Class-based n-gram mod-
els of natural language. ...
- 10
- 335
- 0
Strategies for teaching early chinese language learners
Ngày tải lên :
16/03/2014, 10:02
... new language.
避免将英文翻译为中文，或将中文翻译为英文，也
不鼓励学生翻译。通过可视手段、手势、身体活动
以及清楚的上下文语境让学生明白意思。使用同样
的方式检查学生是否已理解，并要求学生用新学的
语言将意思表演出来。
Ten Principles of Teaching Chinese to
Children
Building Blocks of Chinese ...
Demonstrations
2
links language instruction to
the philosophy and content of
the general elementary school
curriculum.
Thematic Planning
Strategies for Teaching
Early Chinese Language
Learners
...
Connections
Connections
Comparisons
Comparisons
Communities
Communities
Cultures
Cultures
Communication
Communication
Standards for
Standards for
Foreign Language Learning
Foreign Language Learning
in the
in the
21st Century
21st Century
connects content, language
and culture goals to a “big idea,”
or...
- 47
- 403
- 0
