joint phrase alignment and extraction
Tài liệu Báo cáo khoa học: "An Unsupervised Model for Joint Phrase Alignment and Extraction" ppt
Ngày tải lên :
20/02/2014, 04:20
... parameters s and d over all phrase pairs in
the model, long phrase pairs are much more sparse
635
Figure 3: The phrase, block, and word alignments used
in heuristic phrase extraction.
5.1 Heuristic Phrase ... model-
based phrase extraction compared to heuristic phrase
extraction. Using the alignments from HIER, we cre-
ated phrase tables using model probabilities (MOD),
and heuristic extraction on ... perform weight tuning
and testing on specified development and test sets.
We compare the accuracy of our proposed method
of joint phrase alignment and extraction using the
FLAT, HIER and HLEN models,...
- 10
- 641
- 0
Báo cáo khoa học: "Toolkit for Multi-Level Alignment and Information Extraction from Comparable Corpora" pptx
Ngày tải lên :
16/03/2014, 20:20
... content
extraction from comparable corpora. It consists
of tools bundled in two workflows: (1)
alignment of comparable documents and
extraction of parallel sentences and (2)
extraction and bilingual ... generated via word alignment using
GIZA++ (Och and Ney, 2000) on parallel corpora.
For each word in the source language, the top two
translation candidates (based on the word
alignment probability ...
corpora by means of symmetrical word alignment
and/ or by phrase generation (Koehn et al., 2003).
Our toolkit exploits comparable corpora in order to
find and extract comparable sentences for...
- 6
- 289
- 0
Báo cáo khoa học: "Flow Network Models for Word Alignment and Terminology Extraction from Bilingual Corpora" docx
Ngày tải lên :
17/03/2014, 07:20
...
tween
bandwidth
and
largeur de bande
can
be obtained through the edge linking these
two units (type 1), or through two edges,
one from
bandwidth
to
largeur de bande.,
and one from
bandwidth ... from
bandwidth
to
largeur
and
bande
(type 3),
2. secondly, there may be conflicts between
connections: in figure 1 both
largeur de
bande
and
tdldcommunications
are linked to
bandwidth ... multilingual terminology
extraction.
3 Multilingual terminology
extraction
Several works describe methods to extract
terms, or candidate terms, in English and/ or
French (Justeson and Katz, 1995;...
- 7
- 379
- 0
Tài liệu Báo cáo khoa học: "An Open Source Toolkit for Phrase-based and Syntax-based Machine Translation" docx
Ngày tải lên :
19/02/2014, 20:20
... Extraction and Reordering Model
We use a standard way to implement the phrase
extraction module for the phrase- based model.
That is, we extract all phrase- pairs that are
consistent with word alignments. ...
standard phrase- based decoding, decoding
as parsing, decoding as tree-parsing, and
forest-based decoding.
z It is easy-to-use and fast. A new system can
be built using only a few commands. ... word-to-word alignments, several easy-to-use
toolkits are available, such as GIZA++ and Berkeley Aligner.
sequence of commands. Given a number of
sentence-pairs and the word alignments between...
- 6
- 531
- 0
Tài liệu Báo cáo khoa học: "Joint Word Segmentation and POS Tagging using a Single Perceptron" docx
Ngày tải lên :
20/02/2014, 09:20
... Daum
´
e III and Marcu,
2005; Finkel et al., 2006) and for specific problems
such as language modeling and utterance classifica-
tion (Saraclar and Roark, 2005) and labeling and
chunking (Shimizu and Haas, ... open features in the joint segmentor and
POS tagger.
Acknowledgements
We thank Hwee-Tou Ng and Mengqiu Wang for
their helpful discussions and sharing of experimen-
tal data, and the anonymous reviewers ... gen-
erated candidates, the baseline POS tagger can keep
1/T for the next processing stage, while the joint
model can keep only 1/2T , and has to discard the
rest. Therefore, even when the candidate...
- 9
- 576
- 0
Tài liệu Báo cáo khoa học: "Finding Synonyms Using Automatic Word Alignment and Measures of Distributional Similarity" pdf
Ngày tải lên :
20/02/2014, 12:20
... Distributional Similarity Based on Word
Alignment
The alignment approach to synonym extraction is
based on automatic word alignment. Context vec-
tors are built from the alignments found in a paral-
lel ... apposi-
tion and prepositional complement. Examples are
given in table 1. Details on the extraction can be
found in van der Plas and Bouma (2005). The
number of pairs (types) consisting of a word and
a ... consideration.
The alignment frequencies are used for weighting
the features and for applying the frequency cutoff.
In the following section we describe the data and
resources used in our experiments and finally...
- 8
- 516
- 0
Báo cáo khoa học: "cdec: A Decoder, Alignment, and Learning Framework for Finite-State and Context-Free Translation Models" potx
Ngày tải lên :
07/03/2014, 22:20
... framework (§5).
2.1 Alignment forests and alignment
Alignment is the process of determining if and
how a translation model generates a source, tar-
get string pair. To compute an alignment under
a ...
reference
Viterbi extraction
k-best extraction
max-translation
extraction
feature
expectations
intersection by
parsing
Alignment
hypergraph
feature
expectations
max posterior
alignment
Viterbi alignment
Translation ... generic addition and multiplication operation,
⊕ and ⊗, and their identities 0 and 1. Multipli-
cation and addition must be associative. Multi-
plication must distribute over addition, and v ⊗ 0
9
...
- 6
- 517
- 0
Báo cáo khoa học: "Joint Identification and Segmentation of Domain-Specific Dialogue Acts for Conversational Dialogue Systems" doc
Ngày tải lên :
07/03/2014, 22:20
... dialogue act, and Overall indicates the performance
over the entire set. P stands for precision, R for recall,
and F for F-score.
3.3 Results
Table 2 shows the performance of our approach and
the two ... Research, Development,
and Engineering Command (RDECOM). State-
ments and opinions expressed do not necessarily re-
flect the position or the policy of the United States
Government, and no official endorsement ... Semantics and Pragmatics of Dialogue,
page 43–50, Stockholm, Sweden, June.
Oliver Bender, Klaus Macherey, Franz Josef Och, and
Hermann Ney. 2003. Comparison of alignment tem-
plates and maximum...
- 6
- 354
- 0
Báo cáo khoa học: "A Discriminative Model for Joint Morphological Disambiguation and Dependency Parsing" ppt
Ngày tải lên :
17/03/2014, 00:20
... factors.
888
parsing (Smith and Eisner, 2008) and may be able to
address this issue.
7 Conclusions and Future Work
We have proposed a discriminative model that
jointly infers morphological properties and syntactic
structures. ... Generating and Parsing Classical
Greek. Literary and Linguistic Computing 6(4):243–
245.
Yoav Goldberg and Reut Tsarfaty. 2008. A Single Gen-
erative Model for Joint Morphological Segmentation
and Syntactic ... at-
tempted joint inference on morphology and syntax,
and both considered phrase- structure trees for Mod-
ern Hebrew (Cohen and Smith, 2007; Goldberg and
Tsarfaty, 2008).
The primary focus of...
- 10
- 411
- 0
Báo cáo khoa học: "Joint Hebrew Segmentation and Parsing using a PCFG-LA Lattice Parser" docx
Ngày tải lên :
17/03/2014, 00:20
... Adjectives and Nouns
(which should agree on Gender and Number and
definiteness), and between Subjects and Verbs
(which should agree on Gender and Number).
3 PCFG-LA Grammar Estimation
Klein and Manning ... include joint segmentation and parsing of
Chinese, empty element prediction (see (Cai et al.,
2011) for a successful application), and a princi-
pled handling of multiword-expressions, idioms and
named-entities. ... of
constituents inside a phrase is relatively free. This
is most notably apparent in the verbal phrases and
sentential levels. In particular, while most sentences
follow an SVO order, OVS and VSO configurations
are...
- 6
- 376
- 0
Báo cáo khoa học: "A Comparative Study of Hypothesis Alignment and its Improvement for Machine Translation System Combination" pot
Ngày tải lên :
17/03/2014, 01:20
...
2) When two word alignments are ready, we
start from the intersection of the two word
alignments, and then continuously add new links
between backbone and hypothesis if and only if
both ... Tables 3 and 4, we can see that
the intersection word alignment- based expansion
method improves the performance in all the dev
and test sets for both tasks by 0.2-0.57 BLEU-
score and the improvements ...
combining multiple MT systems’ outputs, and
hypothesis alignment is a key step. In this paper,
we first compare four word alignment methods
for hypothesis alignment under the confusion
network...
- 8
- 546
- 1
Báo cáo khoa học: "A Unified Single Scan Algorithm for Japanese Base Phrase Chunking and Dependency Parsing" pdf
Ngày tải lên :
17/03/2014, 02:20
... to chunk
morphemes into base phrases and decide depen-
dency relations of the phrases in a strict left-to-
right manner. We show a pseudo code of the al-
gorithm and evaluate its performance ... does both base phrase chunk-
ing and dependency parsing simultane-
ously in linear-time with a single scan of a
sentence. In this paper, we show a pseudo
code of the algorithm and evaluate its ... pages 49–52,
Suntec, Singapore, 4 August 2009.
c
2009 ACL and AFNLP
A Unified Single Scan Algorithm
for Japanese Base Phrase Chunking and Dependency Parsing
Manabu Sassano
Yahoo Japan Corporation
Midtown...
- 4
- 287
- 0
Báo cáo khoa học: "The Complexity of Phrase Alignment Problems" doc
Ngày tải lên :
23/03/2014, 17:20
... Introduction
Learning in phrase alignment models generally re-
quires computing either Viterbi phrase alignments
or expectations of alignment links. For some re-
stricted combinatorial spaces of alignments—those
that ... practicality of the ILP approach, we
show speed and search accuracy results for aligning
phrases under a standard phrase translation model.
2 Phrase Alignment Problems
Rather than focus on a particular ... all phrases have length at least one: j > i and l > k.
25
Both the conditional model of DeNero et al.
(2006) and the joint model of Marcu and Wong
(2002) operate in A, as does the phrase- based...
- 4
- 231
- 0
Báo cáo khoa học: From meiosis to postmeiotic events: Alignment and recognition of homologous chromosomes in meiosis ppt
Ngày tải lên :
29/03/2014, 08:20
... issue [1]), and mechanisms for
DNA strand exchange have been determined at atomic
resolution (W. Kagawa and H. Kurumizaka, this issue
[2]). However, before a pair of homologous DNA
strands can interact ... for
homologous alignment obtained from recent studies in
the fission yeast Schizosaccharomyces pombe and the
nematode Caenorhabditis elegans, and propose models
for homologous recognition.
Alignment ... FEBS
MINIREVIEW
From meiosis to postmeiotic events: Alignment and
recognition of homologous chromosomes in meiosis
Da-Qiao Ding
1
, Tokuko Haraguchi
1,2,3
and Yasushi Hiraoka
1,2,3
1 Kobe Advanced ICT...
- 6
- 473
- 0
