– Comparing two MT systems – Implementation ? Discussions – How much testing data is needed? – How many reference translations are needed? – How many bootstrap samples are needed?
BLEU Metrics Proposed by IBM’s SMT group (Papineni et al, 2002) Widely used in MT evaluations – DARPA TIDES MT evaluation– IWSLT evaluation– TC-Star
BLEU Metric: BLEU= BP exp(∑ wn log pn ) n=1 N
– Pn: Modified n-gram precision– Geometric mean of p1, p2,..pn– BP: Brevity penalty
1 if BP= (1 r/ c ) if e
c>r c≤r
c: length of the MT hypothesis r: effective reference length
– Usually, N=4 and wn=1/N. Oct 2004 TMI, Baltimore, MD Ying Zhang, Stephan Vogel LTI, Carnegie Mellon University

confidence intervals of mean and variance based on the bootstrap and hypothesis for mean testing based on the Bootstrap are mainly discussed . Key words:...
Confidence intervals for the mean of an unknown distribution can be based on Student’s T, provided the sample size is large. When the underlying ...
Iterated smoothed bootstrap confidence intervals for population quantiles This ...On the other hand, the iterated smoothed bootstrap percentile method interval...
implemented in the algorithm generating the upper and lower confidence limits....4. The Monte Carlo estimate of the percentile p for the quantile q is ...
The 100(1-α)th percentile of the bootstrap distribution, S ∞ (α ) ...D. RESULTS The 95% Bootstrap confidence intervals obtained using Mathematica,...
(1987). Empirical Bayes confidence intervals based on bootstrap samples. J....(1987). A fast scoring algorithm for maximum likelihood estimation in ...
13th, 2011 bootstrap samples as the argument for n, in intervals of 1000, for generating percentile-based bootstrap 95% and 99% confidence intervals. ...
confidence interval constructed based on a biased ...Construct bootstrap confidence intervals using one ... o Percentile method: XX% confidence level is ...
a) Maximum likelihood b) Method of moments c) Percentile matching d) ...3. Estimate the variance of estimators and the confidence intervals for the...
algorithm for calculating sample correlations, but,...the 97.5th percentile of the resampled r values...Confidence Intervals To obtain a confidence interval...
热门文档