– Comparing two MT systems – Implementation ? Discussions – How much testing data is needed? – How many reference translations are needed? – How many bootstrap samples are needed?
Automatic Machine Translation Evaluation Subjective MT evaluations – Fluency and Adequacy scored by human judges– Very expensive in time and money
Objective automatic MT evaluations – Inspired by the Word Error Rate metric used by ASR research– Measuring the“closeness” between the MT hypothesis and human reference translations– Precision: n-gram precision– Recall: Against the best matched reference Approximated by brevity penalty
––––
Cheap, fast Highly correlated with subjective evaluations MT research has greatly benefited from automatic evaluations Typical metrics: IBM BLEU, CMU M-BLEU, CMU METEOR, NIST MTeval, NYU GTM Ying Zhang, Stephan Vogel LTI, Carnegie Mellon University
Oct 2004 TMI, Baltimore, MD

confidence intervals of mean and variance based on the bootstrap and hypothesis for mean testing based on the Bootstrap are mainly discussed . Key words:...
Confidence intervals for the mean of an unknown distribution can be based on Student’s T, provided the sample size is large. When the underlying ...
Iterated smoothed bootstrap confidence intervals for population quantiles This ...On the other hand, the iterated smoothed bootstrap percentile method interval...
implemented in the algorithm generating the upper and lower confidence limits....4. The Monte Carlo estimate of the percentile p for the quantile q is ...
The 100(1-α)th percentile of the bootstrap distribution, S ∞ (α ) ...D. RESULTS The 95% Bootstrap confidence intervals obtained using Mathematica,...
(1987). Empirical Bayes confidence intervals based on bootstrap samples. J....(1987). A fast scoring algorithm for maximum likelihood estimation in ...
13th, 2011 bootstrap samples as the argument for n, in intervals of 1000, for generating percentile-based bootstrap 95% and 99% confidence intervals. ...
confidence interval constructed based on a biased ...Construct bootstrap confidence intervals using one ... o Percentile method: XX% confidence level is ...
a) Maximum likelihood b) Method of moments c) Percentile matching d) ...3. Estimate the variance of estimators and the confidence intervals for the...
algorithm for calculating sample correlations, but,...the 97.5th percentile of the resampled r values...Confidence Intervals To obtain a confidence interval...
热门文档