All in strings: A powerful string-based automatic MT evaluation metric with multiple granularities

作者：Zhu Junguo^*; Yang Muyun; Wang Bo; Li Sheng; Zhao Tiejun

来源：23rd International Conference on Computational Linguistics, Coling 2010, 2010-08-23 to 2010-08-27.

• Automatic evaluation
• Automatic machines
• Automatic metrics
• Human assessment
• MT evaluations
• Regression model
• Translation quality

String-based metrics of automatic machine translation (MT) evaluation are widely applied in MT research. Meanwhile, some linguistic motivated metrics have been suggested to improve the string-based metrics in sentencelevel evaluation. In this work, we attempt to change their original calculation units (granularities) of string-based metrics to generate new features. We then propose a powerful string-based automatic MT evaluation metric, combining all the features with various granularities based on SVM rank and regression models. The experimental results show that i) the new features with various granularities can contribute to the automatic evaluation of translation quality;ii) our proposed string-based metrics with multiple granularities based on SVM regression model can achieve higher correlations with human assessments than the state-of-art automatic metrics.

• 单位
  天津大学