Section VII.B. Empirical results for RUBY
1) Correlation of RUBY and semantic scores:
On mppSMT model: Correlation result is 0.815
Sample of translated results (mppSMT model):
Download
Data of RUBY scores and semantic scores:
Download
On lpSMT model: Correlation result is 0.747
Sample of translated results (lpSMT model):
Download
Data of RUBY scores and semantic scores:
Download
On GNMT model: Correlation result is 0.764
Sample of translated results (GNMT model):
Download
Data of RUBY scores and semantic scores:
Download
2) The use of RUBY in comparing models
2a. mppSMT vs p-mppSMT
Samples of translated results:
Download
Data of RUBY scores, semantic scores, and t-test:
Download
2b. mppSMT, GNMT, lpSMT pairwise comparison
Samples of translated results:
mppSMT ,
lpSMT ,
GNMT
Data of RUBY scores, semantic scores, and t-test:
Download
Each score index is according to a line in the translated results.