Papers by Jin Tei
XQ-MEval: A Dataset with Cross-lingual Parallel Quality for Benchmarking Translation Metrics (2026.findings-acl)
Copied to clipboard
| Challenge: | averaging metric scores across languages is suspicious since translations of equal quality receive different scores across language. |
| Approach: | They propose a semi-automatically built dataset to benchmark translation metrics using MQM-defined errors and a normalization strategy to mitigate cross-lingual scoring bias. |
| Outcome: | The proposed model shows that translation metrics suffer from cross-lingual scoring bias . the proposed model is based on a semi-automatically built dataset covering nine translation directions . |