Papers by Renlong Ai
TQ-AutoTest – An Automated Test Suite for (Machine) Translation Quality (L18-1)
Copied to clipboard
| Challenge: | Especially the trend towards neural MT has renewed peoples' interest in better and more analytical diagnostic methods for MT quality. |
| Approach: | They propose a framework that supports a linguistic evaluation of machine translations using test suites. |
| Outcome: | The proposed framework supports linguistic evaluation of (machine) translations using test suites. |
A Linguistically Motivated Test Suite to Semi-Automatically Evaluate German–English Machine Translation Output (2022.lrec-1)
Copied to clipboard
Vivien Macketanz, Eleftherios Avramidis, Aljoscha Burchardt, He Wang, Renlong Ai, Shushen Manakhimova, Ursula Strohriegel, Sebastian Möller, Hans Uszkoreit
| Challenge: | Using fine-grained evaluation techniques, translation outputs have become better and more fluent. |
| Approach: | They propose a fine-grained test suite for the language pair German–English . they describe the creation and implementation of the test suite in detail . |
| Outcome: | The proposed test suite is based on linguistically motivated categories and phenomena and semi-automatic evaluation is carried out with regular expressions. |