Papers by Ryoma Yoshimura
SOME: Reference-less Sub-Metrics Optimized for Manual Evaluations of Grammatical Error Correction (2020.coling-main)
Copied to clipboard
| Challenge: | Existing reference-less metrics are not optimized for manual evaluations of system outputs because no dataset exists for manual analysis. |
| Approach: | They propose a reference-less metric trained on manual evaluations of system outputs for grammatical error correction. |
| Outcome: | The proposed metric improves correlation with manual evaluation in system- and sentence-level meta-evaluation. |