Papers by Gonçalo Mordido
Mark-Evaluate: Assessing Language Generation using Population Estimation Methods (2020.coling-main)
Copied to clipboard
| Challenge: | Existing population estimation methods focus on open populations or closed populations, but our methods show a higher correlation to human evaluation than existing metrics on several challenging tasks. |
| Approach: | They propose a family of metrics to assess language generation derived from population estimation methods widely used in ecology. |
| Outcome: | The proposed methods show a higher correlation to human evaluation than existing metrics on several challenging tasks, namely unconditional language generation, machine translation, and text summarization. |