Papers with QRelScore
QRelScore: Better Evaluating Generated Questions with Deeper Understanding of Context-aware Relevance (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing metrics for assessing question generation fail to take into account the input context of generation. |
| Approach: | They propose a context-aware Relevance evaluation metric for Question Generation that takes into account the context of question generation into account. |
| Outcome: | The proposed metric achieves higher correlation with human judgments while being much more robust to adversarial samples. |