Papers by Mete Sertkan
Ranger: A Toolkit for Effect-Size Based Multi-Task Evaluation (2023.acl-demo)
Copied to clipboard
| Challenge: | aggregating results over incomparable metrics and scenarios makes conclusions and take-away messages less reliable . |
| Approach: | They propose a task-agnostic toolkit that combines the effect of a treatment on multiple tasks into one statistical evaluation, allowing comparison of metrics and computation of an overall summary effect. |
| Outcome: | The proposed toolkit produces publication-ready forest plots that enable clear communication of evaluation results over multiple tasks. |