Papers by Hongyi Gu
Rubrik’s Cube: Testing a New Rubric for Evaluating Explanations on the CUBE dataset (2025.acl-long)
Copied to clipboard
Diana Galvan-Sosa, Gabrielle Gaudeau, Pride Kavumba, Yunmeng Li, Hongyi Gu, Zheng Yuan, Keisuke Sakaguchi, Paula Buttery
| Challenge: | Large-Language Models (LLMs) are increasingly being used in explanation generation tasks due to their unreliability. |
| Approach: | They propose a rubric and a dataset of 26k explanations written and quality-annotated using the rubric by humans and six open- and closed-source LLMs to test their proposed rubric. |
| Outcome: | The proposed rubric and CUBE dataset focuses on reasoning and language tasks and provides the necessary diversity to test it. |