Papers by Kim Yul
Towards a Holistic and Automated Evaluation Framework for Multi-Level Comprehension of LLMs in Book-Length Contexts (2025.emnlp-main)
Copied to clipboard
Yuho Lee, Jiaqi Deng, Nicole Hee-Yeon Kim, Hyangsuk Min, Taewon Yun, Minjeong Ban, Kim Yul, Hwanjun Song
| Challenge: | HAMLET is a framework for evaluating the long-context comprehension of large language models. |
| Approach: | They propose a framework for evaluating the long-context comprehension of large language models . HAMLET structures key information of source texts into a three-level hierarchy . |
| Outcome: | HAMLET achieves 90% agreement with expert judgments while reducing evaluation cost by up to 25. |
CoTEVer: Chain of Thought Prompting Annotation Toolkit for Explanation Verification (2023.eacl-demo)
Copied to clipboard
| Challenge: | Chain-of-thought prompting generates an explanation before the final prediction, but its performance is affected by the factual accuracy of the explanation. |
| Approach: | They propose a toolkit for annotating the factual correctness of generated explanations and collecting revision data of wrong explanations. |
| Outcome: | The proposed toolkit is publicly available at https://github.com/SeungoneKim/CoTEVer. |