Papers by Yukyung Lee
Multiˆ2OIE: Multilingual Open Information Extraction Based on Multi-Head Attention with BERT (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing open IE systems were based on handcrafted features or fine-grained rules. |
| Approach: | They propose a multi-head argument extraction method using multi-lingual BERT . they use a query, key, and value setting inspired by the Multimodal Transformer . |
| Outcome: | The proposed method outperforms existing sequence-labeling systems on two benchmark datasets and on two languages without training data. |
CheckEval: A reliable LLM-as-a-Judge framework for evaluating text generation using checklists (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing evaluation protocols for text generation suffer from rating inconsistencies . lexical overlap-based metrics align poorly with human judgments . |
| Approach: | They propose a checklist-based evaluation framework that improves rating reliability via decomposed binary questions. |
| Outcome: | The proposed framework improves rating reliability by decomposing binary questions . it improves agreement across evaluator models by 0.45 and reduces score variance . human evaluation remains the gold standard, but it #, Equal contribution. |
RExBench: Can coding agents autonomously implement AI research extensions? (2026.acl-long)
Copied to clipboard
| Challenge: | Existing large language model (LLM) agents are not capable of performing research extension tasks autonomously. |
| Approach: | They propose a benchmark to evaluate LLM agents' ability to extend existing AI research . they use extensions of 12 recently published research papers accompanied by domain expert-written instructions . |
| Outcome: | The proposed benchmark evaluates 12 LLM agents implemented using aider and OpenHands. |
Mismatch between Multi-turn Dialogue and its Evaluation Metric in Dialogue State Tracking (2022.acl-short)
Copied to clipboard
| Challenge: | Existing evaluation metrics for dialog state tracking are limited for belief states accumulated as dialog proceeds . relative slot accuracy allows intuitive evaluation by assigning relative scores according to the turn of each dialog . |
| Approach: | They propose to use relative slot accuracy to complement existing evaluation metrics . joint goal accuracy and slot accuracy are used to evaluate accumulated belief states . |
| Outcome: | The proposed metrics focus on "penalizing states that fail to predict," not "reward for well-predicted states" the proposed metrics do not depend on the number of predefined slots, and allow intuitive evaluation . |
Navigating the Path of Writing: Outline-guided Text Generation with Large Language Models (2025.naacl-industry)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have impacted the writing process, enhancing productivity by collaborating with humans in content creation platforms. |
| Approach: | They propose a framework that uses explicit outlines to guide LLMs in generating goal-oriented, high-quality text. |
| Outcome: | The proposed approach significantly improves text quality according to evaluations by LLMs and professional writers. |