Papers by Seyeon Lee
LEAN-LIFE: A Label-Efficient Annotation Framework Towards Learning from Explanation (2020.acl-demos)
Copied to clipboard
Dong-Ho Lee, Rahul Khanna, Bill Yuchen Lin, Seyeon Lee, Qinyuan Ye, Elizabeth Boschee, Leonardo Neves, Xiang Ren
| Challenge: | Existing frameworks for sequence labeling and classification require massive human effort and labeling data is limited. |
| Approach: | They propose a web-based, Label-Efficient AnnotatioN framework that allows an annotator to provide the needed labels for a task and can capture explanations for each labeling decision. |
| Outcome: | The proposed framework surpasses baseline F1 scores by 5-10 percentage points while using 2X times fewer labeled instances. |
Birds have four legs?! NumerSense: Probing Numerical Commonsense Knowledge of Pre-Trained Language Models (2020.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies show that pre-trained language models possess certain commonsense and factual knowledge. |
| Approach: | They propose to use pre-trained language models to predict masked words . they introduce a probing task with 13.6k m-word-prediction probes . |
| Outcome: | The proposed model performs poorly on the diagnostic dataset prior to any fine-tuning and fine-testing with distant supervision. |
Common Sense Beyond English: Evaluating and Improving Multilingual Language Models for Commonsense Reasoning (2021.acl-long)
Copied to clipboard
| Challenge: | Using multilingual language models, commonsense reasoning research has been limited to English. |
| Approach: | They propose a Mickey Probe task to evaluate commonsense across languages . they propose X-CSQA and XCODAH datasets to be translated to 14 languages based on the Mickey corpus . |
| Outcome: | The proposed method significantly improves sentence representations beyond English. |
RICA: Evaluating Robust Inference Capabilities Based on Commonsense Axioms (2021.emnlp-main)
Copied to clipboard
| Challenge: | Pre-trained language models have impressive performance on commonsense inference benchmarks, but their ability to make robust inferences is debated. |
| Approach: | They propose a challenge that evaluates robust commonsense inference despite textual perturbations using commonsensical knowledge bases and probe PTLMs across two different evaluation settings. |
| Outcome: | The proposed procedure evaluates robust commonsense inference despite textual perturbations using commonsensense knowledge bases and probe PTLMs across two evaluation settings. |