Papers by Minki Kang
Neural Mask Generator: Learning to Generate Adaptive Word Maskings for Language Model Adaptation (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to train language models on diverse text corpora have brought up performance improvements on several natural language understanding (NLU) tasks. |
| Approach: | They propose a method to automatically generate domain- and task-adaptive maskings of a given text for self-supervised pre-training. |
| Outcome: | The proposed framework outperforms rule-based masking strategies on question answering and text classification datasets on which it outperformed rule-driven masking techniques. |
Episodic Memory Reader: Learning What to Remember for Question Answering from Streaming Data (P19-1)
Copied to clipboard
| Challenge: | Existing QA methods lack scalability and performance is difficult to solve with document-level contexts. |
| Approach: | They propose an end-to-end deep network model that sequentially reads the input contexts into an external memory while replacing memories that are less important for answering unseen questions. |
| Outcome: | The proposed model improves on a synthetic dataset and real-world large-scale textual and video QA datasets. |
KALA: Knowledge-Augmented Language Model Adaptation (2022.naacl-main)
Copied to clipboard
| Challenge: | Pre-trained language models (PLMs) have proved to be effective on various natural language understanding tasks. |
| Approach: | They propose a domain adaption framework which modulates the intermediate hidden representations of PLMs with domain knowledge, consisting of entities and their relational facts. |
| Outcome: | The proposed framework outperforms adaptive pre-training on question answering and named entity recognition tasks on multiple datasets across different domains. |
SafeRoute: Adaptive Model Selection for Efficient and Accurate Safety Guardrails in Large Language Models (2025.findings-acl)
Copied to clipboard
Seanie Lee, Dong Bok Lee, Dominik Wagner, Minki Kang, Haebin Seong, Tobias Bocklet, Juho Lee, Sung Ju Hwang
| Challenge: | Deploying large language models (LLMs) requires robust safety guard models to detect and block harmful user prompts. |
| Approach: | They propose a binary router that selectively applies a larger safety guard model to the data that the router considers hard. |
| Outcome: | The proposed method outperforms baselines on multiple benchmark datasets on hard and hard examples. |
Knowledge-Augmented Language Model Verification (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent Language Models (LMs) generate factually incorrect answers to queries . authors propose to augment LMs with knowledge retrieved from external source . |
| Approach: | They propose to augment LMs with knowledge retrieved from external sources . they validate the output and knowledge of the knowledge-augmented LM with a separate verifier . |
| Outcome: | The proposed model can generate factually incorrect answers on multiple questions . a verifier detects retrieval errors and can correct them by retrieving new knowledge or generating new text . |
Learning to Perturb Word Embeddings for Out-of-distribution QA (2021.acl-long)
Copied to clipboard
| Challenge: | QA models that are pretraining with unlabeled data can overfit and may not generalize well to unseen data that falls outside the training distribution. |
| Approach: | They propose a method which perturbs word embedding without changing their semantics. |
| Outcome: | The proposed method outperforms baseline methods on five target domains on a single source dataset on five different target domain domains. |