Papers by Sung-Hyon Myaeng
Let Me Know What to Ask: Interrogative-Word-Aware Question Generation (D19-58)
Copied to clipboard
| Challenge: | Existing models focus on generating questions based on text and the answer to the generated question. |
| Approach: | They propose a pipelined system that predicts the type of interrogative word to be generated . they also propose qg models that can be used to generate questions based on text . |
| Outcome: | The proposed system improves on the task of QG in SQuAD, improving from 46.58 to 47.69 in BLEU-1, 17.55 to 18.53 in blu-4, 21.24 to 22.33 in METEOR, and 44.53 to 46.94 in ROUGE-L. |
Exploiting Numerical-Contextual Knowledge to Improve Numerical Reasoning in Question Answering (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing numerical reasoning models overly rely on parametric knowledge at inference time . previous studies show that understanding numbers in text improves numerical reasoning accuracy . |
| Approach: | They propose a numerical reasoning model that leverages parametric knowledge to alleviate this over-reliance on parametric information. |
| Outcome: | The proposed model improves numerical reasoning accuracy and performance in DROP. |
Handling Anomalies of Synthetic Questions in Unsupervised Question Answering (2020.coling-main)
Copied to clipboard
| Challenge: | Existing approaches to improve unsupervised Question Answering (UQA) are expensive and require additional datasets. |
| Approach: | They propose an unsupervised QA approach that generates QA training data automatically. |
| Outcome: | The proposed method improves unsupervised QA significantly across a number of QA tasks. |
Have You Seen That Number? Investigating Extrapolation in Question Answering Models (2021.emnlp-main)
Copied to clipboard
| Challenge: | Numerical reasoning in machine reading comprehension (MRC) has shown drastic improvements over the past few years. |
| Approach: | They propose an E-digit number form that alleviates the lack of extrapolation in numerical MRC models. |
| Outcome: | The proposed model can't extrapolate to unseen numbers, the authors say . they also show that the model needs to treat numbers differently from regular words . |
Why So Gullible? Enhancing the Robustness of Retrieval-Augmented Models against Counterfactual Noise (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing retrieval-augmented language models assume query relevance and irrelevance as dichotomy . existing models are highly brittle to the presence of conflicting information in both the fine-tuning and in-context few-shot learning scenarios. |
| Approach: | They propose methods for handling knowledge conflicts by fine-tuning a discriminator or prompting it to elicit its discriminative capability. |
| Outcome: | The proposed approaches significantly enhance model robustness on open-domain QA. |
Regularization of Distinct Strategies for Unsupervised Question Generation (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Unsupervised question answering (UQA) is a task of answering questions from a context that contains the answer. |
| Approach: | They propose a method to generate higher-quality questions with a teacher-student architecture and a regularization module to avoid bias toward a particular question generation strategy. |
| Outcome: | The proposed method generates higher-quality questions across diverse datasets and tasks and can be used to create a model with few-shot learning. |
FinePrompt: Unveiling the Role of Finetuned Inductive Bias on Compositional Reasoning in GPT-4 (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models such as GPT-4 have demonstrated impressive capability to solve textual understanding problems at a level parallel to or surpassing state-of-the-art taskspecific models. |
| Approach: | They propose to transfer task-specific inductive biases from finetuned models to prompts to improve GPT-4's compositional reasoning capabilities. |
| Outcome: | The proposed prompt scheme shows competitive zero-shot and few-shot performances compared to existing prompts on complicated reasoning tasks. |
Ultra-High Dimensional Sparse Representations with Binarization for Efficient Text Retrieval (2021.emnlp-main)
Copied to clipboard
| Challenge: | Recent approaches to information retrieval (IR) and natural language processing (NLP) use contextual language models, which can improve both synonymy and polysemy problems associated with words. |
| Approach: | They propose an ultra-high dimensional representation scheme equipped with directly controllable sparsity and a bucketing method where embeddings from multiple layers of BERT are selected/merged to represent diverse linguistic aspects. |
| Outcome: | The proposed representation scheme outperforms sparse models with MS MARCO and TREC CAR, and shows that it is highly efficient for storage and search. |
Leveraging Order-Free Tag Relations for Context-Aware Recommendation (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to tag recommendation neglect orderlessness and inter-dependency . Empirical results on Instagram and Stack Overflow show that our method is significantly superior to the previous approaches. |
| Approach: | They propose a sequence-oblivious generation method for tag recommendation . the next tag to be generated is independent of the order of the generated tags . they also propose regressive generation methods that take orderlessness into account . |
| Outcome: | Empirical results show that the proposed method is superior to previous approaches . the proposed system is based on two domains, Instagram and Stack Overflow . |
Graph-Induced Transformers for Efficient Multi-Hop Question Answering (2022.emnlp-main)
Copied to clipboard
| Challenge: | Recent MHQA tasks that require inter-paragraph/sentence linkages use graphs to model internal structural information within text. |
| Approach: | They propose a graph-induced transformer that applies graph-derived attention patterns directly into a PLM without external graph modules. |
| Outcome: | The proposed model can replace external graph modules while preserving model performance. |
Roles and Utilization of Attention Heads in Transformer-based Neural Language Models (2020.acl-main)
Copied to clipboard
| Challenge: | Sentence encoders based on transformer architectures have shown promising results on various natural language understanding tasks. |
| Approach: | They propose a sentence representation method that takes advantage of most influential attention heads. |
| Outcome: | The proposed method improves performance on the downstream tasks. |
Constructing Multi-Modal Dialogue Dataset by Replacing Text with Semantically Relevant Images (2021.acl-short)
Copied to clipboard
| Challenge: | Existing training methods for multi-modal dialogue systems rely on image captioning or visual question answering datasets that are irrelevant to the dialogue context. |
| Approach: | They propose to create a 45k multi-modal dialogue dataset with minimal human intervention . they use text dialogue datasets, image-mixed dialogues and contextual-similarity filtering . |
| Outcome: | The proposed dataset can be used as training data for multi-modal dialogue systems . human evaluations show that the model can be effectively used . |