Papers by Yeon Seonwoo
Hierarchical Dirichlet Gaussian Marked Hawkes Process for Narrative Reconstruction in Continuous Time Domain (D18-1)
Copied to clipboard
| Challenge: | Existing methods for reconstructing narratives and thread structures of news articles and discussions are lacking . temporal characteristics, triggering event relations, and meta information are used to solve the problem . |
| Approach: | They propose a Hierarchical Dirichlet Gaussian Marked Hawkes process for reconstructing narratives and thread structures of news articles and discussion posts. |
| Outcome: | The proposed model outperforms baseline models on real-world datasets and Wikipedia conversations. |
Virtual Knowledge Graph Construction for Zero-Shot Domain-Specific Document Retrieval (2022.coling-1)
Copied to clipboard
| Challenge: | Domain-specific documents cover terminologies and specialized knowledge. |
| Approach: | They propose a domain-specific document retrieval method that embeds a document into a graph of entities and their relations into . they compare the unsupervised method with previous approaches and use it to compute relevance between queries and documents. |
| Outcome: | The proposed method outperforms baselines and fully-supervised bi-encoders in a zero-shot setting and outperformed bi-supervised approaches. |
Ranking-Enhanced Unsupervised Sentence Representation Learning (2023.acl-long)
Copied to clipboard
Yeon Seonwoo, Guoyin Wang, Changmin Seo, Sajal Choudhary, Jiwei Li, Xiang Li, Puyang Xu, Sunghyun Park, Alice Oh
| Challenge: | Unsupervised sentence representation learning has progressed through contrastive learning and data augmentation methods such as dropout masking. |
| Approach: | They propose a novel unsupervised sentence encoder, RankEncoder, which predicts the semantic vector of an input sentence by leveraging its relationship with other sentences in an external corpus. |
| Outcome: | The proposed unsupervised sentence encoder achieves 80.07% Spearman’s correlation, a 1.1% improvement over the previous state-of-the-art system. |
Context-Aware Answer Extraction in Question Answering (2020.emnlp-main)
Copied to clipboard
| Challenge: | Extractive QA models have shown promising performance in predicting the correct answer to a given question. |
| Approach: | They propose a BLANC-based context prediction task that learns the context prediction tasks. |
| Outcome: | The proposed model outperforms the state-of-the-art models on reading comprehension and hotpotQA. |
Weakly Supervised Pre-Training for Multi-Hop Retriever (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for weakly supervised multi-hop pretraining require costly human annotation. |
| Approach: | They propose a method for weakly supervised multi-hop retriever pretraining without human efforts by generating vector representations of complex questions and subquestion as weak supervision for pre-training. |
| Outcome: | The proposed method is effective and robust on limited data and computational resources. |
CS1QA: A Dataset for Assisting Code-based Question Answering in an Introductory Programming Course (2022.naacl-main)
Copied to clipboard
| Challenge: | CS1QA is a dataset for code-based question answering in the programming education domain. |
| Approach: | They propose a dataset for code-based question answering in the programming education domain. |
| Outcome: | The proposed model can be used as a benchmark for source code comprehension and question answering in the educational setting. |
Two-Step Question Retrieval for Open-Domain QA (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing question retrieval models have shown a significant increase in inference speed but at the cost of lower QA performance compared to the retriever-reader pipeline. |
| Approach: | They propose a two-step question retrieval model with distant supervision to improve inference speed. |
| Outcome: | The proposed model significantly increases the performance of existing question retrieval models with a negligible loss on inference speed. |
Perceptions to Beliefs: Exploring Precursory Inferences for Theory of Mind in Large Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | While theory of mind (ToM) is naturally developed for humans in childhood, large language models (LLMs) exhibit inconsistency in ToM tasks, despite early reports of successful cases. |
| Approach: | They propose to evaluate human ToM precursors-perception inference and perception-to-belief inference-in large language models (LLMs) by annotating characters’ perceptions on ToMi and FANToM. |
| Outcome: | The proposed method significantly improves LLMs’ performance in false belief scenarios. |
Additive Compositionality of Word Vectors (D19-55)
Copied to clipboard
| Challenge: | Existing research on justifying additive compositionality of word embedding models requires a rather strong assumption of uniform word distribution. |
| Approach: | They propose to relax the assumption of uniform word distribution and propose more realistic conditions for proving additive compositionality. |
| Outcome: | The proposed model improves on word similarity and noisy sentence similarity. |