Papers by Jeongyeon Seo
Improving Zero-shot Reader by Reducing Distractions from Irrelevant Documents in Open-Domain Question Answering (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models (LLMs) enable zero-shot approaches in open domain question answering (ODQA), yet with limited advancements as the reader is compared to the retriever. |
| Approach: | They propose to use a distraction-aware answer selection framework to mitigate the impact of irrelevant documents in the retrieved set and the overconfidence of the generated answers to enhance the performance of zero-shot readers. |
| Outcome: | The proposed approach handles distraction across diverse scenarios, enhancing the performance of zero-shot readers. |
Lossless Acceleration of Large Language Models with Hierarchical Drafting based on Temporal Locality in Speculative Decoding (2025.findings-naacl)
Copied to clipboard
Sukmin Cho, Sangjin Choi, Taeho Hwang, Jeongyeon Seo, Soyeong Jeong, Huije Lee, Hoyun Song, Jong C. Park, Youngjin Kwon
| Challenge: | Existing methods for drafting and verifying tokens require significant fine-tuning or have inconsistent performance across tasks. |
| Approach: | They propose a lossless drafting approach that organizes various token sources into multiple databases in a hierarchical framework based on temporal locality. |
| Outcome: | The proposed method outperforms existing database drafting methods on Spec-Bench using 7B and 13B parameters. |
Typos that Broke the RAG’s Back: Genetic Attack on RAG Pipeline by Simulating Documents in the Wild via Low-level Perturbations (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies on the robustness of Large Language Models (LLMs) overlook the interconnected relationships between RAG components or the potential threats prevalent in real-world databases, such as minor textual errors. |
| Approach: | They propose a novel attack method that exploits vulnerabilities in RAG components and tests its robustness against noisy documents. |
| Outcome: | The proposed method devastates the performance of each component and their synergy, and significantly devases the performance. |