Papers by Seohyeong Jeong
Task-specific Compression for Multi-task Language Models using Attribution-based Pruning (2023.findings-eacl)
Copied to clipboard
| Challenge: | Existing compression methods for multi-task language models use large number of parameter parameters even when performing only a specific task. |
| Approach: | They propose a training-free compression method for multi-task language models using pruning method . they use an attribution method to determine which neurons are essential for performing a specific task . |
| Outcome: | The proposed method outperforms baseline pruning methods on six widely-used datasets. |
SCV: Light and Effective Multi-Vector Retrieval with Sequence Compressive Vectors (2025.coling-industry)
Copied to clipboard
| Challenge: | Recent advances in language models (LMs) have driven progress in information retrieval (IR), effectively extracting semantically relevant information. |
| Approach: | They propose a multi-vector retrieval framework with sequence compression vectors and a coarse-to-fine vector search framework that uses span compressive vectors to score documents. |
| Outcome: | The proposed approach achieves the fastest latency compared to other state-of-the-art models and can obtain competitive performance on both in-domain and out-of domain benchmark datasets. |