Papers by Simyung Chang
CIFLEX: Contextual Instruction Flow for Sub-task Execution in Multi-Turn Interactions with a Single On-Device LLM (2025.emnlp-main)
Copied to clipboard
| Challenge: | Experiments show that CIFLEX significantly reduces computational costs without degrading task performance. |
| Approach: | They propose a new execution system for efficient sub-task handling with a single large language model. |
| Outcome: | Experiments show that CIFLEX significantly reduces computational costs without degrading task performance. |
Quadapter: Adapter for GPT-2 Quantization (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Quantization-aware training (QAT) fine-tunes model parameters in response to the numerical error arising from quantization. |
| Approach: | They propose a quantization adapter that scales activations channel-wise to make activations quantization-friendly by scaling them channel- wise. |
| Outcome: | The proposed method prevents overfitting and improves quantization performance. |
Semantic Token Reweighting for Interpretable and Controllable Text Embeddings in CLIP (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Despite the varying significance of textual elements within a sentence depending on the context, efforts to account for variation of importance in constructing text embeddings have been lacking. |
| Approach: | They propose a framework for Semantic Token Reweighting to build Interpretable text embeddings which incorporates controllability as well. |
| Outcome: | The proposed framework improves the text encoding process in CLIP by differentially weighting semantic elements based on contextual importance, enabling finer control over emphasis responsive to data-driven insights and user preferences. |
Chain-of-Rank: Enhancing Large Language Models for Domain-Specific RAG in Edge Device (2025.findings-naacl)
Copied to clipboard
| Challenge: | Retrieval-augmented generation (RAG) is valuable in specialized domains where precision is critical. |
| Approach: | They propose a chain-of-rank algorithm which allows LLMs to access a target domain early via finetuning. |
| Outcome: | The proposed method achieves state-of-the-art in benchmarks and analyzes its efficacy. |
Feedback Adaptation for Retrieval-Augmented Generation (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing evaluation protocols focus on overall accuracy and fail to capture how systems adapt after feedback is introduced. |
| Approach: | They propose to use feedback adaptation as a problem setting for RAG systems . they propose a minimal inference-time instantiation that incorporates feedback without retraining . |
| Outcome: | The proposed evaluations show that training-based approaches exhibit a trade-off between delayed correction and reliable adaptation. |
InfiniPot: Infinite Context Processing on Memory-Constrained LLMs (2024.emnlp-main)
Copied to clipboard
| Challenge: | InfiniPot is a KV cache control framework that can handle long input contexts without additional training. |
| Approach: | They propose a KV cache control framework that can handle long input contexts efficiently without additional training. |
| Outcome: | The proposed framework outperforms models trained for long contexts in various NLP tasks and is highly efficient and versatile. |
Learning Contextual Retrieval for Robust Conversational Search (2025.emnlp-main)
Copied to clipboard
| Challenge: | Effective conversational search requires a deep understanding of user intent across multiple dialogue turns. |
| Approach: | They propose a novel LLM-based retriever that directly incorporates conversational context into the retrieval process. |
| Outcome: | The proposed method outperforms existing methods while incurring no additional inference overhead. |
Crayon: Customized On-Device LLM via Instant Adapter Blending and Edge-Server Hybrid Inference (2024.acl-long)
Copied to clipboard
| Challenge: | Large language models are highly advanced to user-requested tasks. |
| Approach: | They propose a device-server hybrid inference strategy for on-device LLM customization . they construct a pool of diverse base adapters and then blend them into a customized adapter . |
| Outcome: | The proposed method can be used on a large scale without extra training . it can be applied to large-scale LLMs without sacrificing the benefits of on-device customization. |