Papers by Du-Seong Chang
Guidance-Based Prompt Data Augmentation in Specialized Domains for Named Entity Recognition (2024.acl-short)
Copied to clipboard
| Challenge: | specialized fields such as science and biology face significant challenges due to the scarcity of quality data. |
| Approach: | They propose a guidance data augmentation technique that abstracts context and sentence structure and maintains context-entity relationships for DA. |
| Outcome: | The proposed method enhances the training performance of named entity recognition tasks while maintaining context-entity relationships. |
Translation Deserves Better: Analyzing Translation Artifacts in Cross-lingual Visual Question Answering (2024.findings-acl)
Copied to clipboard
ChaeHun Park, Koanho Lee, Hyesu Lim, Jaeseok Kim, Junmo Park, Yu-Jung Heo, Du-Seong Chang, Jaegul Choo
| Challenge: | Recent studies have employed machine translation systems for cross-lingual VQA tasks . however, translated texts contain unique characteristics distinct from human-written ones, referred to as translation artifacts. |
| Approach: | They propose a machine translation system that can train models in multiple languages . they propose augmentation strategies that reduce translation artifacts in translated texts . |
| Outcome: | The proposed approach reduces translation artifacts in models across languages and languages. |
PSYDIAL: Personality-based Synthetic Dialogue Generation Using Large Language Models (2024.lrec-main)
Copied to clipboard
| Challenge: | a new pipeline for personality-based synthetic dialogues is being developed in Korea . a dataset curated by large language models is needed to generate human-like dialogues . |
| Approach: | They propose a personality-based synthetic dialogue data pipeline to elicit responses from large language models via prompting. |
| Outcome: | The proposed pipeline generates human-like dialogues considering real-world scenarios when users engage with chatbots. |
Omni-Embed-Audio: Leveraging Multimodal LLMs for Robust Audio-Text Retrieval (2026.acl-long)
Copied to clipboard
| Challenge: | Experiments with AudioCaps, Clotho, and MECAT show that OEA achieves comparable text-to-text retrieval performance to state-of-the-art M2D-CLAP. |
| Approach: | They propose a retrieval-oriented encoder leveraging multimodal LLMs with native audio understanding that allows users to express their queries in five different ways. |
| Outcome: | Experiments on AudioCaps, Clotho, and MECAT show that OEA achieves comparable text-to-audio retrieval performance to state-of-the-art M2D-CLAP while demonstrating clear advantages in two critical areas. |
Improving Conversational Abilities of Quantized Large Language Models via Direct Preference Alignment (2024.acl-long)
Copied to clipboard
| Challenge: | Quantization-aware direct preference optimization (QDPO) improves conversational abilities of quantized LLMs . token-flipping is a critical factor for degraded text generation quality . |
| Approach: | They propose a method that aligns quantized LLMs with their full-precision counterparts, improving conversational abilities. |
| Outcome: | The proposed method outperforms established fine-tuning techniques on two instruction-tuned LLMs in various languages and models, setting a new benchmark for conversational chatbot development. |
Evaluating Visual and Cultural Interpretation: The K-Viscuit Benchmark with Human-VLM Collaboration (2025.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to creating inclusive vision-language models rely on human annotators, making it labor-intensive and creating cognitive burdens. |
| Approach: | They propose a semi-automated framework for constructing cultural VLM benchmarks . they use an annotated sample of Korean culture to generate questions . |
| Outcome: | The proposed framework is based on a Korean culture dataset and shows that open-source models lag behind proprietary ones in understanding Korean culture. |
Towards Fast Multilingual LLM Inference: Speculative Decoding and Specialized Drafters (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have revolutionized natural language processing and are limited by high inference time in multilingual settings. |
| Approach: | They propose a training recipe for an assistant model in speculative decoding, which are leveraged to draft and-then its future tokens are verified by the target LLM. |
| Outcome: | The proposed model significantly speeds up inference time and out-of-domain speedup across various languages. |
NASH: A Simple Unified Framework of Structured Pruning for Accelerating Encoder-Decoder Language Models (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Structured pruning methods have proven effective in reducing the model size and accelerating inference speed in various network architectures. |
| Approach: | They propose a framework that narrows the encoder and shortens the decoder networks of encoder-decoder models. |
| Outcome: | The proposed framework reduces the number of decoder layers and improves generation quality. |
Revisiting Intermediate Layer Distillation for Compressing Language Models: An Overfitting Perspective (2023.findings-eacl)
Copied to clipboard
| Challenge: | Existing methods for knowledge distillation (KD) are prone to overfitting to training datasets . recent advances in NLP have shown that using PLMs such as BERT and RoBERTa on downstream tasks is effective. |
| Approach: | They propose a consistency-regularized knowledge distillation method which mitigates overfitting of existing methods. |
| Outcome: | The proposed method outperforms existing methods on the GLUE benchmark and synthetic datasets. |
Understanding and Improving Knowledge Distillation for Quantization Aware Training of Large Transformer Encoders (2022.emnlp-main)
Copied to clipboard
| Challenge: | Knowledge distillation (KD) has been used for quantization-aware training to improve the ability of a lightweight model with the transferred knowledge from the teacher. |
| Approach: | They propose two methods to improve attention recovery of quantized large Transformers by combining attention-map and attention-output losses. |
| Outcome: | The proposed methods achieve state-of-the-art accuracy for quantized large Transformer encoder models with sub-2-bit weight quantization. |