Papers by Yichong Huang
Gradient Consistency-based Parameter Allocation for Multilingual Neural Machine Translation (2024.lrec-main)
Copied to clipboard
| Challenge: | Multilingual neural machine translation models are often prone to parameter interference . a common problem is that the model compromises with the language diversity to find a solution . |
| Approach: | They propose a method that allocates parameters based on consistency between the gradients of the individual language and the average gradient. |
| Outcome: | The proposed method reduces parameter interference and improves translation quality. |
i-Code V2: An Autoregressive Generation Framework over Vision, Language, and Speech Data (2024.findings-naacl)
Copied to clipboard
Ziyi Yang, Mahmoud Khademi, Yichong Xu, Reid Pryzant, Yuwei Fang, Chenguang Zhu, Dongdong Chen, Yao Qian, Xuemei Gao, Yi-Ling Chen, Robert Gmyr, Naoyuki Kanda, Noel Codella, Bin Xiao, Yu Shi, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang
| Challenge: | i-Code V2 is one of the first models capable of generating natural language from any combination of Vision, Language, and Speech data. |
| Approach: | They propose to create a model that can generate natural language from any combination of Vision, Language, and Speech data. |
| Outcome: | i-Code V2 matches or outperforms state-of-the-art single- and dual-modality baselines on 7 multimodal tasks. |
Unifying the Convergences in Multilingual Neural Machine Translation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to multilingual neural machine translation are overfitting and inconsistency is ignored . |
| Approach: | They propose a training strategy that picks up language-specific best checkpoints for each language pair to teach the current model on the fly. |
| Outcome: | The proposed training strategy alleviates convergence inconsistency and achieves state-of-the-art on language pairs. |
Fusing Context Into Knowledge Graph for Commonsense Question Answering (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to combine language modeling and knowledge graphs (KG) lack the context to provide a more precise understanding of the concepts. |
| Approach: | They propose to use external entity descriptions to provide contextual information for commonsense question answering models. |
| Outcome: | The proposed model achieves state-of-the-art among non-generative models in OpenBookQA and is the first of its kind in the field. |
CLAIM: Mitigating Multilingual Object Hallucination in Large Vision-Language Models with Cross-Lingual Attention Intervention (2025.acl-long)
Copied to clipboard
Zekai Ye, Qiming Li, Xiaocheng Feng, Libo Qin, Yichong Huang, Baohang Li, Kui Jiang, Yang Xiang, Zhirui Zhang, Yunfei Lu, Duyu Tang, Dandan Tu, Bing Qin
| Challenge: | Large Vision-Language Models (LVLMs) have impressive multimodal abilities but remain prone to multilingual object hallucination. |
| Approach: | They propose a cross-lingual attention intervention method to mitigate multilingual object hallucination in LVLMs by aligning attention patterns. |
| Outcome: | The proposed method improves 13.56% (up to 30%) on the POPE and 21.75% on the hallucination subsets across languages. |
Aligning Translation-Specific Understanding to General Understanding in Large Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large Language models (LLMs) have remarkable abilities in understanding complex texts . however, understanding misalignment leads to LLMs mistakenly translating complex concepts . |
| Approach: | They propose a translation process that aligns the translation-specific understanding with the general understanding to improve translation quality and reduce translation literalness. |
| Outcome: | The proposed translation process improves translation quality and reduces translation literalness by -25% -51%. |
Breaking Language Preference in Multilingual RAG via Language-Controllable Retrieval and Language-Agnostic Reasoning (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to improve retrieval accuracy and generation quality of large language models suffer from language preference. |
| Approach: | They propose a framework that explicitly disentangles multilingual RAG into language-controllable retrieval and language-agnostic reasoning. |
| Outcome: | Experimental results show that the proposed approach outperforms baselines across multilingual benchmarks. |
One for All: Update Parameterized Knowledge Across Multiple Models with Once Edit (2025.acl-long)
Copied to clipboard
Weitao Ma, Xiyuan Du, Xiaocheng Feng, Lei Huang, Yichong Huang, Huiyi Zhang, Xiaoliang Yang, Baohang Li, Xiachong Feng, Ting Liu, Bing Qin
| Challenge: | Existing methods for modifying large language models focus on individual models, resulting in errors and hallucinations. |
| Approach: | They propose an ensemble-based approach that employs a plug-in model as the editing module and a dynamic weight mechanism to enhance its effectiveness. |
| Outcome: | The proposed approach outperforms existing methods while achieving superior editing efficiency. |
Towards Higher Pareto Frontier in Multilingual Machine Translation (2023.acl-long)
Copied to clipboard
| Challenge: | Existing Pareto optimization approaches are limited by the long-tailed distribution of multilingual corpora. |
| Approach: | They propose a Pareto mutual distillation framework that pushes the Paret frontier outwards rather than making trade-offs. |
| Outcome: | The proposed framework pushes the Pareto frontier outwards rather than making trade-offs, the authors show. |
Enabling Unsupervised Neural Machine Translation with Word-level Visual Representations (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Unsupervised neural machine translation methods have been observed to make particular errors in comparison to supervised machine translation, such as confusing nouns that pertain to the same semantic category. |
| Approach: | They propose a method that incorporates images at the word level to augment lexical mappings. |
| Outcome: | Experiments on a multi-lingual dataset show that the proposed method generates more accurate translations with only monolingual data. |
x1: Learning to Think Adaptively Across Languages and Cultures (2026.findings-acl)
Copied to clipboard
Yangfan Ye, Xiaocheng Feng, Xiachong Feng, Yichong Huang, Zekun Yuan, Lei Huang, Weitao Ma, Qichen Hong, Yunfei Lu, Dandan Tu, Bing Qin
| Challenge: | Existing large language models (LLMs) ignore this diversity by reasoning in a single dominant language. |
| Approach: | They propose a family of reasoning models that can adaptively reason in an advantageous language on a per-instance basis. |
| Outcome: | The proposed model can reason in a single dominant language on a per-instance basis. |
Two-Stage Parameter Alignment for Multi-LoRA Merging in Large Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Current general model merging methods are prone to parameter interference problems . a novel two-stage parameter alignment framework is proposed to address this problem . |
| Approach: | They propose a two-stage parameter alignment framework that integrates low-rank LoRAs . they propose to reduce the computational complexity of existing methods by preserving fine-grained functions . |
| Outcome: | The proposed framework exhibits greater robustness than other methods in high-rank and high-interference scenarios while preserving fine-grained functions. |
CC-Tuning: A Cross-Lingual Connection Mechanism for Improving Joint Multilingual Supervised Fine-Tuning (2025.acl-long)
Copied to clipboard
Yangfan Ye, Xiaocheng Feng, Zekun Yuan, Xiachong Feng, Libo Qin, Lei Huang, Weitao Ma, Yichong Huang, Zhirui Zhang, Yunfei Lu, Xiaohui Yan, Duyu Tang, Dandan Tu, Bing Qin
| Challenge: | Existing fine-tuning approaches that focus on English-centric training corpora often introduce implicit cross-lingual alignment, overlooking the potential for more profound, latent-level cross-linguistic interactions. |
| Approach: | They propose a multilingual fine-tuning paradigm that explicitly establishes a cross-lingual connection mechanism at the latent level. |
| Outcome: | The proposed model outperforms vanilla SFT and offers a strong latent-level alternative to data-level augmentation methods. |
i-Code Studio: A Configurable and Composable Framework for Integrative AI (2024.emnlp-demo)
Copied to clipboard
Yuwei Fang, Mahmoud Khademi, Chenguang Zhu, Ziyi Yang, Reid Pryzant, Yichong Xu, Yao Qian, Takuya Yoshioka, Lu Yuan, Michael Zeng, Xuedong Huang
| Challenge: | Existing frameworks for Integrative AI lack flexibility and composability to handle multimodal tasks. |
| Approach: | They propose a configurable framework for Integrative AI that orchestrates multiple pre-trained models to conduct complex multimodal tasks. |
| Outcome: | The proposed framework achieves impressive results on zero-shot multimodal tasks . it can communicate and personalize for users, and it can be used in a multimodal agent . |
FroM: Frobenius Norm-Based Data-Free Adaptive Model Merging (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a new adaptive merging method is proposed to improve fine-tuning performance . traditional methods often encounter task interference when merging full fine-uning models . |
| Approach: | They propose an adaptive merging method that directly measures model parameters using the Frobenius norm . |
| Outcome: | The proposed method outperforms baseline methods in various fine-tuning scenarios. |
MVP-Tuning: Multi-View Knowledge Retrieval with Prompt Tuning for Commonsense Reasoning (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods for commonsense reasoning rely on multi-hop knowledge retrieval and suffer low accuracy due toembedded noise in the acquired knowledge. |
| Approach: | They propose to use multi-hop knowledge retrieval to model knowledge and input text together. |
| Outcome: | The proposed method outperforms baselines on 5 commonsense reasoning datasets and is number one on theleaderboard. |