Papers by Chao Xin
Getting More from Less: Large Language Models are Good Spontaneous Multilingual Learners (2024.emnlp-main)
Copied to clipboard
Shimao Zhang, Changjiang Gao, Wenhao Zhu, Jiajun Chen, Xin Huang, Xue Han, Junlan Feng, Chao Deng, Shujian Huang
| Challenge: | Large Language Models (LLMs) have shown impressive language capabilities, but most of them have very unbalanced performance across different languages. |
| Approach: | They propose to use question translation data to enhance LLMs' multilingual capabilities by using mechanistic interpretability methods. |
| Outcome: | The proposed method improves multilingual alignment even with unannotated answers in English and a wide range of languages even with instruction-tuned LLMs. |
RepoDistill: Distilling Repository Knowledge through Compression-Aware Budget Allocation and Policy Optimization (2026.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have strong performance on code translation tasks, but they struggle with repository-level scenarios where context is extensive and interdependent. |
| Approach: | They propose a framework that integrates retrieval with learning budget allocation for fine-grained context compression. |
| Outcome: | The proposed framework outperforms baselines on SWE-QA, CoderEval, and LongCodeU. |
Hephaestus: Improving Fundamental Agent Capabilities of Large Language Models through Continual Pre-Training (2025.naacl-long)
Copied to clipboard
Yuchen Zhuang, Jingfeng Yang, Haoming Jiang, Xin Liu, Kewei Cheng, Sanket Lokegaonkar, Yifan Gao, Qing Ping, Tianyi Liu, Binxuan Huang, Zheng Li, Zhengyang Wang, Pei Chen, Ruijie Wang, Rongzhi Zhang, Nasser Zalmout, Priyanka Nigam, Bing Yin, Chao Zhang
| Challenge: | Existing LLMs often rely on complex prompting or extensive fine-tuning to introduce new capabilities while preserving strong generalizability. |
| Approach: | They propose a large-scale pre-training corpus to enhance LLM agents' capabilities . they use 103B agent-specific data encompassing 76,537 APIs . |
| Outcome: | The proposed training corpus outperforms open-source LLMs and commercial LLM agents on three agent benchmarks. |
Video2Roleplay: A Multimodal Dataset and Framework for Video-Guided Role-playing Agents (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to RPAs focus on static role profiles, overlooking dynamic perceptual abilities inherent to humans. |
| Approach: | They propose a framework that combines adaptive temporal sampling with dynamic and static role profiles. |
| Outcome: | The proposed framework combines adaptive temporal sampling with dynamic and static role profiles. |
MASTER: Multi-Agent Security Through Exploration of Roles and Topological Structures - A Comprehensive Framework (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs)-based Multi-Agent Systems (MAS) exhibit remarkable problem-solving and task planning capabilities across diverse domains . |
| Approach: | They propose a security research framework for LLM-based multi-agent systems . they propose corresponding defense strategies to address MAS security risks . |
| Outcome: | The proposed framework amplifies the severity of security risks under MAS attacks . it offers an automated construction process for different MAS setups and an interaction paradigm . |
Investigating and Scaling up Code-Switching for Multilingual Language Model Pre-Training (2025.findings-acl)
Copied to clipboard
Zhijun Wang, Jiahuan Li, Hao Zhou, Rongxiang Weng, Jingang Wang, Xin Huang, Xue Han, Junlan Feng, Chao Deng, Shujian Huang
| Challenge: | Large language models (LLMs) exhibit remarkable multilingual capabilities despite the extreme language imbalance in the pre-training data. |
| Approach: | They investigate the existence of code-switching in the pre-training corpus and categorize it into four types within two quadrants. |
| Outcome: | The proposed approach improves performance across benchmarks and representation space. |
Enhancing Neural Topic Model with Multi-Level Supervisions from Seed Words (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing topic seed words are difficult to incorporate into topic models due to the semantic diversity of natural language. |
| Approach: | They propose a neural topic model enhanced with supervisions from seed words on word and document levels. |
| Outcome: | The proposed model outperforms the state-of-the-art seeded topic models in terms of topic quality and classification accuracy. |
Beyond Pedagogical Principles: Multi-Horizon Preference Optimization for Efficient Socratic Tutoring (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for developing LLMs are constrained by static data or sparse reward signals in online settings. |
| Approach: | They propose a framework that iteratively refines tutor agents using a multi-horizon reward function within a dynamic teacher-student simulation environment. |
| Outcome: | The proposed framework improves model performance and balances principles and effectiveness compared to baselines. |
Large Language Models Are Cross-Lingual Knowledge-Free Reasoners (2025.naacl-long)
Copied to clipboard
| Challenge: | Large language models have demonstrated impressive reasoning capabilities across multiple languages, but the relationship between capabilities in different languages is less explored. |
| Approach: | They decompose the process of reasoning tasks into two separate components: knowledge retrieval and knowledge-free reasoning. |
| Outcome: | The proposed model can be transferred across source-target languages despite secondary impact of resource in some specific target languages, while cross-lingual knowledge retrieval significantly hinders the transfer. |
Revisiting Pre-trained Language Models and their Evaluation for Arabic Natural Language Processing (2022.emnlp-main)
Copied to clipboard
Abbas Ghaddar, Yimeng Wu, Sunyam Bagga, Ahmad Rashid, Khalil Bibi, Mehdi Rezagholizadeh, Chao Xing, Yasheng Wang, Xinyu Duan, Zhefeng Wang, Baoxing Huai, Xin Jiang, Qun Liu, Phillippe Langlais
| Challenge: | Existing pre-trained language models are not well-explored and are not reproducible in the literature. |
| Approach: | They propose to improve existing Arabic language pre-trained language models using a more methodical approach. |
| Outcome: | The proposed models outperform existing models on ALUE, a leaderboard-powered benchmark for Arabic NLU and NLG tasks. |
MMAD:Multi-modal Movie Audio Description (2024.lrec-main)
Copied to clipboard
| Challenge: | Current methods of creating accessible movies rely on manual work, resulting in high costs and limited scalability. |
| Approach: | They propose a multi-modal movie audio description pipeline that generates narrations of information that is not accessible through unimodal hearing in movies. |
| Outcome: | The proposed pipeline surpasses existing baselines in performance on widely used datasets. |
Interpretable Charge Predictions for Criminal Cases: Learning to Generate Court Views from Fact Descriptions (N18-1)
Copied to clipboard
| Challenge: | Existing work on court view generation from fact descriptions has improved the working efficiency of legal assistant systems. |
| Approach: | They propose to decode court views conditioned on encoded charge labels from the fact description in a criminal case to improve interpretability of charge prediction systems. |
| Outcome: | The proposed model can generate court views conditioned on encoded charge labels. |
Lost in the Context: Insufficient and Distracted Attention to Contexts in Preference Modeling (2025.acl-long)
Copied to clipboard
Shihan Dou, Jiayi Chen, Chenhao Huang, Feng Chen, Wei Chengzhi, Huiyuan Zheng, Shichun Liu, Yan Liu, Chenxiao Liu, Chao Xin, Lin Yan, Zongzhang Zhang, Tao Gui, Qi Zhang, Xuanjing Huang
| Challenge: | Existing reward models concatenate contexts and responses, but they often ignore crucial segments of the context that are important for evaluating the response quality. |
| Approach: | They propose a reward model that evaluates the response quality based on a given context and assigns a rewards reward. |
| Outcome: | The proposed framework significantly improves preference modeling by increasing attention to relevant information within the context and achieves better generalizability. |
DecoupledESC: Enhancing Emotional Support Generation via Strategy-Response Decoupled Preference Optimization (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing ESC data entangles psychological strategies and response content, making it difficult to construct high-quality preference pairs. |
| Approach: | They propose a Decoupled ESC framework that decomposes the ESC task into two sequential subtasks: strategy planning and empathic response generation. |
| Outcome: | The proposed framework outperforms baselines, reducing preference bias and improving response quality. |
Dynamic Collaboration of Multi-Language Models based on Minimal Complete Semantic Units (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to enhance reasoning capabilities of language models are expensive and often lack the ability to perform complex reasoning tasks. |
| Approach: | They propose a token-level multi-model collaboration strategy to enhance reasoning capabilities in language models by selecting the optimal tokens from the next token distributions. |
| Outcome: | The proposed method is superior to existing methods and will be released soon. |
Understanding LLMs’ Cross-Lingual Context Retrieval: How Good It Is And Where It Comes From (2025.emnlp-main)
Copied to clipboard
| Challenge: | Cross-lingual context retrieval is a fundamental aspect of cross-lingual alignment, but the performance and mechanism of it for large language models (LLMs) remains unclear. |
| Approach: | They evaluate cross-lingual context retrieval of over 40 large language models . they use cross-linguistic machine reading comprehension as a representative scenario . |
| Outcome: | The results show that open LLMs show strong cross-lingual context retrieval ability . the results also show that their oracle performances improve after training . |
Interpretable Rationale Augmented Charge Prediction System (C18-2)
Copied to clipboard
| Challenge: | Existing studies treat charge prediction as a text classification problem, but in the field of justice, every decision may be a matter of life and death. |
| Approach: | They propose to extract readable rationales from text and then create a rationale augmented classification model to enhance the prediction accuracy. |
| Outcome: | The proposed system can extract readable rationales in a high consistency with manual annotation and is comparable with the attention model in prediction accuracy. |
CRST: a Claim Retrieval System in Twitter (C18-2)
Copied to clipboard
| Challenge: | CRST retrieves tweets containing arguments for controversial topics from Twitter. |
| Approach: | They propose a system that retrieves tweets containing claims for a given topic from Twitter. |
| Outcome: | The proposed system outperforms existing claims retrieval and argument mining systems. |